Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/check-pr-title.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,6 @@ jobs:
name: 'Check PR title'
runs-on: ubuntu-22.04
steps:
- uses: amannn/action-semantic-pull-request@v6.0.1
- uses: amannn/action-semantic-pull-request@v6.1.1
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
84 changes: 42 additions & 42 deletions package-lock.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 3 additions & 3 deletions package.json
Original file line number Diff line number Diff line change
Expand Up @@ -87,12 +87,12 @@
"lerna": "^8.1.8",
"lint-staged": "^16.0.0",
"playwright": "^1.46.0",
"prettier": "3.5.3",
"prettier": "3.6.2",
"puppeteer": "^24.0.0",
"rimraf": "^6.0.1",
"tsx": "^4.16.5",
"turbo": "2.5.4",
"typescript": "~5.8.0",
"turbo": "2.5.6",
"typescript": "~5.9.0",
"typescript-eslint": "^8.28.0",
"vite-tsconfig-paths": "^5.0.0",
"vitest": "^3.0.0"
Expand Down
2 changes: 1 addition & 1 deletion packages/actor-scraper/camoufox-scraper/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
"@apify/tsconfig": "^0.1.0",
"@types/node": "^22.7.4",
"tsx": "^4.19.1",
"typescript": "~5.8.0"
"typescript": "~5.9.0"
},
"scripts": {
"start": "npm run start:dev",
Expand Down
1 change: 0 additions & 1 deletion packages/actor-scraper/cheerio-scraper/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -325,7 +325,6 @@ visit the [Mozilla documentation](https://developer.mozilla.org/en-US/docs/Web/J
- ##### **`globalStore: Object`**

Represents an in-memory store that can be used to share data across page function invocations, e.g. state variables, API responses, or other data. The `globalStore` object has an interface similar to JavaScript's [`Map`](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Map) object, with a few important differences:

- All `globalStore` functions are `async`; use `await` when calling them.
- Keys must be strings and values must be JSON stringify-able.
- The `forEach()` function is not supported.
Expand Down
2 changes: 1 addition & 1 deletion packages/actor-scraper/cheerio-scraper/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@
"@apify/tsconfig": "^0.1.0",
"@types/node": "^22.7.4",
"tsx": "^4.19.1",
"typescript": "~5.8.0"
"typescript": "~5.9.0"
},
"peerDependencies": {
"cheerio": "^1.0.0-rc.12"
Expand Down
2 changes: 1 addition & 1 deletion packages/actor-scraper/jsdom-scraper/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@
"@apify/tsconfig": "^0.1.0",
"@types/node": "^22.7.4",
"tsx": "^4.19.1",
"typescript": "~5.8.0"
"typescript": "~5.9.0"
},
"peerDependencies": {
"jsdom": "^26.0.0"
Expand Down
2 changes: 1 addition & 1 deletion packages/actor-scraper/playwright-scraper/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
"@apify/tsconfig": "^0.1.0",
"@types/node": "^22.7.4",
"tsx": "^4.19.1",
"typescript": "~5.8.0"
"typescript": "~5.9.0"
},
"scripts": {
"start": "npm run start:dev",
Expand Down
2 changes: 1 addition & 1 deletion packages/actor-scraper/puppeteer-scraper/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@
"@apify/tsconfig": "^0.1.0",
"@types/node": "^22.7.4",
"tsx": "^4.19.1",
"typescript": "~5.8.0"
"typescript": "~5.9.0"
},
"scripts": {
"start": "npm run start:dev",
Expand Down
2 changes: 1 addition & 1 deletion packages/actor-scraper/web-scraper/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
"@types/content-type": "^1.1.8",
"@types/node": "^22.7.4",
"tsx": "^4.19.1",
"typescript": "~5.8.0"
"typescript": "~5.9.0"
},
"scripts": {
"start": "npm run start:dev",
Expand Down
3 changes: 0 additions & 3 deletions website/versioned_docs/version-1.3/api/puppeteer.md
Original file line number Diff line number Diff line change
Expand Up @@ -210,7 +210,6 @@ await Apify.utils.puppeteer.enqueueLinksByClickingElements({
**Parameters**:

- **`options`**: `object` - All `enqueueLinksByClickingElements()` parameters are passed via an options object with the following keys:

- **`page`**: `Page` - Puppeteer [`Page`](https://pptr.dev/#?product=Puppeteer&show=api-class-page) object.
- **`requestQueue`**: [`RequestQueue`](../api/request-queue) - A request queue to which the URLs will be enqueued.
- **`selector`**: `string` - A CSS selector matching elements to be clicked on. Unlike in [`utils.enqueueLinks()`](../api/utils#enqueuelinks),
Expand All @@ -223,7 +222,6 @@ await Apify.utils.puppeteer.enqueueLinksByClickingElements({
[`Request`](Request.md) objects.

If `pseudoUrls` is an empty array, `null` or `undefined`, then the function enqueues all links found on the page.

- **`[transformRequestFunction]`**: [`RequestTransform`](../typedefs/request-transform) - Just before a new [`Request`](Request.md) is
constructed and enqueued to the [`RequestQueue`](../api/request-queue), this function can be used to remove it or modify its contents such as
`userData`, `payload` or, most importantly `uniqueKey`. This is useful when you need to enqueue multiple `Requests` to the queue that share
Expand Down Expand Up @@ -254,7 +252,6 @@ await Apify.utils.puppeteer.enqueueLinksByClickingElements({

You may want to reduce this for example when you're sure that your clicks do not open new tabs, or increase when you're not getting all the
expected URLs.

- **`[maxWaitForPageIdleSecs]`**: `number` <code> = 5</code> - This is the maximum period for which the function will keep tracking events, even
if more events keep coming. Its purpose is to prevent a deadlock in the page by periodic events, often unrelated to the clicking itself. See
`waitForPageIdleSecs` above for an explanation.
Expand Down
2 changes: 0 additions & 2 deletions website/versioned_docs/version-1.3/api/utils.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,6 @@ await Apify.utils.enqueueLinks({
**Parameters**:

- **`options`**: `object` - All `enqueueLinks()` parameters are passed via an options object with the following keys:

- **`[page]`**: `PuppeteerPage` | `PlaywrightPage` - Puppeteer [`Page`](https://pptr.dev/#?product=Puppeteer&show=api-class-page) object. Either
`page` or `$` option must be provided.
- **`[limit]`**: `Number` - Limit the count of actually enqueued URLs to this number. Useful for testing across the entire crawling scope.
Expand All @@ -86,7 +85,6 @@ await Apify.utils.enqueueLinks({
[`Request`](../api/request) objects.

If `pseudoUrls` is an empty array, `null` or `undefined`, then the function enqueues all links found on the page.

- **`[transformRequestFunction]`**: [`RequestTransform`](../typedefs/request-transform) - Just before a new [`Request`](../api/request) is
constructed and enqueued to the [`RequestQueue`](../api/request-queue), this function can be used to remove it or modify its contents such as
`userData`, `payload` or, most importantly `uniqueKey`. This is useful when you need to enqueue multiple `Requests` to the queue that share
Expand Down
3 changes: 0 additions & 3 deletions website/versioned_docs/version-2.3/api/puppeteer.md
Original file line number Diff line number Diff line change
Expand Up @@ -212,7 +212,6 @@ await Apify.utils.puppeteer.enqueueLinksByClickingElements({
**Parameters**:

- **`options`**: `object` - All `enqueueLinksByClickingElements()` parameters are passed via an options object with the following keys:

- **`page`**: `Page` - Puppeteer [`Page`](https://pptr.dev/#?product=Puppeteer&show=api-class-page) object.
- **`requestQueue`**: [`RequestQueue`](../api/request-queue) - A request queue to which the URLs will be enqueued.
- **`selector`**: `string` - A CSS selector matching elements to be clicked on. Unlike in [`utils.enqueueLinks()`](../api/utils#enqueuelinks),
Expand All @@ -225,7 +224,6 @@ await Apify.utils.puppeteer.enqueueLinksByClickingElements({
[`Request`](../api/request) objects.

If `pseudoUrls` is an empty array, `null` or `undefined`, then the function enqueues all links found on the page.

- **`[transformRequestFunction]`**: [`RequestTransform`](../typedefs/request-transform) - Just before a new [`Request`](../api/request) is
constructed and enqueued to the [`RequestQueue`](../api/request-queue), this function can be used to remove it or modify its contents such as
`userData`, `payload` or, most importantly `uniqueKey`. This is useful when you need to enqueue multiple `Requests` to the queue that share
Expand Down Expand Up @@ -256,7 +254,6 @@ await Apify.utils.puppeteer.enqueueLinksByClickingElements({

You may want to reduce this for example when you're sure that your clicks do not open new tabs, or increase when you're not getting all the
expected URLs.

- **`[maxWaitForPageIdleSecs]`**: `number` <code> = 5</code> - This is the maximum period for which the function will keep tracking events, even
if more events keep coming. Its purpose is to prevent a deadlock in the page by periodic events, often unrelated to the clicking itself. See
`waitForPageIdleSecs` above for an explanation.
Expand Down
2 changes: 0 additions & 2 deletions website/versioned_docs/version-2.3/api/utils.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,6 @@ await Apify.utils.enqueueLinks({
**Parameters**:

- **`options`**: `object` - All `enqueueLinks()` parameters are passed via an options object with the following keys:

- **`[page]`**: `PuppeteerPage` | `PlaywrightPage` - Puppeteer [`Page`](https://pptr.dev/#?product=Puppeteer&show=api-class-page) object. Either
`page` or `$` option must be provided.
- **`[limit]`**: `Number` - Limit the count of actually enqueued URLs to this number. Useful for testing across the entire crawling scope.
Expand All @@ -86,7 +85,6 @@ await Apify.utils.enqueueLinks({
[`Request`](../api/request) objects.

If `pseudoUrls` is an empty array, `null` or `undefined`, then the function enqueues all links found on the page.

- **`[transformRequestFunction]`**: [`RequestTransform`](../typedefs/request-transform) - Just before a new [`Request`](../api/request) is
constructed and enqueued to the [`RequestQueue`](../api/request-queue), this function can be used to remove it or modify its contents such as
`userData`, `payload` or, most importantly `uniqueKey`. This is useful when you need to enqueue multiple `Requests` to the queue that share
Expand Down
Loading