This repository was archived by the owner on Jul 5, 2023. It is now read-only.
File tree Expand file tree Collapse file tree 1 file changed +6
-5
lines changed Expand file tree Collapse file tree 1 file changed +6
-5
lines changed Original file line number Diff line number Diff line change @@ -29,23 +29,24 @@ DOWNLOADER_MIDDLEWARES = {
2929```
3030## Usage
3131
32- Use the scrapy_proxycrawl.ProxyCrawlRequest instead of the scrapy built-in Request:
32+ Use the scrapy_proxycrawl.ProxyCrawlRequest instead of the scrapy built-in Request.
33+ The scrapy_proxycrawl.ProxyCrawlRequest accepts additional arguments, used in Proxy Crawl API:
3334
3435``` python
3536from scrapy_proxycrawl import ProxyCrawlRequest
3637
3738yield ProxyCrawlRequest(
38- url,
39+ " http://target- url" ,
3940 callback = self .parse_result
4041 device = ' desktop' ,
4142 country = ' US' ,
42- page_wait = 8000 ,
43+ page_wait = 1000 ,
4344 ajax_wait = True ,
4445 dont_filter = True
4546)
4647```
47- The scrapy_proxycrawl.ProxyCrawlRequest accepts additional arguments, used in Proxy Crawl API.
48- The request and response will be handled by the middleware, switching the urls automatically.
48+
49+ The target url will be replaced with proxy crawl url and parameters will be encoded into the url by the middleware automatically.
4950
5051
5152If you have questions or need help using the library, please open an issue or [ contact us] ( https://proxycrawl.com/contact ) .
You can’t perform that action at this time.
0 commit comments