Skip to content

Releases: scrapinghub/scrapyrt

v0.17.0

28 Jul 17:15

Choose a tag to compare

  • Added support for Scrapy 2.13+.

  • Lowered the minimum required Scrapy version from 2.10 to 2.7.

  • The start_requests API parameter is deprecated in favor of a new
    spider_start API parameter.

    Same with the corresponding __init__ parameter and attribute of the
    CrawlManager class.

v0.16.0

14 Feb 09:19
84ce691

Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v0.15.0...v0.16.0

v0.15.0

20 Sep 07:25

Choose a tag to compare

  • fix compatibility with Scrapy 2.11 on crawler object

v0.14.0

10 Aug 09:18

Choose a tag to compare

  • fix compatibility with scrapy 2.10 #150
  • drop end of life pythons (3.6, 3.7)
  • add python 3.11 support

v0.13.0

10 Dec 10:53
2e605ce

Choose a tag to compare

  • add support for specifying Twisted reactor in Scrapy settings or ScrapyRT settings, fixes #132
  • drop Python 3.5 support
  • add Python 3.10 support
  • remove distutils call 4e4c6f5
  • README updates

v0.12

08 Mar 13:16

Choose a tag to compare

  • dropped Python 2 support
  • tested with Python 3.8, 3.9, Scrapy 2.4+, add official support
  • option to explicitly pass crawl arguments for spider by "crawl_args" argument to GET and POST endpoints
  • bug fix when API was hanging on bytes returned from user spiders
  • removed not needed and outdated dependencies such as demjson, six
  • documentation lifting (readme.md page in pip and github)

Bug fix release

20 Sep 12:09

Choose a tag to compare

  • fixed bug resulting from fact that since version 19.2.0 Twisted expects http headers of string type
  • removed outdated, unused logging code that relied on scrapy.log deprecated in Scrapy

python 3 support, start requests option

18 Apr 10:56

Choose a tag to compare

Changes

  • add support for Python 3. Tested on 3.5
  • add boolean argument to execute Scrapy.spider.start_requests method