Skip to content

Milestones

List view

  • WebMagic-0.7.3

    Bugfix?

    Due by June 30, 2017
    •10/10 issues closed
    100% complete0 open10 closed

  • WebMagic-0.7.2

    Bugfix.

    Due by June 30, 2017
    •4/4 issues closed
    100% complete0 open4 closed

  • WebMagic-0.7.1

    Bugfix. PageModel进行部分重构。

    Due by June 30, 2017
    •11/11 issues closed
    100% complete0 open11 closed

  • WebMagic-0.6.2

    Due by March 31, 2017
    •8/8 issues closed
    100% complete0 open8 closed

  • WebMagic-0.7.0

    * 重构HttpClientDownloader，完善POST等其他HTPP Method支持。 * 重写Proxy API，简化代码，强化扩展性。

    Due by June 1, 2017
    •23/23 issues closed
    100% complete0 open23 closed

  • WebMagic-0.6.1

    Due by January 31, 2017
    •4/4 issues closed
    100% complete0 open4 closed

  • WebMagic-0.6.0

    * 修复多个代理不稳定的问题。 * 增强多个爬虫对线程的利用。 * 争取在Xsoup中使用新的XPath语法分析器，达成语法的全支持。

    Due by January 31, 2017
    •26/26 issues closed
    100% complete0 open26 closed

  • WebMagic-0.5.3

    * [#139](https://github.com/code4craft/webmagic/pull/139) 修复JsonFilePipeline保存路径的问题 * [#144](https://github.com/code4craft/webmagic/pull/149) 修复@TargetUrl增加SourceRegion后取不到链接的问题 * [#149](https://github.com/code4craft/webmagic/pull/149) 修复Jsoup默认将HTML实体转义导致取不到结果的问题 * [#157](https://github.com/code4craft/webmagic/pull/157) 修复FileCacheQueueScheduler中去重偶尔不工作的问题 [@zhugw](https://github.com/zhugw) * [#188](https://github.com/code4craft/webmagic/pull/188) 增加重试的间隔时间，默认为1秒 [@edwardsbean](ht[tps* //github.com/edwardsbean) * [#193](https://github.com/code4craft/webmagic/pull/193) 修复分页功能MultiPagePipeline可能出现的并发问题 [edwardsbean](https://github.com/edwardsbean) * [#198](https://github.com/code4craft/webmagic/pull/198) 修正site.setHttpProxy()不起作用的bug [@okuc](https://github.com/okuc)

    Due by July 14, 2014
    •5/5 issues closed
    100% complete0 open5 closed

  • WebMagic-0.5.2

    No due date
    •7/7 issues closed
    100% complete0 open7 closed

  • WebMagic-0.5.1

    No due date
    •2/2 issues closed
    100% complete0 open2 closed

  • WebMagic-0.4.3

    * Last version of 0.4.x.

    Due by March 14, 2014
    •7/7 issues closed
    100% complete0 open7 closed

  • WebMagic-0.5.0

    * Admin dashboard with spider creating and management.

    Due by April 30, 2014
    •22/22 issues closed
    100% complete0 open22 closed

  • 0.4.2

    Due by November 15, 2014
    0% complete0 open0 closed

  • WebMagic-Avalon

    Avalon is a script and monitor platform for customize crawlers without writing any code. See blog (Chinese) [http://code4craft.github.io/blog/2013/11/11/webmagic-avalon-start/](http://code4craft.github.io/blog/2013/11/11/webmagic-avalon-start/)

    Due by November 11, 2014
    •2/2 issues closed
    100% complete0 open2 closed

  • 0.4.1

    * Add more xpath expression in XSoup * Wait for bugfix lol..

    Due by December 24, 2013
    •7/7 issues closed
    100% complete0 open7 closed

  • 0.4.0

    * Add direct download * Some enhancement * Some bugfix * Ehancement in downloading by httpclient

    Due by November 11, 2013
    •8/8 issues closed
    100% complete0 open8 closed