Commit Graph

252 Commits (snyk-fix-081664f536676380fbe24bfe4f709570)

Author SHA1 Message Date
Joe Zhou 888682863c Update versions for release 2 years ago
Sutra Zhou 5d5f3bf20e Update for next development version 2 years ago
Sutra Zhou 838c47f1f6 Update versions for release 2 years ago
Sutra Zhou d2b2eed9df Pass the task to onSuccess & onError. 2 years ago
vio.ao 7a62a6cb45 Revert "Revert "Common the downloader status process and pass error information when …""
This reverts commit acfbd7b883.
2 years ago
Sutra Zhou acfbd7b883
Revert "Common the downloader status process and pass error information when …" 2 years ago
vio.ao d01f26333b Common the downloader status process and pass error information when onError 2 years ago
David Hsing 54da7af17e change dependency versions into properties
change dependency versions into properties
update commons-collections from 3.x to 4.4
3 years ago
Sutra Zhou c5a037a807 Update for next development version 4 years ago
Sutra Zhou 4e51a4f68b Update versions for release 4 years ago
wecandoitjustthink 528a8908af 增加了List<SpiderStatusMXBean>属性的get方法,供SpiderMonitor的子类获取. 4 years ago
Sutra Zhou 71b7dfbf9a
Merge pull request #993 from yqia182/master
SpiderStatus中getPagePerSecond()方法,增加验证逻辑,避免空指针,避免除数为零。
4 years ago
JustThink 54127318a4 SpiderStatus中getPagePerSecond()方法,增加验证逻辑,避免空指针,避免除数为零。 4 years ago
Sutra Zhou 0e01550a79 Upgrade dependencies, including the jedis from 2.9.3 to 3.4.1. 4 years ago
Sutra Zhou c489647c4b Revert " Downloader 提供刷新组件的api,方便在spider中操作"
This reverts commit 2e2a0fdf3e.
4 years ago
yao 2e2a0fdf3e Downloader 提供刷新组件的api,方便在spider中操作 4 years ago
Sutra Zhou 4b902270b4 Bump version number from 0.7.3 to 0.7.4. 4 years ago
Sutra Zhou 5d14efc50f Serialize request URL only in FileCacheQueueScheduler. 5 years ago
Sutra Zhou 71aa04c89f Upgrade dependencies. 5 years ago
Sutra Zhou ba1b4017a7 Mark slf4j-log4j12 as optional. 5 years ago
Sutra Zhou b98a87e45a Serialize requests in FileCacheQueueScheduler, so that the extra info of request could be restored. 5 years ago
yihua.huang c701fe8d38 #702 Refactor: rename CheckForAdditionalInfo to checkForAdditionalInfo 7 years ago
yihy 266083fa07 [Fix] #698  Repair using redis,Request additional information is lost 7 years ago
yihua.huang e5db538c19 #647 remove ThreadSafe annotation 7 years ago
yihua.huang e276b11ea9 vesion 0.7.3 8 years ago
yihua.huang 1b6394bef9 version 0.7.2 8 years ago
yihua.huang 76766a7c77 RequestUtils for range #222 8 years ago
yihua.huang 13cdf82695 update version to 0.7.2-SNAPSHOT 8 years ago
yihua.huang 1e9187f24e version 0.7.1 8 years ago
yihua.huang 5de6205563 use RawText as source for JsonPath #589 8 years ago
yihua.huang 211ac74389 use group 0 of targetUrl instead of group 1 #588 8 years ago
yihua.huang 9b77306098 test of ExtractByUrl #586 8 years ago
yihua.huang d8bd0637a1 add custom formatter test #586 8 years ago
yihua.huang 6cc647577a fix test for ExtractLinks #586 8 years ago
yihua.huang a6f8ed5476 complete formatter refactor by ObjectFormatterBuilder #586 8 years ago
yihua.huang b1ef61b278 add tests before refactor #586 8 years ago
yihua.huang b363ee6a9d move constant to class 8 years ago
yihua.huang df682857a7 fix test and some refactor 8 years ago
yihua.huang 0e6eb46eba add test for jsonpath in pagemodel #462 8 years ago
yihua.huang f5018d569e remove test_issue409 #409 8 years ago
yihua.huang 17ae500c77 test_issue409 #409 8 years ago
yihua.huang 4cd5b4f93e test_issue409 8 years ago
yihua.huang fb0acd710c complete SimpleHttpClientTest 8 years ago
yihua.huang d07941d900 SimpleHttpClientTest 8 years ago
yihua.huang f02f469c69 add test #570 8 years ago
yihua.huang 2d693580fc add test 8 years ago
yihua.huang b879b0eed0 fix redisscheduler #583 8 years ago
Yihua Huang 9903f0367d Merge pull request #570 from SoulZhong/master
修复formatter初始化未传参bug
8 years ago
yihua.huang 2e35e149be for 0.7.1 8 years ago
yihua.huang 17478fcfc4 0.7.0 release 8 years ago