Commit Graph

243 Commits (snyk-fix-3bde29486cddc7ed8a030e05f97999dd)

Author SHA1 Message Date
Sutra Zhou 4e51a4f68b Update versions for release 4 years ago
wecandoitjustthink 528a8908af 增加了List<SpiderStatusMXBean>属性的get方法,供SpiderMonitor的子类获取. 4 years ago
Sutra Zhou 71b7dfbf9a
Merge pull request #993 from yqia182/master
SpiderStatus中getPagePerSecond()方法,增加验证逻辑,避免空指针,避免除数为零。
4 years ago
JustThink 54127318a4 SpiderStatus中getPagePerSecond()方法,增加验证逻辑,避免空指针,避免除数为零。 4 years ago
Sutra Zhou 0e01550a79 Upgrade dependencies, including the jedis from 2.9.3 to 3.4.1. 4 years ago
Sutra Zhou c489647c4b Revert " Downloader 提供刷新组件的api,方便在spider中操作"
This reverts commit 2e2a0fdf3e.
4 years ago
yao 2e2a0fdf3e Downloader 提供刷新组件的api,方便在spider中操作 4 years ago
Sutra Zhou 4b902270b4 Bump version number from 0.7.3 to 0.7.4. 4 years ago
Sutra Zhou 5d14efc50f Serialize request URL only in FileCacheQueueScheduler. 5 years ago
Sutra Zhou 71aa04c89f Upgrade dependencies. 5 years ago
Sutra Zhou ba1b4017a7 Mark slf4j-log4j12 as optional. 5 years ago
Sutra Zhou b98a87e45a Serialize requests in FileCacheQueueScheduler, so that the extra info of request could be restored. 5 years ago
yihua.huang c701fe8d38 #702 Refactor: rename CheckForAdditionalInfo to checkForAdditionalInfo 7 years ago
yihy 266083fa07 [Fix] #698  Repair using redis,Request additional information is lost 7 years ago
yihua.huang e5db538c19 #647 remove ThreadSafe annotation 7 years ago
yihua.huang e276b11ea9 vesion 0.7.3 8 years ago
yihua.huang 1b6394bef9 version 0.7.2 8 years ago
yihua.huang 76766a7c77 RequestUtils for range #222 8 years ago
yihua.huang 13cdf82695 update version to 0.7.2-SNAPSHOT 8 years ago
yihua.huang 1e9187f24e version 0.7.1 8 years ago
yihua.huang 5de6205563 use RawText as source for JsonPath #589 8 years ago
yihua.huang 211ac74389 use group 0 of targetUrl instead of group 1 #588 8 years ago
yihua.huang 9b77306098 test of ExtractByUrl #586 8 years ago
yihua.huang d8bd0637a1 add custom formatter test #586 8 years ago
yihua.huang 6cc647577a fix test for ExtractLinks #586 8 years ago
yihua.huang a6f8ed5476 complete formatter refactor by ObjectFormatterBuilder #586 8 years ago
yihua.huang b1ef61b278 add tests before refactor #586 8 years ago
yihua.huang b363ee6a9d move constant to class 8 years ago
yihua.huang df682857a7 fix test and some refactor 8 years ago
yihua.huang 0e6eb46eba add test for jsonpath in pagemodel #462 8 years ago
yihua.huang f5018d569e remove test_issue409 #409 8 years ago
yihua.huang 17ae500c77 test_issue409 #409 8 years ago
yihua.huang 4cd5b4f93e test_issue409 8 years ago
yihua.huang fb0acd710c complete SimpleHttpClientTest 8 years ago
yihua.huang d07941d900 SimpleHttpClientTest 8 years ago
yihua.huang f02f469c69 add test #570 8 years ago
yihua.huang 2d693580fc add test 8 years ago
yihua.huang b879b0eed0 fix redisscheduler #583 8 years ago
Yihua Huang 9903f0367d Merge pull request #570 from SoulZhong/master
修复formatter初始化未传参bug
8 years ago
yihua.huang 2e35e149be for 0.7.1 8 years ago
yihua.huang 17478fcfc4 0.7.0 release 8 years ago
yihua.huang 49de9374cd new SimpleHttpClient #576 8 years ago
yihua.huang 7ffc6998ef add isExtractLinks to OOSpider #575 8 years ago
soul bc828e1384 修复formatter初始化未传参bug 8 years ago
yihua.huang a8c2e6c729 alpha release 8 years ago
yihua.huang 3c1338193b for 0.7.0.alpha 8 years ago
yihua.huang d38d51dfcb fix javadoc 8 years ago
yihua.huang 1b04a7f2b3 #527 move logic check from downloaderto spider 8 years ago
yihua.huang 74110e6ec5 remove useless file 8 years ago
yihua.huang b100dfe273 update version 8 years ago