Commit Graph

263 Commits (e4ab6e27e4fd127d1feeea862a7ff10eb91c2ae7)

Author SHA1 Message Date
Sutra Zhou e4ab6e27e4 Optimize Request#extras, refs #1148. 11 months ago
Sutra Zhou 1e5c6488ff Update for next development version 1 year ago
Sutra Zhou 73dd2ebbac Update versions for release 1 year ago
Sutra Zhou 67644de3d9 Expose Page to onSuccess & onError. 1 year ago
Joe Zhou 8c008563ff Update for next development version 1 year ago
Joe Zhou 07e83a421b Update versions for release 1 year ago
Joe Zhou 6e8d130113 Update for next development version 2 years ago
Joe Zhou 3688226e32 Update versions for release 2 years ago
Joe Zhou a5fb4e0414 Upgrade dependencies. 2 years ago
Joe Zhou ef616c999e Fix warnings. 2 years ago
Joe Zhou cda8467f95 Update for next development version 2 years ago
Joe Zhou 888682863c Update versions for release 2 years ago
Sutra Zhou 5d5f3bf20e Update for next development version 2 years ago
Sutra Zhou 838c47f1f6 Update versions for release 2 years ago
Sutra Zhou d2b2eed9df Pass the task to onSuccess & onError. 2 years ago
vio.ao 7a62a6cb45 Revert "Revert "Common the downloader status process and pass error information when …""
This reverts commit acfbd7b883.
2 years ago
Sutra Zhou acfbd7b883
Revert "Common the downloader status process and pass error information when …" 2 years ago
vio.ao d01f26333b Common the downloader status process and pass error information when onError 2 years ago
David Hsing 54da7af17e change dependency versions into properties
change dependency versions into properties
update commons-collections from 3.x to 4.4
3 years ago
Sutra Zhou c5a037a807 Update for next development version 4 years ago
Sutra Zhou 4e51a4f68b Update versions for release 4 years ago
wecandoitjustthink 528a8908af 增加了List<SpiderStatusMXBean>属性的get方法,供SpiderMonitor的子类获取. 4 years ago
Sutra Zhou 71b7dfbf9a
Merge pull request #993 from yqia182/master
SpiderStatus中getPagePerSecond()方法,增加验证逻辑,避免空指针,避免除数为零。
4 years ago
JustThink 54127318a4 SpiderStatus中getPagePerSecond()方法,增加验证逻辑,避免空指针,避免除数为零。 4 years ago
Sutra Zhou 0e01550a79 Upgrade dependencies, including the jedis from 2.9.3 to 3.4.1. 4 years ago
Sutra Zhou c489647c4b Revert " Downloader 提供刷新组件的api,方便在spider中操作"
This reverts commit 2e2a0fdf3e.
4 years ago
yao 2e2a0fdf3e Downloader 提供刷新组件的api,方便在spider中操作 4 years ago
Sutra Zhou 4b902270b4 Bump version number from 0.7.3 to 0.7.4. 4 years ago
Sutra Zhou 5d14efc50f Serialize request URL only in FileCacheQueueScheduler. 5 years ago
Sutra Zhou 71aa04c89f Upgrade dependencies. 5 years ago
Sutra Zhou ba1b4017a7 Mark slf4j-log4j12 as optional. 5 years ago
Sutra Zhou b98a87e45a Serialize requests in FileCacheQueueScheduler, so that the extra info of request could be restored. 5 years ago
yihua.huang c701fe8d38 #702 Refactor: rename CheckForAdditionalInfo to checkForAdditionalInfo 7 years ago
yihy 266083fa07 [Fix] #698  Repair using redis,Request additional information is lost 7 years ago
yihua.huang e5db538c19 #647 remove ThreadSafe annotation 7 years ago
yihua.huang e276b11ea9 vesion 0.7.3 8 years ago
yihua.huang 1b6394bef9 version 0.7.2 8 years ago
yihua.huang 76766a7c77 RequestUtils for range #222 8 years ago
yihua.huang 13cdf82695 update version to 0.7.2-SNAPSHOT 8 years ago
yihua.huang 1e9187f24e version 0.7.1 8 years ago
yihua.huang 5de6205563 use RawText as source for JsonPath #589 8 years ago
yihua.huang 211ac74389 use group 0 of targetUrl instead of group 1 #588 8 years ago
yihua.huang 9b77306098 test of ExtractByUrl #586 8 years ago
yihua.huang d8bd0637a1 add custom formatter test #586 8 years ago
yihua.huang 6cc647577a fix test for ExtractLinks #586 8 years ago
yihua.huang a6f8ed5476 complete formatter refactor by ObjectFormatterBuilder #586 8 years ago
yihua.huang b1ef61b278 add tests before refactor #586 8 years ago
yihua.huang b363ee6a9d move constant to class 8 years ago
yihua.huang df682857a7 fix test and some refactor 8 years ago
yihua.huang 0e6eb46eba add test for jsonpath in pagemodel #462 8 years ago