Sutra Zhou
|
c489647c4b
|
Revert " Downloader 提供刷新组件的api,方便在spider中操作"
This reverts commit 2e2a0fdf3e.
|
4 years ago |
yao
|
2e2a0fdf3e
|
Downloader 提供刷新组件的api,方便在spider中操作
|
4 years ago |
|
Sutra Zhou
|
4b902270b4
|
Bump version number from 0.7.3 to 0.7.4.
|
4 years ago |
|
Sutra Zhou
|
5d14efc50f
|
Serialize request URL only in FileCacheQueueScheduler.
|
5 years ago |
|
Sutra Zhou
|
71aa04c89f
|
Upgrade dependencies.
|
5 years ago |
|
Sutra Zhou
|
ba1b4017a7
|
Mark slf4j-log4j12 as optional.
|
5 years ago |
|
Sutra Zhou
|
b98a87e45a
|
Serialize requests in FileCacheQueueScheduler, so that the extra info of request could be restored.
|
5 years ago |
yihua.huang
|
c701fe8d38
|
#702 Refactor: rename CheckForAdditionalInfo to checkForAdditionalInfo
|
7 years ago |
yihy
|
266083fa07
|
[Fix] #698 Repair using redis,Request additional information is lost
|
7 years ago |
|
yihua.huang
|
e5db538c19
|
#647 remove ThreadSafe annotation
|
7 years ago |
|
yihua.huang
|
e276b11ea9
|
vesion 0.7.3
|
8 years ago |
|
yihua.huang
|
1b6394bef9
|
version 0.7.2
|
8 years ago |
|
yihua.huang
|
76766a7c77
|
RequestUtils for range #222
|
8 years ago |
|
yihua.huang
|
13cdf82695
|
update version to 0.7.2-SNAPSHOT
|
8 years ago |
|
yihua.huang
|
1e9187f24e
|
version 0.7.1
|
8 years ago |
|
yihua.huang
|
5de6205563
|
use RawText as source for JsonPath #589
|
8 years ago |
|
yihua.huang
|
211ac74389
|
use group 0 of targetUrl instead of group 1 #588
|
8 years ago |
|
yihua.huang
|
9b77306098
|
test of ExtractByUrl #586
|
8 years ago |
|
yihua.huang
|
d8bd0637a1
|
add custom formatter test #586
|
8 years ago |
|
yihua.huang
|
6cc647577a
|
fix test for ExtractLinks #586
|
8 years ago |
|
yihua.huang
|
a6f8ed5476
|
complete formatter refactor by ObjectFormatterBuilder #586
|
8 years ago |
|
yihua.huang
|
b1ef61b278
|
add tests before refactor #586
|
8 years ago |
|
yihua.huang
|
b363ee6a9d
|
move constant to class
|
8 years ago |
|
yihua.huang
|
df682857a7
|
fix test and some refactor
|
8 years ago |
|
yihua.huang
|
0e6eb46eba
|
add test for jsonpath in pagemodel #462
|
8 years ago |
|
yihua.huang
|
f5018d569e
|
remove test_issue409 #409
|
8 years ago |
|
yihua.huang
|
17ae500c77
|
test_issue409 #409
|
8 years ago |
|
yihua.huang
|
4cd5b4f93e
|
test_issue409
|
8 years ago |
|
yihua.huang
|
fb0acd710c
|
complete SimpleHttpClientTest
|
8 years ago |
|
yihua.huang
|
d07941d900
|
SimpleHttpClientTest
|
8 years ago |
|
yihua.huang
|
f02f469c69
|
add test #570
|
8 years ago |
|
yihua.huang
|
2d693580fc
|
add test
|
8 years ago |
|
yihua.huang
|
b879b0eed0
|
fix redisscheduler #583
|
8 years ago |
|
Yihua Huang
|
9903f0367d
|
Merge pull request #570 from SoulZhong/master
修复formatter初始化未传参bug
|
8 years ago |
|
yihua.huang
|
2e35e149be
|
for 0.7.1
|
8 years ago |
|
yihua.huang
|
17478fcfc4
|
0.7.0 release
|
8 years ago |
|
yihua.huang
|
49de9374cd
|
new SimpleHttpClient #576
|
8 years ago |
|
yihua.huang
|
7ffc6998ef
|
add isExtractLinks to OOSpider #575
|
8 years ago |
soul
|
bc828e1384
|
修复formatter初始化未传参bug
|
8 years ago |
|
yihua.huang
|
a8c2e6c729
|
alpha release
|
8 years ago |
|
yihua.huang
|
3c1338193b
|
for 0.7.0.alpha
|
8 years ago |
|
yihua.huang
|
d38d51dfcb
|
fix javadoc
|
8 years ago |
|
yihua.huang
|
1b04a7f2b3
|
#527 move logic check from downloaderto spider
|
8 years ago |
|
yihua.huang
|
74110e6ec5
|
remove useless file
|
8 years ago |
|
yihua.huang
|
b100dfe273
|
update version
|
8 years ago |
|
yihua.huang
|
c13110c4cb
|
fix samples
|
8 years ago |
|
yihua.huang
|
d87c73b472
|
change check-and-set to atomic sadd for redis DuplicateRemover #368
|
8 years ago |
|
yihua.huang
|
aaccc93215
|
new version
|
8 years ago |
|
yihua.huang
|
3e633c6871
|
version
|
8 years ago |
|
yihua.huang
|
f45e2f118b
|
for release
|
8 years ago |