Commit Graph

1104 Commits (snyk-fix-9e933ef3fbdfa89b1dad83f86cbbea2a)
 

Author SHA1 Message Date
Yihua Huang 228911b58c Merge pull request #370 from gyk001/master
fixed #301 修复使用注解抽取JSON数据的问题
8 years ago
yihua.huang 507556d0aa fix test: ProxyTest.testProxy() do not load exist proxy config 8 years ago
yihua.huang 55f131e5ef #380 update fastjson to 1.2.21 8 years ago
Jerry e56b8c3efc fix the monitor bug which the spider will terminate when a seed url with port 8 years ago
郭玉昆 700898fe8a fixed #301 修复使用注解抽取JSON数据的问题 9 years ago
Yihua Huang e22d6426fc Merge pull request #343 from Salon-sai/master
add: redis scheduler with priority
9 years ago
Salon.sai f89a6a6826 add: redis scheduler with priority 9 years ago
yihua.huang 448e528140 update StringUtils to apache lang3 #314 9 years ago
yihua.huang 3e33959b7a #319 fix javadoc 9 years ago
yihua.huang 3a6e246350 Merge branch 'kapsterio-fix' 9 years ago
yihua.huang 8730e3e97a Merge branch 'fix' of git://github.com/kapsterio/webmagic into kapsterio-fix 9 years ago
Yihua Huang 37cb43b667 Merge pull request #176 from lavenderx/master
add PhantomJSDownloader
9 years ago
yihua.huang 2400ff7e1a resovle conflict 9 years ago
yihua.huang 9de64ea0f2 Merge branch 'hepan-master' 9 years ago
yihua.huang b7f3c4bba0 Merge branch 'master' of git://github.com/hepan/webmagic into hepan-master 9 years ago
yihua.huang d8f978fd20 fix test in JsonPathSelectorTest #289 9 years ago
yihua.huang 25821c3c06 Merge branch 'EdwardsBean-proxy-strategy' 9 years ago
yihua.huang 61c28a0130 refactor on proxypool 9 years ago
yihua.huang b871b210c5 Merge branch 'proxy-strategy' of github.com:EdwardsBean/webmagic into EdwardsBean-proxy-strategy 9 years ago
yihua.huang b5413368de update ut 9 years ago
yihua.huang a8c9005381 Merge branch 'oxf1-master' 9 years ago
Jon 83c27ebbc4 增加IP代理认证功能 9 years ago
yihua.huang ca072c5575 fix URL regex in GithubRepoPageProcessor #305 9 years ago
hepan 89c6e52863 代理增加用户名密码认证 9 years ago
Linker Lin 047cb8ff8f updated versions to 0.5.4-SNAPSHOT 9 years ago
Linker Lin b9544424f2 Update pom.xml
回滚。。。
我想,主要的问题还是主版本号没了 SNAPSHOT
9 years ago
Linker Lin b05d605c4b Update pom.xml
在纯净的环境中,需要做上面的改动。
9 years ago
zhangheng09 6b179c3d55 这个改动的原因基于两点:1)代理归还给代理池的时机应该是执行完http请求后就要尽早归还 2)http代理应该是HttpClientDownloader该考虑的事,不应该有Spider来处理,Spider并不知道它的downloader是个HttpClientDownloader 9 years ago
zhangheng09 5f106c9c69 当page为null时,意味着非正常的响应状态,应该抛出异常,否则SpiderListener的onSuccess方法和onError方法都会执行 9 years ago
yihua.huang c0b8e8f8ae remove .classpath .project 9 years ago
yihua.huang ce89ebb2b4 remove en_doc zh_docs dir 9 years ago
yihua.huang b9ac76aa8b update readme 9 years ago
yihua.huang a0c74a6a26 readme in zh 9 years ago
yihua.huang cb61820d31 update spiderman link 9 years ago
yihua.huang a8e6de4b90 Merge branch 'master' of git.oschina.net:flashsword20/webmagic 9 years ago
yihua.huang cd08b230b8 update version to 0.5.3 9 years ago
yihua.huang 0fd4623f0a Merge branch 'osc' 9 years ago
yihua.huang ce5495ecd5 remove useless files 9 years ago
yihua.huang 8265c7dade remove submodules for relase 9 years ago
yihua.huang 972ccd3d56 update version to 0.5.3-SNAPSHOT 9 years ago
yihua.huang 7edfa26f90 complete javadoc 9 years ago
yihua.huang 8b90b91e33 complete some javadoc 9 years ago
yihua.huang 2b556cf053 update verison to 0.5.3-SNAPSHOT 9 years ago
yihua.huang 9c5716a543 complete javadoc 9 years ago
yihua.huang db3cbf6ca5 update version to 0.5.3-SNAPSHOT 9 years ago
yihua.huang 81ce1ffc5f fix ignore 9 years ago
yihua.huang 93764fa2c9 ignore some test 9 years ago
yihua.huang 5706bb90af update xsoup to 0.3.1 9 years ago
yihua.huang 7586e3d75c add some test for github repo downloader 9 years ago
yihua.huang 800f66c4cc Revert "remove some unkown config"
This reverts commit 0e245c9896.
9 years ago