Commit Graph

1150 Commits (433fe408336c7c48b3b3e1c693f58b849dd0b648)
 

Author SHA1 Message Date
郭玉昆 700898fe8a fixed #301 修复使用注解抽取JSON数据的问题 9 years ago
Yihua Huang e22d6426fc Merge pull request #343 from Salon-sai/master
add: redis scheduler with priority
9 years ago
Salon.sai f89a6a6826 add: redis scheduler with priority 9 years ago
yihua.huang 448e528140 update StringUtils to apache lang3 #314 9 years ago
yihua.huang 3e33959b7a #319 fix javadoc 9 years ago
yihua.huang 3a6e246350 Merge branch 'kapsterio-fix' 9 years ago
yihua.huang 8730e3e97a Merge branch 'fix' of git://github.com/kapsterio/webmagic into kapsterio-fix 9 years ago
Yihua Huang 37cb43b667 Merge pull request #176 from lavenderx/master
add PhantomJSDownloader
9 years ago
yihua.huang 2400ff7e1a resovle conflict 9 years ago
yihua.huang 9de64ea0f2 Merge branch 'hepan-master' 9 years ago
yihua.huang b7f3c4bba0 Merge branch 'master' of git://github.com/hepan/webmagic into hepan-master 9 years ago
yihua.huang d8f978fd20 fix test in JsonPathSelectorTest #289 9 years ago
yihua.huang 25821c3c06 Merge branch 'EdwardsBean-proxy-strategy' 9 years ago
yihua.huang 61c28a0130 refactor on proxypool 9 years ago
yihua.huang b871b210c5 Merge branch 'proxy-strategy' of github.com:EdwardsBean/webmagic into EdwardsBean-proxy-strategy 9 years ago
yihua.huang b5413368de update ut 9 years ago
yihua.huang a8c9005381 Merge branch 'oxf1-master' 9 years ago
Jon 83c27ebbc4 增加IP代理认证功能 9 years ago
yihua.huang ca072c5575 fix URL regex in GithubRepoPageProcessor #305 9 years ago
hepan 89c6e52863 代理增加用户名密码认证 9 years ago
Linker Lin 047cb8ff8f updated versions to 0.5.4-SNAPSHOT 9 years ago
Linker Lin b9544424f2 Update pom.xml
回滚。。。
我想,主要的问题还是主版本号没了 SNAPSHOT
9 years ago
Linker Lin b05d605c4b Update pom.xml
在纯净的环境中,需要做上面的改动。
9 years ago
zhangheng09 6b179c3d55 这个改动的原因基于两点:1)代理归还给代理池的时机应该是执行完http请求后就要尽早归还 2)http代理应该是HttpClientDownloader该考虑的事,不应该有Spider来处理,Spider并不知道它的downloader是个HttpClientDownloader 9 years ago
zhangheng09 5f106c9c69 当page为null时,意味着非正常的响应状态,应该抛出异常,否则SpiderListener的onSuccess方法和onError方法都会执行 9 years ago
yihua.huang c0b8e8f8ae remove .classpath .project 9 years ago
yihua.huang ce89ebb2b4 remove en_doc zh_docs dir 9 years ago
yihua.huang b9ac76aa8b update readme 9 years ago
yihua.huang a0c74a6a26 readme in zh 9 years ago
yihua.huang cb61820d31 update spiderman link 9 years ago
yihua.huang a8e6de4b90 Merge branch 'master' of git.oschina.net:flashsword20/webmagic 9 years ago
yihua.huang cd08b230b8 update version to 0.5.3 9 years ago
yihua.huang 0fd4623f0a Merge branch 'osc' 9 years ago
yihua.huang ce5495ecd5 remove useless files 9 years ago
yihua.huang 8265c7dade remove submodules for relase 9 years ago
yihua.huang 972ccd3d56 update version to 0.5.3-SNAPSHOT 9 years ago
yihua.huang 7edfa26f90 complete javadoc 9 years ago
yihua.huang 8b90b91e33 complete some javadoc 9 years ago
yihua.huang 2b556cf053 update verison to 0.5.3-SNAPSHOT 9 years ago
yihua.huang 9c5716a543 complete javadoc 9 years ago
yihua.huang db3cbf6ca5 update version to 0.5.3-SNAPSHOT 9 years ago
yihua.huang 81ce1ffc5f fix ignore 9 years ago
yihua.huang 93764fa2c9 ignore some test 9 years ago
yihua.huang 5706bb90af update xsoup to 0.3.1 9 years ago
yihua.huang 7586e3d75c add some test for github repo downloader 9 years ago
yihua.huang 800f66c4cc Revert "remove some unkown config"
This reverts commit 0e245c9896.
9 years ago
yihua.huang 73ae7a1d52 remove ci for jdk6 9 years ago
yihua.huang 0e245c9896 remove some unkown config 9 years ago
yihua.huang 9ed06ccdf0 update surefire version 9 years ago
Yihua Huang 9d0eeb9000 Merge pull request #218 from bingoko/master
添加PhantomJS无界面浏览器支持
9 years ago