Commit Graph

1153 Commits (snyk-fix-53f8206c2d48cf7014326d6f53ad35a4)
 

Author SHA1 Message Date
yihua.huang 3c653d941a Merge branch 'master' of github.com:code4craft/webmagic 8 years ago
yihua.huang 5a9328c32e update link 8 years ago
Yihua Huang 9903f0367d Merge pull request #570 from SoulZhong/master
修复formatter初始化未传参bug
8 years ago
yihua.huang ec7c52104f update logo 8 years ago
yihua.huang 2482c2c877 update version in readme 8 years ago
yihua.huang 858d535ec7 remove useless files 8 years ago
yihua.huang 2e35e149be for 0.7.1 8 years ago
yihua.huang 17d8bfa907 docs and pgp version 8 years ago
yihua.huang 17478fcfc4 0.7.0 release 8 years ago
yihua.huang 636359300f add Site.disableCookieManagement #577 8 years ago
yihua.huang 49de9374cd new SimpleHttpClient #576 8 years ago
yihua.huang 7ffc6998ef add isExtractLinks to OOSpider #575 8 years ago
yihua.huang 8999ea9320 add public constructor for SimpleProxyProvider 8 years ago
soul bc828e1384 修复formatter初始化未传参bug 8 years ago
yihua.huang a8c2e6c729 alpha release 8 years ago
yihua.huang 3c1338193b for 0.7.0.alpha 8 years ago
yihua.huang e8abc28072 #552 add some log when crawler stop 8 years ago
zhuyue 9e1b7ed3f7 Update RegexSelector.java 8 years ago
zhuyue 975adf7072 Merge pull request #2 from zhuyuesut/zhuyuesut-fixbug
Update RegexSelectorTest.java
8 years ago
zhuyue c80f25edbd Update RegexSelectorTest.java
简单的增加了一点测试
8 years ago
zhuyue 39c3c2f904 Merge pull request #1 from zhuyuesut/zhuyuesut-fixbug
Update RegexSelector.java
8 years ago
zhuyue 0c359a2bde Update RegexSelector.java 8 years ago
zhuyue c3183252ac Update RegexSelector.java 8 years ago
yihua.huang cbf80af5dd test for SimpleProxyProvider #535 8 years ago
yihua.huang eb632a93d3 SimpleProxyProvider #535 8 years ago
yihua.huang 62a6985103 update javadoc config 8 years ago
yihua.huang d38d51dfcb fix javadoc 8 years ago
Yihua Huang 0cd2f6031a Merge pull request #528 from GZhY/master
对 WebMagic-0.7.0 的小修补
8 years ago
GZhY 5f34adf938 完善 LinksSelector.selectList 的测试用例 8 years ago
GZhY ce3f0ac239 删除 fixAllRelativeHrefs 并修复 SeleniumDownloader 对 fixAllRelativeHrefs 的依赖 8 years ago
GZhY bc6e81e00f 修复checkElementAndConvert方法注释中注释错误 8 years ago
yihua.huang 4a2c0f4f97 add returnProxy for proxyProvider 8 years ago
yihua.huang 1b04a7f2b3 #527 move logic check from downloaderto spider 8 years ago
Yihua Huang 6ead04a758 Merge pull request #524 from code4craft/proxyRefactor
HttpClient部分重构
8 years ago
yihua.huang 0f4d6e8b12 #525 remove port in UrlUtils.getDomain() 8 years ago
yihua.huang a1ae632b62 test for request cookies and headers 8 years ago
yihua.huang db67db8103 #523 remove fixAllRelativeHrefs by default, get absolute urls for links() 8 years ago
yihua.huang abd020b45b some comments 8 years ago
yihua.huang 2622b448b8 fix test 8 years ago
yihua.huang b06a248c00 fix test 8 years ago
yihua.huang 1cfbd13aae refacor in httpclientdownloader 8 years ago
yihua.huang 83ada9749e fix test 8 years ago
yihua.huang fe95a6842f Request再次重构:去掉params,仅保留HttpRequestBody 8 years ago
yihua.huang 395396c68e 增加HttpRequestBody 8 years ago
Yihua Huang 25df6650d9 Merge pull request #513 from xbynet/master
Request支持设置header与cookie、新增POST请求时,XML、JSON参数支持、Page支持获取响应header
8 years ago
xbynet c93a8a2722 修复字符编码检测BUG 8 years ago
yihua.huang 74110e6ec5 remove useless file 8 years ago
yihua.huang b100dfe273 update version 8 years ago
xbynet@outlook.com 1c24baa8d1 Request支持设置header与cookie
新增POST请求时,XML、JSON参数支持
Page支持获取响应header
8 years ago
xbynet 5824e9515b Merge pull request #3 from code4craft/master
合并最新代码
8 years ago