992 Commits (0.8.0)

 

All Branches   

Search

Author	SHA1	Message	Date
yihua.huang	2400ff7e1a	resovle conflict	9 years ago
yihua.huang	9de64ea0f2	Merge branch 'hepan-master'	9 years ago
yihua.huang	b7f3c4bba0	Merge branch 'master' of git://github.com/hepan/webmagic into hepan-master	9 years ago
yihua.huang	d8f978fd20	fix test in JsonPathSelectorTest #289	9 years ago
yihua.huang	25821c3c06	Merge branch 'EdwardsBean-proxy-strategy'	9 years ago
yihua.huang	61c28a0130	refactor on proxypool	9 years ago
yihua.huang	b871b210c5	Merge branch 'proxy-strategy' of github.com:EdwardsBean/webmagic into EdwardsBean-proxy-strategy	9 years ago
yihua.huang	b5413368de	update ut	9 years ago
yihua.huang	a8c9005381	Merge branch 'oxf1-master'	9 years ago
Jon	83c27ebbc4	增加IP代理认证功能	9 years ago
yihua.huang	ca072c5575	fix URL regex in GithubRepoPageProcessor #305	9 years ago
hepan	89c6e52863	代理增加用户名密码认证	9 years ago
Linker Lin	047cb8ff8f	updated versions to 0.5.4-SNAPSHOT	9 years ago
Linker Lin	b9544424f2	Update pom.xml ... 回滚。。。 我想，主要的问题还是主版本号没了 SNAPSHOT	9 years ago
Linker Lin	b05d605c4b	Update pom.xml ... 在纯净的环境中，需要做上面的改动。	9 years ago
zhangheng09	6b179c3d55	这个改动的原因基于两点：1）代理归还给代理池的时机应该是执行完http请求后就要尽早归还 2)http代理应该是HttpClientDownloader该考虑的事，不应该有Spider来处理，Spider并不知道它的downloader是个HttpClientDownloader	9 years ago
zhangheng09	5f106c9c69	当page为null时，意味着非正常的响应状态，应该抛出异常，否则SpiderListener的onSuccess方法和onError方法都会执行	9 years ago
yihua.huang	c0b8e8f8ae	remove .classpath .project	9 years ago
yihua.huang	ce89ebb2b4	remove en_doc zh_docs dir	9 years ago
yihua.huang	b9ac76aa8b	update readme	9 years ago
yihua.huang	a0c74a6a26	readme in zh	9 years ago
yihua.huang	cb61820d31	update spiderman link	9 years ago
yihua.huang	a8e6de4b90	Merge branch 'master' of git.oschina.net:flashsword20/webmagic	9 years ago
yihua.huang	cd08b230b8	update version to 0.5.3	9 years ago
yihua.huang	0fd4623f0a	Merge branch 'osc'	9 years ago
yihua.huang	ce5495ecd5	remove useless files	9 years ago
yihua.huang	8265c7dade	remove submodules for relase	9 years ago
yihua.huang	972ccd3d56	update version to 0.5.3-SNAPSHOT	9 years ago
yihua.huang	7edfa26f90	complete javadoc	9 years ago
yihua.huang	8b90b91e33	complete some javadoc	9 years ago
yihua.huang	2b556cf053	update verison to 0.5.3-SNAPSHOT	9 years ago
yihua.huang	9c5716a543	complete javadoc	9 years ago
yihua.huang	db3cbf6ca5	update version to 0.5.3-SNAPSHOT	9 years ago
yihua.huang	81ce1ffc5f	fix ignore	9 years ago
yihua.huang	93764fa2c9	ignore some test	9 years ago
yihua.huang	5706bb90af	update xsoup to 0.3.1	9 years ago
yihua.huang	7586e3d75c	add some test for github repo downloader	9 years ago
yihua.huang	800f66c4cc	Revert "remove some unkown config" ... This reverts commit 0e245c9896.	9 years ago
yihua.huang	73ae7a1d52	remove ci for jdk6	9 years ago
yihua.huang	0e245c9896	remove some unkown config	9 years ago
yihua.huang	9ed06ccdf0	update surefire version	9 years ago
Yihua Huang	9d0eeb9000	Merge pull request #218 from bingoko/master ... 添加PhantomJS无界面浏览器支持	9 years ago
Yihua Huang	84b046e4c9	Merge pull request #227 from hsqlu/master ... update deprecated method	9 years ago
Yihua Huang	cfde3b7657	Merge pull request #237 from SpenceZhou/master ... Update RedisScheduler.java	9 years ago
SpenceZhou	165e5a72eb	Update RedisScheduler.java ... 修改redisscheduler中获取爬取总数bug	9 years ago
Yihua Huang	5f9e1a96f2	Merge pull request #233 from x1ny/master ... 修正FileCacheQueueScheduler导致程序不能正常结束和未关闭流	9 years ago
Yihua Huang	7d7eb033d3	Merge pull request #234 from chy996633/master ... 知乎爬虫抓取	9 years ago
chy996633	afd1617b58	知乎爬虫抓取	9 years ago
x1ny	90e14b31b0	修正FileCacheQueueScheduler导致程序不能正常结束和未关闭流 ... FileCacheQueueScheduler中开启了一个线程周期运行来保存数据但在爬虫结束后没有关闭导致程序无法结束，以及没有关闭io流。 解决方法： 让FileCacheQueueScheduler实现Closable接口，在close方法中关闭线程以及流。 在Spider的close方法中添加对scheduler的关闭操作。	9 years ago
Qiannan Lu	155215290f	resolve issue #226	10 years ago