Commit Graph

190 Commits (2c454a7ef605668d6a949e26b09ddbab86c93338)

Author SHA1 Message Date
yihua.huang e40b48e77b Merge tag 'webmagic-0.4.0' of github.com:code4craft/webmagic
[maven-release-plugin]  copy for tag webmagic-0.4.0

Conflicts:
	pom.xml
	webmagic-core/pom.xml
	webmagic-extension/pom.xml
11 years ago
yihua.huang 0b4fadc24d [maven-release-plugin] prepare release webmagic-0.4.0 11 years ago
yihua.huang fe6d9bb2e2 get keep-alive rework 11 years ago
yihua.huang fd6d2fd6f8 try to keepalive TCP connection 11 years ago
yihua.huang 425df08523 update version to 0.4.0 11 years ago
yihua.huang e046bb0723 remove useless code 11 years ago
yihua.huang 6e32a19f80 update api for direct download 11 years ago
yihua.huang 807aefe9df change EntityUtil to IOUtil because some encoding error 11 years ago
yihua.huang 00b0a751b4 #33 ignore 'content-encoding' when redirect 11 years ago
yihua.huang 8f774afc84 add direct download 11 years ago
yihua.huang c18b603399 optimize long compare 11 years ago
yihua.huang ed3f3583cc downloader refactor 11 years ago
yihua.huang a37f40e6e6 add cookie supoort 11 years ago
yihua.huang 3c6fced48e update connection client 11 years ago
yihua.huang 09153ff715 #22 http proxy support #32 update httpclient to 4.3.1 11 years ago
yihua.huang edfc319c45 update httpclient to 4.3.1 11 years ago
yihua.huang 160a149b05 todo bugfix 11 years ago
yihua.huang 583a0eba8c #29 refactor some method name 11 years ago
yihua.huang 6fa82a418b #29 seed urls with more information 11 years ago
yihua.huang 1446ada732 some refactor 11 years ago
yihua.huang 84976c81ec remove useless code 11 years ago
yihua.huang b4fcf41168 add exit when comlete option 11 years ago
yihua.huang 352887870c remove shutdown call 11 years ago
yihua.huang a3f9ad198f refactor multi thread code in Spider 11 years ago
yihua.huang 7fb44d2eec #30 reuse PoolingClientConnectionManager for HttpClientDownloader 11 years ago
yihua.huang 5a226387e0 #27 nullpointer fix 11 years ago
yihua.huang 16e12e3bc9 #27 customize http header for downloader 11 years ago
yihua.huang 1a2c84ea78 #27 add timeout config to site 11 years ago
yihua.huang 372cc0ad06 update jar 12 years ago
yihua.huang 4acbc19cee [maven-release-plugin] prepare for next development iteration 12 years ago
yihua.huang cc3b787991 [maven-release-plugin] prepare release webmagic-0.3.2 12 years ago
yihua.huang b131878123 add example 12 years ago
yihua.huang 95ab4edec3 some bugfix 12 years ago
yihua.huang fba330872b fix a thread pool exception 12 years ago
yihua.huang 3c79d031bd fix thread pool 12 years ago
yihua.huang a2fba8caa2 update to 0.3.1 12 years ago
yihua.huang fb693a4ac4 [maven-release-plugin] prepare for next development iteration 12 years ago
yihua.huang bfaaa042b9 [maven-release-plugin] prepare release webmagic-parent-0.3.1 12 years ago
yihua.huang c17a31a21d fix null pointe exception #26 12 years ago
yihua.huang d2e0f0cd33 #25 use URL api in UrlUtils.canonicalizeUrl() 12 years ago
yihua.huang ef4cf49fee add stop method to spider #24 12 years ago
yihua.huang 58150a090d update jar 12 years ago
yihua.huang 57556ab879 merege 12 years ago
yihua.huang 692de76f86 fix issue #21 charset detect error 12 years ago
yihua.huang e7bf425df4 [maven-release-plugin] prepare for next development iteration 12 years ago
yihua.huang 77ff252316 [maven-release-plugin] prepare release webmagic-0.3.0 12 years ago
yihua.huang 1fc8e104ab add cycle retry 12 years ago
yihua.huang d141541ef3 add retry 12 years ago
yihua.huang a1ef2523cc update xsoup version 12 years ago
yihua.huang aefd0569a5 update version 12 years ago