Commit Graph

169 Commits (583a0eba8c04d29ab30bac74138a586aa4edc475)

Author SHA1 Message Date
yihua.huang 583a0eba8c #29 refactor some method name 11 years ago
yihua.huang 6fa82a418b #29 seed urls with more information 11 years ago
yihua.huang 1446ada732 some refactor 12 years ago
yihua.huang 84976c81ec remove useless code 12 years ago
yihua.huang b4fcf41168 add exit when comlete option 12 years ago
yihua.huang 352887870c remove shutdown call 12 years ago
yihua.huang a3f9ad198f refactor multi thread code in Spider 12 years ago
yihua.huang 7fb44d2eec #30 reuse PoolingClientConnectionManager for HttpClientDownloader 12 years ago
yihua.huang 5a226387e0 #27 nullpointer fix 12 years ago
yihua.huang 16e12e3bc9 #27 customize http header for downloader 12 years ago
yihua.huang 1a2c84ea78 #27 add timeout config to site 12 years ago
yihua.huang 4acbc19cee [maven-release-plugin] prepare for next development iteration 12 years ago
yihua.huang cc3b787991 [maven-release-plugin] prepare release webmagic-0.3.2 12 years ago
yihua.huang b131878123 add example 12 years ago
yihua.huang 95ab4edec3 some bugfix 12 years ago
yihua.huang fba330872b fix a thread pool exception 12 years ago
yihua.huang 3c79d031bd fix thread pool 12 years ago
yihua.huang fb693a4ac4 [maven-release-plugin] prepare for next development iteration 12 years ago
yihua.huang bfaaa042b9 [maven-release-plugin] prepare release webmagic-parent-0.3.1 12 years ago
yihua.huang c17a31a21d fix null pointe exception #26 12 years ago
yihua.huang d2e0f0cd33 #25 use URL api in UrlUtils.canonicalizeUrl() 12 years ago
yihua.huang ef4cf49fee add stop method to spider #24 12 years ago
yihua.huang 692de76f86 fix issue #21 charset detect error 12 years ago
yihua.huang e7bf425df4 [maven-release-plugin] prepare for next development iteration 12 years ago
yihua.huang 77ff252316 [maven-release-plugin] prepare release webmagic-0.3.0 12 years ago
yihua.huang 1fc8e104ab add cycle retry 12 years ago
yihua.huang d141541ef3 add retry 12 years ago
yihua.huang a1ef2523cc update xsoup version 12 years ago
yihua.huang aefd0569a5 update version 12 years ago
yihua.huang 194518fd82 add switch 12 years ago
yihua.huang 326b97c65a update 12 years ago
yihua.huang 2c3574537a refactor in selectors 12 years ago
yihua.huang 85b7cf1563 complete test 12 years ago
yihua.huang d7cd9e5747 update pom 12 years ago
yihua.huang 55d4a76ab7 newselectors 12 years ago
yihua.huang d7abbd0e4b fix compile error 12 years ago
yihua.huang 5e9e8b2541 add TextContentSelector 12 years ago
yihua.huang 0cc0ccee35 add charset specific for easy call of HttpClientDownloader 12 years ago
yihua.huang 91dcccf7b5 add a sample 12 years ago
yihua.huang ad66d33f38 [maven-release-plugin] prepare for next development iteration 12 years ago
yihua.huang 9dc6b11954 [maven-release-plugin] prepare release webmagic-parent-0.2.1 12 years ago
yihua.huang 4f62dfc8a4 release 12 years ago
yihua.huang 74c940c758 [maven-release-plugin] prepare for next development iteration 12 years ago
yihua.huang a4bb4e3429 [maven-release-plugin] prepare release webmagic-parent-0.2.1 12 years ago
yihua.huang 194f16aa75 update 12 years ago
yihua.huang 0f0f1a9bcd release notes 12 years ago
yihua.huang c1471718df extractors 12 years ago
yihua.huang 20705b34ac add more option to extractors 12 years ago
yihua.huang c70ed57025 remove PriorityScheduler to core 12 years ago
yihua.huang 7003426898 update pom 12 years ago