github-forks
/
webmagic
mirror of https://github.com/code4craft/webmagic.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
1,252 Commits
50 Branches
37 Tags
20 MiB
Commit Graph

1252 Commits (ed7429c29322a2755299e801a978f259bf69495c)
 

Author SHA1 Message Date
Joe Zhou faf7e1559a Update README for the webmagic version.
Joe Zhou cda8467f95 Update for next development version
Joe Zhou 43ce1a0db9 Merge branch 'release/0.8.0'
Joe Zhou 3085896743 Merge tag 'WebMagic-0.8.0' into develop 
Tag release
Joe Zhou 7d091def55 Upgrade fastjson, jruby, slf4j.
Joe Zhou a7a06936f0 Fix requireMavenVersion.
Joe Zhou 888682863c Update versions for release
Joe Zhou 64e6a9800a Add dead-lock note for QueueScheduler.
Joe Zhou e735e4e585 Log the remaining capacity.
Joe Zhou 4915431845 Revise logging level from warn to info, as we have passed the exception to onError. refs
Joe Zhou 075b98291b Return spider in setEmptySleepTime itself for chainning.
Joe Zhou ac912e8f1f Revise QueueScheduler to support capacity-restricted.
Sutra Zhou 5d5f3bf20e Update for next development version
Sutra Zhou 6ba2256458 Merge tag 'WebMagic-0.7.6' into develop 
Tag release
Sutra Zhou f45a8ff3e7 Merge branch 'master' of github.com:code4craft/webmagic
Sutra Zhou dc7218eba3 Merge branch 'release/0.7.6'
Sutra Zhou 838c47f1f6 Update versions for release
Sutra Zhou d2b2eed9df Pass the task to onSuccess & onError.
Sutra Zhou 5f80e02abd Interrupt current thread.
Sutra Zhou 904cd28236
Merge pull request from code4craft/snyk-fix-e9d89e9698a464f561824a17e083e765 
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.4 to 2.13.4.2
snyk-bot a0ad7b808b
fix: webmagic-samples/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038426
Sutra Zhou 126c32ecd0 Fix compatible issue.
Sutra Zhou 6647af8d61
Merge pull request from jialigit/master 
: 是非法字符，无法作为文件名
Sutra Zhou da357f0370
Merge pull request from code4craft/snyk-fix-305ed17aec2839f91059daec3059c3ce 
[Snyk] Security upgrade us.codecraft:xsoup from 0.3.4 to 0.3.6
snyk-bot 223cfc609d
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJSOUP-2989728
Sutra Zhou 889b218798
Merge pull request from code4craft/snyk-fix-1f503660a3fe9a29c6255ad6d4e9b9ce 
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.2.1 to 2.13.4
snyk-bot a255640c3d
fix: webmagic-samples/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038424
Sutra Zhou afc8309409 Upgrade maven plugins and dependencies.
Sutra Zhou 69accb656a
Merge pull request from vioao/enhance_jsoup_parse_table 
Enhance Jsoup could parse tr td tag directly
vio.ao e7a7fbeeeb Enhance Jsoup could parse tr td tag directly
Sutra Zhou db9c92edf5
Merge pull request from vioao/common-downloader-error-process 
Common downloader error process
vio.ao 5751681c91 Common the downloader status process and pass error information when onError
vio.ao 7a62a6cb45 Revert "Revert "Common the downloader status process and pass error information when …"" 
This reverts commit acfbd7b883.
Sutra Zhou a3428846ca
Merge pull request from code4craft/revert-1082-common-downloader-status-process 
Revert "Common the downloader status process and pass error information when …"
Sutra Zhou acfbd7b883
Revert "Common the downloader status process and pass error information when …"
Sutra Zhou ee5a0585d7
Merge pull request from vioao/common-downloader-status-process 
Common the downloader status process and pass error information when …
vio.ao d01f26333b Common the downloader status process and pass error information when onError
Sutra Zhou 16221e391d Fix xhtml namespace.
Sutra Zhou 31c4e48e79
Merge pull request from code4craft/snyk-fix-53f8206c2d48cf7014326d6f53ad35a4 
[Snyk] Security upgrade org.seleniumhq.selenium:selenium-java from 3.141.59 to 4.0.0
snyk-bot 565300cbaa
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMSQUAREUPOKHTTP3-2958044
Sutra Zhou 4a22c803e2
Merge pull request from code4craft/snyk-fix-4eb94e676367a3667c00737cdabdf3de 
[Snyk] Security upgrade us.codecraft:xsoup from 0.3.2 to 0.3.4
snyk-bot 31cf237e7c
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJSOUP-1567345
Sutra Zhou 433fe40833
Merge pull request from code4craft/snyk-fix-8beb1ce977279ec88cdb90c43603581c 
[Snyk] Security upgrade com.alibaba:fastjson from 1.2.75 to 1.2.83
snyk-bot 1ece3ce344
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMALIBABA-2859222
Sutra Zhou 6747046b6c
Merge pull request from yokelsoft/develop 
change dependency versions into properties
David Hsing 54da7af17e change dependency versions into properties 
change dependency versions into properties
update commons-collections from 3.x to 4.4
Sutra Zhou add873d488
Merge pull request from code4craft/snyk-fix-a0dcc179d2c2f593e02424c579060a2d 
[Snyk] Security upgrade org.jetbrains.kotlin:kotlin-stdlib from 1.1.2-2 to 1.6.0
snyk-bot 137e7b56ca
fix: webmagic-scripts/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJETBRAINSKOTLIN-2628385
Sutra Zhou e47bf1733b
Merge pull request from code4craft/snyk-fix-25c8898b02f8de0fc143c2eaa3e8c7cc 
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.2 to 2.13.2.1
snyk-bot 9628739ceb
fix: webmagic-samples/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2421244