Commit Graph

1218 Commits (f64400c072f2af87de3a3b05db77afe47c3f3849)
 

Author SHA1 Message Date
snyk-bot f64400c072
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMSQUAREUPOKIO-5773320
2 years ago
Joe Zhou fd4a136f9a Merge branch 'release/0.9.0' 2 years ago
Joe Zhou 3688226e32 Update versions for release 2 years ago
Joe Zhou ad010927f6 Fix test. 2 years ago
Joe Zhou a5fb4e0414 Upgrade dependencies. 2 years ago
Joe Zhou 58fd08bcf8 Expose Request to ProxyProvider. 2 years ago
Yihua Huang 9e59b37834
fix: pom.xml to reduce vulnerabilities (#1119)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMGOOGLEGUAVA-5710356

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2 years ago
Snyk bot aeb0e89f02
fix: pom.xml to reduce vulnerabilities (#1114)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-3369748
2 years ago
Tanky-Zhang 244ade7b4c
feat:update host verify (#1112) 2 years ago
hooy 717931166a
向 webmagic-saxon 组件提供若干新 API,更优雅更灵活更强大 (#1108)
* Feature:
* webmagic-saxon 组件新增若干新 API;

* Update: 更优雅的写代码。

* Update: JaxpSelectorUtils 工具类增加 final 关键字。
2 years ago
Sutra Zhou f47038db63
Merge pull request #1107 from hooyantsing/develop
修复 HtmlCleaner 无法正常解析 tr 和 td 标签的问题
2 years ago
hooyantsing 08f4a4046b Update: 提供测试用例。 2 years ago
hooyantsing 12ce86425f BugFix: Jsoup 和 HtmlCleaner 构建 Dom 时,若缺失 table 标签,则无法正常解析 tr 和 td 标签。 2 years ago
Joe Zhou a266df406f Add Site.defaultCharset. closes #1101. 2 years ago
Joe Zhou 80424b0bd7 Replace List with Iterable, fixed #1099. 2 years ago
Joe Zhou ef616c999e Fix warnings. 2 years ago
Joe Zhou faf7e1559a Update README for the webmagic version. 2 years ago
Joe Zhou cda8467f95 Update for next development version 2 years ago
Joe Zhou 43ce1a0db9 Merge branch 'release/0.8.0' 2 years ago
Joe Zhou 3085896743 Merge tag 'WebMagic-0.8.0' into develop
Tag release
2 years ago
Joe Zhou 7d091def55 Upgrade fastjson, jruby, slf4j. 2 years ago
Joe Zhou a7a06936f0 Fix requireMavenVersion. 2 years ago
Joe Zhou 888682863c Update versions for release 2 years ago
Joe Zhou 64e6a9800a Add dead-lock note for QueueScheduler. 2 years ago
Joe Zhou e735e4e585 Log the remaining capacity. 2 years ago
Joe Zhou 4915431845 Revise logging level from warn to info, as we have passed the exception to onError. refs #1094 2 years ago
Joe Zhou 075b98291b Return spider in setEmptySleepTime itself for chainning. 2 years ago
Joe Zhou ac912e8f1f Revise QueueScheduler to support capacity-restricted. 2 years ago
Sutra Zhou 5d5f3bf20e Update for next development version 2 years ago
Sutra Zhou 6ba2256458 Merge tag 'WebMagic-0.7.6' into develop
Tag release
2 years ago
Sutra Zhou f45a8ff3e7 Merge branch 'master' of github.com:code4craft/webmagic 2 years ago
Sutra Zhou dc7218eba3 Merge branch 'release/0.7.6' 2 years ago
Sutra Zhou 838c47f1f6 Update versions for release 2 years ago
Sutra Zhou d2b2eed9df Pass the task to onSuccess & onError. 2 years ago
Sutra Zhou 5f80e02abd Interrupt current thread. 2 years ago
Sutra Zhou 904cd28236
Merge pull request #1089 from code4craft/snyk-fix-e9d89e9698a464f561824a17e083e765
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.4 to 2.13.4.2
2 years ago
snyk-bot a0ad7b808b
fix: webmagic-samples/pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038426
2 years ago
Sutra Zhou 126c32ecd0 Fix compatible issue. 2 years ago
Sutra Zhou 6647af8d61
Merge pull request #762 from jialigit/master
: 是非法字符,无法作为文件名
2 years ago
Sutra Zhou da357f0370
Merge pull request #1088 from code4craft/snyk-fix-305ed17aec2839f91059daec3059c3ce
[Snyk] Security upgrade us.codecraft:xsoup from 0.3.4 to 0.3.6
2 years ago
snyk-bot 223cfc609d
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJSOUP-2989728
2 years ago
Sutra Zhou 889b218798
Merge pull request #1087 from code4craft/snyk-fix-1f503660a3fe9a29c6255ad6d4e9b9ce
[Snyk] Security upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.2.1 to 2.13.4
2 years ago
snyk-bot a255640c3d
fix: webmagic-samples/pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038424
2 years ago
Sutra Zhou afc8309409 Upgrade maven plugins and dependencies. 2 years ago
Sutra Zhou 69accb656a
Merge pull request #1086 from vioao/enhance_jsoup_parse_table
Enhance Jsoup could parse tr td tag directly
2 years ago
vio.ao e7a7fbeeeb Enhance Jsoup could parse tr td tag directly 2 years ago
Sutra Zhou db9c92edf5
Merge pull request #1085 from vioao/common-downloader-error-process
Common downloader error process
2 years ago
vio.ao 5751681c91 Common the downloader status process and pass error information when onError 2 years ago
vio.ao 7a62a6cb45 Revert "Revert "Common the downloader status process and pass error information when …""
This reverts commit acfbd7b883.
2 years ago
Sutra Zhou a3428846ca
Merge pull request #1083 from code4craft/revert-1082-common-downloader-status-process
Revert "Common the downloader status process and pass error information when …"
2 years ago