Commit Graph

1141 Commits (snyk-fix-729e15e7770e9475a8504ae0fb1b5fe7)
 

Author SHA1 Message Date
snyk-bot 3776de6de2
fix: webmagic-samples/pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2421244
3 years ago
Sutra Zhou f50b1c77b6
Merge pull request #1056 from code4craft/snyk-fix-cdf627b4ee226c4d9171b1960a044dc0
[Snyk] Security upgrade net.sourceforge.htmlcleaner:htmlcleaner from 2.9 to 2.26
3 years ago
snyk-bot a4f2bead80
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJDOM-1309669
3 years ago
Sutra Zhou 571bac9d88
Merge pull request #1050 from code4craft/snyk-fix-3bb5020d5999f6b3ded6eb3378296acd
[Snyk] Security upgrade com.github.dreamhead:moco-core from 1.2.0 to 1.3.0
3 years ago
snyk-bot 88da899a89
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2326698
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1584063
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1584064
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-2314893
3 years ago
Sutra Zhou 1b4098c357
Merge pull request #1048 from code4craft/snyk-fix-5e9c00d3ecc1ab84f141bc680b00fe19
[Snyk] Security upgrade com.jayway.jsonpath:json-path from 2.5.0 to 2.6.0
3 years ago
snyk-bot 0c2a7daf4b
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1078499
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1298655
3 years ago
Sutra Zhou 626ba57b0e
Merge pull request #1036 from code4craft/snyk-fix-f533124205b5e86f0bda976e921ffec2
[Snyk] Security upgrade org.jruby:jruby from 9.2.14.0 to 9.3.0.0
3 years ago
snyk-bot cdbba362bb
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMGITHUBJNR-1570422
3 years ago
Sutra Zhou 04978f912d Merge branch 'release/0.7.5' 4 years ago
Sutra Zhou 113eaa4bae Bump version number to 0.7.5. 4 years ago
Sutra Zhou 4e51a4f68b Update versions for release 4 years ago
Sutra Zhou e3e66fb270 Upgrade webmagic-samples dependencies. 4 years ago
Sutra Zhou 14b09a3385 Update maven plugin versions. 4 years ago
Sutra Zhou 31a00f5f8e Set gitflow-maven-plugin versionTagPrefix. 4 years ago
Sutra Zhou db70b6e095 Add maven reports. 4 years ago
Sutra Zhou 1068e185a0
Merge pull request #1029 from code4craft/snyk-fix-9e933ef3fbdfa89b1dad83f86cbbea2a
[Snyk] Security upgrade com.jayway.jsonpath:json-path from 2.4.0 to 2.6.0
4 years ago
snyk-bot 129e9184bf
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1078499
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1298655
4 years ago
Sutra Zhou c7828f44ac
Merge pull request #1025 from gkorland/patch-1
Update to Jedis 3.6.0
4 years ago
Guy Korland 189c5962e6
Update to Jedis 3.6.0 4 years ago
Sutra Zhou dba0ddb92c Remove unknown tag from javadoc. 4 years ago
Sutra Zhou 133106a15c
Merge pull request #1013 from FreaxLin/Restore_the_already_crawled_example
提交可恢复爬取内容例子
4 years ago
linweisen 76f625c02e 提交可恢复爬取内容例子 4 years ago
Sutra Zhou 868b0cb05b
Merge pull request #1011 from code4craft/snyk-fix-9cd27ad57a7323a57b3b3f45ce02a123
[Snyk] Security upgrade com.github.dreamhead:moco-core from 1.1.0 to 1.2.0
4 years ago
snyk-bot e2c143b52f
fix: pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-1048302
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1020439
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1070799
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1082234
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1082235
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1082236
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-564897
- https://snyk.io/vuln/SNYK-JAVA-ORGFREEMARKER-1076795
4 years ago
Sutra Zhou be6f5ff771 Add missing @Deprecated annotations. 4 years ago
Sutra Zhou 4e8a086dae Pass exception to onError. Fixes #1005. 4 years ago
Sutra Zhou dcfd238413 Polish java version setting. 4 years ago
Sutra Zhou 59fc16101b
Merge pull request #1000 from thebirdandfish/develop
增加了List<SpiderStatusMXBean>属性的get方法,供SpiderMonitor的子类获取.
4 years ago
wecandoitjustthink 528a8908af 增加了List<SpiderStatusMXBean>属性的get方法,供SpiderMonitor的子类获取. 4 years ago
Sutra Zhou 71b7dfbf9a
Merge pull request #993 from yqia182/master
SpiderStatus中getPagePerSecond()方法,增加验证逻辑,避免空指针,避免除数为零。
4 years ago
JustThink 54127318a4 SpiderStatus中getPagePerSecond()方法,增加验证逻辑,避免空指针,避免除数为零。 4 years ago
Sutra Zhou d92dc8397f Upgrade htmlcleaner from 2.5 to 2.9, this is the highest version to let Xpath2Selector pass the test cases. 4 years ago
Sutra Zhou 124c52b988 Downgrade htmlcleaner from 2.24 back to 2.5, to make Xpath2Selector pass the test cases. 4 years ago
Sutra Zhou 683db09133 Complete testXPath2 assertion. 4 years ago
Sutra Zhou 2f71f7912c Fix scm tag. 4 years ago
Sutra Zhou d0e2776991 Upgrade xsoup from 0.3.1 to 0.3.2. 4 years ago
Sutra Zhou 0e01550a79 Upgrade dependencies, including the jedis from 2.9.3 to 3.4.1. 4 years ago
Sutra Zhou 0d73f08ef6 Upgrade maven plugins. 4 years ago
Sutra Zhou e14a762632 Add gitflow-maven-plugin. 4 years ago
Sutra Zhou ab6ff7f809 Revert "pageCount修改"
This reverts commit 9a71f0ac92.
4 years ago
Sutra Zhou 30daec4803 Revert "提供出现某种异常刷新代理,异常可配置"
This reverts commit 4a6441e7c5.
4 years ago
Sutra Zhou d0843bee0d Revert "简化代码"
This reverts commit 9cc5287743.
4 years ago
Sutra Zhou 5ceccc62e0 Revert "提供异常刷新httpClient,异常可配置,重写getHttpClient代码"
This reverts commit 19465089c3.
4 years ago
Sutra Zhou 33e3fcdf22 Revert "代理接口的修改,提供刷星代理API。downloader 下载错误时,提供request,exception,proxyProvider三个参数,"
This reverts commit ba69eba669.
4 years ago
Sutra Zhou c489647c4b Revert " Downloader 提供刷新组件的api,方便在spider中操作"
This reverts commit 2e2a0fdf3e.
4 years ago
Sutra Zhou 4bedd97267 Revert " 刷新代理api重构,需要提供旧代理,如果依然是旧代理,才进行刷新,防止应延迟响应造成的过度刷新"
This reverts commit 0aa2c3949d.
4 years ago
Sutra Zhou 3f756c9325 Revert " 代理功能扩展,对原代理提供商进行拆分,加入lombok"
This reverts commit 33906e36f4.
4 years ago
Sutra Zhou aabc5584b8 Revert " bug修改,对结果提供缓存能力"
This reverts commit f68795d7dd.
4 years ago
Sutra Zhou 57dfc7cfb3
Merge pull request #977 from sutra/build
Remove useless imports to fix build.
4 years ago