github-forks
/
webmagic
mirror of https://github.com/code4craft/webmagic.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
1,249 Commits
50 Branches
37 Tags
19 MiB
Commit Graph

1249 Commits (0ceaf14882b87fe8606386e16df3ba701e2ad547)
 

Author SHA1 Message Date
snyk-bot 3776de6de2
fix: webmagic-samples/pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2421244
Sutra Zhou f50b1c77b6
Merge pull request from code4craft/snyk-fix-cdf627b4ee226c4d9171b1960a044dc0 
[Snyk] Security upgrade net.sourceforge.htmlcleaner:htmlcleaner from 2.9 to 2.26
snyk-bot a4f2bead80
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJDOM-1309669
Sutra Zhou 571bac9d88
Merge pull request from code4craft/snyk-fix-3bb5020d5999f6b3ded6eb3378296acd 
[Snyk] Security upgrade com.github.dreamhead:moco-core from 1.2.0 to 1.3.0
snyk-bot 88da899a89
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2326698
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1584063
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1584064
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-2314893
Sutra Zhou 1b4098c357
Merge pull request from code4craft/snyk-fix-5e9c00d3ecc1ab84f141bc680b00fe19 
[Snyk] Security upgrade com.jayway.jsonpath:json-path from 2.5.0 to 2.6.0
snyk-bot 0c2a7daf4b
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1078499
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1298655
Sutra Zhou 692605bd75 Merge branch 'develop' of github.com:code4craft/webmagic into develop
Sutra Zhou 34da2fb3a0 Make PageProcessor#getSite be default method. Closes .
Sutra Zhou 626ba57b0e
Merge pull request from code4craft/snyk-fix-f533124205b5e86f0bda976e921ffec2 
[Snyk] Security upgrade org.jruby:jruby from 9.2.14.0 to 9.3.0.0
snyk-bot cdbba362bb
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMGITHUBJNR-1570422
Sutra Zhou f110147b62
Merge pull request from carl-don-it/perfect_spider_run 
perfect Spider.run to avoid some rare concurrent issue, change the Sp…
carl.don:tjr fcdb9074d6 格式化 Spider.run 代码
carl.don:tjr ab5d81a6b6 perfect Spider.run to avoid some rare concurrent issue, change the Spider.emptySleepTime to long type
Sutra Zhou c5a037a807 Update for next development version
Sutra Zhou 4024230e17 Merge branch 'release/0.7.5' into develop
Sutra Zhou 04978f912d Merge branch 'release/0.7.5'
Sutra Zhou 113eaa4bae Bump version number to 0.7.5.
Sutra Zhou 4e51a4f68b Update versions for release
Sutra Zhou e3e66fb270 Upgrade webmagic-samples dependencies.
Sutra Zhou 14b09a3385 Update maven plugin versions.
Sutra Zhou 31a00f5f8e Set gitflow-maven-plugin versionTagPrefix.
Sutra Zhou db70b6e095 Add maven reports.
Sutra Zhou 1068e185a0
Merge pull request from code4craft/snyk-fix-9e933ef3fbdfa89b1dad83f86cbbea2a 
[Snyk] Security upgrade com.jayway.jsonpath:json-path from 2.4.0 to 2.6.0
snyk-bot 129e9184bf
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1078499
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-1298655
Sutra Zhou c7828f44ac
Merge pull request from gkorland/patch-1 
Update to Jedis 3.6.0
Guy Korland 189c5962e6
Update to Jedis 3.6.0
Sutra Zhou dba0ddb92c Remove unknown tag from javadoc.
Sutra Zhou 133106a15c
Merge pull request from FreaxLin/Restore_the_already_crawled_example 
提交可恢复爬取内容例子
linweisen 76f625c02e 提交可恢复爬取内容例子
Sutra Zhou 868b0cb05b
Merge pull request from code4craft/snyk-fix-9cd27ad57a7323a57b3b3f45ce02a123 
[Snyk] Security upgrade com.github.dreamhead:moco-core from 1.1.0 to 1.2.0
snyk-bot e2c143b52f
fix: pom.xml to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-1048302
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1020439
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1070799
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1082234
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1082235
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1082236
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-564897
- https://snyk.io/vuln/SNYK-JAVA-ORGFREEMARKER-1076795
Sutra Zhou be6f5ff771 Add missing @Deprecated annotations.
Sutra Zhou 4e8a086dae Pass exception to onError. Fixes .
Sutra Zhou dcfd238413 Polish java version setting.
Sutra Zhou 59fc16101b
Merge pull request from thebirdandfish/develop 
增加了List<SpiderStatusMXBean>属性的get方法,供SpiderMonitor的子类获取.
wecandoitjustthink 528a8908af 增加了List<SpiderStatusMXBean>属性的get方法,供SpiderMonitor的子类获取.
Sutra Zhou 71b7dfbf9a
Merge pull request from yqia182/master 
SpiderStatus中getPagePerSecond()方法，增加验证逻辑，避免空指针，避免除数为零。
JustThink 54127318a4 SpiderStatus中getPagePerSecond()方法，增加验证逻辑，避免空指针，避免除数为零。
Sutra Zhou d92dc8397f Upgrade htmlcleaner from 2.5 to 2.9, this is the highest version to let Xpath2Selector pass the test cases.
Sutra Zhou 124c52b988 Downgrade htmlcleaner from 2.24 back to 2.5, to make Xpath2Selector pass the test cases.
Sutra Zhou 683db09133 Complete testXPath2 assertion.
Sutra Zhou 2f71f7912c Fix scm tag.
Sutra Zhou d0e2776991 Upgrade xsoup from 0.3.1 to 0.3.2.
Sutra Zhou 0e01550a79 Upgrade dependencies, including the jedis from 2.9.3 to 3.4.1.
Sutra Zhou 0d73f08ef6 Upgrade maven plugins.
Sutra Zhou e14a762632 Add gitflow-maven-plugin.
Sutra Zhou ab6ff7f809 Revert "pageCount修改" 
This reverts commit 9a71f0ac92.
Sutra Zhou 30daec4803 Revert "提供出现某种异常刷新代理，异常可配置" 
This reverts commit 4a6441e7c5.
Sutra Zhou d0843bee0d Revert "简化代码" 
This reverts commit 9cc5287743.