Commit Graph

1308 Commits (master)
 

Author SHA1 Message Date
Yihua Huang 1cd199b160
fix: webmagic-scripts/pom.xml to reduce vulnerabilities (#1181)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJETBRAINSKOTLIN-2393744

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2 months ago
Joe Zhou 837253cfc9 Merge branch 'release/1.0.2' 2 months ago
Joe Zhou bf1088bd67 Update versions for release 2 months ago
Joe Zhou c20edb8246 Polish code. 2 months ago
Joe Zhou 0a9fe8d3e0 Add static methods to construct Page. 2 months ago
Bob Conan 7e500d7b95
Updated README.md, fix typo(s) (#1180) 3 months ago
Joe Zhou 6ed83769e0 Update for next development version 3 months ago
Joe Zhou 63e675066f Merge tag 'WebMagic-1.0.1' into develop
Tag release
3 months ago
Joe Zhou e98f7d722a Merge branch 'release/1.0.1' 3 months ago
Joe Zhou 6eab7a4155 Update versions for release 4 months ago
dependabot[bot] 50026ff937
Bump commons-io:commons-io from 2.11.0 to 2.14.0 (#1179)
Bumps commons-io:commons-io from 2.11.0 to 2.14.0.

---
updated-dependencies:
- dependency-name: commons-io:commons-io
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
Joe Zhou 541ced9eea Change the default status code from 200 to 0 & downloadSuccess from true to false, for Page. 4 months ago
Yihua Huang 19f60bf340
fix: pom.xml to reduce vulnerabilities (#1178)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMMONSIO-8161190

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
4 months ago
xiezcGitHub 15ec80fcf1
FileCacheQueueScheduler使用BloomFilter进行去重 (#1176)
Co-authored-by: xiezc <blanexie@qq.com>
6 months ago
xiezcGitHub 2c135dadce
#1172 问题的解决 (#1173)
Co-authored-by: xiezhicheng <xiezhicheng@xiaomi.com>
6 months ago
Joe Zhou 25c2d95e96 Update for next development version 7 months ago
Joe Zhou 9d75cce16d Merge branch 'release/1.0.0' 7 months ago
Joe Zhou c88330f25d Merge tag 'WebMagic-1.0.0' into develop
Tag release
7 months ago
Joe Zhou 3e9cd9b5c3 Update versions for release 7 months ago
Niu_XZ 4d0cdb011f
stopWhenComplete,增加动态修改完成时停止方法。 (#1169)
Co-authored-by: niuxiaozu <niuxiaozu@yeah.net>
8 months ago
Joe Zhou 49a5efff46 Add a private constructor to hide the implicit public one. 8 months ago
Joe Zhou 5c43e36118 Make sure the contentType of detectCharset could be null. 8 months ago
Joe Zhou d2aebc60a7 Make getCharset to support null parameter. 8 months ago
Sutra Zhou 7d2d2244b3 Upgrade oxerr-parent from 2.1.0 to 2.2.1. 9 months ago
Sutra Zhou 16a4fe3e28 Use oxerr-parent instead. 9 months ago
Sutra Zhou 4ee30c0592 Merge tag 'WebMagic-0.10.3' into develop
Tag hotfix
10 months ago
Sutra Zhou 38f240c42e Update to hotfix version 10 months ago
Sutra Zhou f7fdcd025f Merge branch 'hotfix/0.10.3' 10 months ago
Sutra Zhou 462c60fef2 Fix for entity is null. 10 months ago
Sutra Zhou 54aef0f0e0 Update versions for hotfix 10 months ago
Sutra Zhou 6be02f3a0f Merge tag 'WebMagic-0.10.2' into develop
Tag hotfix
10 months ago
Sutra Zhou a81c4e7627 Update to hotfix version 10 months ago
Sutra Zhou 0dc852e219 Merge branch 'hotfix/0.10.2' 10 months ago
Sutra Zhou 0dbfaf7284 Remove useless log. 10 months ago
Sutra Zhou bda51537b6 Update versions for hotfix 10 months ago
Sutra Zhou 2217b1c8f2 Merge tag 'WebMagic-0.10.1' into develop
Tag hotfix
10 months ago
Sutra Zhou 884f51ba3b Update to hotfix version 10 months ago
Sutra Zhou 2994716ba5 Merge branch 'hotfix/0.10.1' 10 months ago
Sutra Zhou 78740a4e28 Fix NPE. 10 months ago
Sutra Zhou 5afe3e7b81 Revert "fix: pom.xml to reduce vulnerabilities (#1134)"
This reverts commit 19288e9c11.
10 months ago
Sutra Zhou a0ff4a2d2e Fix log message. 10 months ago
Sutra Zhou 76ef0332f1 Update versions for hotfix 10 months ago
Joe Zhou a5144350bd Upgrade maven plugins to latest versions. 10 months ago
Joe Zhou e34b495625 Upgrade maven-suirefire-plugin from 3.0.0-M7 to 3.2.5. 10 months ago
Joe Zhou 5344db0106 Upgrade jacoco-maven-plugin from 0.8.8 to 0.8.12. 10 months ago
Joe Zhou 9ab342c3a7 Remove public modifiers from junit5 test methods. 10 months ago
Joe Zhou 5196a56ccf Format code. 10 months ago
Joe Zhou dba1668306 Add tests to test the equals & hashCode of Proxy. 10 months ago
Joe Zhou b7e0d360ec Upgrade junit from 4.13.2 to 5.10.2. 10 months ago
François Gibier d8321baf56
Refactored and implement of a template method pattern for logger config in webmagic-scripts (#1158)
* Refactor of processSingle in PageModelExtractor

* Changed my refactor of processSingle, this one is a lot better

* Changed my refactor of processSingle, this one is a lot better

* add lombok for getters and setters

* Refactored and implement of a template method pattern for logger config
10 months ago