Commit Graph

1308 Commits (1cd199b160bfd24d81372897713048cfa6e55faf)
 

Author SHA1 Message Date
Yihua Huang 1cd199b160
fix: webmagic-scripts/pom.xml to reduce vulnerabilities (#1181)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJETBRAINSKOTLIN-2393744

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2 months ago
Joe Zhou 837253cfc9 Merge branch 'release/1.0.2' 2 months ago
Joe Zhou bf1088bd67 Update versions for release 2 months ago
Joe Zhou c20edb8246 Polish code. 2 months ago
Joe Zhou 0a9fe8d3e0 Add static methods to construct Page. 2 months ago
Bob Conan 7e500d7b95
Updated README.md, fix typo(s) (#1180) 2 months ago
Joe Zhou 6ed83769e0 Update for next development version 3 months ago
Joe Zhou 63e675066f Merge tag 'WebMagic-1.0.1' into develop
Tag release
3 months ago
Joe Zhou e98f7d722a Merge branch 'release/1.0.1' 3 months ago
Joe Zhou 6eab7a4155 Update versions for release 3 months ago
dependabot[bot] 50026ff937
Bump commons-io:commons-io from 2.11.0 to 2.14.0 (#1179)
Bumps commons-io:commons-io from 2.11.0 to 2.14.0.

---
updated-dependencies:
- dependency-name: commons-io:commons-io
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
Joe Zhou 541ced9eea Change the default status code from 200 to 0 & downloadSuccess from true to false, for Page. 4 months ago
Yihua Huang 19f60bf340
fix: pom.xml to reduce vulnerabilities (#1178)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMMONSIO-8161190

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
4 months ago
xiezcGitHub 15ec80fcf1
FileCacheQueueScheduler使用BloomFilter进行去重 (#1176)
Co-authored-by: xiezc <blanexie@qq.com>
6 months ago
xiezcGitHub 2c135dadce
#1172 问题的解决 (#1173)
Co-authored-by: xiezhicheng <xiezhicheng@xiaomi.com>
6 months ago
Joe Zhou 25c2d95e96 Update for next development version 7 months ago
Joe Zhou 9d75cce16d Merge branch 'release/1.0.0' 7 months ago
Joe Zhou c88330f25d Merge tag 'WebMagic-1.0.0' into develop
Tag release
7 months ago
Joe Zhou 3e9cd9b5c3 Update versions for release 7 months ago
Niu_XZ 4d0cdb011f
stopWhenComplete,增加动态修改完成时停止方法。 (#1169)
Co-authored-by: niuxiaozu <niuxiaozu@yeah.net>
8 months ago
Joe Zhou 49a5efff46 Add a private constructor to hide the implicit public one. 8 months ago
Joe Zhou 5c43e36118 Make sure the contentType of detectCharset could be null. 8 months ago
Joe Zhou d2aebc60a7 Make getCharset to support null parameter. 8 months ago
Sutra Zhou 7d2d2244b3 Upgrade oxerr-parent from 2.1.0 to 2.2.1. 9 months ago
Sutra Zhou 16a4fe3e28 Use oxerr-parent instead. 9 months ago
Sutra Zhou 4ee30c0592 Merge tag 'WebMagic-0.10.3' into develop
Tag hotfix
9 months ago
Sutra Zhou 38f240c42e Update to hotfix version 9 months ago
Sutra Zhou f7fdcd025f Merge branch 'hotfix/0.10.3' 9 months ago
Sutra Zhou 462c60fef2 Fix for entity is null. 9 months ago
Sutra Zhou 54aef0f0e0 Update versions for hotfix 9 months ago
Sutra Zhou 6be02f3a0f Merge tag 'WebMagic-0.10.2' into develop
Tag hotfix
9 months ago
Sutra Zhou a81c4e7627 Update to hotfix version 9 months ago
Sutra Zhou 0dc852e219 Merge branch 'hotfix/0.10.2' 9 months ago
Sutra Zhou 0dbfaf7284 Remove useless log. 9 months ago
Sutra Zhou bda51537b6 Update versions for hotfix 9 months ago
Sutra Zhou 2217b1c8f2 Merge tag 'WebMagic-0.10.1' into develop
Tag hotfix
9 months ago
Sutra Zhou 884f51ba3b Update to hotfix version 9 months ago
Sutra Zhou 2994716ba5 Merge branch 'hotfix/0.10.1' 9 months ago
Sutra Zhou 78740a4e28 Fix NPE. 9 months ago
Sutra Zhou 5afe3e7b81 Revert "fix: pom.xml to reduce vulnerabilities (#1134)"
This reverts commit 19288e9c11.
9 months ago
Sutra Zhou a0ff4a2d2e Fix log message. 9 months ago
Sutra Zhou 76ef0332f1 Update versions for hotfix 9 months ago
Joe Zhou a5144350bd Upgrade maven plugins to latest versions. 9 months ago
Joe Zhou e34b495625 Upgrade maven-suirefire-plugin from 3.0.0-M7 to 3.2.5. 9 months ago
Joe Zhou 5344db0106 Upgrade jacoco-maven-plugin from 0.8.8 to 0.8.12. 9 months ago
Joe Zhou 9ab342c3a7 Remove public modifiers from junit5 test methods. 9 months ago
Joe Zhou 5196a56ccf Format code. 9 months ago
Joe Zhou dba1668306 Add tests to test the equals & hashCode of Proxy. 9 months ago
Joe Zhou b7e0d360ec Upgrade junit from 4.13.2 to 5.10.2. 9 months ago
François Gibier d8321baf56
Refactored and implement of a template method pattern for logger config in webmagic-scripts (#1158)
* Refactor of processSingle in PageModelExtractor

* Changed my refactor of processSingle, this one is a lot better

* Changed my refactor of processSingle, this one is a lot better

* add lombok for getters and setters

* Refactored and implement of a template method pattern for logger config
10 months ago