Commit Graph

1303 Commits (7e500d7b95972d062b4442f505c24dd06ca32f0c)
 

Author SHA1 Message Date
Bob Conan 7e500d7b95
Updated README.md, fix typo(s) (#1180) 2 months ago
Joe Zhou 6ed83769e0 Update for next development version 3 months ago
Joe Zhou 63e675066f Merge tag 'WebMagic-1.0.1' into develop
Tag release
3 months ago
Joe Zhou e98f7d722a Merge branch 'release/1.0.1' 3 months ago
Joe Zhou 6eab7a4155 Update versions for release 3 months ago
dependabot[bot] 50026ff937
Bump commons-io:commons-io from 2.11.0 to 2.14.0 (#1179)
Bumps commons-io:commons-io from 2.11.0 to 2.14.0.

---
updated-dependencies:
- dependency-name: commons-io:commons-io
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
Joe Zhou 541ced9eea Change the default status code from 200 to 0 & downloadSuccess from true to false, for Page. 4 months ago
Yihua Huang 19f60bf340
fix: pom.xml to reduce vulnerabilities (#1178)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMMONSIO-8161190

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
4 months ago
xiezcGitHub 15ec80fcf1
FileCacheQueueScheduler使用BloomFilter进行去重 (#1176)
Co-authored-by: xiezc <blanexie@qq.com>
6 months ago
xiezcGitHub 2c135dadce
#1172 问题的解决 (#1173)
Co-authored-by: xiezhicheng <xiezhicheng@xiaomi.com>
6 months ago
Joe Zhou 25c2d95e96 Update for next development version 7 months ago
Joe Zhou 9d75cce16d Merge branch 'release/1.0.0' 7 months ago
Joe Zhou c88330f25d Merge tag 'WebMagic-1.0.0' into develop
Tag release
7 months ago
Joe Zhou 3e9cd9b5c3 Update versions for release 7 months ago
Niu_XZ 4d0cdb011f
stopWhenComplete,增加动态修改完成时停止方法。 (#1169)
Co-authored-by: niuxiaozu <niuxiaozu@yeah.net>
8 months ago
Joe Zhou 49a5efff46 Add a private constructor to hide the implicit public one. 8 months ago
Joe Zhou 5c43e36118 Make sure the contentType of detectCharset could be null. 8 months ago
Joe Zhou d2aebc60a7 Make getCharset to support null parameter. 8 months ago
Sutra Zhou 7d2d2244b3 Upgrade oxerr-parent from 2.1.0 to 2.2.1. 9 months ago
Sutra Zhou 16a4fe3e28 Use oxerr-parent instead. 9 months ago
Sutra Zhou 4ee30c0592 Merge tag 'WebMagic-0.10.3' into develop
Tag hotfix
9 months ago
Sutra Zhou 38f240c42e Update to hotfix version 9 months ago
Sutra Zhou f7fdcd025f Merge branch 'hotfix/0.10.3' 9 months ago
Sutra Zhou 462c60fef2 Fix for entity is null. 9 months ago
Sutra Zhou 54aef0f0e0 Update versions for hotfix 9 months ago
Sutra Zhou 6be02f3a0f Merge tag 'WebMagic-0.10.2' into develop
Tag hotfix
9 months ago
Sutra Zhou a81c4e7627 Update to hotfix version 9 months ago
Sutra Zhou 0dc852e219 Merge branch 'hotfix/0.10.2' 9 months ago
Sutra Zhou 0dbfaf7284 Remove useless log. 9 months ago
Sutra Zhou bda51537b6 Update versions for hotfix 9 months ago
Sutra Zhou 2217b1c8f2 Merge tag 'WebMagic-0.10.1' into develop
Tag hotfix
9 months ago
Sutra Zhou 884f51ba3b Update to hotfix version 9 months ago
Sutra Zhou 2994716ba5 Merge branch 'hotfix/0.10.1' 9 months ago
Sutra Zhou 78740a4e28 Fix NPE. 9 months ago
Sutra Zhou 5afe3e7b81 Revert "fix: pom.xml to reduce vulnerabilities (#1134)"
This reverts commit 19288e9c11.
9 months ago
Sutra Zhou a0ff4a2d2e Fix log message. 9 months ago
Sutra Zhou 76ef0332f1 Update versions for hotfix 9 months ago
Joe Zhou a5144350bd Upgrade maven plugins to latest versions. 9 months ago
Joe Zhou e34b495625 Upgrade maven-suirefire-plugin from 3.0.0-M7 to 3.2.5. 9 months ago
Joe Zhou 5344db0106 Upgrade jacoco-maven-plugin from 0.8.8 to 0.8.12. 9 months ago
Joe Zhou 9ab342c3a7 Remove public modifiers from junit5 test methods. 9 months ago
Joe Zhou 5196a56ccf Format code. 9 months ago
Joe Zhou dba1668306 Add tests to test the equals & hashCode of Proxy. 9 months ago
Joe Zhou b7e0d360ec Upgrade junit from 4.13.2 to 5.10.2. 9 months ago
François Gibier d8321baf56
Refactored and implement of a template method pattern for logger config in webmagic-scripts (#1158)
* Refactor of processSingle in PageModelExtractor

* Changed my refactor of processSingle, this one is a lot better

* Changed my refactor of processSingle, this one is a lot better

* add lombok for getters and setters

* Refactored and implement of a template method pattern for logger config
10 months ago
François Gibier 2df7dca871
Changed refactor of processSingle again, this one is a better version (#1157)
* Refactor of processSingle in PageModelExtractor

* Changed my refactor of processSingle, this one is a lot better

* Changed my refactor of processSingle, this one is a lot better
10 months ago
François Gibier 05e5eefc7d
Refactor of processSingle in PageModelExtractor (#1155) 10 months ago
Joe Zhou f10fabcb58 Update .gitignore, with merging Maven.gitignore & Global/Eclipse.gitignore in github/gitignore. 10 months ago
dependabot[bot] 383bea32f6
Bump com.jayway.jsonpath:json-path from 2.8.0 to 2.9.0 (#1154)
Bumps [com.jayway.jsonpath:json-path](https://github.com/jayway/JsonPath) from 2.8.0 to 2.9.0.
- [Release notes](https://github.com/jayway/JsonPath/releases)
- [Changelog](https://github.com/json-path/JsonPath/blob/master/changelog.md)
- [Commits](https://github.com/jayway/JsonPath/compare/json-path-2.8.0...json-path-2.9.0)

---
updated-dependencies:
- dependency-name: com.jayway.jsonpath:json-path
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
Sutra Zhou ed7429c293 Rename webmagic-parent to webmagic. 10 months ago