Commit Graph

1296 Commits (541ced9eeaa55d14d2f9496b741d08a9ea42cb9a)
 

Author SHA1 Message Date
Joe Zhou 541ced9eea Change the default status code from 200 to 0 & downloadSuccess from true to false, for Page. 4 months ago
xiezcGitHub 15ec80fcf1
FileCacheQueueScheduler使用BloomFilter进行去重 (#1176)
Co-authored-by: xiezc <blanexie@qq.com>
6 months ago
xiezcGitHub 2c135dadce
#1172 问题的解决 (#1173)
Co-authored-by: xiezhicheng <xiezhicheng@xiaomi.com>
6 months ago
Joe Zhou 25c2d95e96 Update for next development version 7 months ago
Joe Zhou c88330f25d Merge tag 'WebMagic-1.0.0' into develop
Tag release
7 months ago
Joe Zhou 9d75cce16d Merge branch 'release/1.0.0' 7 months ago
Joe Zhou 3e9cd9b5c3 Update versions for release 7 months ago
Niu_XZ 4d0cdb011f
stopWhenComplete,增加动态修改完成时停止方法。 (#1169)
Co-authored-by: niuxiaozu <niuxiaozu@yeah.net>
8 months ago
Joe Zhou 49a5efff46 Add a private constructor to hide the implicit public one. 8 months ago
Joe Zhou 5c43e36118 Make sure the contentType of detectCharset could be null. 8 months ago
Joe Zhou d2aebc60a7 Make getCharset to support null parameter. 8 months ago
Sutra Zhou 7d2d2244b3 Upgrade oxerr-parent from 2.1.0 to 2.2.1. 9 months ago
Sutra Zhou 16a4fe3e28 Use oxerr-parent instead. 9 months ago
Sutra Zhou 4ee30c0592 Merge tag 'WebMagic-0.10.3' into develop
Tag hotfix
10 months ago
Sutra Zhou 38f240c42e Update to hotfix version 10 months ago
Sutra Zhou f7fdcd025f Merge branch 'hotfix/0.10.3' 10 months ago
Sutra Zhou 462c60fef2 Fix for entity is null. 10 months ago
Sutra Zhou 54aef0f0e0 Update versions for hotfix 10 months ago
Sutra Zhou 6be02f3a0f Merge tag 'WebMagic-0.10.2' into develop
Tag hotfix
10 months ago
Sutra Zhou a81c4e7627 Update to hotfix version 10 months ago
Sutra Zhou 0dc852e219 Merge branch 'hotfix/0.10.2' 10 months ago
Sutra Zhou 0dbfaf7284 Remove useless log. 10 months ago
Sutra Zhou bda51537b6 Update versions for hotfix 10 months ago
Sutra Zhou 2217b1c8f2 Merge tag 'WebMagic-0.10.1' into develop
Tag hotfix
10 months ago
Sutra Zhou 884f51ba3b Update to hotfix version 10 months ago
Sutra Zhou 2994716ba5 Merge branch 'hotfix/0.10.1' 10 months ago
Sutra Zhou 78740a4e28 Fix NPE. 10 months ago
Sutra Zhou 5afe3e7b81 Revert "fix: pom.xml to reduce vulnerabilities (#1134)"
This reverts commit 19288e9c11.
10 months ago
Sutra Zhou a0ff4a2d2e Fix log message. 10 months ago
Sutra Zhou 76ef0332f1 Update versions for hotfix 10 months ago
Joe Zhou a5144350bd Upgrade maven plugins to latest versions. 10 months ago
Joe Zhou e34b495625 Upgrade maven-suirefire-plugin from 3.0.0-M7 to 3.2.5. 10 months ago
Joe Zhou 5344db0106 Upgrade jacoco-maven-plugin from 0.8.8 to 0.8.12. 10 months ago
Joe Zhou 9ab342c3a7 Remove public modifiers from junit5 test methods. 10 months ago
Joe Zhou 5196a56ccf Format code. 10 months ago
Joe Zhou dba1668306 Add tests to test the equals & hashCode of Proxy. 10 months ago
Joe Zhou b7e0d360ec Upgrade junit from 4.13.2 to 5.10.2. 10 months ago
François Gibier d8321baf56
Refactored and implement of a template method pattern for logger config in webmagic-scripts (#1158)
* Refactor of processSingle in PageModelExtractor

* Changed my refactor of processSingle, this one is a lot better

* Changed my refactor of processSingle, this one is a lot better

* add lombok for getters and setters

* Refactored and implement of a template method pattern for logger config
10 months ago
François Gibier 2df7dca871
Changed refactor of processSingle again, this one is a better version (#1157)
* Refactor of processSingle in PageModelExtractor

* Changed my refactor of processSingle, this one is a lot better

* Changed my refactor of processSingle, this one is a lot better
10 months ago
François Gibier 05e5eefc7d
Refactor of processSingle in PageModelExtractor (#1155) 10 months ago
Joe Zhou f10fabcb58 Update .gitignore, with merging Maven.gitignore & Global/Eclipse.gitignore in github/gitignore. 10 months ago
dependabot[bot] 383bea32f6
Bump com.jayway.jsonpath:json-path from 2.8.0 to 2.9.0 (#1154)
Bumps [com.jayway.jsonpath:json-path](https://github.com/jayway/JsonPath) from 2.8.0 to 2.9.0.
- [Release notes](https://github.com/jayway/JsonPath/releases)
- [Changelog](https://github.com/json-path/JsonPath/blob/master/changelog.md)
- [Commits](https://github.com/jayway/JsonPath/compare/json-path-2.8.0...json-path-2.9.0)

---
updated-dependencies:
- dependency-name: com.jayway.jsonpath:json-path
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
10 months ago
Sutra Zhou ed7429c293 Rename webmagic-parent to webmagic. 10 months ago
Sutra Zhou 4ebf48f6e3 Replace log4j 1.x with log4j 2.x, refs #534. 10 months ago
Joe Zhou 2c730eb978 Update Java version from 1.8 to 11, refs #1134. 10 months ago
Joe Zhou 0ceaf14882 Bump version number from 0.10.1-SNAPSHOT to 1.0.0-SNAPSHOT for Java version updating from 1.8 to 11, refs #1134. 10 months ago
Sutra Zhou 31548deb93
Revert "Refactored code for increased optimization. (#1139)" (#1153)
This reverts commit f051d978e2.
10 months ago
Parthgajera056 f051d978e2
Refactored code for increased optimization. (#1139)
* refactoring by decompose conditional technique

* refactoring by introduction explaining variable technique

* refactoring by rename method/variable technique

* refactoring by introducing explaining variable technique

* Added Extract class refactoring to increase maintainablilty

* Refactoring using replace conditional with polymorphism
10 months ago
ayushi250317 9b9f173c1c
Refactored Code to increase maintainability (#1152)
* Initial Commit

* Assignment 1 Submission

* Resolving Implementation Smells

* Refactoring Code to increase maintainability
10 months ago
ayushi250317 28ac8bf9c4
Refactored Code to Resolve Implementation Code Smells (#1151)
* Initial Commit

* Assignment 1 Submission

* Resolving Implementation Smells
11 months ago