Commit Graph

1252 Commits (ed7429c29322a2755299e801a978f259bf69495c)
 

Author SHA1 Message Date
Sutra Zhou ed7429c293 Rename webmagic-parent to webmagic. 10 months ago
Sutra Zhou 4ebf48f6e3 Replace log4j 1.x with log4j 2.x, refs #534. 10 months ago
Joe Zhou 2c730eb978 Update Java version from 1.8 to 11, refs #1134. 10 months ago
Joe Zhou 0ceaf14882 Bump version number from 0.10.1-SNAPSHOT to 1.0.0-SNAPSHOT for Java version updating from 1.8 to 11, refs #1134. 10 months ago
Sutra Zhou 31548deb93
Revert "Refactored code for increased optimization. (#1139)" (#1153)
This reverts commit f051d978e2.
10 months ago
Parthgajera056 f051d978e2
Refactored code for increased optimization. (#1139)
* refactoring by decompose conditional technique

* refactoring by introduction explaining variable technique

* refactoring by rename method/variable technique

* refactoring by introducing explaining variable technique

* Added Extract class refactoring to increase maintainablilty

* Refactoring using replace conditional with polymorphism
10 months ago
ayushi250317 9b9f173c1c
Refactored Code to increase maintainability (#1152)
* Initial Commit

* Assignment 1 Submission

* Resolving Implementation Smells

* Refactoring Code to increase maintainability
10 months ago
ayushi250317 28ac8bf9c4
Refactored Code to Resolve Implementation Code Smells (#1151)
* Initial Commit

* Assignment 1 Submission

* Resolving Implementation Smells
10 months ago
ayushi250317 80842d72db
Added test cases for improving line and branch coverage (#1150)
* Initial Commit

* Assignment 1 Submission
10 months ago
Ch3n4y 7f8607b881
update com.fasterxml.jackson.core:jackson-databind 2.15.2 to 2.16.0 (#1149) 11 months ago
Sutra Zhou 22a60df6aa Fix build for selenium upgrading from 3.141.59 to 4.14.1, refs #1134. 11 months ago
Sutra Zhou e4ab6e27e4 Optimize Request#extras, refs #1148. 11 months ago
Sutra Zhou 95d1f44150 Optimize Request#extras, fix #1148. 11 months ago
Sutra Zhou 7ededbea1a Fix javadoc. 1 year ago
Sutra Zhou 1e5c6488ff Update for next development version 1 year ago
Sutra Zhou 26e134f9a1 Merge tag 'WebMagic-0.10.0' into develop
Tag release
1 year ago
Sutra Zhou 5d55bf33d2 Merge branch 'release/0.10.0' 1 year ago
Sutra Zhou 73dd2ebbac Update versions for release 1 year ago
Harikrishna 7c20290ce4
Refactor addTargetRequests method to eliminate redundant code. (#1138) 1 year ago
Harikrishna a911104076
Refactored to remove multiple calls of getSourceTexts() api (#1137) 1 year ago
Harikrishna 622ed5a17f
Refactor compareLong method using Long.compare, corrected the local variable name (#1136) 1 year ago
Sutra Zhou 67644de3d9 Expose Page to onSuccess & onError. 1 year ago
Yihua Huang 19288e9c11
fix: pom.xml to reduce vulnerabilities (#1134)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGSELENIUMHQSELENIUM-6062318

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
1 year ago
Joe Zhou eda3be9432 Fix log format. 1 year ago
Maciej Walkowiak 73f60f809e
Fix typos (#1131) 1 year ago
Joe Zhou c0d38a6f1a Upgrade maven-fluido-skin from 1.9 to 1.11.1. 1 year ago
Joe Zhou 8c008563ff Update for next development version 1 year ago
Joe Zhou 21de4689ab Merge branch 'release/0.9.1' 1 year ago
Joe Zhou 780e712b0c Merge tag 'WebMagic-0.9.1' into develop
Tag release
1 year ago
Joe Zhou 07e83a421b Update versions for release 1 year ago
Joe Zhou 0b62461b7a Upgrade mapdb from 3.0.9 to 3.0.10. 1 year ago
dack-su 238814acb4
update net.sourceforge.htmlcleaner:htmlcleaner 2.26 to 2.29 (#1127) 1 year ago
Yihua Huang 028f1ed4a4
fix: pom.xml to reduce vulnerabilities (#1126)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETSOURCEFORGEHTMLCLEANER-5710357

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
1 year ago
Joe Zhou 6e8d130113 Update for next development version 2 years ago
Joe Zhou fd4a136f9a Merge branch 'release/0.9.0' 2 years ago
Joe Zhou 94107bc5b3 Merge tag 'WebMagic-0.9.0' into develop
Tag release
2 years ago
Joe Zhou 3688226e32 Update versions for release 2 years ago
Joe Zhou ad010927f6 Fix test. 2 years ago
Joe Zhou a5fb4e0414 Upgrade dependencies. 2 years ago
Joe Zhou 58fd08bcf8 Expose Request to ProxyProvider. 2 years ago
Yihua Huang 9e59b37834
fix: pom.xml to reduce vulnerabilities (#1119)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMGOOGLEGUAVA-5710356

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2 years ago
Snyk bot aeb0e89f02
fix: pom.xml to reduce vulnerabilities (#1114)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-NETMINIDEV-3369748
2 years ago
Tanky-Zhang 244ade7b4c
feat:update host verify (#1112) 2 years ago
hooy 717931166a
向 webmagic-saxon 组件提供若干新 API,更优雅更灵活更强大 (#1108)
* Feature:
* webmagic-saxon 组件新增若干新 API;

* Update: 更优雅的写代码。

* Update: JaxpSelectorUtils 工具类增加 final 关键字。
2 years ago
Sutra Zhou f47038db63
Merge pull request #1107 from hooyantsing/develop
修复 HtmlCleaner 无法正常解析 tr 和 td 标签的问题
2 years ago
hooyantsing 08f4a4046b Update: 提供测试用例。 2 years ago
hooyantsing 12ce86425f BugFix: Jsoup 和 HtmlCleaner 构建 Dom 时,若缺失 table 标签,则无法正常解析 tr 和 td 标签。 2 years ago
Joe Zhou a266df406f Add Site.defaultCharset. closes #1101. 2 years ago
Joe Zhou 80424b0bd7 Replace List with Iterable, fixed #1099. 2 years ago
Joe Zhou ef616c999e Fix warnings. 2 years ago