github-forks
/
webmagic
mirror of https://github.com/code4craft/webmagic.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

Commit Graph

  • 9cc2dbdb6d update com.fasterxml.jackson.core:jackson-databind 2.13.4.2 to 2.14.0-rc1 pen4 2022-11-19 19:34:05 +0800
  • 4915431845 Revise logging level from warn to info, as we have passed the exception to onError. refs #1094 Joe Zhou 2022-11-15 22:48:02 +0800
  • 075b98291b Return spider in setEmptySleepTime itself for chainning. Joe Zhou 2022-11-12 11:06:08 +0800
  • ac912e8f1f Revise QueueScheduler to support capacity-restricted. Joe Zhou 2022-11-12 10:17:36 +0800
  • 5d5f3bf20e Update for next development version Sutra Zhou 2022-10-24 00:17:21 +0800
  • 6ba2256458 Merge tag 'WebMagic-0.7.6' into develop Sutra Zhou 2022-10-24 00:17:15 +0800
  • f45a8ff3e7 Merge branch 'master' of github.com:code4craft/webmagic WebMagic-0.7.6 Sutra Zhou 2022-10-24 00:15:30 +0800
  • dc7218eba3 Merge branch 'release/0.7.6' Sutra Zhou 2022-10-24 00:10:29 +0800
  • 838c47f1f6 Update versions for release Sutra Zhou 2022-10-23 23:58:21 +0800
  • d2b2eed9df Pass the task to onSuccess & onError. Sutra Zhou 2022-10-19 22:10:04 +0800
  • 5f80e02abd Interrupt current thread. Sutra Zhou 2022-10-19 22:08:38 +0800
  • 904cd28236
         Merge pull request #1089 from code4craft/snyk-fix-e9d89e9698a464f561824a17e083e765 Sutra Zhou 2022-10-18 21:11:02 +0800
  • a0ad7b808b
         fix: webmagic-samples/pom.xml to reduce vulnerabilities snyk-fix-e9d89e9698a464f561824a17e083e765 snyk-bot 2022-10-18 13:06:21 +0000
  • 126c32ecd0 Fix compatible issue. Sutra Zhou 2022-10-16 07:20:22 +0800
  • 6647af8d61
         Merge pull request #762 from jialigit/master Sutra Zhou 2022-10-12 11:25:41 +0800
  • da357f0370
         Merge pull request #1088 from code4craft/snyk-fix-305ed17aec2839f91059daec3059c3ce Sutra Zhou 2022-10-07 13:09:01 +0800
  • 223cfc609d
         fix: pom.xml to reduce vulnerabilities snyk-fix-305ed17aec2839f91059daec3059c3ce snyk-bot 2022-10-06 04:58:32 +0000
  • 889b218798
         Merge pull request #1087 from code4craft/snyk-fix-1f503660a3fe9a29c6255ad6d4e9b9ce Sutra Zhou 2022-10-03 16:39:56 +0800
  • a255640c3d
         fix: webmagic-samples/pom.xml to reduce vulnerabilities snyk-fix-1f503660a3fe9a29c6255ad6d4e9b9ce snyk-bot 2022-10-03 07:46:32 +0000
  • afc8309409 Upgrade maven plugins and dependencies. Sutra Zhou 2022-10-01 23:34:01 +0800
  • 69accb656a
         Merge pull request #1086 from vioao/enhance_jsoup_parse_table Sutra Zhou 2022-10-01 18:28:35 +0800
  • e7a7fbeeeb Enhance Jsoup could parse tr td tag directly vio.ao 2022-10-01 18:23:15 +0800
  • db9c92edf5
         Merge pull request #1085 from vioao/common-downloader-error-process Sutra Zhou 2022-10-01 17:44:43 +0800
  • 5751681c91 Common the downloader status process and pass error information when onError vio.ao 2022-10-01 17:34:02 +0800
  • 7a62a6cb45 Revert "Revert "Common the downloader status process and pass error information when …"" vio.ao 2022-10-01 17:33:11 +0800
  • d4ebdb9b6e Common the downloader status process and pass error information when onError vio.ao 2022-10-01 17:19:37 +0800
  • a3428846ca
         Merge pull request #1083 from code4craft/revert-1082-common-downloader-status-process Sutra Zhou 2022-10-01 10:37:27 +0800
  • acfbd7b883
         Revert "Common the downloader status process and pass error information when …" revert-1082-common-downloader-status-process Sutra Zhou 2022-10-01 10:37:09 +0800
  • ee5a0585d7
         Merge pull request #1082 from vioao/common-downloader-status-process Sutra Zhou 2022-10-01 09:07:46 +0800
  • d01f26333b Common the downloader status process and pass error information when onError vio.ao 2022-10-01 00:21:17 +0800
  • 16221e391d Fix xhtml namespace. Sutra Zhou 2022-08-05 01:03:00 +0800
  • b154e44b01
         Merge a142c465d5 into 31c4e48e79 Interfer0n 2022-07-31 17:45:52 +0900
  • 31c4e48e79
         Merge pull request #1075 from code4craft/snyk-fix-53f8206c2d48cf7014326d6f53ad35a4 Sutra Zhou 2022-07-23 14:14:51 +0800
  • 565300cbaa
         fix: pom.xml to reduce vulnerabilities snyk-fix-53f8206c2d48cf7014326d6f53ad35a4 snyk-bot 2022-07-23 05:43:39 +0000
  • 4a22c803e2
         Merge pull request #1072 from code4craft/snyk-fix-4eb94e676367a3667c00737cdabdf3de Sutra Zhou 2022-06-30 08:51:30 +0800
  • 31cf237e7c
         fix: pom.xml to reduce vulnerabilities snyk-fix-4eb94e676367a3667c00737cdabdf3de snyk-bot 2022-06-29 19:41:24 +0000
  • 433fe40833
         Merge pull request #1071 from code4craft/snyk-fix-8beb1ce977279ec88cdb90c43603581c Sutra Zhou 2022-06-08 08:45:56 +0800
  • 1ece3ce344
         fix: pom.xml to reduce vulnerabilities snyk-fix-8beb1ce977279ec88cdb90c43603581c snyk-bot 2022-06-07 19:18:20 +0000
  • 6747046b6c
         Merge pull request #1067 from yokelsoft/develop Sutra Zhou 2022-05-03 20:04:23 +0800
  • 54da7af17e change dependency versions into properties David Hsing 2022-05-03 17:42:42 +0800
  • add873d488
         Merge pull request #1065 from code4craft/snyk-fix-a0dcc179d2c2f593e02424c579060a2d Sutra Zhou 2022-04-15 07:21:22 +0800
  • 137e7b56ca
         fix: webmagic-scripts/pom.xml to reduce vulnerabilities snyk-fix-a0dcc179d2c2f593e02424c579060a2d snyk-bot 2022-04-12 16:18:38 +0000
  • e47bf1733b
         Merge pull request #1064 from code4craft/snyk-fix-25c8898b02f8de0fc143c2eaa3e8c7cc Sutra Zhou 2022-03-27 00:21:43 +0800
  • 9628739ceb
         fix: webmagic-samples/pom.xml to reduce vulnerabilities snyk-fix-25c8898b02f8de0fc143c2eaa3e8c7cc snyk-bot 2022-03-26 16:18:31 +0000
  • 37b00d41a7
         Merge pull request #1063 from code4craft/snyk-fix-3bde29486cddc7ed8a030e05f97999dd Sutra Zhou 2022-03-22 20:24:41 +0800
  • 90e3d631fb
         fix: webmagic-samples/pom.xml to reduce vulnerabilities snyk-fix-3bde29486cddc7ed8a030e05f97999dd snyk-bot 2022-03-21 17:09:14 +0000
  • ddb026d613
         Merge pull request #1060 from code4craft/snyk-fix-729e15e7770e9475a8504ae0fb1b5fe7 Sutra Zhou 2022-03-12 10:09:46 +0800
  • 3776de6de2
         fix: webmagic-samples/pom.xml to reduce vulnerabilities snyk-fix-729e15e7770e9475a8504ae0fb1b5fe7 snyk-bot 2022-03-11 16:26:38 +0000
  • f50b1c77b6
         Merge pull request #1056 from code4craft/snyk-fix-cdf627b4ee226c4d9171b1960a044dc0 Sutra Zhou 2022-01-19 01:41:04 +0800
  • a4f2bead80
         fix: pom.xml to reduce vulnerabilities snyk-fix-cdf627b4ee226c4d9171b1960a044dc0 snyk-bot 2022-01-18 16:51:10 +0000
  • 8531438bc9
         Update Spider.java GG22G2 2022-01-06 13:22:59 +0800
  • 571bac9d88
         Merge pull request #1050 from code4craft/snyk-fix-3bb5020d5999f6b3ded6eb3378296acd Sutra Zhou 2022-01-02 22:24:16 +0800
  • 88da899a89
         fix: pom.xml to reduce vulnerabilities snyk-fix-3bb5020d5999f6b3ded6eb3378296acd snyk-bot 2022-01-01 18:51:21 +0000
  • 1b4098c357
         Merge pull request #1048 from code4craft/snyk-fix-5e9c00d3ecc1ab84f141bc680b00fe19 Sutra Zhou 2021-12-17 21:18:50 +0800
  • 0c2a7daf4b
         fix: pom.xml to reduce vulnerabilities snyk-fix-5e9c00d3ecc1ab84f141bc680b00fe19 snyk-bot 2021-12-16 13:32:43 +0000
  • c9a19e3af8 [fix] #1046 修复 RedisPriorityScheduler 丢失 Request 信息的 bug asimov 2021-12-01 14:53:03 +0800
  • 7bf3252581
         Merge 461e29ac6d into 692605bd75 Jean Debout Gatari 2021-10-25 16:46:45 -0500
  • 692605bd75 Merge branch 'develop' of github.com:code4craft/webmagic into develop Sutra Zhou 2021-10-24 23:20:56 +0800
  • 34da2fb3a0 Make PageProcessor#getSite be default method. Closes #1040. Sutra Zhou 2021-10-24 23:20:38 +0800
  • 0b5b6add97 refactor: Remove unused imports Aurélien Mino 2021-09-26 20:56:01 +0000
  • 626ba57b0e
         Merge pull request #1036 from code4craft/snyk-fix-f533124205b5e86f0bda976e921ffec2 Sutra Zhou 2021-09-23 23:04:31 +0800
  • cdbba362bb
         fix: pom.xml to reduce vulnerabilities snyk-fix-f533124205b5e86f0bda976e921ffec2 snyk-bot 2021-09-23 07:48:41 +0000
  • f110147b62
         Merge pull request #1033 from carl-don-it/perfect_spider_run Sutra Zhou 2021-08-04 18:25:05 +0800
  • fcdb9074d6 格式化 Spider.run 代码 carl.don:tjr 2021-08-04 18:23:04 +0800
  • ab5d81a6b6 perfect Spider.run to avoid some rare concurrent issue, change the Spider.emptySleepTime to long type carl.don:tjr 2021-08-04 17:17:22 +0800
  • 1dc1d4c783
         Merge 13f9840b57 into c5a037a807 Bouaoud Malik 2021-07-23 03:19:47 +0530
  • 2b67361fd3
         Merge 5ae70799b4 into c5a037a807 Bouaoud Malik 2021-07-23 03:19:47 +0530
  • 1de7dff03c
         Merge 24742e8e9c into c5a037a807 VivianDelannoyEtu 2021-07-23 03:19:47 +0530
  • c5a037a807 Update for next development version Sutra Zhou 2021-07-22 13:02:46 +0800
  • 4024230e17 Merge branch 'release/0.7.5' into develop Sutra Zhou 2021-07-22 13:02:44 +0800
  • 04978f912d Merge branch 'release/0.7.5' WebMagic-0.7.5 Sutra Zhou 2021-07-22 12:59:39 +0800
  • 113eaa4bae Bump version number to 0.7.5. Sutra Zhou 2021-07-22 12:57:14 +0800
  • 4e51a4f68b Update versions for release Sutra Zhou 2021-07-22 12:42:55 +0800
  • e3e66fb270 Upgrade webmagic-samples dependencies. Sutra Zhou 2021-07-22 12:38:38 +0800
  • 14b09a3385 Update maven plugin versions. Sutra Zhou 2021-07-22 12:36:11 +0800
  • 31a00f5f8e Set gitflow-maven-plugin versionTagPrefix. Sutra Zhou 2021-07-22 12:09:02 +0800
  • db70b6e095 Add maven reports. Sutra Zhou 2021-06-22 21:58:49 +0800
  • 1068e185a0
         Merge pull request #1029 from code4craft/snyk-fix-9e933ef3fbdfa89b1dad83f86cbbea2a Sutra Zhou 2021-06-03 11:34:10 +0800
  • 129e9184bf
         fix: pom.xml to reduce vulnerabilities snyk-fix-9e933ef3fbdfa89b1dad83f86cbbea2a snyk-bot 2021-06-03 03:28:14 +0000
  • f683d2fc5c
         Merge 71158077a5 into 868b0cb05b FAnett1997 2021-05-25 06:31:30 +0200
  • 71158077a5
         Adding code maintainability badge FAnett1997 2021-05-25 06:31:24 +0200
  • c7828f44ac
         Merge pull request #1025 from gkorland/patch-1 Sutra Zhou 2021-05-19 10:12:44 +0800
  • 189c5962e6
         Update to Jedis 3.6.0 Guy Korland 2021-05-18 16:55:29 +0300
  • dba0ddb92c Remove unknown tag from javadoc. Sutra Zhou 2021-04-28 12:17:52 +0800
  • 19f1fb7f6d 修改仓库地址 chenzw 2021-04-27 23:09:58 +0800
  • a694e02cb9 Add crawl with script with chromedriver in windows. lxiaodao 2021-04-14 19:03:27 +0800
  • 24742e8e9c exception if the waiting time detectably elapsed before return from the method Vivian Delannoy 2021-04-13 22:59:40 +0200
  • f745dd78a5 exception if the waiting time detectably elapsed before return from the method Vivian Delannoy 2021-04-13 22:34:36 +0200
  • 6b6a419ef9 code smells fixes Vivian Delannoy 2021-04-12 00:58:52 +0200
  • fcffe42bd1 adding a try-catch-finally to properly close configFileReader Vivian Delannoy 2021-04-11 23:14:43 +0200
  • 133106a15c
         Merge pull request #1013 from FreaxLin/Restore_the_already_crawled_example Sutra Zhou 2021-04-09 17:04:18 +0800
  • 76f625c02e 提交可恢复爬取内容例子 linweisen 2021-04-09 17:00:00 +0800
  • 9b46b7cf0f little fix smells deprecated decorator in Spider.java Vivian Delannoy 2021-04-08 17:15:10 +0200
  • 868b0cb05b
         Merge pull request #1011 from code4craft/snyk-fix-9cd27ad57a7323a57b3b3f45ce02a123 Sutra Zhou 2021-04-07 10:11:09 +0800
  • 461e29ac6d Add @Override notation for compiler warning and code readability reason Jean-Debout Gatari 2021-04-05 21:19:33 +0200
  • 943a4db9e0 Make constructors visible to the only members concerned Jean-Debout Gatari 2021-04-05 21:05:51 +0200
  • c87464e28d Refactor on unnecessary boolean expression Jean-Debout Gatari 2021-04-05 17:39:41 +0200
  • 5a3f9a8ede Break down method goal into small pieces for code simplicity Jean-Debout Gatari 2021-04-05 17:07:06 +0200
  • 971ca5b23e Refactor on catch multiple exceptions for better readability Jean-Debout Gatari 2021-04-05 14:32:27 +0200
  • 1ec13accbe Refactor variables names for code explicitness Jean-Debout Gatari 2021-04-05 14:17:00 +0200