github-forks
/
webmagic
mirror of https://github.com/code4craft/webmagic.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
699 Commits
50 Branches
37 Tags
20 MiB
Commit Graph

699 Commits (7586e3d75c62ee2226af349bad30ab665ec3732d)
 

Author SHA1 Message Date
yihua.huang 7aaf837e15 change logger to slf4j style for performance
yihua.huang f9b157951d Merge branch 'master' of github.com:code4craft/webmagic
yihua.huang 22c394e629 [doc]
Yihua Huang 3efa774191 Merge pull request from ccliangbo/logInScheduler 
Modify the log levels of LocalDuplicatedRemovedScheduler.java
Bo LIANG 762a3973fd Modify the log levels of LocalDuplicatedRemovedScheduler.java 
The old version will print a debug level log each time the push method is
called. So sometimes, when a html page have multiple links for the same
page, the debug log will appears more than once. Also, when we meet a
duplicate URL, it will also print a log, which will be confusing.
I change the level of it to trace. And each time a URL is really push into
queue, print a debug level log.
yihua.huang 44293cd894 [doc]add qq group in readme
yihua.huang 9a0a4051ed [doc] ch3 part1
yihua.huang 7ca644cdd9 format readme
yihua.huang a1c7e826f7 fix dep of slf4j-log4j12
yihua.huang a34e92d11a fix huabanprocessor
yihua.huang 50cee4c7bb [doc] complete docs2.0 ch1
yihua.huang 9ec0ca02c6 doc2.0 ch1
yihua.huang 7e0e5b0969 clean ui
yihua.huang 94f97da4dc [Avalon] fix spring config for static and ignore google fonts for better loading speed
yihua.huang 22e8697671 add forger to folder
yihua.huang 05abd566a4 remove submodule
yihua.huang 01848301d4 encode illegal charactors in url
yihua.huang 2780423e60 enable blank space in quotes in UrlUtils.fixAllRelativeHrefs
yihua.huang 97b6f46280 Bugfix: break loop in addTargetRequests
yihua.huang d1563da33b add contributor
yihua.huang b13f1da039 reformat
yihua.huang 7038c00a9a reformat
yihua.huang 6252042ed2 add warning of slf4j
yihua.huang f3c2503a29 add warning of slf4j
yihua.huang 4e15a68ff4 update xsoup version to 0.2.2 
Bugfix: Parsing error when separate chars in quotes cause in xsoup
yihua.huang 8d8194bee4 Change HashMap to LinkedHashMap in ResultItems for same order of input and output
yihua.huang c72483a220 update en_docs
yihua.huang e008b7b851 update zh_docs
yihua.huang 8958d774f2 add default values for @Formatter
yihua.huang 90447bff02 update xsoup to 0.2.1
yihua.huang 8b35d79569 Do not cache document in Selectable for selected Html element
yihua.huang 6201fd6966 add worker as container
yihua.huang 6577a75892 fix spring config path in web.xml of webmagic-worker
yihua.huang c7169328c7 refactor config resource
yihua.huang 23d1151bc0 seperate spring config file
yihua.huang 316980973c invite h2 as test and standalone db, add spring profile for switch
yihua.huang 9a4eab44be add DynamicClassException to DynamicClassService.compileAndSave
yihua.huang 09c43efc96 service and mock
yihua.huang 7036950f28 update submodule url
yihua.huang f763764a21 add travis ci support for submodule
yihua.huang 3eaa5c4d23 ignore dao test after test pass
yihua.huang 6e882b78b5 add DynamicClassDao and UT
yihua.huang 994c1d5341 avalon readme
yihua.huang 8ea0a0624b fix submodule url for travis-ci
yihua.huang 8f84fb2ab5 fix submodule url for travis-ci
yihua.huang c2d27056ea move worker and admin into avalon
yihua.huang 79e6eedb31 add web.xml for ci pass in webamgic-worker
yihua.huang 6c11718566 Clean project structure
yihua.huang 9606a173cd fix ZipCodePageProcessor
yihua.huang 2801daf185 update version in readme