docrawler

0 Fork 0

T

swaits 72cac47961 docrawl() completely refactored to use goroutine per URL

* outputs status
* crawlStatus() function created (split out of docrawl())
* changed from using bool flags to linkType in single httpItem enum, tests updated to match this
* unified where we set httpItem.linkType (inside fetchType), appropriate errors and returns added
* renamed a lot of things from 'page' to 'item'
* include refurl in httpItem
* []*Location result is now sorted

2015-02-16 22:13:52 -08:00

.vendor

add coverage to Makefile (make cover)

2015-02-15 12:40:56 -08:00

docs

docrawl() completely refactored to use goroutine per URL

2015-02-16 22:13:52 -08:00

src/docrawler

docrawl() completely refactored to use goroutine per URL

2015-02-16 22:13:52 -08:00

util

misc. minor cleanup