swaits 72cac47961 docrawl() completely refactored to use goroutine per URL ...

* outputs status
* crawlStatus() function created (split out of docrawl())
* changed from using bool flags to linkType in single httpItem enum, tests updated to match this
* unified where we set httpItem.linkType (inside fetchType), appropriate errors and returns added
* renamed a lot of things from 'page' to 'item'
* include refurl in httpItem
* []*Location result is now sorted

2015-02-16 22:13:52 -08:00

..

Design.md

design doc extra line removed

2015-02-15 22:30:53 -08:00

TODO.md

docrawl() completely refactored to use goroutine per URL

2015-02-16 22:13:52 -08:00