Commit Graph
3 Commits
Author SHA1 Message Date
swaits 72cac47961 docrawl() completely refactored to use goroutine per URL
* outputs status
* crawlStatus() function created (split out of docrawl())
* changed from using bool flags to linkType in single httpItem enum, tests updated to match this
* unified where we set httpItem.linkType (inside fetchType), appropriate errors and returns added
* renamed a lot of things from 'page' to 'item'
* include refurl in httpItem
* []*Location result is now sorted
2015-02-16 22:13:52 -08:00
swaits d3aeafeba5 update TODO 2015-02-16 16:28:36 -08:00
swaits fe46e7af15 add a TODO list 2015-02-16 06:13:59 -08:00