5 Commits

Include renames

Author	SHA1	Message	Date
swaits	81ae0c433b	Merge from develop	2015-02-16 22:23:19 -08:00
swaits	72cac47961	docrawl() completely refactored to use goroutine per URL ... * outputs status * crawlStatus() function created (split out of docrawl()) * changed from using bool flags to linkType in single httpItem enum, tests updated to match this * unified where we set httpItem.linkType (inside fetchType), appropriate errors and returns added * renamed a lot of things from 'page' to 'item' * include refurl in httpItem * []*Location result is now sorted	2015-02-16 22:13:52 -08:00
swaits	d3aeafeba5	update TODO	2015-02-16 16:28:36 -08:00
swaits	2e99708417	won't recrawl pages that are the same after stripping #anchor (blah.html#about, blah.html#contact, etc.) ... * but broken * committing on feature branch and will come back to this	2015-02-16 16:26:16 -08:00
swaits	fe46e7af15	add a TODO list	2015-02-16 06:13:59 -08:00