swaits 2c2cfc126c links are now uniq'd before marshaling
* crawled is now a map to httpItem's (instead of struct{}) so we can connect pages mid-crawl
* added duplicate link to html site, test updated to match
* now any httpItem with linkType == tUnknown is listed as "Broken" in the output
2015-02-16 22:47:56 -08:00
2015-02-16 22:23:19 -08:00
S
Description
Simple web crawler written in Go.
MIT
5.1 MiB
0 Stars 1 Watchers 0 Forks
Languages
Go 96.5%
JavaScript 1.3%
HTML 0.8%
CSS 0.6%
Emacs Lisp 0.3%
Other 0.3%