swaits 1a66b03d0d add indentation to json output. update test.

2015-02-17 01:50:39 -08:00

..

testsite

links are now uniq'd before marshaling

2015-02-16 22:47:56 -08:00

docrawler_test.go

add indentation to json output. update test.

2015-02-17 01:50:39 -08:00

docrawler.go

deal with anchors and index.html "page aliasing: proprerly

2015-02-17 01:26:20 -08:00

fetch_test.go

renamed Page -> httpItem, and changed its members to unexported as well

2015-02-16 18:14:12 -08:00

fetch.go

reviewed coverage report. remove some dead code. add a few comments to areas of code unlikely to hit.

2015-02-17 00:44:39 -08:00

item_test.go

rename page.go -> item.go

2015-02-16 18:17:01 -08:00

item.go

rename docrawl -> doCrawl; add some missing comments

2015-02-16 23:02:03 -08:00

output.go

add indentation to json output. update test.

2015-02-17 01:50:39 -08:00

parse_test.go

remove error from return of parseLinks as it's not needed

2015-02-16 23:08:33 -08:00

parse.go

remove error from return of parseLinks as it's not needed

2015-02-16 23:08:33 -08:00

url_test.go

deal with anchors and index.html "page aliasing: proprerly

2015-02-17 01:26:20 -08:00

url.go

deal with anchors and index.html "page aliasing: proprerly

2015-02-17 01:26:20 -08:00

util_test.go

rename docrawl -> doCrawl; add some missing comments

2015-02-16 23:02:03 -08:00

util.go

won't recrawl pages that are the same after stripping #anchor (blah.html#about, blah.html#contact, etc.)

2015-02-16 16:26:16 -08:00