swaits a7ca3de99e change the functions basically just taking a single *httpItem parameter to use them as receivers instead

2015-02-18 07:55:22 -08:00

..

testsite

links are now uniq'd before marshaling

2015-02-16 22:47:56 -08:00

docrawler_test.go

change the functions basically just taking a single *httpItem parameter to use them as receivers instead

2015-02-18 07:55:22 -08:00

docrawler.go

change the functions basically just taking a single *httpItem parameter to use them as receivers instead

2015-02-18 07:55:22 -08:00

fetch_test.go

change the functions basically just taking a single *httpItem parameter to use them as receivers instead

2015-02-18 07:55:22 -08:00

fetch.go

change the functions basically just taking a single *httpItem parameter to use them as receivers instead

2015-02-18 07:55:22 -08:00

item_test.go

rename page.go -> item.go

2015-02-16 18:17:01 -08:00

item.go

rename docrawl -> doCrawl; add some missing comments

2015-02-16 23:02:03 -08:00

output.go

add indentation to json output. update test.

2015-02-17 01:50:39 -08:00

parse_test.go

remove error from return of parseLinks as it's not needed

2015-02-16 23:08:33 -08:00

parse.go

remove error from return of parseLinks as it's not needed

2015-02-16 23:08:33 -08:00

url_test.go

deal with anchors and index.html "page aliasing: proprerly

2015-02-17 01:26:20 -08:00

url.go

deal with anchors and index.html "page aliasing: proprerly

2015-02-17 01:26:20 -08:00

util_test.go

rename docrawl -> doCrawl; add some missing comments

2015-02-16 23:02:03 -08:00

util.go

won't recrawl pages that are the same after stripping #anchor (blah.html#about, blah.html#contact, etc.)

2015-02-16 16:26:16 -08:00