won't recrawl pages that are the same after stripping #anchor (blah.html#about, blah.html#contact, etc.)

* but broken
* committing on feature branch and will come back to this
This commit is contained in:
swaits committed 2015-02-16 16:26:16 -08:00
1 parent d9009cdbaa
commit 2e99708417
9 files changed
+89 -14

No files matched your search

+1
View File
@@ -13,6 +13,7 @@
* helper function to do the whole crawl process
* document code better
* test with godoc
* omit fields in json when nil? (Broken, etc.)
## Features