won't recrawl pages that are the same after stripping #anchor (blah.html#about, blah.html#contact, etc.)
* but broken * committing on feature branch and will come back to this
This commit is contained in:
1 parent
d9009cdbaa
commit
2e99708417
9 files changed
+89
-14
No files matched your search
@@ -13,6 +13,7 @@
|
||||
* helper function to do the whole crawl process
|
||||
* document code better
|
||||
* test with godoc
|
||||
* omit fields in json when nil? (Broken, etc.)
|
||||
|
||||
## Features
|
||||
|
||||
|
||||
Reference in new issue
Block a user