2 Commits

Include renames

Author	SHA1	Message	Date
swaits	2e99708417	won't recrawl pages that are the same after stripping #anchor (blah.html#about, blah.html#contact, etc.) ... * but broken * committing on feature branch and will come back to this	2015-02-16 16:26:16 -08:00
swaits	38224a8987	misc. minor cleanup ... * moved $/testfilter.sh to $/util/testfilter.sh (updated Makefile accordingly) * updated idea in Design.md * renamed TestParse/TestFetch to TestSimpleParse/TestSimpleFetch.. more tests coming * parse now sorts its results. test updated. * moved regexp compilation to init instead of every time parse() is called * misc comments and cleanup	2015-02-15 00:40:36 -08:00