6 Commits

Include renames

Author	SHA1	Message	Date
swaits	2e99708417	won't recrawl pages that are the same after stripping #anchor (blah.html#about, blah.html#contact, etc.) ... * but broken * committing on feature branch and will come back to this	2015-02-16 16:26:16 -08:00
swaits	fe46e7af15	add a TODO list	2015-02-16 06:13:59 -08:00
swaits	b159dbf636	design doc extra line removed	2015-02-15 22:30:53 -08:00
swaits	38224a8987	misc. minor cleanup ... * moved $/testfilter.sh to $/util/testfilter.sh (updated Makefile accordingly) * updated idea in Design.md * renamed TestParse/TestFetch to TestSimpleParse/TestSimpleFetch.. more tests coming * parse now sorts its results. test updated. * moved regexp compilation to init instead of every time parse() is called * misc comments and cleanup	2015-02-15 00:40:36 -08:00
swaits	da7c5ba57c	design doc update	2015-02-14 21:11:10 -08:00
swaits	b0e64c7973	initial commit, empty go project, plus simple design doc	2015-02-14 21:00:18 -08:00