swaits 8e3995b45c add tests for very simple fetching and parsing
* added test for fetching a known file and verifying its content matches
* add test for parsing a known string and verify URLs are extracted
* add test for a request which doesn't exist and verify 404 is received (canary test)
* add comments throughout test (for each test function)
* wrote (stupidly) simple fetcher which takes a URL, GETs it, and returns the body and error
* wrote (stupidly) simple parser which takes a string, parses out (src|href|xhref)="...", and returns a slice of the captured links
* added needed html files
2015-02-14 23:49:35 -08:00
2015-02-14 21:53:22 -08:00
2015-02-14 21:11:10 -08:00
2015-02-14 22:39:55 -08:00
2015-02-14 22:39:55 -08:00
S
Description
Simple web crawler written in Go.
MIT
5.1 MiB
0 Stars 1 Watchers 0 Forks
Languages
Go 96.5%
JavaScript 1.3%
HTML 0.8%
CSS 0.6%
Emacs Lisp 0.3%
Other 0.3%