swaits c95ad7ab95 now crawling multiple pages! ...

* moved Page{} and NewPage() into page.go
* queued and crawled are both maps now. used to track which pages we already know about
* tests updated to match the multipage crawling
* added another file to the testsite (scripts/blah.js)

2015-02-15 15:26:21 -08:00

.vendor

add coverage to Makefile (make cover)

2015-02-15 12:40:56 -08:00

docs

misc. minor cleanup

2015-02-15 00:40:36 -08:00

src/docrawler

now crawling multiple pages!

2015-02-15 15:26:21 -08:00

util

misc. minor cleanup

2015-02-15 00:40:36 -08:00

.flow

flow initialization: Added configuration file.

2015-02-14 23:50:10 -08:00

.hgignore

add coverage to Makefile (make cover)

2015-02-15 12:40:56 -08:00

Makefile

minor Makefile cleanup

2015-02-15 14:02:08 -08:00

S

Description

Simple web crawler written in Go.

MIT

5.1 MiB

0 Stars 1 Watchers 0 Forks

Languages

Go 96.5%

JavaScript 1.3%

HTML 0.8%

CSS 0.6%

Emacs Lisp 0.3%

Other 0.3%