[gopher] New Gopher Wayback Machine Bot

[John Goerzen <jgoerzen@xxxxxxxxxxxx>]

Hello,

Since Gopher servers are dropping off the 'net at an unfortunate rate, I
have decided to write a bot to try to index all gopherspace that is
still reachable.

This bot is now running on my laptop and is spidering away.  The IP that
you see connections from will vary depending on where my laptop is at a
given time ;-)

I have set it to make no more than 1 simultaneous connection to any
given host.  Hopefully that should make it nice enough to not cause
anyone any trouble.

Cameron, floodgap.com seems to have some sort of rate limiting and keeps
giving me a Connection refused error after a certain number of documents
have been spidered.

-- John