Complete.Org: Mailing Lists: Archives: gopher: January 2001:
[gopher] Re: Gopher "robots.txt" (was Re: New V-2 WAIS database) 		Home

[gopher] Re: Gopher "robots.txt" (was Re: New V-2 WAIS database)

[Top] [All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index] [Thread Index]
To: gopher@xxxxxxxxxxxx
Subject: [gopher] Re: Gopher "robots.txt" (was Re: New V-2 WAIS database)
From: Marco d'Itri <md@xxxxxxxx>
Date: Sun, 14 Jan 2001 00:21:28 +0100
Reply-to: gopher@xxxxxxxxxxxx 
On Jan 13, Cameron Kaiser <spectre@xxxxxxxxxxxxxxxxxxxx> wrote:

 >Good point. I am actually trying to think of a way like the HTTP robots.txt
 >that can more or less transparently tell V-2 what to stay out of. Suggestions?
I don't know well gopher yet, but you'd better find one before starting
to index my site, or your database will be filled with crap.

-- 
ciao,
Marco
[Prev in Thread] Current Thread [Next in Thread]