[gopher] Re: Gopher "robots.txt" (was Re: New V-2 WAIS database)

[John Goerzen <jgoerzen@xxxxxxxxxxxx>]

This proposal would be extremely difficult to implement for gopher
sites that carry mirrors, especially mirrors of other gopher sites.

-- John

Cameron Kaiser <spectre@xxxxxxxxxxxxxxxxxxxx> writes:

> I'd like to see an approach on a per-directory (menu) basis, maybe a selector
> like this in menus not to be indexed:
> 
> iFFerror.hostF909
> 
> F, of course, is Gopherese for <TAB>. It's a null display string of item
> type i, so normal clients just display a blank line. You can encode any
> sort of pragma this way; I just encoded it in the port number for poor sods
> who use IE so that clicking on the link doesn't do anything useful. 909 as
> the port number is the pragma for the robot to not index anything in this
> directory/menu, so it leaves it alone.
> 
> Such a pragma, like I said, would be wide open for other applications and
> best of all is very simple to implement on both robot (my) side and servers.
> 
> Comments?
> 
> -- 
> ----------------------------- personal page: http://www.armory.com/~spectre/ 
> --
>  Cameron Kaiser, Point Loma Nazarene University * ckaiser@xxxxxxxxxxxxxxxxxxxx
> -- Immigration is the sincerest form of flattery. -- Jack Paar 
> ----------------
> 
> 
> 

-- 
John Goerzen <jgoerzen@xxxxxxxxxxxx>                       www.complete.org
Sr. Software Developer, Progeny Linux Systems, Inc.    www.progenylinux.com
#include <std_disclaimer.h>                     <jgoerzen@xxxxxxxxxxxxxxxx>