# Robots file, specify which server parts are unavailable to which robots # Syntax : several entries composed of # User-agent: name or * # Disallow: URL as a path (/cyberworld/map/) # See : http://web.nexor.co.uk/mak/doc/robots/norobots.html User-agent: * Disallow: /cgi-bin/ Disallow: /~pierre/cgi-bin/