# See The Web Robots Pages # http://info.webcrawler.com/mak/projects/robots.html User-Agent: * # directed to all robots Disallow: /cgi-bin Disallow: /Inc Disallow: /Admin Disallow: /Data