# $Id: robots.txt$ # # This is a file retrieved by webwalkers, a.k.a. spiders, that # conform to a defacto standard. # See # # Comments to the webmaster should be sent to wade@wadewb.com # # Format is: # User-agent: # Disallow: | # ----------------------------------------------------------------------------- #User-agent: Fast corporate crawler User-agent: * Sitemap: http://wadesword.org/Blog/sitemap.xml Disallow: /Images/ Disallow: /logs/ Disallow: /db/ Disallow: /include/ Disallow: /RSS/ Disallow: /Lisa/