User-agent: * # disallow all files in these directories Disallow: /amazon/ Disallow: /carp_free/ Disallow: /cbfg/ Disallow: /gt/ Disallow: /RSS/ Disallow: /RSSCB2.5/ Disallow: /stats/ Disallow: /plesk-stat/ # disallow archiving site User-agent: ia_archiver Disallow: / # disable duggmirror User-agent: duggmirror Disallow: /