User-agent: * Disallow: /Position Disallow: /cgi-bin Disallow: logs Disallow: /*.pl$ Disallow: /*.cgi$ Disallow: /*.swf$ Disallow: /*.log$ Disallow: /*.txt$ Disallow: /*.dat$