User-agent: * Disallow: /cgi-bin Disallow: /cgi-bin/ Disallow: /mrsid Disallow: /mrsid/ Disallow: /mrsid/mrsid_images Disallow: /mrsid/mrsid_images/ User-agent: scooter # AltaVista web page search Disallow: / User-agent: vscooter # AltaVista web page search Disallow: / User-agent: Slurp # Inktomi web page search Disallow: / User-agent: msnbot # MSNbot web page search Disallow: / User-agent: msnbot/0.11 # MSNbot web page search Disallow: /