# directed to all spiders, not just Scooter User-agent: * Disallow: /_private Disallow: /aspnet_client Disallow: /devel Disallow: /ip_sliced