# This robot should be usered in WWW. # Ban all robots spidering the domain directories. Only the index file should be indexed bij bot. User-agent: Mediapartners-Google* User-agent: * Disallow: /calendar Disallow: /cms Disallow: /contact Disallow: /css Disallow: /customer Disallow: /faq Disallow: /frm Disallow: /help Disallow: /img Disallow: /inc Disallow: /job Disallow: /js Disallow: /link Disallow: /mailing Disallow: /news Disallow: /pages Disallow: /poll Disallow: /postcode Disallow: /product Disallow: /rss Disallow: /search Disallow: /shoppingcart Disallow: /sitemap Disallow: /swf Disallow: /upload Disallow: /upload_directory Disallow: /uploads