1User-agent: dotbot 2Disallow: / 3User-agent: Slurp 4Crawl-delay: 5 5User-agent: twiceler 6Crawl-delay: 5 7User-agent: ScoutJet 8Disallow: / 9User-agent: Fasterfox 10Disallow: / 11User-agent: * 12# Disallow all unnecessary content from the search 13Disallow: /iis/* 14Disallow: /login/* 15Disallow: /admin/* 16Disallow: /map/* 17Disallow: /email/* 18Disallow: /my/* 19Disallow: /gps/* 20Disallow: /datastore/* 21Disallow: /api/* 22Disallow: /bait.asp 23Disallow: /hotels/* 24Sitemap: http://www.geocaching.com/sitemaps/sitemap-index.xml