1# robots.txt 2# 3# This file is to prevent the crawling and indexing of certain parts 4# of your site by web crawlers and spiders run by sites like Yahoo! 5# and Google. By telling these "robots" where not to go on your site, 6# you save bandwidth and server resources. 7# 8# This file will be ignored unless it is at the root of your host: 9# Used: http://example.com/robots.txt 10# Ignored: http://example.com/site/robots.txt 11# 12# For more information about the robots.txt standard, see: 13# http://www.robotstxt.org/robotstxt.html 14 15User-agent: * 16Disallow: /shop/refreshTariffs/* 17Disallow: /*?activeTabNum=8* 18Disallow: /login* 19Disallow: /assets2/theme/ 20Disallow: */bluedawn-theme/ 21Disallow: /search? 22Disallow: /storelocator/* 23Disallow: /shop/prepaysims/* 24Disallow: /*?is4G=true* 25Disallow: /*?is4G=false* 26Disallow: /*?activeTabNum=* 27Disallow: /search 28Disallow: /browsing/ 29 30User-agent: Googlebot 31Disallow: 32 33User-agent: Googlebot-image 34Disallow: 35 36User-agent: AdsBot-Google 37Disallow: 38 39Sitemap: https://www.o2.co.uk/sitemap.xml 40Sitemap: https://www.o2.co.uk/sitemap.xml