1# robots.txt for http://www.ics.uci.edu/ 2# see <http://www.robotstxt.org/> for an explanation. 3 4User-agent: * # All other spiders should avoid 5Disallow: /bin/ 6Disallow: /~mpufal/ # Ticket #50447 requested by ugrad
1# robots.txt for http://www.ics.uci.edu/ 2# see <http://www.robotstxt.org/> for an explanation. 3 4User-agent: * # All other spiders should avoid 5Disallow: /bin/ 6Disallow: /~mpufal/ # Ticket #50447 requested by ugrad