Searched defs:robotstxt (Results 1 – 11 of 11) sorted by relevance
1 package robotstxt package
4 package robotstxt package
223 void Server::robotstxt(Document &doc) in robotstxt() function in Server
107 robotstxt : 1, // URL is a robots.txt to be scanned member