1# If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead. 2# Please see https://developer.wordpress.com/docs/firehose/ for more details. 3 4Sitemap: https://wordpress.com/sitemap.xml 5Sitemap: https://wordpress.com/news-sitemap.xml 6 7User-agent: * 8Disallow: /wp-admin/ 9Allow: /wp-admin/admin-ajax.php 10Disallow: /wp-signup.php 11Disallow: /press-this.php 12Disallow: /remote-login.php 13Disallow: /activate/ 14Disallow: /cgi-bin/ 15Disallow: /mshots/v1/ 16Disallow: /next/ 17Disallow: /public.api/ 18 19# This file was generated on Mon, 22 Jul 2019 20:38:45 +0000 20