# WordPress default, as the core generates it. # admin-ajax.php is allowed back in on purpose: themes and plugins call it # from the front end, and blocking it breaks how the page renders for the crawler. User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://example.com/wp-sitemap.xml