User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php User-agent: AhrefsSiteAudit Allow: / User-agent: Mediapartners-Google* Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-Mobile Allow: / User-agent: rogerbot Allow: /