User-agent: * Disallow: /wp-admin/ Disallow: /wp-content/uploads/ Disallow: /wp-content/plugins/ Allow: /wp-admin/admin-ajax.php Disallow: *.pdf$ # Block pdf files from all bots. Albeit non-standard, it works for major search engines.