WordPress.org

Español (Puerto Rico)

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: robots.txt

Plugin Tag: robots.txt

  • Block eCommerce Assets via robots.txt

    (0 total ratings)

    Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

    apasionados 100+ active installations Tested with 6.3.10

  • Check Search Engine Visibility on Migration

    (1 total ratings)

    Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.

    Rhys Wynne 70+ active installations Tested with 6.9.7

  • Forge AI Bot Log – Block AI Bots, Crawler Detection & Verification

    (0 total ratings)

    Detect, verify and block AI crawlers, bots and scrapers. Vendor IP lists and reverse-DNS checks flag spoofed user agents, not trust them.

    forgecreative 60+ active installations Tested with 7.1

  • Unblock CSS & JS for Googlebot

    (0 total ratings)

    Modifies robots.txt to allow Googlebot access JS and CSS files.

    Miina Sikk 50+ active installations Tested with 4.4.34

  • CeeWP Robots.txt Manager

    (0 total ratings)

    Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!

    CeeWP 40+ active installations Tested with 6.8.8

  • Block Common Crawl via robots.txt

    (0 total ratings)

    Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

    apasionados 30+ active installations Tested with 6.3.10

  • Copyright AI Content Licensing – Block AI Crawlers + Get Paid

    (0 total ratings)

    AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.

    Tyler Martin 30+ active installations Tested with 6.9.7

  • Block Feed and Comments via robots.txt

    (0 total ratings)

    Blocks some Feed and Comment resources in order to avoid spam bots

    apasionados 20+ active installations Tested with 6.3.10

  • AI Deny

    (1 total ratings)

    Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

    Code For Broke 20+ active installations Tested with 6.9.7

  • IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt

    (1 total ratings)

    Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.

    IntentDeep 20+ active installations Tested with 6.9.7

  • ProAI TXT Manager for LLMS and Robots

    (1 total ratings)

    Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.

    ProAI 10+ active installations Tested with 6.8.8

  • ChatBot Blocker by CellarWeb

    (0 total ratings)

    ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.

    Rick Hellewell 10+ active installations Tested with 6.4.10

  • LJPL Armored robots.txt

    (0 total ratings)

    Add some directives to your robots.txt file to keep your site safer

    Lukasz Jasinski 10+ active installations Tested with 3.4.2

  • GoBookMart Robots Editor

    (1 total ratings)

    A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.

    Gobookmart 10+ active installations Tested with 6.9.7

  • HumanGate

    (0 total ratings)

    Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.

    DarkAI 10+ active installations Tested with 6.9.7

  • Thin Content Manager

    (1 total ratings)

    See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.

    msfreed 10+ active installations Tested with 3.7.41

  • Mephivio Robots LLMs

    (0 total ratings)

    Generates llms.txt, llms-full.txt, JSON-LD and robots.txt discovery files for AI agents and search crawlers, without promising ranking gains.

    Mephivio 10+ active installations Tested with 7.1

  • Robots.txt Extender

    (0 total ratings)

    Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

    bettoadami 10+ active installations Tested with 5.0.27

  • M7tawa LLMS.txt Manager

    (0 total ratings)

    Manage llms.txt and robots.txt with local generation, virtual fallback, conflict detection, and a built-in safety audit.

    Ayman Abdullah Fewer than 10 active installations Tested with 7.1

  • Everlange Connect – llms.txt, AI robots.txt & JSON-LD

    (0 total ratings)

    Free llms.txt and AI-crawler robots.txt for your site, generated locally — no account needed. Get cited by ChatGPT, Perplexity, Claude and Gemini.

    Everlange Fewer than 10 active installations Tested with 7.0.4