WordPress.org

Македонски

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: robots.txt

Plugin Tag: robots.txt

  • Block eCommerce Assets via robots.txt

    (0 total ratings)

    Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

    apasionados 100+ active installations Tested with 6.3.9

  • Check Search Engine Visibility on Migration

    (1 total ratings)

    Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.

    Rhys Wynne 70+ active installations Tested with 6.9.6

  • Unblock CSS & JS for Googlebot

    (0 total ratings)

    Modifies robots.txt to allow Googlebot access JS and CSS files.

    Miina Sikk 50+ active installations Tested with 4.4.34

  • CeeWP Robots.txt Manager

    (0 total ratings)

    Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!

    CeeWP 40+ active installations Tested with 6.8.7

  • AI Deny

    (1 total ratings)

    Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

    Code For Broke 40+ active installations Tested with 6.9.6

  • Block Common Crawl via robots.txt

    (0 total ratings)

    Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

    apasionados 30+ active installations Tested with 6.3.9

  • Copyright AI Content Licensing – Block AI Crawlers + Get Paid

    (0 total ratings)

    AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.

    Tyler Martin 30+ active installations Tested with 6.9.6

  • Block Feed and Comments via robots.txt

    (0 total ratings)

    Blocks some Feed and Comment resources in order to avoid spam bots

    apasionados 20+ active installations Tested with 6.3.9

  • IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt

    (1 total ratings)

    Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.

    IntentDeep 20+ active installations Tested with 6.9.6

  • ProAI TXT Manager for LLMS and Robots

    (1 total ratings)

    Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.

    ProAI 10+ active installations Tested with 6.8.7

  • ChatBot Blocker by CellarWeb

    (0 total ratings)

    ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.

    Rick Hellewell 10+ active installations Tested with 6.4.9

  • LJPL Armored robots.txt

    (0 total ratings)

    Add some directives to your robots.txt file to keep your site safer

    Lukasz Jasinski 10+ active installations Tested with 3.4.2

  • HumanGate

    (0 total ratings)

    Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.

    DarkAI 10+ active installations Tested with 6.9.6

  • Thin Content Manager

    (1 total ratings)

    See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.

    msfreed 10+ active installations Tested with 3.7.41

  • Robots.txt Extender

    (0 total ratings)

    Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

    bettoadami 10+ active installations Tested with 5.0.26

  • AI Visibility Control – Dynamic llms.txt & robots.txt Crawler Control

    (0 total ratings)

    Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.

    Techbysh Fewer than 10 active installations Tested with 7.0.3

  • AI Rights Protection by SimpleFeed

    (1 total ratings)

    Protect your rights by reviewing and blocking AI bots from using your content without compensation.

    Alex Khomichenko Fewer than 10 active installations Tested with 6.7.6

  • GoBookMart Robots Editor

    (1 total ratings)

    A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.

    Gobookmart Fewer than 10 active installations Tested with 6.9.6

  • FocusWeb AI Crawler Monitor – Track, Verify & Block AI Bots

    (0 total ratings)

    Track, verify and block AI crawlers (GPTBot, ClaudeBot, PerplexityBot). Spot spoofed bots, control robots.txt, measure AI referral traffic.

    Uri N. Fewer than 10 active installations Tested with 7.0.3

  • Advanced SEO Toolkit

    (0 total ratings)

    Advanced SEO Toolkit is a comprehensive solution for optimizing your WordPress site for search engines.

    Mehdi Rezaei Fewer than 10 active installations Tested with 6.6.6