WordPress.org

Gaeilge

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: robots.txt

Plugin Tag: robots.txt

  • Block Common Crawl via robots.txt

    (0 total ratings)

    Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

    apasionados 30+ active installations Tested with 6.3.7

  • CeeWP Robots.txt Manager

    (0 total ratings)

    Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!

    CeeWP 30+ active installations Tested with 6.8.3

  • Block Feed and Comments via robots.txt

    (0 total ratings)

    Blocks some Feed and Comment resources in order to avoid spam bots

    apasionados 30+ active installations Tested with 6.3.7

  • AI Content Signals

    (1 total ratings)

    Add Content Signals to your robots.txt to control how AI crawlers can use your content.

    Fernando Tellado 20+ active installations Tested with 6.8.3

  • LJPL Armored robots.txt

    (0 total ratings)

    Add some directives to your robots.txt file to keep your site safer

    Lukasz Jasinski 10+ active installations Tested with 3.4.2

  • AI Deny

    (0 total ratings)

    Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

    Code For Broke 10+ active installations Tested with 6.9

  • ChatBot Blocker by CellarWeb

    (0 total ratings)

    ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.

    Rick Hellewell 10+ active installations Tested with 6.4.7

  • Copyright AI Content Licensing – Block AI Crawlers + Get Paid

    (0 total ratings)

    AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.

    Tyler Martin 10+ active installations Tested with 6.8.3

  • Thin Content Manager

    (1 total ratings)

    See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.

    msfreed 10+ active installations Tested with 3.7.41

  • Admin Robots.txt Editor

    (0 total ratings)

    Easily create, edit, and manage your site's robots.txt file directly from the WordPress admin panel.

    Karan Makani 10+ active installations Tested with 6.8.3

  • Robots.txt Extender

    (0 total ratings)

    Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

    bettoadami 10+ active installations Tested with 5.0.24

  • Kandeshop LLMS.txt Generator

    (0 total ratings)

    Create and manage an llms.txt file from your WordPress admin to guide LLM/AI crawlers. Set policies and disallow rules.

    Darren Kandekore Fewer than 10 active installations Tested with 6.8.3

  • AWP Disallow Root Control

    (4 total ratings)

    Disallow access to the root directory via robots.txt with an option to enable or disable.

    Algorithus Fewer than 10 active installations Tested with 6.6.4

  • AI Rights Protection by SimpleFeed

    (1 total ratings)

    Protect your rights by reviewing and blocking AI bots from using your content without compensation.

    Alex Khomichenko Fewer than 10 active installations Tested with 6.7.4

  • GoBookMart Robots Editor

    (1 total ratings)

    A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.

    Gobookmart Fewer than 10 active installations Tested with 6.9

  • Advanced SEO Toolkit

    (0 total ratings)

    Advanced SEO Toolkit is a comprehensive solution for optimizing your WordPress site for search engines.

    Mehdi Rezaei Fewer than 10 active installations Tested with 6.6.4

  • Block old browser versions and suspicious browsers

    (0 total ratings)

    With the help of WhatIsMyBrowser the plugin detects old and bad browsers and denies them access. A special robots.txt denies crawling by bad bots.

    hupe13 Fewer than 10 active installations Tested with 6.9

  • Check System Details

    (0 total ratings)

    Easily check your WordPress installation and server details along with database tables, installed plugins, and the active theme.

    Prabhat Fewer than 10 active installations Tested with 6.2.8

  • LLMs.txt – AI Website Content Crawling

    (0 total ratings)

    Generate a structured llms.txt file to manage AI and search engine crawling access across your WordPress site.

    Magazine3 Fewer than 10 active installations Tested with 6.8.3

  • Valvai – AI Traffic Control Center

    (0 total ratings)

    Block, log and monetise AI crawlers directly from your WordPress dashboard.

    valvai Fewer than 10 active installations Tested with 6.8.3