Block Common Crawl via robots.txt is a WordPress Plugin Directory app by apasionados.
AppRanks verdict
Generated from live marketplace data — refreshed daily
Block Common Crawl via robots.txt is a newly-listed WordPress app with a limited review volume. Category data on the canonical marketplace listing is currently incomplete, so AppRanks falls back to platform-wide rather than category-relative comparison for this listing. no published reviews yet means feature claims are unverified by the wider merchant base. Without a published review base, the only fit-signal available is the developer's own documentation plus the marketplace's listing-quality audit (linked below). Paid-only pricing means evaluating fit on the marketplace listing or via the developer's documentation before installing. AppRanks tracks rating, review count, pricing tier, and category position daily — the figures on this page reflect the most recent scrape from the canonical WordPress Plugin Directory listing.
Pros
- +Published by apasionados — established developer track record
Cons
- −No public reviews yet — fit and reliability are unverified
Looking to switch from Block Common Crawl via robots.txt?
See Block Common Crawl via robots.txt's alternatives ranked by audit score, rating, and review velocity.
How Block Common Crawl via robots.txt works
Show full descriptionShow less
This plugin adds lines to the virtual robots.txt file that WordPress creates automagically if the file is not present physically on the server to block the Common Crawl bot (CCBot) that is used to train AI algorithms like ChatGPT (in version 3.5 it makes up 60% of the training data mix) to crawl websites. Here is the information about the Common Crawl bot (CCBot).
Please be aware of what this plugin does exactly: If you activate the plugin it will add some lines to the robots.txt file to tell Common Crawl bots to not to crawl and index parts of this website.
Please only activate this plugin if you know what you’re doing.
What can I do with this plugin? This plugin adds the necessary lines to the virtual robots.txt file that WordPress creates automagically to block the Common Crawl bot (CCBot) is used to train AI algorithms like ChatGPT to crawl websites.
What ideas is this plugin based on? Our plugin to block the OpenAI ChatGTP bot after the launch of the OpenAI ChatGPT plugins that crawl websites.
What is the robots.txt file? The robots.txt file is a plain text file located at the root folder of a domain (or subdomain) which tells web crawlers (like Googlebot) what parts of the website they should access and index.
The first thing a search engine crawler looks at when it is visiting a page is the robots.txt file and it controls how search engine spiders see and interact with the web pages.
System requirements PHP version 7.4 or greater.
We require 7.4 or higher because we believe that everybody should be running a modern PHP version. When releasing this plugin WordPress recommends PHP 7.4 or higher. We would recommend 8.0 or higher as 7.4 has no security updates since 28 Nov 2022.
How to get this plugin in your Language! The first release is avaliable in English and Spanish. In the “languages” folder we have included the necessary files to translate this plugin.
If you would like the plugin in your language and you’re good at translating, please use the native WordPress Translation functionality.
New to Translating a plugin? First read through the Translator Handbook, then select your locale at Translating WordPress and finally go to the translation page for this plugin to translate it.
Further Reading You can access the description of the plugin in Spanish at: Block Common Crawl bot (CCBot) via robots.txt en español.
Contact For further information please send us an email.
Keyword rankings
Block Common Crawl via robots.txt ranks for 1 keywords across WordPress Plugin Directory. Here are the top 1:
- 1.ai agentRank #842
Competitors & alternatives
AppRanks tracks competitor sets per category. For Block Common Crawl via robots.txt, the independent listing audit includes a competitive context section, and the full WordPress app index shows the broader marketplace landscape this app competes in. Sign up free to surface a side-by-side competitor matrix customized to your tracked apps.
Frequently asked questions
What is Block Common Crawl via robots.txt?
Block Common Crawl via robots.txt is an app for WordPress. It is published on WordPress Plugin Directory and tracked by AppRanks, and AppRanks has been tracking its public marketplace data on the refresh cadence published in our methodology. AppRanks tracks its category position, review-velocity trend, and the top alternatives in the same space. Developed by apasionados.