Blackhole for Bad Bots vs CeeWP Robots.txt Manager

✨ Trap bad bots in a virtual black hole Important: Do NOT use this plugin on sites with caching. Learn more » 👾 Bye bye bad bots.. Bad bots are the worst. They do all sorts of nasty stuff and waste server resources. The Blackhole plugin helps to stop bad bots and save precious resources for legit visitors. 👾 How does it work? First the plugin adds a hidden trigger link to the footer of your pages. You then add a line to your robots.txt file that forbids all bots from following the hidden link. Bots that then ignore or disobey your robots rules will crawl the link and fall into the trap. Once trapped, bad bots are denied further access to your WordPress site. I call it the “one-strike” rule: bots have one chance to obey your site’s robots.txt rule. Failure to comply results in immediate banishment. The best part is that the Blackhole only affects bad bots: human users never see the hidden link, and good bots obey the robots rules in the first place. Win-win! 🙂 ✨ Add a blackhole trap to help stop bad bots Important: Do NOT use this plugin on sites with caching. Learn more » 👾 Features Easy to set up Squeaky clean code Focused and modular Lightweight, fast and flexible Built with the WordPress API Works with other security plugins Easy to reset the list of bad bots Easy to delete any bot from the list Regularly updated and “future proof” Blackhole link includes “nofollow” attribute Plugin options configurable via settings screen Works silently behind the scenes to protect your site Whitelists all major search engines to never block Focused on flexibility, performance, and security Email alerts with WHOIS lookup for blocked bots Complete inline documentation via the Help tab Provides setting to whitelist any IP addresses Customize the message displayed to bad bots 😉 One-click restore the plugin default options Does NOT use or require any .htaccess rules Blackhole for Bad Bots protects your site against bad bots, spammers, scrapers, scanners, and other automated threats. ✨ Not using WordPress? Check out the standalone PHP version of Blackhole! 👾 Whitelist By default, this plugin does NOT block any of the major search engines (user agents): AOL.com Baidu Bingbot/MSN DuckDuckGo Googlebot Teoma Yahoo! Yandex These search engines (and all of their myriad variations) are whitelisted via user agent. So are a bunch of other “useful” bots. They always are allowed full access to your site, even if they disobey your robots.txt rules. This list can be customized in the plugin settings. For a complete list of whitelisted bots, visit the Help tab in the plugin settings (under “Whitelist Settings”). ✨ Check out Blackhole Pro and level up with advanced features! 👾 Exclusive Pro Features Option to disable for logged-in users Threshold control (number of allowed hits) Custom email alerts Custom messages for blocked bots Custom redirect for blocked bots Custom blackhole trigger links Complete inline documentation Block bots based on user agent Block bots based on IP address Whitelist/allow bots by user agent Whitelist/allow bots by IP address Redirect whitelisted bots Set custom HTTP Status Code Full-featured Bad Bot Log with paging, sorting, and field search Manually add bad bots to the Bad Bot Log Geo/IP location lookups for each bad bot Logs number of blocked hits for each bot ..plus everything the free version can do and more. ✨ Learn more and get Blackhole Pro » 👾 Privacy User Data: This plugin automatically blocks bad bots. When bad bots fall into the trap, their IP address, user agent, and other request data are stored in the WP database. No other user data is collected by this plugin. At any time, the administrator may delete all saved data via the plugin settings. Services: This plugin does not connect to any third-party locations or services. Cookies: This plugin does not set any cookies. Credit: Header Image Courtesy NASA/JPL-Caltech. Blackhole for Bad Bots is developed and maintained by Jeff Starr, 15-year WordPress developer and book author. 👾 Support development I develop and maintain this free plugin with love for the WordPress community. To show support, you can make a donation or purchase one of my books: The Tao of WordPress Digging into WordPress .htaccess made easy WordPress Themes In Depth Wizard’s SQL Recipes for WordPress And/or purchase one of my premium WordPress plugins: BBQ Pro – Blazing fast WordPress firewall Blackhole Pro – Automatically block bad bots Banhammer Pro – Monitor traffic and ban the bad guys GA Google Analytics Pro – Connect WordPress to Google Analytics Head Meta Pro – Ultimate Meta Tags for WordPress REST Pro Tools – Awesome tools for managing the WP REST API Simple Ajax Chat Pro – Unlimited chat rooms USP Pro – Unlimited front-end forms Links, tweets and likes also appreciated. Thank you! 🙂

CeeWP Robots.txt Manager is a lightweight and user-friendly plugin that allows you to easily manage your WordPress site’s virtual robots.txt file. Add custom rules without creating physical files, with full control over search engine access to your content. Why Choose Robots.txt Manager? No File Management: Works with WordPress’s built-in virtual robots.txt system Two Operating Modes: Choose between appending to or replacing default rules User-Friendly Interface: Clean admin panel with helpful examples WordPress Standards: Follows all WordPress coding and security standards Automatic Cleanup: Removes all data when uninstalled Key Features: Simple interface to add custom robots.txt rules Replace Mode: Option to completely replace WordPress default robots.txt with custom rules Append Mode: Add custom rules to existing WordPress robots.txt (default behavior) Dynamic Textarea: Automatically adjusts height based on content Live Preview: Direct link to view your robots.txt file Smart Warnings: Alerts when search engines are discouraged Privacy Respect: Honors WordPress privacy settings Examples Included: Ready-to-use code snippets for common scenarios Professional UI: Modern interface with WordPress dashicons Perfect for: SEO Professionals: Fine-tune search engine crawling behavior Website Owners: Block access to private directories and files Developers: Prevent indexing of development or staging content E-commerce Sites: Control bot access to sensitive areas Content Creators: Manage sitemap declarations and crawl rates How It Works: The plugin adds a new menu item under Settings > Robots.txt Manager where you can easily add your custom rules. Choose between two modes: Append Mode (Default): Your custom rules are added to WordPress’s default robots.txt Replace Mode: Your custom rules completely replace WordPress’s default robots.txt The interface includes helpful examples, real-time textarea sizing, and a direct link to view your live robots.txt file. Privacy This plugin does not collect, store, or transmit any personal data. All settings are stored locally in your WordPress database and are only used to generate your robots.txt file. Credits Developed with ❤️ by CeeWP – https://ceewp.com/ Special thanks to the WordPress community for continuous inspiration and feedback.