Bisteinoff SEO Robots.txt vs Indexedy | Track Google Indexing & Get Your Links Indexed Faster

Have you encountered an obstacle while creating and editing robots.txt file on your website? Bisteinoff SEO Robots.txt is an easy-to-use plugin that helps you generate and configure a correct robots.txt file, which is essential for search engine optimization (SEO). This file defines crawling rules for search engine bots such as Google, Bing, Yahoo!, Yandex, and others. The plugin works perfectly both if the file robots.txt has never been created or if it already exists. Once installed the plugin makes an optimized robots.txt file that includes special rules common for WordPress websites. After that you can proceed further customization specific for your own website if needed. If the plugin detects one or several Sitemap XML files it will include them into robots.txt file. No FTP access, manual coding or file editing is required that makes managing settings easy and convenient! Key Features Automatic generation of optimized robots.txt with WordPress-specific rules Special rules for Google and Yandex search engines Custom rules support for any search engine bot Automatic sitemap detection and inclusion WooCommerce compatibility with specific rules Multisite support Easy-to-use admin interface Modern PHP architecture with namespaces for conflict-free operation

Indexedy is a powerful WordPress plugin that helps you monitor and track which of your posts, pages, and custom post types are indexed by Google. Get real-time insights into your content’s indexing status with multiple checking methods and comprehensive statistics. Key Features Multiple Checking Methods: Choose from Google Search Console API, Gemini AI, or Site Query (site:domain) searches Bulk Indexing Checks: Check multiple URLs at once from the post list or Index Inspector page Comprehensive Dashboard: View detailed statistics, indexing health scores, and 30-day performance trends Post List Integration: Check indexing status directly from your posts and custom post types list screens Index Inspector: Dedicated page for filtering and checking indexing status by post type and status Status Tracking: Persistent status tracking with historical data and trend analysis Custom Post Type Support: Works with all public post types including custom post types Performance Charts: Visual representation of indexing trends over the last 30 days Status Breakdown: Detailed breakdown by post type showing indexed, not indexed, and unknown status counts How It Works Indexedy provides three methods to check if your content is indexed by Google: Google Search Console API: The most accurate method using official Google Search Console data Gemini AI: Uses Google’s Gemini AI to check indexing status Site Query: Uses Google Custom Search API with site:domain queries You can use one method or enable “Auto” mode to try all methods until one succeeds. Getting Started Install and activate the plugin Go to Indexedy > Settings to configure your preferred checking method(s) Add API credentials for Google Search Console, Gemini, or Custom Search Engine Start checking URLs from the Index Inspector page or directly from your post list External Services This plugin connects to external Google services to check indexing status. The following services are used: Google Search Console API What it is: Google Search Console URL Inspection API is used to check if URLs are indexed in Google Search. This is the most accurate method as it uses official Google data. What data is sent and when: * When you check a URL’s indexing status using the Google Search Console method, the plugin sends: * The URL you want to check (inspectionUrl) * Your website’s URL (siteUrl) * Your site’s language code (languageCode) * For authentication, the plugin uses OAuth2 with a Service Account JSON key that you provide. This involves: * Sending a JWT (JSON Web Token) to Google’s OAuth2 token endpoint to obtain an access token * The access token is cached for 1 hour to reduce API calls Service provided by: Google LLC * Terms of Service: https://developers.google.com/terms * Privacy Policy: https://policies.google.com/privacy * API Documentation: https://developers.google.com/webmaster-tools/v1/urlInspection.index/inspect Google Gemini API What it is: Google’s Gemini AI service is used as an alternative method to check if URLs are indexed in Google Search using AI-powered analysis. What data is sent and when: * When you check a URL’s indexing status using the Gemini method, the plugin sends: * The URL you want to check * The domain and path extracted from the URL * A text prompt asking Gemini to check if the URL is indexed * This data is sent each time you manually check a URL or when bulk checking is performed Service provided by: Google LLC * Terms of Service: https://ai.google.dev/terms * Privacy Policy: https://policies.google.com/privacy * API Documentation: https://ai.google.dev/api Google Custom Search API What it is: Google Custom Search API is used to perform site:domain queries to check if URLs appear in Google search results. This is an optional method that provides more reliable results than HTML parsing. What data is sent and when: * When you check a URL’s indexing status using the Site Query method with Custom Search API configured, the plugin sends: * A search query containing the URL (in the format: site:domain URL) * Your Custom Search Engine API key * Your Custom Search Engine ID * This data is sent each time you manually check a URL or when bulk checking is performed Service provided by: Google LLC * Terms of Service: https://developers.google.com/custom-search/terms * Privacy Policy: https://policies.google.com/privacy * API Documentation: https://developers.google.com/custom-search/v1/overview Important Notes All external service connections are optional – you can choose which method(s) to use in the plugin settings You must provide your own API credentials for each service you wish to use The plugin only sends data when you actively check URLs – it does not automatically send data in the background All data transmission uses secure HTTPS connections Access tokens for Google Search Console are cached locally for 1 hour to minimize API calls If you do not configure the Google Custom Search API, the plugin may fall back to HTML parsing of Google search results, which is less reliable and may violate Google’s Terms of Service. We strongly recommend using the Custom Search API instead.