Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral Traffic
Track crawlers, scrapers, LLM assistants, and AI agents on your website. Generate a robots.txt that blocks AI bots. Formerly Dark Visitors. Track, control, and optimize your website for AI agents and bots You have 40% more visitors than you think. Protect your content from unwanted AI scraping, and turn the rising wave of AI agents, LLM assistants, and other bots visiting your website into a new growth channel for your business. For full details, visit the Known Agents website. 1. AI Agent & Bot Analytics Get realtime visibility into the hidden ecosystem of crawlers, scrapers, and AI agents browsing your website Watch traffic from crawlers and scrapers as it happens: Track the hidden activity of all known artificial agents visiting your website in real time. Replay AI agent navigation patterns: Follow a single agent’s session as it navigates your website. Find where agents get stuck, identify dead ends, and help them complete their tasks. Catch bots spoofing legitimate agents: Identify bad actors and unauthorized scrapers pretending to be legitimate agents like Googlebot or Bingbot. Never miss a bot traffic spike: Stay informed when an agent’s traffic starts surging or overloading your server. Reveal which agents visit most, and which pages they target: Break down bot traffic by page to understand what they’re interested in. Export reports to CSV: Download agent activity reports for custom analysis. 2. LLM Citation & Referral Tracking (GEO, AEO) Measure citations and human click-throughs from AI chat platforms like ChatGPT, Claude, and Gemini Increase citations in AI chat responses: See which pages LLMs recommend most often. Double down on content that’s working. Find out which AI platforms are sending you traffic: Measure how many humans are clicking through to your website from a citation. Export reports to CSV: Download LLM referral reports for custom analysis. 3. Automatic Robots.txt & Bad Bot Detection Protect your content and reduce server cost by serving a robots.txt that updates continuously Set robots.txt rules for entire categories of bots: Control access for entire agent categories including AI crawlers, scrapers, SEO bots, and more. One selection covers every current and future agent in that group. We track new bots, you don’t have to: Your robots.txt is updated as new agents emerge, so you never have to manage them yourself or make manual edits. Block misbehaving crawlers and scrapers: Detect and block bots that ignore your robots.txt rules using the WordPress plugin, or our automation detectors. Demos Demos can be found on the home page. Further Details This plugin connects your website to Known Agents. It uses the Known Agents API to connect to your account and provide functionality. By signing up, you agree to the Terms of Service and Privacy Policy. Are you finding this plugin useful? Please leave us a ★★★★★ review! Questions or issues? Ask us for help.
Top keywords
- agents13×2.74%
- ai12×2.53%
- website9×1.89%
- bots8×1.68%
- agent7×1.47%
- robots6×1.26%
- robots txt6×1.26%
- scrapers6×1.26%
- txt6×1.26%
- crawlers5×1.05%
- traffic5×1.05%
- ai agents4×0.84%
AI AEO for WooCommerce
AI AEO for WooCommerce is built specifically for Answer Engine Optimization (AEO). Traditional SEO plugins optimize for rankings. This plugin optimizes your products for AI understanding and retrieval. AI systems do not rank pages the way Google does. They extract structured data, interpret meaning, and recommend products based on confidence. If your store lacks structured context, multilingual signals, and semantic clarity — your products will not be selected. This plugin fixes that. Learn more: AI AEO for WooCommerce Plugin Overview 🧠 What problem does this solve? Most WooCommerce stores are invisible in AI search because: Missing or incomplete structured data Weak product semantics (keyword-based, not meaning-based) No multilingual signals No clear product entity definition No FAQ or use-case context Missing trust signals (shipping, returns, policies) Result: AI systems cannot confidently recommend your product. 🇪🇺 Why this is especially powerful for European WooCommerce stores European eCommerce is inherently multilingual and cross-border. Customers search in their native languages: English (base entity): “minimalist leather wallet for men” German: “leder geldbörse herren” French: “portefeuille cuir homme” Spanish: “cartera minimalista hombre” But most WooCommerce stores only provide English product data. AI systems rely on language matching + semantic understanding. If your product does not exist in the query language (even at a structured level), it is far less likely to be selected. 🧠 English → Multilingual mapping (how AI understands your product) This plugin keeps your original English product title as the base entity, and generates multilingual equivalents that AI systems map back to the same product. Example: Original (English base entity): Minimalist RFID Leather Wallet for Men Generated multilingual titles: German: Leder Geldbörse Herren Minimalistisch RFID French: Portefeuille Cuir Homme Minimaliste RFID Spanish: Cartera Minimalista Hombre RFID Italian: Portafoglio Uomo Minimalista RFID AI systems use this structure to: Recognize all variations as the same product Match queries across languages Improve confidence in recommendations Instead of creating multiple translated pages, you create one strong multilingual product entity. 🚀 What this enables A single product can now match: English: “best minimalist wallet for travel” German: “leder geldbörse herren” French: “portefeuille cuir homme” Spanish: “cartera minimalista hombre” Without duplicating content or managing multiple language pages. 🇪🇺 The hidden problem with multilingual WooCommerce (example) A customer in France searches: “portefeuille cuir homme” Your product exists: “Minimalist RFID Leather Wallet for Men” (in English) Even if you have a multilingual plugin installed, most setups: Keep English as the default product entity Translate content at the page level Do not inject multilingual meaning into structured data Result: AI systems may NOT confidently match your product to the French query. Why? Because AI systems rely on: Structured signals Entity consistency Language-level matching Not just visible translated content. ⚠️ What actually happens Your product is in English The user searches in French AI cannot strongly map the query → product Another store with better language signals gets recommended 👉 You lose customers who were already searching for your product. ❌ Why multilingual plugins alone don’t solve this Traditional multilingual setups: Create separate translated pages Rely on default language indexing Do not connect all languages to a single product entity AI systems still see: Fragmented or weak signals No strong cross-language mapping So your product remains under-recommended. ✅ How this plugin solves it This plugin keeps: One English base entity And adds: Multilingual titles directly into structured data Cross-language semantic signals Strong entity mapping across languages Now AI systems can: Understand all language variations as the same product Match queries across regions Recommend your product with higher confidence Learn more about European multilingual strategy: Scale your WooCommerce store to 43+ European languages via AI schema ✅ What this plugin actually does 1. Makes your products understandable to AI Generates AI-optimized product titles and context that help AI systems understand: What the product is Who it is for When and why it should be used How it compares to alternatives This improves entity matching and retrieval accuracy. 2. Adds structured data AI systems rely on Automatically generates Schema.org markup: Product Offer (price, currency, availability) AggregateRating FAQ schema This enables machine-readable extraction, not just indexing. 3. Adds multilingual product intelligence Generates product titles in 90+ languages Injects multilingual signals into structured data This allows AI systems to match queries across regions without requiring multiple translated pages. 4. Prepares your store for AI-driven discovery Instead of optimizing for: Rankings You optimize for: AI answers Product recommendations Cross-language discovery 🔍 Why this is different from SEO plugins SEO plugins: Optimize meta titles and keywords Focus on rankings This plugin: Optimizes for AI systems (ChatGPT, Perplexity, Gemini) Structures product data for machine understanding Improves likelihood of being selected in AI-generated answers This is not SEO. This is AEO (Answer Engine Optimization). 📈 Example queries your products can match English: best minimalist wallet for travel German: leder geldbörse herren French: portefeuille cuir homme Spanish: cartera minimalista hombre English: bluetooth headphones for flights English: privacy messaging app without phone number AI systems use structured understanding to match these queries to your products. ⚙️ Features AI-powered product title generation using Google Gemini, OpenAI (ChatGPT), and Anthropic (Claude) Multilingual support (90+ languages) Schema.org structured data (Product, Offer, Rating, FAQ) Batch processing for large catalogs Product collections with shortcode support XML sitemap integration 🧩 How it works Select your WooCommerce products Generate AI titles and structured data Review and publish Your store becomes AI-readable and machine-friendly 📌 Who should use this plugin? WooCommerce stores targeting European or global markets Stores selling across multiple languages Large product catalogs Founders exploring AI search visibility Anyone preparing for post-SEO discovery ⚠️ Important This plugin does NOT guarantee rankings. It improves your chances of being: Understood Matched Recommended …by AI systems like ChatGPT, Perplexity, and Google Gemini and more. Requirements WooCommerce 7.0 or higher A Google Gemini API key (https://aistudio.google.com/app/apikey) External Services This plugin connects to the Google Gemini API. Service: https://ai.google.dev/ Data sent: product title, description, categories, attributes When: only on manual generation or batch processing API key: provided by you, requests go directly to Google Terms: https://ai.google.dev/terms Privacy: https://policies.google.com/privacy No customer personal data is sent.