Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral Traffic
Track crawlers, scrapers, LLM assistants, and AI agents on your website. Generate a robots.txt that blocks AI bots. Formerly Dark Visitors. Track, control, and optimize your website for AI agents and bots You have 40% more visitors than you think. Protect your content from unwanted AI scraping, and turn the rising wave of AI agents, LLM assistants, and other bots visiting your website into a new growth channel for your business. For full details, visit the Known Agents website. 1. AI Agent & Bot Analytics Get realtime visibility into the hidden ecosystem of crawlers, scrapers, and AI agents browsing your website Watch traffic from crawlers and scrapers as it happens: Track the hidden activity of all known artificial agents visiting your website in real time. Replay AI agent navigation patterns: Follow a single agent’s session as it navigates your website. Find where agents get stuck, identify dead ends, and help them complete their tasks. Catch bots spoofing legitimate agents: Identify bad actors and unauthorized scrapers pretending to be legitimate agents like Googlebot or Bingbot. Never miss a bot traffic spike: Stay informed when an agent’s traffic starts surging or overloading your server. Reveal which agents visit most, and which pages they target: Break down bot traffic by page to understand what they’re interested in. Export reports to CSV: Download agent activity reports for custom analysis. 2. LLM Citation & Referral Tracking (GEO, AEO) Measure citations and human click-throughs from AI chat platforms like ChatGPT, Claude, and Gemini Increase citations in AI chat responses: See which pages LLMs recommend most often. Double down on content that’s working. Find out which AI platforms are sending you traffic: Measure how many humans are clicking through to your website from a citation. Export reports to CSV: Download LLM referral reports for custom analysis. 3. Automatic Robots.txt & Bad Bot Detection Protect your content and reduce server cost by serving a robots.txt that updates continuously Set robots.txt rules for entire categories of bots: Control access for entire agent categories including AI crawlers, scrapers, SEO bots, and more. One selection covers every current and future agent in that group. We track new bots, you don’t have to: Your robots.txt is updated as new agents emerge, so you never have to manage them yourself or make manual edits. Block misbehaving crawlers and scrapers: Detect and block bots that ignore your robots.txt rules using the WordPress plugin, or our automation detectors. Demos Demos can be found on the home page. Further Details This plugin connects your website to Known Agents. It uses the Known Agents API to connect to your account and provide functionality. By signing up, you agree to the Terms of Service and Privacy Policy. Are you finding this plugin useful? Please leave us a ★★★★★ review! Questions or issues? Ask us for help.
Top keywords
- agents13×2.74%
- ai12×2.53%
- website9×1.89%
- bots8×1.68%
- agent7×1.47%
- robots6×1.26%
- robots txt6×1.26%
- scrapers6×1.26%
- txt6×1.26%
- crawlers5×1.05%
- traffic5×1.05%
- ai agents4×0.84%
GEO Plugin by Squirrly SEO
Become the Brand AI Recommends. GEO Plugin by Squirrly SEO helps your WordPress site become easier for AI answer engines to understand, trust, cite, and recommend across ChatGPT, Perplexity, Claude, Gemini, and Google AI Overviews. The GEO Plugin by Squirrly SEO optimizes your WordPress site for the three layers of modern search at once: classic SEO so you rank on Google, AEO (Answer Engine Optimization) so AI engines pull your content as the direct answer, and GEO (Generative Engine Optimization) so ChatGPT, Perplexity, Gemini, Claude and Google AI Overviews cite your pages by name. One plugin to get you found by both search engines and AI. Why GEO and AEO matter now Search is splitting in two. People still type into Google, but more and more they just ask an AI. Google AI Overviews now appear on a large share of results and reduce clicks to the classic blue links, while ChatGPT, Perplexity and Gemini answer hundreds of millions of questions every week, usually by quoting a few trusted sources. Traditional SEO gets your page indexed. AEO and GEO get your page chosen as the answer and cited. The GEO Plugin by Squirrly SEO does all three, so you do not have to choose. AEO and GEO features GEO/AEO Audit – scores how ready each page is to be cited by AI: a direct-answer block near the top, question-style headings, lists and tables, content depth, freshness, and FAQ / HowTo / Article schema. AI crawler control – decide how GPTBot, ClaudeBot, PerplexityBot, Google-Extended and other AI bots can access your content, straight from your robots rules. llms.txt and llms-full.txt – generate, upload and serve the emerging llms.txt standard so generative engines understand your best content. LLM Indexing – push new and updated URLs to the IndexNow API and the Google Indexing API so search and AI engines discover them fast. Answer-ready Schema / structured data – FAQ, HowTo, Article, Q&A, Organization and more: the machine-readable formats AI engines lift word for word. Inner Links and Link Opportunities – build topical authority by linking the right pages for the right keywords. SEO features Focus Pages – see exactly why a page is not ranking and what to fix, page by page. AI Keyword Research – find keywords you can actually rank for, with real competition and search-intent analysis. Live Assistant – real-time, on-page optimization guidance as you write in Gutenberg, Elementor, Divi and other builders. SEO Goals – a guided, prioritized plan of what to do next. Technical SEO on autopilot – XML sitemaps, canonical links, meta robots, Open Graph and Twitter / X cards, redirects and favicons. Audits and tracking – SERP and rank tracking, traffic, authority and backlink audits, plus competitor analysis. Built for how AI reads the web AEO and GEO reward content that is easy for a machine to extract: a clear answer up front, headings phrased as the questions people ask, lists and tables instead of walls of text, accurate schema, and a fresh last-updated date. Squirrly checks every one of these for you and tells you exactly what to fix, so the same work that helps you rank on Google also helps you get quoted by AI. Getting started in 3 steps Install and activate the plugin, then connect your free Squirrly account to unlock the cloud tools (audits, keyword research, rank tracking). Add your important pages to the GEO/AEO Audit. Squirrly scores each page for SEO and answer-readiness and gives you a prioritized “fix these first” list. Turn on the AEO/GEO essentials: generate your llms.txt, allow the AI crawlers you want, and switch on LLM Indexing so new and updated URLs are pushed to search and AI engines automatically. Works with your stack Gutenberg, Elementor, Divi, WooCommerce, WordPress Multisite, WPML, and PHP 7.0 to 8.x. Migrate safely Import your existing SEO data from Rank Math, Yoast, All in One SEO, SEO Framework, SEO Press, SEO Pressor, Add Meta Tags, Greg’s High Performance SEO, HeadSpace2, Platinum SEO Pack, SEO Title Tags and SEO Ultimate. Trusted worldwide Built by Squirrly Limited (United Kingdom) since 2012, used in 150+ countries, and a multiple-time award-winning SEO tool. Powered by Squirrly’s own AI from AISQ.com: Ranking Vision AI, Keyword Research AI and Ask AI. BENEFITS / CUSTOMER SUCCESS / ALL FEATURES / LIVE DEMO What’s Next If you like our WordPress SEO plugin, then consider checking out our other projects: Squirrly Social – One Year of Social Media Posts in a Flash. Starbox PRO – Your Authors Will Shine Like Stars. Squirrly SPY – Your Competitor’s SEO Growth. In Your Hands.. Education Cloud PLUS – It’s like Netflix for Marketing Education. RankJumps – Managed SEO. Done-for-you by Experts from Squirrly. Learning Solutions by Squirrly – Teach Online. Starting Tomorrow. Hide My WP Ghost – WordPress Security Layer and Security Enhancements. WordPress Developers Page – Innovations and Partnerships. Plugins – Other Plugins created by Squirrly. Credits Florin Muresan – CEO at Squirrly Calin Vingan – CTO at Squirrly Sorel Nagy – Developer Andreea Leau – VP Marketing Cristina Leau – Squirrly mascot designer Alexandra Nicola – COO at Squirrly Teodora Vingan – SEO Analyser Irina Pogor – Content Writer Ana Darstaru – Chief of Customer Service Lucian Nertan – VP of Agency Rares Papita – CHO Investors Ibrahim Evsan, serial entrepreneur, one of the best known bloggers in Germany Philipp Kandal, co-Founder and CTO of Skobbler (recently acquired for $24M by Telenav) Many Thanks. License Squirrly is Free to use. The version from the WP directory will install the Free Version. You’ll be able to use this seo software once you install the plugin and use your email to connect to Squirrly.co For higher content marketing and SEO needs, you can check our Official Site and see what the PRO Plan offers.