Umay AI Markdown vs Spyglasses – AI Traffic Analytics

Modern AI agents (ChatGPT, Claude, Perplexity, Gemini, etc.) work much better with Markdown than HTML. Umay AI Markdown inspects the incoming Accept header and, only when text/markdown is requested, intercepts the response and serves a clean, agent-friendly Markdown representation of the page. Browsers, search engines, and any client that does not explicitly ask for Markdown receive the unchanged HTML response. There is no settings page, no cron job, and no external service call. Key features Zero configuration — install, activate, done. Only triggers when Accept: text/markdown is present. Regular visitors and search engines are never affected. Hybrid content extraction: uses the_content for posts/pages, falls back to a DOM-based extractor for archives, taxonomies, and the homepage. Powered by the industry-standard league/html-to-markdown library. Transient-cached for 12 hours per URL (sha256-keyed). Auto-invalidated on save_post, term edits, theme switches, and menu updates. Built-in IP rate limiter (30 requests / minute by default) to mitigate abuse. Strict input sanitization, header injection protection, libxml entity hardening (XXE-safe), and full WordPress Coding Standards compliance. PSR-4 autoloaded, namespaced OOP code. No globals. Sends Vary: Accept, X-Robots-Tag: noindex, and X-Content-Type-Options: nosniff on every Markdown response. What gets sent to AI agents Each Markdown response includes a YAML front-matter block with the page title, site name, canonical URL, and ISO-8601 generation timestamp, followed by the page body converted to Markdown. Navigation, footer, sidebars, scripts, styles, comment forms, related posts, and other page chrome are stripped before conversion. Filters Two filters are available for advanced customization: umay_mdn_bypass — Return true to skip Markdown handling for the current request. umay_mdn_cache_ttl — Override the default 12-hour cache lifetime (in seconds, minimum 60). umay_mdn_rate_limit — Override the default 30-requests-per-minute rate limit. umay_mdn_converter_options — Modify the league/html-to-markdown converter options array.

Important: This plugin requires a free account with Spyglasses. Sign up at spyglasses.io to get your API key. By using this plugin, you agree to our Terms of Service and Privacy Policy. Spyglasses provides advanced detection for AI agents, bots, and AI referrer traffic that interacts with your WordPress site. Key Features AI Agent Detection: Automatically detect traffic from AI browsing assistants AI Referrer Tracking: Identify human visitors who clicked links from AI-generated content Real-time Monitoring: Track and monitor AI-related traffic to your site Bot Blocking: Selectively block specific AI agents or entire categories of bots AI Model Trainer Protection: Prevent AI systems from scraping your content for model training Dashboard Insights: View detailed analytics on AI traffic via the Spyglasses dashboard Central Management: Configure all blocking settings from your Spyglasses dashboard Lightweight: Minimal impact on site performance and user experience Easy Setup: Simple configuration with just an API key Auto-Updating Patterns: Automatically syncs with latest AI detection patterns daily Smart Filtering: Automatically excludes WordPress internal processes to prevent log pollution Cache-Friendly: Fully compatible with all major caching plugins including LiteSpeed Cache, WP Super Cache, W3TC, WP Rocket, and more Reliable Fallbacks: Local pattern storage ensures detection continues working even during API outages How It Works Spyglasses uses pattern recognition to identify: AI agents and bots visiting your site through user-agent detection Human visitors from AI platforms through referrer detection When AI-related traffic is detected, information about the visit is securely sent to the Spyglasses collector for analysis and reporting. You can also choose to block specific types of bots from accessing your site through your Spyglasses dashboard. Privacy & Transparency Spyglasses only collects information about AI-related traffic, not about your regular human visitors. All code is open source and available for review on GitHub. External Services This plugin connects to external Spyglasses API services to provide AI traffic detection and analytics functionality. A Spyglasses account is required for the plugin to work. Spyglasses Pattern API What it does: Downloads the latest AI agent detection patterns to keep your site’s bot detection up-to-date. API Endpoint: https://www.spyglasses.io/api/patterns Data sent: Your API key for authentication When: Daily automatic sync (if enabled) or manual sync from plugin settings Purpose: Ensures your site can detect the newest AI agents and bots as they emerge Spyglasses Collector API What it does: Receives and processes data about AI agent and other bot visits to your website for analytics and reporting. API Endpoint: https://www.spyglasses.io/api/collect Data sent when an AI agent or bot is detected: * IP Address of the AI agent/bot * User Agent string of the AI agent/bot * URL/web page that was visited * HTTP request headers from the AI agent/bot * Request method (GET, POST, etc.) * Response status code and timing * Referrer information (if available) * Timestamp of the visit When: Only when traffic matching AI agent or bot patterns is detected on your site Purpose: Provides analytics dashboard showing AI traffic patterns, blocked requests, and detailed visitor logs Important: No data about regular human visitors is collected or sent. Only traffic that matches known AI agent patterns triggers data collection. Service Provider Both services are provided by Orchestra AI, Inc.: Website: spyglasses.io Terms of Service: spyglasses.io/legal/terms Privacy Policy: spyglasses.io/legal/privacy-policy