Botkibble
AI agents, LLMs, and crawlers have to wade through navigation bars, sidebars, ads, and comment forms to reach the content they want, and every element costs tokens. Cloudflare measured an 80% reduction in token usage when converting a blog post from HTML to Markdown (16,180 tokens down to 3,150). Botkibble adds a Markdown endpoint to every published post and page. Cloudflare offers Markdown for Agents at the CDN edge on Pro, Business, and Enterprise plans. Botkibble does the same thing (for free) at the origin, so it works on any host. GitHub Repository Three ways to request Markdown: .md suffix: append .md to any post or page URL (e.g. example.com/my-post.md) Query parameter: add ?format=markdown to any post or page URL Content negotiation: send Accept: text/markdown in the request header What’s in every response: Structured metadata header with title, date, categories, tags, word count, character count, and estimated token count (in YAML frontmatter format, readable by any AI agent) Clean Markdown converted from fully-rendered post HTML (shortcodes run, filters applied) Content-Type: text/markdown and Vary: Accept response headers Content-Signal header for AI signal declaration — defaults to ai-train=no, search=yes, ai-input=yes — see contentsignals.org X-Markdown-Tokens header with estimated token count Discovery via in the HTML head and Link HTTP header Automatic cache invalidation when a post is updated or deleted Performance: Botkibble writes Markdown to disk on the first request, then serves it as a static file. A built-in Fast-Path serves cached files during WordPress’s init hook, before the main database query runs. No extra configuration needed. Add a web server rewrite rule and Botkibble bypasses PHP entirely, serving .md files the same way a server would serve an image or CSS file: Method Avg. response time Standard HTML 0.97s Markdown (cold, first request) 0.95s Markdown (cached, PHP Fast-Path) 0.87s Markdown (Nginx/Apache direct) 0.11s Serving directly from disk is 88% faster than a full WordPress page load. See the Performance section below for Nginx and Apache configuration. Security: Drafts, private posts, and password-protected content return 403 Forbidden Rate limits cache-miss regenerations (20/min by default) to mitigate DoS abuse X-Robots-Tag: noindex keeps Markdown versions out of search results Link: rel="canonical" points search engines back to the HTML version Cache variants (optional): You can persist alternate cached representations by adding ?botkibble_variant=slim (or any other variant name). Variant caches are stored under: /wp-content/uploads/botkibble/_v/ / .md What it does NOT do: Expose drafts, private posts, or password-protected content Serve non-post/page content types by default Require any configuration. Activate and it works. Why Markdown? HTML is expensive for AI systems to process. Cloudflare measured an 80% reduction in token usage when converting a blog post from HTML to Markdown (16,180 tokens down to 3,150). Cloudflare now offers Markdown for Agents at the CDN edge via the Accept: text/markdown header, available on Pro, Business, and Enterprise plans. This plugin does the same thing at the origin, so it works on any host. It also adds .md suffix URLs, ?format=markdown query parameters, YAML frontmatter, static file caching, and server-level offloading. If you use Cloudflare, both share the same Accept: text/markdown header, Content-Signal headers, and X-Markdown-Tokens response headers. Cloudflare currently defaults to Content-Signal: ai-train=yes, search=yes, ai-input=yes with no way to change it. Botkibble defaults to ai-train=no and lets you override the full signal per site via the botkibble_content_signal filter. Performance & Static Offloading This plugin supports static file offloading by writing Markdown content to /wp-content/uploads/botkibble/. Nginx Configuration To bypass PHP entirely and have Nginx serve the files (including variants) directly: # Variants location ~* ^/(_v/[^/]+/.+)\.md$ { default_type text/markdown; try_files /wp-content/uploads/botkibble/$1.md /index.php?$args; } # Default location ~* ^/(.+)\.md$ { default_type text/markdown; try_files /wp-content/uploads/botkibble/$1.md /index.php?$args; } Apache (.htaccess) Add this to your .htaccess before the WordPress rules: RewriteEngine On # Variants RewriteCond %{DOCUMENT_ROOT}/wp-content/uploads/botkibble/_v/$1/$2.md -f RewriteRule ^_v/([^/]+)/(.+)\.md$ /wp-content/uploads/botkibble/_v/$1/$2.md [L,T=text/markdown] # Default RewriteCond %{DOCUMENT_ROOT}/wp-content/uploads/botkibble/$1.md -f RewriteRule ^(.*)\.md$ /wp-content/uploads/botkibble/$1.md [L,T=text/markdown] Even without these rules, the plugin uses a “Fast-Path” that serves cached files from PHP before the main database query is executed. Credits We thank Cristi Constantin (https://github.com/cristi-constantin) for contributing cache variants, URL and SEO improvements, and fixing important bugs.
Top keywords
- markdown24×3.18%
- md16×2.12%
- botkibble15×1.99%
- text8×1.06%
- text markdown8×1.06%
- uploads8×1.06%
- uploads botkibble8×1.06%
- wp-content8×1.06%
- wp-content uploads8×1.06%
- wp-content uploads botkibble8×1.06%
- content7×0.93%
- header7×0.93%
Havenlytics – Real Estate Listings, Property Search & Agent Workspace
Havenlytics is a WordPress real estate plugin for agencies, agents, developers, and property directories. Create and manage property listings with the Havenlytics Migration Engine, CSV Import & Export, visual builders, AJAX search, interactive maps, galleries, and built-in analytics. Agents manage listings from a secure frontend Agent Workspace without entering wp-admin. Administrators retain control over registration, identity verification, listing review, taxonomy requests, and publishing workflows. Havenlytics works with any WordPress theme. The free Havenlytics Realty companion theme is optional. 📘 Documentation: https://havenlytics.com/documentation/ 🚀 Live Demo: https://demo.havenlytics.com/ 👤 Agent Workspace Demo: 🔐 Agent Login: https://demo.havenlytics.com/agent-dashboard/login 📝 Agent Registration: https://demo.havenlytics.com/agent-dashboard/register 🔑 Forgot Password: https://demo.havenlytics.com/agent-dashboard/forgot-password 🌐 Official Website: https://havenlytics.com/ 🎨 Official Theme: https://wordpress.org/themes/havenlytics-realty/ (optional) 💬 Community: https://facebook.com/groups/havenlytics/ 📺 YouTube: https://www.youtube.com/@havenlytics 📧 Support: https://havenlytics.com/support/ Quick Start Install and activate Havenlytics. Run the Property Setup Wizard. Choose one of the following: Import demo content Import property listings from CSV Migrate an existing Havenlytics website Create your own property listings Customize property fields, search filters, and listing layouts using the visual builders. Open Analytics to monitor property listings, inquiries, and website performance. (Optional) Install the free Havenlytics Realty companion theme for a complete demo-ready experience. Visit Havenlytics → Documentation or https://havenlytics.com/documentation/ for detailed guides, tutorials, and videos. 🎥 Video Tutorial: How to Install Havenlytics 🎥 Video Tutorial: Easily Move Your Website to a New Domain (Migration Engine) Who It’s For Real estate agencies, brokerages, and independent agents Property listing websites and searchable directories Property management and real estate development companies WordPress professionals building real estate sites for clients Why Havenlytics 🏠 Purpose-built for real estate — Listings, agents, agencies, inquiries, and workflows in one complete system. 📦 Migration Engine (HPTP) — Securely migrate complete Havenlytics websites with properties, agents, agencies, media, taxonomies, builders, and settings preserved. 📄 CSV Import & Export — Import or export property listings using CSV with intelligent column mapping, validation, reusable mapping profiles, and support for popular real estate platforms. 🔍 AJAX Search & Interactive Maps — Responsive search filters with Leaflet or Google Maps, clustering, and location search. 🎨 Visual Builders — Build property forms, search filters, and listing cards without writing code. 📊 Analytics Dashboard — Track listings, inquiries, property views, and performance directly inside WordPress. 👤 Agent Workspace — Secure frontend dashboard for agents with listings, favorites, identity verification, and workflow management. 🧱 Gutenberg & Elementor — Native Gutenberg blocks, Elementor widgets, shortcodes, and template overrides using one shared rendering engine. 🌍 Multilingual Support — Fully translation-ready with WordPress language packs. Includes complete Russian localization and supports any WordPress language. 👨💻 Developer Friendly — REST APIs, 50+ hooks & filters, template overrides, and modular architecture. ⚡ Performance & Security — Optimized caching, capability checks, nonces, rate limiting, and production-ready architecture. Core Features ✅ Migration Engine (HPTP) — Secure Havenlytics-to-Havenlytics website migration with migration packages, progress tracking, resume support, duplicate handling, and builder preservation. ✅ CSV Import & Export — Import and export property listings using CSV with intelligent field mapping, reusable mapping profiles, validation, progress tracking, and platform presets. ✅ Property Import Wizard (Demo Content) — Quickly install demo properties, media, maps, documents, agents, and sample content for new websites. ✅ Gutenberg Blocks — Native WordPress blocks for Property Archive, Search, Inquiry, Dashboard, Authentication, Saved Properties, Agents, Agency, and more. ✅ Analytics Dashboard — Property statistics, inquiry analytics, charts, property views, and CSV reporting. ✅ Search Builder — Drag-and-drop advanced search forms and sidebar filters. ✅ Property Builder — Visual property form and listing card builder. ✅ Interactive Maps — Leaflet or Google Maps with markers, clustering, and location search. ✅ Contact Agent & Inquiries — Inquiry forms, email notifications, and admin inbox. ✅ Agent & Agency Management — Profiles, taxonomies, badges, archive pages, and frontend management. ✅ Agent Workspace — Frontend property management without wp-admin. ✅ Favorites & Saved Properties — Persistent saved listings with guest-to-account merging. ✅ Identity Verification — Secure email verification and protected Workspace access. ✅ Taxonomy Requests — Agent-submitted taxonomy requests with administrator approval workflow. ✅ Elementor Widgets — Property Archive, Agents, Agency, and dynamic frontend layouts. ✅ Performance & Cache — Cache dashboard and optimization tools. ✅ REST API & Template Overrides — Developer APIs, hooks, filters, and template customization. ✅ Multilingual Support — Translation-ready with WordPress language packs, complete Russian localization, and support for any WordPress language. Also includes 50+ shortcodes, grid/list/map layouts, mortgage calculator, property documents, media galleries, videos, responsive templates, 160+ currencies, and extensive developer hooks. Agent Workspace A frontend portal where approved agents (and administrators) manage listings without wp-admin. Includes login and registration, Property Builder–driven forms, media, preview, submit-for-review workflow, favorites, Saved Properties, and cookie-authenticated hvnly/v1 REST endpoints. Choose open or administrator-approved registration. Identity Verification & Taxonomy Requests Agents must verify their email before Workspace access. Tokens are single-use and HMAC-protected; changing a verified email requires re-verification. Administrators can manually verify, resend, or emergency-disable verification. Agents can request missing property taxonomy terms from the Workspace. Administrators review requests under Havenlytics → Taxonomy Requests with approve, reject, merge, delete, notifications, and audit history. Analytics, Builders & Email Use Analytics for property, agent, agency, inquiry, and view statistics with date filters and CSV export — no Google Analytics required. Search Builder and Property Builder configure search forms, sidebar filters, and property fields with drag-and-drop controls. Configure email under Havenlytics → Settings → Email; Contact Agent messages under Settings → Contact Agent. 🎥 Video tutorial: Build Property Search Forms with Search Builder Elementor, Widgets & Pages Requires Elementor Free or Pro. Widgets in the Havenlytics category: HVN: Property Archive, HVN: Property Agents, and HVN: Property Agency — AJAX archives with search, grid/list/map views, and pagination. Sidebar widgets (Appearance → Widgets): Featured Properties, Property Agent, Mortgage Calculator, Related Properties, and Agent Listings Carousel. On activation, Havenlytics creates Property Grid, Lists, Search, Agents, and Agency pages when those slugs are free. Fresh installs also get Rent, Sale, Commercial, and Let department pages. Shortcodes Display listings with [hvnly_property_grid], [hvnly_property_lists], [hvnly_property_search], [hvnly_property_agents], and [hvnly_property_agencies]. Copy-ready examples and 50+ variations are under Havenlytics → Settings → Shortcodes. 🎥 Video tutorial: Display Property Content with Shortcodes Live demos: property grid, property lists, property search. Multilingual Support Havenlytics is fully internationalized and follows WordPress localization standards. Features include: Complete Russian translation included Translation-ready for any WordPress-supported language Compatible with WordPress language packs Supports translate.wordpress.org language packs RTL language compatible Uses WordPress i18n APIs Developer-friendly localization for custom extensions Included Translations 🇷🇺 Russian (ru_RU) 📘 Full documentation: https://havenlytics.com/documentation/ Support For installation help, troubleshooting, and usage questions, use the official WordPress.org support forum. Before posting, review the Havenlytics documentation and include your WordPress, PHP, and Havenlytics versions when relevant. Do not post passwords, API keys, verification links, or personal customer information. Contributing Contributions and feedback are welcome: Report bugs and request features via the official support forum Translate the plugin into your language via translate.wordpress.org Write documentation or share feedback via havenlytics.com/support Join our community discussions on Facebook Privacy Policy Havenlytics includes the Appsero SDK for optional usage telemetry. Telemetry is disabled by default and is only enabled if an administrator opts in. Privacy Policy: https://appsero.com/privacy-policy/ All Havenlytics data is stored in your own WordPress database. Contact Agent inquiries are also stored locally. Maps may use OpenStreetMap, Carto, or Google Maps (when configured). Imported CSV files may download remote media you provide. Uninstall removes plugin options, custom tables, cron events, and Appsero telemetry data. Property posts and Media Library files are retained unless deleted manually. Credits This plugin bundles: Font Awesome Free (CC BY 4.0, SIL OFL 1.1, MIT) Leaflet, Leaflet.markercluster, and leaflet.fullscreen (BSD-2-Clause/MIT) Inter font (SIL OFL 1.1) Appsero Client SDK (MIT)