Duplicator – Backups & Migration Plugin – Cloud Backups, Scheduled Backups, & More vs Crawler Record

Crawler Record logs the last time specific user agents (for search and AI chat/LLMs) accessed your content including: Google Bing ChatGPT (OpenAI) Claude (Anthropic) Perplexity DuckDuckGo Meta Apple Common Crawl You can view this information: Admin page: a grouped list of all crawlers, with last seen time, last page, and robots status for the crawler. Admin Bar (front-end): quick-glance status for the current singular or URL context (no dropdowns in wp-admin). Per Page/Post: From the edit screen on any page or post, you can see that last time each crawler visited that page. Recent Pages: From the admin page you can select a crawlwer and get a list of the recent pages this UA has visited. Robots-aware: The plugin checks your robots.txt and evaluates Allow/Disallow rules for a given path. If Settings → Reading → “Discourage search engines” is enabled, all agents are shown as blocked with a prominent warning. Performance-friendly by design: Write-throttling (default 10 minutes) and an auxiliary “last post ID per agent” record avoids heavy admin queries on large sites. Privacy-friendly: Saves only bot visit timestamps and last URLs crawled — no personal data. Learn how to use this plugin. Highlights Supports common user-agent variants for Google, Bing, OpenAI (ChatGPT), Anthropic (Claude), Perplexity, Meta, Apple, DuckDuckGo, and Common Crawl. Robots status computed from local robots.txt (physical or virtual) without outbound requests. Clear UI with grouped sections, microsecond timestamps, and a small diagnostics toggle showing the matched robots group and rule. Known limitations Can only track crawlers from the time the plugin is installed- cannot look into the past. robots.txt wildcards (*) and end-of-line marker ($) are not interpreted; matching is prefix-based only. Future versions may add full spec support. To reduce database load and avoid slowing the website, bot tracking is throttled, so not every crawler visit will necessarily be recorded. Privacy This plugin stores: – Timestamps of crawler visits (float, with microseconds) – Last URL seen per crawler (per-URL records) – Last post ID per crawler (for admin performance) It does not collect or store personal data about site visitors. No data is transmitted to third parties. License GPLv2 or later. See LICENSE file.

WordPress Backup & Migration Plugin Duplicator provides a simple way to move WordPress sites, create reliable backups, or clone a site for staging. With Duplicator, you can easily migrate, transfer, or clone your WordPress site between domains or hosts with no downtime. Create full backups of your website, or package your entire site to download and install elsewhere with only a few steps. At Duplicator, reliabilty, security, and ease of use are our top priorities. Our variety of cloud backup integrations and easy migration wizard make Duplicator the most beginner-friendly backup and migration plugin on the market. You don’t have to hire a developer. Create a backup and migrate sites in just a few minutes. Duplicator Pro This plugin is the Lite version of Duplicator Pro, which comes with scheduled backups, cloud storage integrations, multisite support, and more. Get Duplicator Pro for the complete migration and backup solution. Easy Site Migration, Backup, and Cloning Duplicator streamlines site migrations by packaging your website files and database into a single file, known as a “backup”. Download and re-install your “backup” on any new WordPress location or server without dealing with complicated setups. Launch at your new destination without installing WordPress. Duplicator is the only migration and backup plugin that works on an empty site. See why experts love Duplicator: “Duplicator provides an easy to use tool to make backups of your site, or to transfer it to another location.” Richard McAdams – Expert Web Developer Secure WordPress Backups Duplicator offers cloud WordPress backups with military-grade encryption. Automatically backup your entire WordPress site to secure cloud storage. Recovery Points (1-click Restore) Duplicator makes 1-click restores for WordPress backups easy and stress-free. Quickly restore your entire website in minutes just like a time machine. Fast WordPress Migrations Duplicator makes WordPress website migrations fast and stress-free. Quickly move to a new host, domain, or server. No downtime, no data loss, and no coding required. WordPress Multisite Backups Duplicator offers automatic WordPress Multisite backups with easy 1-click restore. Safely backup your entire Multisite network to secure cloud storage. WooCommerce Backups Duplicator offers reliable WooCommerce backups with military-grade encryption. Easily and automatically back up your entire online store to secure cloud storage. Pre-configured WordPress Installs Never start from scratch with Duplicator’s smart pre-configured WordPress installs. Save time and hassle duplicating ready-made sites with 1-click. WordPress Recovery Points with Quick Rollbacks Duplicator offers hourly recovery points and 1-click rollbacks for WordPress sites. Quickly and automatically recover from failed WordPress updates or disasters. Partial WordPress Backup Plugin Duplicator makes partial backups for WordPress quick and easy. Save storage and restore sites faster with database-only, media-only, or completely custom backups. Server to Server WordPress Migration Import Tool Duplicator makes server-to-server WordPress migrations fast and hassle-free. Quickly import your website to a new server in minutes. No downtime, no data loss. Smart WordPress Migration Wizard Duplicator’s smart WordPress migration wizard makes transferring your website to a new host or server effortless. No downtime, no data loss, and no code required. Drag & Drop Import WordPress Website Tool Migrating WordPress sites has never been easier with Duplicator’s drag & drop import tools. Quickly transfer your site to a new host or server in minutes, no code required. Clone WordPress Website Plugin Duplicator clones your entire WordPress website with 1-click, no code needed. Perfect for staging sites, sandbox, or site migration. WordPress Staging Site Duplicator Pro lets you create a WordPress staging site directly from your WordPress dashboard. Safely test plugin updates, theme changes, and new features on a staging environment before pushing changes to your live site. No manual setup, no separate hosting, and no risk to your production site. Duplicator Pro Features Duplicator Pro takes Duplicator to the next level with features you’ll love, such as: WordPress staging sites – create a staging copy of your site to safely test changes before going live Drag and Drop installs – just drag the backup file to the destination site! Scheduled backups Cloud Storage to Dropbox Backups, Google Drive Backups, Microsoft OneDrive Backups, Amazon S3 Backups and FTP/SFTP Backups Custom Backups and Cloning: want just plugins, or just themes, just the database? No problem! A special 2-step streamlined installer mode for mega-fast installs Recovery Points added for very fast emergency site restores Support for managed and shared hosts such as WordPress.com, WPEngine, GoDaddy Managed, and more Multi-threaded to support larger websites & databases Migrate an entire multisite WordPress network or a sub site as a standalone site Database and user creation in the installer with cPanel API Connect to cPanel directly from the installer Custom plugin hooks for developers Advanced permissions Email notifications Professional support … and much more! Supported Backup Cloud Storage Integrations We support any Amazon S3 compatible storage providers plus these first-party integrations. Localhost Backups FTP/ SFTP Backups Dropbox Backups Google Drive Backups Microsoft OneDrive Backups Amazon S3 Backups Cloudflare R2 Backups Wasabi Backups Dream Objects Backups Vultr Backups Digital Ocean Spaces Backups Google Cloud Storage Backups Backblaze B2 Storage Backups Linode Object Storage Backups You can easily see why Duplicator is the best WordPress backup and migration plugin on the market! Want to unlock these features? Upgrade to our Pro version Branding Guidelines Duplicator® is a registered trademark of Snap Creek LLC. When writing about the backup & migration plugin by Duplicator, please make sure to uppercase the initial first letter. Duplicator (correct) duplicator (incorrect)