News-Parser vs VigIA – AI Visibility, Analytics & Control

News-parser WordPress Plugin News-parser is a plugin for WordPress that allows you to easily receive the full text of the article, as well as images from the site using an RSS feed. Parsed information from the site is saved as a draft,which you can just publish or edit at your discretion. This makes it easy to create content for your site. New Features The following new features are available in the new version of the plugin: * Sitemap Parsing: You can now parse information directly from sitemap files, expanding the sources of data for your content. * Yoast SEO Integration for AI Descriptions: Seamlessly integrate with Yoast SEO to automatically generate compelling post descriptions using AI, enhancing your SEO efforts. * Expanded AI Provider Support: Enjoy greater flexibility with added support for DeepSeek and Anthropic AI APIs, alongside existing providers. * CSS Selector Parsing Templates: Create custom parsing templates using CSS selectors for precise and targeted data extraction from websites. * Autopilot Post Filtering: Implement advanced filtering options when using the autopilot function, giving you more control over the content processed automatically. Website and Documentation Explore the plugin`s resources: Website: https://www.news-parser.com/ Documentation: Docs Features Gutenberg editor support. Autopilot Function for Automatic RSS Parsing Visual content extractor. WP-CLI support Flexible template creation system to speed up parsing. Ability to parse not only from RSS XML source but also from url. Sitemap Parsing: Parse information directly from sitemap files. Yoast SEO Integration for AI Descriptions: Generate post descriptions using AI and integrate seamlessly with Yoast SEO. Expanded AI Provider Support: Supports DeepSeek, Anthropic, and other AI APIs. CSS Selector Parsing Templates: Create parsing templates using CSS selectors for precise data extraction. Autopilot Post Filtering: Advanced filtering options for autopilot function. Installing You can clone the GitHub repository: https://github.com/zalevsk1y/news-parser.git Or download it directly as a ZIP file: https://github.com/zalevsk1y/news-parser/archive/master.zip This will download the latest developer copy of News-parser. How to use NewsParser plugin? Parsing RSS To parse RSS, go to the News-Parsing->Parsing RSS menu in the admin panel of your site. Enter the RSS feed address in the search bar. Click on the Parse RSS Feed button. When parsed data is fetched from the server,it will appear on your screen. You can open the visual extractor by clicking on the icon and create a template for parsing posts from this RSS source or simply select the content you are interested in and save it as a draft. Watch this short video to learn HOW TO PARSE FROM RSS with news-parser plugin: To parse several posts, select posts and press the Parse Selected button. Wait for the data to be saved,you`ll be notified by the message at the top of the screen. The icon at the bottom of the post allows you to go on to edit or publish a saved draft.Note that parsing selected post could be done only if you created parsing template! Watch this short video to learn HOW TO PARSE SEVERAL POSTS with news-parser plugin: Visual Constructor. To create a template or simply select the content you are interested in, use the visual constructor. You can open visual constructor by clicking icon at the bottom of post box. To select content, click on the block that you need in the main window and it will be marked with a turquoise frame. When you hover over the content, the expected area will be painted in turquoise color. To cancel the selection, click on the block again. Try to separate different types of content (pictures, video, text) into separate blocks. The YouTube video will be replaced with a picture of the YouTube logo. You can extrude it and this video will be inserted into your post. Parsing videos from other sources is not yet supported. Pictures are inserted into your post as a link; the exception is a featured image which is saved in your media library. In the sidebar, you can change the featured image of your post. Just select the appropriate image on the left side of the designer and click the Change Image button. The last image you selected will be selected as featured image. You can also create a post without featured image. Just click on No featured image. You can change the name of the post in the next submenu ‘Post title’. Write your version of the post title in textaria and click the Change Title button. To add a source link, check the box labeled ‘Add source link’ to the post. in the ‘Extra Options’ submenu. Beyond visual content selection, you can now also leverage the power of AI directly within the constructor. A dedicated ‘AI’ tab is now available in the panel, allowing you to generate content using AI models. Simply navigate to the ‘AI’ tab to explore the available options and create engaging content. Furthermore, to optimize your posts for search engines, you can now easily add AI-generated SEO descriptions.Within the panel, you will find an ‘SEO’ tab. In the ‘SEO’ tab, you can utilize AI to create compelling post descriptions, enhancing your SEO directly from the post visual creation interface. Watch this short video to learn HOW TO USE VISUAL CONSTRUCTOR: Create Parsing Template To save the template, it is necessary to mark the content in the main window of the visual constructor, select the ‘Save parsing template that you can use in automatic parsing from this source item.’ and click the Save Template button. It is important to understand that individual posts even from one source can be very different, therefore parsed pages may not contain the content you need. Now, you can also create powerful parsing templates using CSS selectors. In the ‘Template’ tab within the Visual Constructor, you’ll find a new section called ‘Template Patterns’. As you visually select elements in the main window, you will see their corresponding CSS selectors populate in the ‘Template Patterns’ block. If you select the ‘Save Parsing Template’ checkbox, you unlock the ability to directly edit these template patterns. Two editable parameters become available: ‘Elements pattern’ and ‘Exclude elements pattern’. It’s important to note that when you edit the ‘Elements pattern’ field, the elements you selected visually in the constructor will be disregarded. Therefore, if you intend to primarily use the visual constructor for creating parsing rules, leave the ‘Elements pattern’ field empty. When editing the pattern fields, separate each CSS selector with a comma. Once you have finished editing your CSS selector patterns, click the ‘Update’ button to apply the changes and save your template. This allows for fine-grained control over content selection using the precision of CSS selectors. Watch this short video to learn HOW TO CREATE PARSING TEMPLATE: Parse single page. To parse a single page, select News-Parsing-> Parse Page in the admin panel of your site. In the search bar, enter the site address URL and press Parse Page button. Visual constructor will open. In the visual constructor, select the content and click the Create Post Draft button. The draft will be automatically created and you can edit it in the Posts editor.If everything suits you, you can simply publish this post or edit it at your discretion. Watch this short video to learn HOW TO PARSE SINGLE PAGE with news-parser plugin: Autopilot Function for Automatic RSS Parsing The autopilot function is now available to automatically parse posts from an RSS feed. Please note that the WordPress cron system (wp-cron – https://developer.wordpress.org/plugins/cron/) is used for scheduling the autopilot function. WP-Cron triggers the task scheduler only when your website receives a visit. If you experience any issues with the autopilot function not running as expected, you can add the following line to your wp-config.php file: define('ALTERNATE_WP_CRON', true); This can sometimes improve the reliability of WP-Cron. To configure the autopilot settings, please follow these steps: Navigate to the Autopilot tab in the menu (News Parser -> Autopilot). In the Schedule Options, select the URL that corresponds to the RSS source you want to parse from. Click the Select button. Once the data is loaded, the following configuration options will become available: Status: Determines whether the autopilot is active (enabled) or inactive (disabled) for this specific source. Maximum Number of Posts: Set the maximum number of posts to be parsed in a single autopilot run from this source. Maximum Number of Autopilot Runs: Specify the total number of times the autopilot should run for this source before it automatically stops. Parsing Frequency: Define how often parsing should occur from this source. You can set intervals like hourly, daily, etc. Use Original Post Creation Date: Enable this option to use the original publication date from the source post as the creation date for your parsed post. If disabled, the post will be dated when it is parsed and published on your site. Filter Type: Choose the type of filtering condition to apply. Available options are Include and Exclude. Filter Object: Determines which post parameter will be used as the object for filtering rules. You can select from three options: URL: Filter based on the URL of the source post. Title: Filter based on the title of the source post. Meta: Filter based on meta data from the source post. Filtering Expression: Define the words or phrases to be used for filtering. Separate words with | (OR) or & (AND). For example: apple|grape (includes posts with “apple” OR “grape”) or apple&grape (includes posts with “apple” AND “grape”). If ‘Meta’ is selected as the Filter Object: You will need to specify the name attribute of the tag. The Filtering Expression will then be applied to the content attribute of the specified meta tag. Additionally, in this menu, you can delete previously saved parsing templates. The Autopilot feature for automatically parsing RSS feeds has been significantly enhanced with new logging capabilities, removal of run and post limits, and more granular control over parsing behavior. Watch this short video to learn HOW TO USE AUTOPILOT with news-parser plugin: AI Feature To use AI feature you need to get API key from OpenAI or from Google. To use AI for generating content on your website, follow these instructions: 1. Set up the Open API Key: – To setup OpenAPI key, open the wp-config.php file and add the following line to define your API key: define('NEWS_PARSER_OPENAI_API_KEY', 'your_key'). – To setup Google key, open the wp-config.php file and add the following line to define your API key: define('NEWS_PARSER_GEMINI_API_KEY','your_key'). 2. Access the Visual Constructor: Go to the Visual Constructor within your website’s admin panel. 3. Select the AI Provider: In the AI tab of the Visual Constructor, you will see a list of available AI providers. Choose the desired provider from the list. 3. Generate Featured Image: In the Featured Image section, check the “Generate using AI” option if you want to generate a new featured image for your post. Select the model and enter a prompt. Use ${title} in the prompt wherever you want to insert the original title. 4. Generate Post Title: In the Post Title section, check the “Generate using AI” option if you want to generate a new title for your post. Select the model and enter a prompt. Use ${title} in the prompt wherever you want to insert the original title. 5. Generate Post Body: In the Post Body section, select the model for generating the post’s content. Enter a prompt in the request field and use ${post} where you want to include the original article’s text and you can use tag ${title} here as well. 6. Add Pipeline (Optional): If you need to modify the text using multiple requests, open the “Add Pipeline” tab. Enter the additional request text, which will automatically include the result of the previous request. Click “Add Prompt” to add this request to the pipeline. With the pipeline, you can ask the AI to review the results of the previous generation or request translation of the generated text into another language. 7. Apply AI Modifications: After configuring the AI settings for content modification, you can apply them immediately by selecting the content in the Visual Constructor and clicking the “Create Post” button. Alternatively, you can save these settings as a template for applying them during RSS parsing or when using the autopilot function. Please note that when using AI for content generation, it requires making API requests to the OpenAI API, which will incur charges on your OpenAI account. Additionally, the AI generation process can take a significant amount of time. By following these instructions, you can use artificial intelligence to create content for your website, whether it’s parsing individual pages, parsing from RSS feeds, or using the autopilot function. SEO Feature This tab contains three sections: Post Description, SEO Plugins, and Description AI Generation. Post Description – This section displays the current post description and allows you to replace it with a custom description that you provide. To enable this feature and make the description visible in search results, you need to have an SEO plugin installed, such as Yoast SEO, and activate the SEO Integration within the plugin settings. SEO Plugins – To utilize the SEO plugin integration, you must check the Enable SEO Integration option. Then, select your desired SEO plugin from the dropdown menu to establish the integration. Description AI Generation – This section enables you to create and modify post descriptions using AI. When crafting your AI prompt, you can include the original post description by using the placeholder ${description}. This allows the AI to incorporate the existing description into the newly generated one if desired. WP-CLI Support With the latest update, a new feature has been introduced that leverages wp-cli. This feature enables users to activate an autopilot function, allowing for automated parsing and saving of posts from RSS feeds. The autopilot function can now be accessed directly from the command-line interface, providing a convenient way to manage this process. To utilize this functionality, you’ll need to install wp-cli and execute the command wp autopilot in the command-line interface. Additionally, you’ll need to specify the desired interval at which the autopilot function should be triggered by including the additional parameter wp autopilot --interval=. This allows you to customize the frequency of the autopilot function according to your specific needs. By incorporating wp-cli and the new “wp autopilot” command, managing the automatic parsing and saving of posts from RSS feeds becomes more efficient and streamlined. This feature provides enhanced control and flexibility, empowering users to automate their post management tasks with ease. Example: wp autopilot --interval=hourly Dependencies * php-simple-html-dom-parser https://github.com/sunra/php-simple-html-dom-parser Bugs If you find an issue, let us know here or Discord Contacts GitHub Discord Instagram

VigIA (Spanish for “lookout” or “watchman”, incorporating “IA” – Spanish for “AI”) is a complete AI visibility toolkit for WordPress. Monitor 60+ AI crawlers, control access to your content, and optimize how AI systems discover and understand your site. What does VigIA do? Scores your AI visibility with a 100-point analyzer covering 20 checks across 5 categories Tracks AI crawlers visiting your site (GPTBot, ClaudeBot, PerplexityBot, and 60+ others) Provides detailed analytics with advanced filters, server-side pagination, and exportable reports with metadata banner Blocks unwanted crawlers via PHP (403 response) Manages robots.txt rules for AI crawlers with compliance monitoring Sends email alerts about crawler activity (daily, weekly, or monthly) Generates llms.txt files to help AI systems understand your site Serves markdown endpoints for posts, pages, taxonomy archives (categories, tags, WooCommerce product categories, custom taxonomies) and WooCommerce products with schema-like data Generates JSON-LD structured data with Site Identity and AI Discovery signals Exposes abilities for AI agents and automation tools (WordPress 6.9+) Key Features AI Visibility Analyzer * 100-point scoring system with letter grades (A+ to F) * 20 individual checks across 5 categories * Access & AI Discovery (37 pts): robots.txt, AI bot directives, Content Signals, llms.txt, sitemap, RSS feed * Structured Data & Semantic Context (25 pts): JSON-LD schemas, Open Graph, Twitter Cards, meta description, canonical URL * Content Structure & Readability (20 pts): heading hierarchy, semantic HTML5, image alt text, content/HTML ratio * AI Interaction & Distribution (8 pts): markdown delivery, AI share buttons * Access Performance (10 pts): TTFB measurement * Smart recommendations with direct links to VigIA features and plugin suggestions * Analyze any page on your site with URL autocomplete selector * Results cached for 24 hours with manual re-analyze option Analytics Dashboard * Total visits, unique crawlers, and pages crawled statistics * Timeline chart with daily breakdown * Category distribution (AI Training, AI Search, AI Assistant, Data Scraper) * Top crawlers and most crawled pages tables with paginated navigation * Share Buttons & AI-powered Summaries integration: see share button clicks per page * Recent activity log with content type and HTTP status columns (color coded by status family) * Advanced filters: multi-select crawler picker, content type, HTTP status code, and configurable date range * Server-side pagination with four-button pager (first, previous, next, last) — operates over the full database, not just the latest 500 rows * Period comparison functionality * CSV export with a metadata banner (site name, site URL, export type, date range, export timestamp, applied filters) * “Export filtered CSV” button that downloads exactly what the active filters return, with vigia-filtered-YYYY-MM-DD.csv filename * Content type detection distinguishes Home, Post, Page, Product, custom CPTs, Category archive, Tag archive, Date/Author archive, Feed, Sitemap, REST API, File, Admin / login attempts (/wp-admin, /wp-login.php), WordPress system (admin-ajax, xmlrpc, wp-cron, wp-comments-post), 404 Not found, and Other Crawler Blocking * Block crawlers via PHP with 403 Forbidden response * Quick block dropdown in analytics dashboard * Manage blocks from Extras page * Works on any server (Apache, Nginx, LiteSpeed, etc.) Robots.txt Management * Add Disallow rules for AI crawlers * Visual preview of your robots.txt * Compliance monitoring: see which crawlers ignore your rules * One-click blocking for non-compliant crawlers * Works with both physical and virtual robots.txt Email Alerts * Daily, weekly, or monthly reports * Three detail levels: Minimal, Normal, Complete * Non-compliant crawler warnings * Activity comparison with previous period Markdown for Agents * Serve posts, pages and any public post type as optimized markdown for AI agents * Serve taxonomy archive pages (categories, tags, WooCommerce product categories, custom taxonomies) as markdown — disabled by default, opt in per taxonomy * Dedicated .md URL endpoints (e.g., /your-post.md, /category/news.md, /product-category/electronics.md) * Accept: text/markdown content negotiation on posts and taxonomy archive pages * Discoverability via Link HTTP headers and HTML tags * YAML frontmatter for posts: title, date, modified, author, image, categories, tags, post type, lang * YAML frontmatter for taxonomy terms: title, description, url, type, taxonomy, parent, count, image (term meta), lang * WooCommerce product frontmatter adds schema-like fields: sku, product_type, price, regular_price, sale_price, currency, availability, stock_quantity, rating, rating_count, review_count * Taxonomy term body includes the term description (rendered through the_content), the list of direct child terms in hierarchical taxonomies, and an excerpt of the latest posts/products assigned to the term * Product listings inside product_cat archives include an inline summary with formatted price, “was X” on sale items, star rating and out-of-stock flag * Respects blocking rules (blocked crawlers get 403) and LLMs.txt exclusion filters * Per-term noindex detection from Yoast SEO, Rank Math, All in One SEO and SEOPress * Analytics integration: tracks markdown requests per crawler * X-Markdown-Tokens response header * Filters: vigia_markdown_post_eligible, vigia_markdown_term_eligible, vigia_markdown_term_posts_limit * Follows the Cloudflare Markdown for Agents standard LLMs.txt Generator * Select content by post type with one click * Filter by taxonomies (categories, tags, custom) * Manual include/exclude with AJAX search * Exclude by URL patterns (wildcards supported) * SEO plugin integration (auto-exclude noindex content) * Auto-regeneration (daily, weekly, monthly) * Robots.txt integration (add llms.txt and llms-full.txt references) * Generate llms.txt and llms-full.txt files * Full content or excerpt mode * Compatible with Yoast SEO, Rank Math, All in One SEO, SEOPress, The SEO Framework, and Native SEO NoIndexer JSON-LD Structured Data * Generate WebSite and Organization/Person schema for site identity * AI Discovery: ReadAction pointers to llms.txt, llms-full.txt, and Markdown for Agents endpoints * Social profiles and sameAs links for brand identity across the web * SearchAction for Google sitelinks search box * Media library integration for logo selection * SEO plugin conflict detection (Yoast, Rank Math, AIOSEO, SEOPress, The SEO Framework) * Choose output page (front page or any published page) * Live JSON-LD preview with real-time updates * Smart integration with LLMs.txt and Markdown for Agents features Supported AI Crawlers VigIA monitors 60+ AI crawlers including: OpenAI: GPTBot, OAI-SearchBot, OAI-AdsBot, ChatGPT-User Anthropic: ClaudeBot, Claude-SearchBot, Claude-User, Claude-Code Google: Google-Extended, GoogleOther, Gemini-Deep-Research, Google-NotebookLM Perplexity: PerplexityBot, Perplexity-User Meta: Meta-ExternalAgent, FacebookBot, Meta-WebIndexer Amazon: Amazonbot, Amzn-SearchBot, bedrockbot Mistral: MistralAI-User, MistralAI-Index Microsoft: BingBot ByteDance: Bytespider Apple: Applebot-Extended And many more… Privacy Focused VigIA stores visitor data locally in your WordPress database. No data is sent to external servers. Abilities API VigIA is one of the first WordPress plugins to implement the Abilities API introduced in WordPress 6.9. This API allows AI agents, automation tools, and external systems to discover and interact with VigIA’s functionality in a standardized, secure way. What are Abilities? Abilities are self-contained units of functionality that VigIA exposes through WordPress’s central registry. Each ability has defined inputs, outputs, and permissions, making it easy for automation tools to understand and use them. Available Abilities VigIA registers the following abilities: Analytics vigia/get-crawler-stats – Get statistics about AI crawler visits (total visits, unique crawlers, pages crawled) vigia/get-top-crawlers – Get a ranked list of most active AI crawlers vigia/get-top-pages – Get the most crawled pages on your site Blocking vigia/get-blocked-items – List all blocked crawlers and IP addresses vigia/block-crawler – Block a crawler by User-Agent pattern vigia/unblock-crawler – Remove an existing block Robots.txt vigia/get-robots-rules – Get current AI crawler rules in robots.txt vigia/add-robots-disallow – Add a Disallow directive for a crawler vigia/remove-robots-rule – Remove a robots.txt rule Use Cases Automated monitoring: AI agents can query crawler statistics and alert you to anomalies Reactive blocking: Automation tools can block crawlers that repeatedly ignore robots.txt External dashboards: Aggregate data from multiple WordPress sites with VigIA installed WP-CLI integration: Future command-line access through the Abilities API n8n / Make workflows: Build custom automation flows using VigIA’s abilities Requirements The Abilities API ships with WordPress 6.9 and later. On older WordPress versions, VigIA works normally but abilities and MCP are not available. MCP Server (Model Context Protocol) VigIA exposes its 9 abilities as native MCP tools to any MCP-compatible client (Claude Code, Cursor, Claude Desktop, Codex CLI, Antigravity, Continue, Cline, Zed and similar) using the official WordPress MCP Adapter. The adapter ships bundled with the plugin, so the MCP endpoint is active right after installation — no Composer step or terminal access required. Requirements WordPress 6.9 or later (provides the Abilities API) Quick connect (recommended) Open VigIA > Extras > MCP and click “Generate password and connection commands”. The plugin creates a dedicated Application Password named VigIA MCP and renders ready-to-paste commands for Claude Code, Cursor, Claude Desktop and a generic block (URL + Authorization header) for any other MCP client. The plain password is shown only once. If you lose it, revoke the entry from the same panel and generate a new one. Endpoint https://your-site.example/wp-json/vigia/v1/mcp The endpoint uses HTTP Basic auth with the WordPress Application Password. The user must have the manage_options capability. Connecting Claude Code Quick Connect builds the full command for you. The shape is: claude mcp add --transport http vigia https://your-site.example/wp-json/vigia/v1/mcp --header "Authorization: Basic BASE64_OF_USER_AND_APP_PASSWORD" Claude Code merges the new entry into its config file automatically — no risk of breaking other servers. Connecting Cursor Save the JSON block from Quick Connect as ~/.cursor/mcp.json. You can also reach this file from inside Cursor at Settings → Cursor Settings → MCP. If the file already exists with other content, see the FAQ. Claude Desktop and other clients Claude Desktop does not speak HTTP MCP, so it needs a small bridge and a config file of its own. Any other client (Codex CLI, Continue, Cline, Antigravity, Zed, or your own) takes the two raw values Quick Connect exposes: the server URL and the Authorization header. Both cases are covered in the FAQ, together with how to merge VigIA into a config file that already exists without losing what is in it. Read-only mode If you only want your AI to consult VigIA (not change anything), enable “Read-only mode” in the MCP tab. While on, write actions (block, unblock, robots changes) return a permission denied error. Read actions (statistics, top crawlers, blocked items, robots rules) keep working. The toggle stores a vigia_mcp_read_only option that hooks into the vigia_can_write_via_abilities filter. Developers can still force read-only from a mu-plugin: add_filter( 'vigia_can_write_via_abilities', '__return_false' ); The mu-plugin filter at the default priority takes precedence over the toggle. Who can reach the endpoint The endpoint requires the capability to manage options, the same one every tool behind it already asked for. The vigia_mcp_transport_capability filter can lower that bar; each tool keeps its own permission check. After connecting Restart your MCP client after adding the server so it picks up the new tools. Then try a few prompts to confirm everything is wired up: “Show me VigIA crawler stats for the last 7 days.” “List the top 5 most crawled pages on this site.” “Add a robots.txt Disallow rule for TestBot and then list the current AI crawler rules.” The third example exercises a read + write + read round-trip, which is the most complete sanity check. Support Need private support or custom development? Do you need one-on-one help, priority troubleshooting, or a custom feature, integration, or tweak built specifically for your site? I offer private support and custom development. Just contact me and tell me what you need. Need help or have suggestions? Official website WordPress support forum YouTube channel Documentation and tutorials Love the plugin? Please leave us a 5-star review and help spread the word! About AyudaWP We are specialists in WordPress security, SEO, AI and performance optimization plugins. We create tools that solve real problems for WordPress site owners while maintaining the highest coding standards and accessibility requirements.