پلگ ان ٽيگ: crawler
-
SEObot Monitor for Googlebot, Bingbot and search engine spiders
With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …
-
Berq Markdown: Markdown Pages for AI & LLM Crawlers
Increase your AI visibility. Berq Markdown serves every page as a clean Markdown file so AI assistants and LLM crawlers can read, cite, and recommend …
-
-
Robots.txt Extender
Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
JaspreetChahal’s wordpress bot detector lite
This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …
-
-
AI Crawlers Visibility, Analytics & Control
Monitor, block, and analyze AI crawlers like GPTBot, ClaudeBot, and Google-Extended on your WordPress site.
-
Whizz MD — Markdown Endpoints for AI Crawlers
Serve every WordPress post and page as a clean .md file with full SEO frontmatter — discoverable by AI crawlers and search engines on the fly.
-
Pixellize Site Issue Scanner
Powerful SEO auditor by Pixellize. Crawls your site to fix broken links, missing meta tags, and unoptimized images.
-
Cleotic AI Traffic
See AI crawler visits and AI assistant referrals on your site, with optional signed sync to Cleotic.
-
WEO LLMS & AI Crawler Guide
The professional architect for your llms.txt file. Control how AI agents (ChatGPT, Claude, Perplexity) consume your website content with a structured, …
-
OpenBotAuth – AI Crawler Access Control
Verify AI crawlers with HTTP Signatures and enforce allow/deny/teaser policies; also serves llms.txt and AI-ready feeds.
-
Aiso AI Crawler Analytics
See which AI assistants — ChatGPT, Claude, Perplexity, Google and more — crawl your site, broken down by assistant, crawler, purpose and page.
-
OtterFixer AI Bot Tracker
A lightweight plugin that logs visits from common AI/LLM crawler user-agents and shows a simple report in wp-admin.
-
Crawl Hunt – Advanced SEO Optimization Tool
A powerful website crawler and monitoring tool for WordPress.
-
FacetFence Product Filters
Protect WooCommerce filtered URLs from crawl floods with noindex/canonical controls, signed cookies, rate limits, logs, and rollback.
-
LLMAffiliate AI Traffic Monetizer
Detect LLM user agents, enforce Google parity, and serve enhanced content through a configurable content service.
-
Valvai – AI Traffic Control Center
Block, log and monetise AI crawlers directly from your WordPress dashboard.
-
AI Kansoku Lab Tracker
Track AI crawler visits such as GPTBot, ClaudeBot, and PerplexityBot server-side and visualize them in WordPress.
-
AI Visibility Control – Dynamic llms.txt & robots.txt Crawler Control
Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.
