پلگ ان ٽيگ: crawlers
-
Robots.txt rewrite
Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
-
Block AI Crawlers
Tells AI (Artificial Intelligence) companies not to scrap your site for their AI products.
-
Dark Visitors
Generate a robots.txt to opt out of AI training. Get realtime analytics on the AI agents, crawlers, scrapers, and other bots visiting your website.
-
Robots Meta Whiz
Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.
-
-
Seo Crawlytics Data Export & Delete
Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.
-
Log-Hero.com Plugin
Analyze how search engines and other bots crawl and understand your web page. The official PHP Wordpress plugin for log-hero.com.
-
-
AI Rights Protection by SimpleFeed
Protect your rights by reviewing and blocking AI bots from using your content without compensation.
