Etiqueta del plugin: crawler
-
AI Bot Monitor
Tracks and logs AI, Search and Social bots including ChatGPT, Perplexity, Googlebot, Bing and Meta crawlers.
-
ADG Markdown for AI Crawlers
Serve AI crawlers clean Markdown of your content on the same URL, and auto-generate llms.txt / llms-full.txt (with an on-disk fallback).