robots-txt-ai-crawler-audit
io.github.jmshinhwa/robots-txt-ai-crawler-audit
95
security score
Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI
Security scan
Last scanned 21 hours ago — static analysis of the published manifest.
- lowManifest makes network requests.