octocrawl

Web scraper for agents: blocked, empty and wrong pages reported as such, with an Evidence Record.