Agent Access Check

Before fetching a site: will it let an AI agent in (CAPTCHA, robots), and where is its agent door?