A clearer look at the front door

Is your website open to the right bots?

See whether useful crawlers are welcomed, unwanted automation is discouraged, and the places most likely to be abused show visible protection.