I've blocked webcrawlers from my websites for years now, so you can't find them on Google (or most other search engines). But plenty of people find them anyway because my audience shares links with each other, puts links on sites that are indexed by search engines, etc.
If I were addressing a more general audience, this might not work as well.