zlacker

>Search engines operate under the assumption that they have permission to access any public available server unless explicitly forbidden.

And why should opt-out be a reasonable norm? To be clear, the internet (among many other things) breaks down if every exchange of information is opt-in. Sharing of photographs taken in public places is another example. But the internet basically functions because people share information on an opt-out basis (that may or may not even be respected).