zlacker

[parent] [thread] 1 comments
1. 50+(OP)[view] [source] 2023-07-20 18:35:20
what about the robots meta tags[1], e.g., noindex, nofollow, noarchive?

1: https://developers.google.com/search/docs/crawling-indexing/...

replies(1): >>tenplu+m1
2. tenplu+m1[view] [source] 2023-07-20 18:40:27
>>50+(OP)
This is actually the correct way. Robots.txt only stops google from crawling your website, but it might still appear in the index. If you search for the site, then it is shown in the search results, but without any of the content of the page. If you want to prevent indexing as well, you'll have to do this.

Also explained here: https://developers.google.com/search/docs/crawling-indexing/...

[go to top]