Search found 2 matches
- Mon Sep 03, 2018 12:02 am
- Forum: Off Topic Section
- Topic: Google 404 error re:robots.txt
- Replies: 2
- Views: 2131
Re: Google 404 error re:robots.txt
Thank you baconfries for your reply. On further investigation with Google, I find the error refers to the last crawl of the former site (same name), last crawled prior to the WBB site going live. So the WBB site is OK. No need for a robots file, no page is excluded. Panic over! And a great forum!! T...
- Sun Sep 02, 2018 9:33 pm
- Forum: Off Topic Section
- Topic: Google 404 error re:robots.txt
- Replies: 2
- Views: 2131
Google 404 error re:robots.txt
This site (byrobbie(dot)co(dot)nz has been live for 3 weeks and Google has just reported that one page is not indexed. (accessories). Google seems to be looking for a robots.txt file. I have put INDEX:follow on all pages under page properties and I cannot see how to generate a robots.txt file like m...