I have incorporated google analytic code into my website, however, I don't want Google to crawl through my website for some days. If I run "robot.txt", still my website can be viewed in google search result page. I don't want it to be shown at all for the specified period of time? How can I stop google from crawling my website? Also, how can I set the duration?


You need to set below code in robot.txt ( you need to stop googlebot looking at your website )

  • User-Agent: googlebot
  • Disallow: /

Its not happen in one day, Its take some time when google next time crawling your website then it not access your website.

| improve this answer | |

Not the answer you're looking for? Browse other questions tagged or ask your own question.