I have incorporated google analytic code into my website, however, I don't want Google to crawl through my website for some days. If I run "robot.txt", still my website can be viewed in google search result page. I don't want it to be shown at all for the specified period of time? How can I stop google from crawling my website? Also, how can I set the duration?


You need to set below code in robot.txt ( you need to stop googlebot looking at your website )

  • User-Agent: googlebot
  • Disallow: /

Its not happen in one day, Its take some time when google next time crawling your website then it not access your website.

Not the answer you're looking for? Browse other questions tagged or ask your own question.