How Can I Avoid The Crawler Of Google? How can i avoid the crawler of google?

[xhrist14n 0]

I want to avoid the crawler of google into the contents of mi site.How can i avoid the google crawler ?regardschristian

[yordan 10]

Have a look at the robots.txt syntax. The crawlers read the info in that file. If this file tells them not to crawl your site, they don't.

[HannahI 0]

I think you need to tell Google to search your page, but I'm not sure.

[yordan 10]

I think you need to tell Google to search your page, but I'm not sure.

No, Google looks at your page without any advice from you.

[takerraj 0]

What is your publishing platform? If you are using wordpress then you can easily block crawlers by using the inbuilt function. In wordpress, under settings, you will have blog visibility option. Select "I would like to block search engines and allow visitors". That's it. You are done.If you are using other platform, then let me know, I'll try to help you out.

Edited November 25, 2009 by takerraj (see edit history)