khan11 0 Report post Posted July 13, 2006 hello guys,i dont know much about seo system,but i heard google crawls any website after 1 week,is it true or its google's choice to crawl any site?i know its kiddy question but i cant solve this in my mind. Share this post Link to post Share on other sites
T100 0 Report post Posted July 13, 2006 You can summit your site to google for crawling and google will index your page shortly. If you do not publicize your website, google will not know your existence until someone who likes your site put a hyperlink pointing to your site. Google will then follow the link and crawling onto your website. Google bot is a very diligent bot, you have to expect a high bandwidth use if you intend to have google index your page. You can preserve your bandwidth by editing a robots.txt file. You may either prohibit google from crawling your site, or prevent it from indexing some of your pages. (images take up the most bandwidth.) Share this post Link to post Share on other sites
khan11 0 Report post Posted July 13, 2006 i dont know how to create robots.txt file so you will be laughing to read that i created robots.txt and written nothing in it and then uploaded on my webserver coz i dont know what to write in it. Share this post Link to post Share on other sites
Sinari 0 Report post Posted July 15, 2006 I think that Google crawls them in a week- but I have yet to be listed in the Google search anywhere. I've been in the "crawling" list for a few weeks, but still nothing. Not sure how it works yet, but any advice would definently help. Share this post Link to post Share on other sites
Florisjuh 0 Report post Posted July 18, 2006 Google Crawl bot is one of the smartest bots ever, if your site has usefull information on it the bot will find it Share this post Link to post Share on other sites
kbsp 0 Report post Posted July 27, 2006 so these bots use up a lot of bandwidth how much are we talking im saying like for a forums like this...and i hear they even crawl peoples pm is that trueso they download files off the site too? Share this post Link to post Share on other sites
Malexos 0 Report post Posted July 28, 2006 I don't think they search peoples PM's, otherwise, my whole dirty conversation with my girlfriend would've been public . . . Aww, crap!(No, they can't crawl PM's, without your password, and username, just public pages with no special privalages needed) Share this post Link to post Share on other sites
Dooga 0 Report post Posted July 28, 2006 Google usually crawls every site that people submit, with an exception of sites that were previously banned from their system (usually because you used some "under the table" method to increase your rank, which includes stuff like redirecting other sites, having too many irrelevant keywords, etc.) Share this post Link to post Share on other sites
khan11 0 Report post Posted July 30, 2006 i think or im sure that google dont needs any user or pass to login to crawl the pages coz alot of times i check from my admin panel that someone is crawling many pages without getting logged in.This means its the google bot.Its up to webmaster that if he put google ads in Private Messaging page then google will surely crawl that area.Guys i heard that we can put some code to not allow google to crawl the page we dont want to.So if some of you know please share here.Thanks in advance. Share this post Link to post Share on other sites
arnz 0 Report post Posted August 1, 2006 I've noticed that on some boards, that Google comes up under the "users" browsing bars when it comes to viewing some Invision powered forums. Share this post Link to post Share on other sites
brandice 0 Report post Posted August 1, 2006 I'm sure that submitting your site to google might help, but I have never submitted the site that I have now. I've just added links to the site in all of my BBS profiles and on my Myspace page. I got spidered and put on google much faster that way, for some reason. Share this post Link to post Share on other sites
trace-uk 0 Report post Posted August 2, 2006 providing you've got linsk to your site out there on well-used and well-crawled websites and submitted your new url to google, it usually is done very qucikly. Though, expect google to only crawlt he idnex page of the new site. expect a 8 wekk wait for ti to have all the website's pages. you'd then need to wait utnilt he next google update to even think about getting it in the serps. usually it takes 2 updates, as by the first google update the search engines doesn't know about all the links to your site and rates it poorly. Share this post Link to post Share on other sites
richierich1m 0 Report post Posted December 28, 2006 No its not fixed like this some sites get crwaled even after a mont and some sites may get crawled in plain two days like one of my site did Share this post Link to post Share on other sites
zamaliphe 0 Report post Posted February 1, 2007 I'm sure that submitting your site to google might help, but I have never submitted the site that I have now. I've just added links to the site in all of my BBS profiles and on my Myspace page. I got spidered and put on google much faster that way, for some reason.i did submit my site to google and 4 Weeks so far nothing happens i think i have to add meny liks to my web site every wear to be added fast to google i'm gona try your way and see Share this post Link to post Share on other sites
richierich1m 0 Report post Posted February 1, 2007 There isn't a definate period for google to crwal the site ,i see sometimes it index my site once in two days and sometimes not even in a month ,i think it scans the site everytime it somes to your site through a link ,so the more links you have to your site the more it comes to your site for indexing , so get as much link as u can get ,its really worth it Share this post Link to post Share on other sites
