Jump to content
xisto Community
Sign in to follow this  
itssami

What Is "unknown Robot (identified By 'crawl') "

Recommended Posts

Hey...On my stats page of website , i see often this bot visits my website...Unknown robot (identified by 'crawl') I see it almost every second day .Can some one please tell me which companys bot it is and what is its purpose.Note: I have submitted my website to good and other search engines , a month ago , it is on Yahoo and msn already but its not on dmoz and google.Is it related to that bot etc ??

Share this post


Link to post
Share on other sites

There are many Search engines other than Google and Yahoo. The programmer who created your software added general Crawler recognisation code for major companies. For all other search engines whose crawling bots are not identified, it will show up as Unknown or Unidentified Bot.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
Sign in to follow this  

×
×
  • Create New...

Important Information

Terms of Use | Privacy Policy | Guidelines | We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.