Jump to content
xisto Community
Sign in to follow this  
jcguy

Meta Tags To Stop Spiders

Recommended Posts

What are spiders and leaches?  Are spiders or leaches bad? If so what do they do?????

<{POST_SNAPBACK}>


Spiders are actually robots that crawl the web constantly by following links on a webpage to other pages. Because the web is made up of billions of web pages linked together, it is possible for the spiders to crawl the entire content of the web. That's how Google, with its spiders, can build a database for you to search.

 

As for leaches, I'm not very sure, but it sounds very scary

Share this post


Link to post
Share on other sites

Well, in this case, its spelt 'leeches'...Leeches are also automated robots or programs that search websites for files and mass-download them, eating up bandwidth. Leeches are also programs used by people on P2P networks to download files from a specific network without letting others access file from the leech....

Share this post


Link to post
Share on other sites

get around this

Meta Tags

 

If you want to use google to find pages like this, type this in the search box

 

"robots.Txt" disallow:" filetype:txt

 

-ladyzfirst

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
Sign in to follow this  

×
×
  • Create New...

Important Information

Terms of Use | Privacy Policy | Guidelines | We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.