BAd bot varies depending on who you will ask, they are the spiders that do a lot more harm than good on your website (ie: an email harvester). A website ripper on the other hand are offline browsing programs that a surfer may unleash on your website to crawl and download every one of its pages for offline viewing. In both cases, both your website’s bandwidth and resource usage are jacked up as a result, this can sometimes to the point of crashing your server. Bad bots typically ignore the wishes of your robots.txt file, so you’ll want to ban them using means such as .htaccess.
GD Star Rating
loading...
loading...
GD Star Rating
loading...
loading...
Related posts:
Posted under Linux Hosting
This post was written by admin on October 18, 2008
