Alpha Aleu wrote:
There's another bot that's a spider,I believe,the MSN[Bot].
We don't need a list, but if you all really want them, then here are a list of most:
Majestic-12 [Bot]
MSN [Bot]
Yahoo [Bot]
Google [Bot]
AdsBot [Google]
Alexa [Bot]
Alta Vista [Bot]
Ask Jeeves [Bot]
Baidu [Spider]
Exabot [Bot]
FAST Enterprise [Crawler]
FAST WebCrawler [Crawler]
Francis [Bot]
Gigabot [Bot]
Google Adsense [Bot]
Google Desktop
Google Feedfetcher
Heise IT-Markt [Crawler]
Heritrix [Crawler]
IBM Research [Bot]
ICCrawler - ICjobs
MSN NewsBlogs
MSNbot Media
Metager [Bot]
NG-Search [Bot]
Nutch [Bot]
Nutch/CVS [Bot]
OmniExplorer [Bot]
Online link [Validator]
SEO Crawler
SEOSearch [Crawler]
Seekport [Bot]
Sensis [Crawler]
Seoma [Crawler]
Snappy [Bot]
Steeler [Crawler]
Synoo [Bot]
Telekom [Bot]
TurnitinBot [Bot]
Voyager [Bot]
W3 [Sitesearch]
W3C [Linkcheck]
W3C [Validator]
WiseNut [Bot]
YaCy [Bot]
Yahoo MMCrawler [Bot]
Yahoo Slurp [Bot]
YahooSeeker [Bot]
ichiro [Crawler]
psbot [Picsearch]
That list does not display every single Bot/Crawler, but most of them. These are good Bot's, in most ways.
