Buscaplus Robi/1.0 (http://www.buscaplus.com/robi/)  	Buscaplus (Spain) robot  	R  	Info
BW-C-2.0  	Logitech Desktop Managers (LDM) Backweb (BW) update check  	D  	Info
CamelHttpStream/1.0  	Evolution integrated mail solution Camel TCP stream class  	  	Info
Cancer Information and Support International;  	Some user agent   	  	Info
carleson/1.0  	Cosmix project crawler (204.14.48.x / 38.113.234.xxx)  	R  	Info
Carnegie_Mellon_University_Research_WebBOT-->PLEASE READ-->http://www.andrew.cmu.edu/~brgordon/webbot/index.html http://www.andrew.cmu.edu/~brgordon/webbot/index.html  	Carnegie Mellon University WebBOT  	R  	Info
Carnegie_Mellon_University_WebCrawler http://www.andrew.cmu.edu/~brgordon/webbot/index.html  	Carnegie Mellon University WebBOT  	R  	Info
Catall Spider  	Catall.de search & web directory (Germany)  	R  	Info
CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com)  	UIUCs Cazoodle search based on MetaQuerier  	R  	Info
ccubee/x.x  	Empyreum Ccubee (Czech) search engine solution  	R  	Info
CE-Preload  	Cisco Content Engine  	P  	Info
Ceramic Tile Installation Guide (http://www.floorstransformed.com)  	Floortransformed.com robot (link ckecking ??)  	R  	Info
cfetch/1.0  	Cosmix project crawler (204.14.48.x / 38.113.234.xxx)  	R  	Info
CFNetwork/x.x  	MaxOS X CoreFoundation CFNetwork API  	  	Info
cg-eye interactive  	cg-eye CGI checker  	  	Info
Charon/1.x (Amiga)  	Charon Amiga download manager  	D  	Info
Checkbot/1.xx LWP/5.xx  	Checkbot link validation  	C  	Info
CheckLinks/1.x.x  	Checklinks - Perl link checker  	C  	Info
CheckUrl  	NTL user agent  	  	Info
CheckWeb  	CheckWeb link validation  	C  	Info
Chilkat/1.0.0 (+http://www.chilkatsoft.com/ChilkatHttpUA.asp)  	Chilkat HTTP component user-agent  	  	Info
China Local Browse 2.6  	Unknown spam bot from telekom.com.my (218.111.83.xxx)  	S  	Info
ChristCRAWLER 2.0  	Christcentral.com Christcrawler (was www.christcrawler.com)  	R  	Info
CHttpClient by Open Text Corporation  	CHttpClient - C++ class using WinInet  	  	Info
CipinetBot (http://www.cipinet.com/bot.html)  	CipinetBot -Cipinet Search Engine Web Crawler  	R  	Info
CJ Spider/  	Commision Junction link checking spider  	C  	Info
CJB.NET Proxy  	CJB Net anonymous socks proxy service (216.194.70.x)  	P  	Info
ClariaBot/1.0  	Claria (ex Gator) SearchScout robot (64.152.73.xx)  	R  	Info
Claymont.com  	Claymont Search robot  	R  	Info
CloakDetect/0.9 (+http://fulltext.seznam.cz/)  	Seznam Search (Czech Republic) robot  	R  	Info
Clushbot/2.x (+http://www.clush.com/bot.html)  	Clush clustered search robot  	R  	Info
Clushbot/3.x-BinaryFury (+http://www.clush.com/bot.html)  	Clush clustered search robot  	R  	Info
Clushbot/3.xx-Ajax (+http://www.clush.com/bot.html)  	Clush clustered search robot  	R  	Info
Clushbot/3.xx-Hector (+http://www.clush.com/bot.html)  	Clush clustered search robot  	R  	Info
Clushbot/3.xx-Peleus (+http://www.clush.com/bot.html)  	Clush clustered search robot  	R  	Info
COAST WebMaster Pro/4.x.x.xx (Windows NT)  	COAST Webmaster - Web management and maintenance software  	  	Info
CoBITSProbe  	Proposed Content-Based Image Tracking System (CoBITS) P2P crawler  	R C  	Info
Cocoal.icio.us/1.0 (v36) (Mac OS X; http://www.scifihifi.com/cocoalicious)  	Cocoa del.icio.us (social bookmarks manager) client for Mac OS X  	C  	Info
ColdFusion  	Cold Fusion server used by various IPs i.e.: - NetWORLD web catalogue link checking  	P C  	Info
ColdFusion (BookmarkTracker.com)  	Cold Fusion server used by Bookmark Tracker - online favourites managment  	C  	Info
collage.cgi/1.82  	WebCollage Syndicator graphics crawler/collector  	R D  	Info
combine/0.0  	Combine harvesting & indexing robot  	R  	Info
Combine/2.0 http://combine.it.lth.se/  	Combine harvesting & indexing robot  	R  	Info
Combine/3 http://combine.it.lth.se/  	Combine harvesting & indexing robot  	R  	Info
Combine/x.0  	Combine harvesting & indexing robot  	R  	Info
cometrics-bot, http://www.cometrics.de  	cometrics Web Content Mining solution - Germany  	R  	Info
Commerce Browser Center  	Wildsoft Germany (closed) Internet client system user-agent (was www.oskarweb.de)  	B   	Info
complex_network_group/Nutch-0.9-dev (discovering the structure of the world-wide-web; http://cantor.ee.ucla.edu/~networks/crawl; nimakhaj@gmail.com)  	UCLA Complex Networks Groups Complex Network Analysis  	C  	Info
Computer_and_Automation_Research_Institute_Crawler crawler@ilab.sztaki.hu  	Hungarian Academy of Sciences data mining search  	R  	Info
Comrite/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)  	ComRite Chinese Search Engine for Oversea Web Sites (69.248.26.xx)  	R  	Info
Contact  	unknown   	  	Info
ContactBot/0.2  	Probably E-Mail harvesting robot - same as LMQueueBot  	S  	Info
ContentSmartz  	ContentSmartz e-mail harvesting tools  	S   	Info
contype  	Internet Explorer versions 4.x and 5 plugin content  	B  	Info
Convera Internet Spider V6.x  	Converas RetrievalWare Internet Spider (63.241.61.x)  	R  	Info
ConveraCrawler/0.2  	Converas RetrievalWare Internet Spider (63.241.61.x)  	R  	Info
ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl)  	Converas RetrievalWare Internet Spider (63.241.61.x)  	R  	Info
ConveraMultiMediaCrawler/0.1 (+http://www.authoritativeweb.com/crawl)  	Converas RetrievalWare Internet Spider (63.241.61.x)  	R  	Info
CoolBot  	Suchmaschine21 (Germany) robot  	R  	Info
CoralWebPrx/0.1.17 (See http://coralcdn.org/)  	Coral Content Distribution Network  	P C  	Info
cosmos/0.8_(robot@xyleme.com)  	Xyleme SA France robot  	R  	Info
cosmos/0.9_(robot@xyleme.com)  	Xyleme SA France robot  	R  	Info
CoteoNutchCrawler/Nutch-0.9 (info [at] coteo [dot] com)  	Coteo.com - local French directory link checking  	C  	Info
CougarSearch/0.x (+http://www.cougarsearch.com/faq.shtml)  	Cougarsearch.com robot  	R  	Info
Cowbot-0.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)  	Naver Japan / Korea robot  	R  	Info
Cowbot-0.1.x (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)  	Naver Japan / Korea robot  	R  	Info
CrawlConvera0.1 (CrawlConvera@yahoo.com)  	Converas RetrievalWare Internet Spider  	R  	Info
Crawler  	unknown.Level3.net robot   	  	Info
Crawler (cometsearch@cometsystems.com)  	Cometsystems Comet Search robot via Findwhat (now Miva)  	R  	Info
Crawler admin@crawler.de  	Crawler.de / Abacho robot  	R  	Info
Crawler V 0.2.x admin@crawler.de  	Crawler.de / Abacho robot  	R  	Info
crawler@alexa.com  	Alexa crawler  	R  	Info
CrawlerBoy Pinpoint.com  	Pinpoint WAP search robot  	R  	Info
Crawllybot/0.1 (Crawllybot; +http://www.crawlly.com; crawler@crawlly.com)  	Crawlly Beta search - Germany (72.232.194.2xx)  	R  	Info
CreativeCommons/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net)  	Creatice Commons using Nutch open source robot  	R  	Info
CrocCrawler vx.3 [en] (http://www.croccrawler.com) (X11; I; Linux 2.0.44 i686)  	Croccrawler robot  	R  	Info
csci_b659/0.13  	Web mining project from CSCI 659 (computer science course) at Indiana Univerity  	R  	Info
CSE HTML Validator Professional (http://www.htmlvalidator.com/)  	CSE HTML Validator for Windows  	C  	Info
Cuam Ver0.050bx  	Cuam - IE based browser  	B  	Info
Cuasarbot/0.9b http://www.cuasar.com/spider_beta/   	Cuasar (Spain) music / ringtone search spider  	R  	Info
curl/7.10.x (i386-redhat-linux-gnu) libcurl/7.10.x OpenSSL/0.9.7a ipv6 zlib/1.1.4  	Curl file transferring tool  	D  	Info
curl/7.7.x (i386--freebsd4.3) libcurl 7.7.x (SSL 0.9.6) (ipv6 enabled)  	Curl file transferring tool  	D  	Info
curl/7.8 (i686-pc-linux-gnu) libcurl 7.8 (OpenSSL 0.9.6)  	Curl file transferring tool  	D  	Info
curl/7.9.x (win32) libcurl 7.9.x  	Curl file transferring tool  	D  	Info
CurryGuide SiteScan 1.1  	CurryGuide UK link check robot  	R  	Info
Custo x.x (www.netwu.com)  	Custo web site spidering tool (link checking)  	C  	Info
Custom Spider www.bisnisseek.com /1.0  	Bisnisseek (was www.bisnisseek.com) robot  	R   	Info
Cyberdog/2.0 (Macintosh; 68k)  	Cyberdog Mac Browser (was www.cyberdog.org)  	B   	Info
CyberSpyder Link Test/2.1.12 (admin@mspennyworth.com)  	CyberSpyder Link Test software  	C  	Info
CydralSpider/1.x (Cydral Web Image Search; http://www.cydral.com)  	Cydral image & site search spider  	R  	Info
DA 3.5 (www.lidan.com)  	Downloadaccelerator download manager  	D  	Info
DA 4.0  	Downloadaccelerator download manager  	D  	Info
DA 4.0 (www.downloadaccelerator.com)  	Downloadaccelerator download manager  	D  	Info
DA 5.0  	Downloadaccelerator download manager  	D  	Info
DA 7.0  	Downloadaccelerator download manager  	D  	Info
Dart Communications PowerTCP  	PowerTCP ActiveX control tool  	  	Info
DataCha0s/2.0  	Unknown bot from Kornet Korea (218.149.129.xxx) scans for Perl Awstats  	S   	Info
DataCha0s/2.0  	Unknown UA looking for Awstats Perl components  	S  	Info
DataFountains/DMOZ Downloader  	INFOMINE/iVia Scholary Internet Resource Collections robot  	R  	Info
DataFountains/Dmoz Downloader (http://ivia.ucr.edu/useragents.shtml)  	INFOMINE/iVia Scholary Internet Resource Collections robot  	R  	Info
DataFountains/DMOZ Feature Vector Corpus Creator (http://ivia.ucr.edu/useragents.shtml)  	INFOMINE/iVia Scholary Internet Resource Collections robot  	R

Info
DataparkSearch/4.47 (+http://dataparksearch.org/bot)  	DataparkSearch open source search engine  	R  	Info
DataparkSearch/4.xx (http://www.dataparksearch.org/)  	DataparkSearch open source search engine  	R  	Info
DataSpear/1.0 (Spider; http://www.dataspear.com/spider.html; spider@dataspear.com)  	DataSpear Directory robot (24.109.29.xx)  	R  	Info
DataSpearSpiderBot/0.2 (DataSpear Spider Bot; http://dssb.dataspear.com/bot.html; dssb@dataspear.com)  	DataSpear Directory robot (24.109.29.xx)  	R  	Info
DatenBot( http://www.sicher-durchs-netz.de/bot.html)  	Sicher-durchs-Netz German security related search (62.75.220.xxx)  	R  	Info
DaviesBot/1.7 (www.wholeweb.net)  	Wholeweb robot  	R  	Info
daypopbot/0.x  	Daypop blog - weblog - online mag search spider  	R  	Info
dbDig(http://www.prairielandconsulting.com)  	dbDig search engine  	R  	Info
DBrowse 1.4b  	Some site scanning tool via diff. IPs i.e.: - wanweb.net (208.6.163.xxx) - cox.net (68.4.xxx.xxx)  	S  	Info
DBrowse 1.4d  	Some site scanning tool via diff. IPs i.e.: - pacbell.net (67.112.xxx.xxx)  	S  	Info
DC-Sakura/x.xx  	DC-Sakura download manager  	D  	Info
dCSbot/1.1  	unknown divine/Openmarket.com robot  	R   	Info
DDD  	some (website) downloading tool  	D   	Info
dds explorer v1.0 beta  	user agent   	  	Info
de.searchengine.comBot 1.2 (http://de.searchengine.com/spider)  	Searchengine.com (Germany) submission checking / robot (84.73.57.xx)  	R  	Info
DeadLinkCheck/0.4.0 libwww-perl/5.xx  	DLC Perl HTTP link checking  	C  	Info
Deep Link Calculator v1.0  	Sootle Web Directory deep link checker  	C  	Info
deepak-USC/ISI  	deepak-USC/ISI robot from USC/Information Science Institute  	R  	Info
DeepIndex  	Deepindex robot  	R  	Info
DeepIndex ( http://www.zetbot.com )  	Zetbot search Belgium (213.41.128.xx) using Deepindex robot  	R  	Info
DeepIndex (www.en.deepindex.com)  	Deepindex robot  	R  	Info
DeepIndexer.ca  	Deepindex robot (via Paragon.net Canada)  	R  	Info
del.icio.us-thumbnails/1.0 Mozilla/5.0 (compatible; Konqueror/3.4; FreeBSD) KHTML/3.4.2 (like Gecko)  	del.icio.us picture robot for thumbnail preview via Yahoo  	D  	Info
DeleGate/9.0.5-fix1  	DeleGate application level gateway / proxy server  	P  	Info
Demo Bot DOT 16b  	Some site scanning tool from 217.34.59.xxx (btopenworld.com)  	S   	Info
Demo Bot Z 16b  	Some site scanning tool from 68.154.96.xx (bellsouth.net)  	S  	Info
Denmex websearch (http://search.denmex.com)  	Denmex Websearch robot/link checking  	R  	Info
Der groЯe BilderSauger 2.00u  	DataBecker Bilder Sauger (discontinued) web graphics downloader  	D  	Info
dev-spider2.searchpsider.com/1.3b  	Searchspider.com robot (72.245.225.xxx)  	R  	Info
DevComponents.com HtmlDocument Object  	DevComponents HTMLDocument Class Library for Visual Studio.net  	  	Info
DiaGem/1.1 (http://www.skyrocket.gr.jp/diagem.html)  	DiaGem Japan web crawler  	R  	Info
Diamond/x.0  	Claria (ex Gator) SearchScout robot (64.152.73.xx)  	R  	Info
DiamondBot  	Claria (ex Gator) SearchScout robot (64.152.73.xx)  	R  	Info
Digger/1.0 JDK/1.3.0rc3  	Diggit! robot  	R  	Info
DigOut4U  	OpenPortal4U robot  	R  	Info
DIIbot/1.2  	Findsame.com (site is offline) / Digital-Integrity robot  	R  	Info
Dillo/0.8.5-i18n-misc  	Dillo Web Browser  	B  	Info
Dillo/0.x.x  	Dillo Web Browser  	B  	Info
DISCo Pump x.x  	DISCo Pump offline browser / website ripper  	D  	Info
DittoSpyder  	Ditto picture search robot  	R  	Info
dlman  	some download agent  	D  	Info
dloader(NaverRobot)/1.0  	Naver Japan / Korea robot  	R  	Info
DoCoMo/1.0/Nxxxi/c10  	NTT DoCoMo (Japan) robot  	R  	Info
DoCoMo/1.0/Nxxxi/c10/TB  	NTT DoCoMo (Japan) robot  	R  	Info
DoCoMo/1.0/P502i/c10 (Google CHTML Proxy/1.0)  	Google (216.239.39.x) proxy server  	P   	Info
DoCoMo/2.0 P900iV(c100;TB;W24H11)   	NTT DoCoMo (Japan) robot  	R  	Info
DoCoMo/2.0 SH901iS(c100;TB;W24H12),gzip(gfe) (via translate.google.com)  	NTT DoCoMo (Japan) proxy server (210.136.161.1xx)  	P  	Info
DoCoMo/2.0/SO502i (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html)  	Yahoo Search Japan robot (203.216.197.xxx)  	R  	Info
DocZilla/1.0 (Windows; U; WinNT4.0; en-US; rv:1.0.0) Gecko/20020804  	DocZilla - Mozilla-based SGML/XML/HTML- browser  	B  	Info
dodgebot/experimental  	unknown robot from AGMLAB Information Technologies (Information retrieval system ?)  	R  	Info
DonutP; Windows98SE  	Donut P - Japanese IE based browser  	B  	Info
Download Demon/3.x.x.x  	Download Demon/Netzip download manager  	D  	Info
Download Druid 2.x  	Download Druid IE plugin download manager  	D  	Info
Download Express 1.0  	Download Express download manager  	D  	Info
Download Master  	Download Master download manager  	D  	Info
Download Ninja 3.0  	Download Ninja download manager (Japan)  	D  	Info
Download Wonder  	Download Wonder download manager  	D  	Info
Download-Tipp Linkcheck (http://download-tipp.de/)  	Download-Tipp Germany link checking  	R  	Info
Download.exe(1.1) (+http://www.sql-und-xml.de/freeware-tools/)  	download.exe .NET based downloading tool  	D  	Info
Dr.Web (R) online scanner: http://online.drweb.com/  	Dr.WEB online virus scanner  	  	Info
Dragonfly File Reader  	Dragonfly CMS - Open Source content management system  	B  	Info
Drecombot/1.0 (http://career.drecom.jp/bot.html)  	Drecom Japan (210.233.67.xxx) - Blog search ??  	R  	Info
Drupal (+http://drupal.org/)  	Drupal - open source content management platform  	C  	Info
DSurf15a 01  	Some site scanning tool via diff. IPs i.e.: - cox.net (68.5.xxx.xxx) - pacbell.net (64.16x.xxx.xxx)  	S  	Info
DSurf15a 71  	Some site scanning tool via diff. IPs i.e.: - cox.net (68.4.xxx.xxx)  	S  	Info
DSurf15a 81  	Some site scanning tool via diff. IPs i.e.: - verizon.net (4.47.xxx.xxx)  	S  	Info
DSurf15a VA  	Some site scanning tool via diff. IPs i.e.: - eastlink.ca (24.222.xxx.xxx) - cogeco.net (216.221.8x.xxx)  	S   	Info
DTAAgent  	DTAAgent Java object for data collecting  	R D  	Info
dtSearchSpider  	dt Search Spider software  	R  	Info
Dual Proxy  	Fourelle Venturi proxy server  	P  	Info
Dumbot(version 0.1 beta - dumbfind.com)  	DumbFind.com robot  	R  	Info
Dumbot(version 0.1 beta - http://www.dumbfind.com/dumbot.html)  	DumbFind.com robot  	R  	Info
Dumbot(version 0.1 beta)  	DumbFind.com robot  	R  	Info
e-sense 1.0 ea(www.vigiltech.com/esensedisclaim.html)  	Vigiltech e-Sense user research robot (website is offline)  	R   	Info
e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/)  	e-Society Project (Japan) crawler (133.9.238.xx)  	R  	Info
EARTHCOM.info/1.x [www.earthcom.info]  	Earthcom (Czech Republic) search robot (194.108.39.xx)  	R  	Info
EARTHCOM.info/1.xbeta [www.earthcom.info]  	Earthcom (Czech Republic) search robot (194.108.39.xx)  	R  	Info
EasyDL/3.xx  	Keywen Encyclopedia Bot  	R  	Info
EasyDL/3.xx http://keywen.com/Encyclopedia/Bot  	Keywen Encyclopedia Bot  	R  	Info
EBrowse 1.4b  	Some site scanning tool via diff. IPs i.e.: - swbell.net (65.66.xxx.xxx)  	S   	Info
eCatch/3.0  	eCatch (now Wysigot) offline browser  	B D  	Info
EchO!/2.0  	Echo.fr robot  	R  	Info
Educate Search VxB  	Some site scanning tool via diff. IPs i.e.: - cox.net (68.4.xxx.xxx)  	S  	Info
egothor/3.0a (+http://www.xdefine.org/robot.html)  	Xdefine text search engine robot - based on Egothor open source crawler  	R  	Info
EgotoBot/4.8 (+http://www.egoto.com/about.htm)  	Egoto Search robot  	R  	Info
ejupiter.com  	eJupiter searcg robot (206.191.49.xx)  	R  	Info
EldoS TimelyWeb/3.x  	TimelyWeb web page monitoring tool  	C  	Info
elfbot/1.0 (+http://www.uchoose.de/crawler/elfbot/)  	Elftales crawler for uChoose theme based search (Germany)  	R  	Info
ELI/20070402:2.0 (DAUM RSS Robot, Daum Communications Corp.; +http://ws.daum.net/aboutkr.html)  	DAUMOA - RSS search robot of Daum  	R  	Info