![[Home]](http://fantomaster.com/images/shim.gif)
fantomas spiderSpy™
Whether you are optimizing your web pages by meta tags, by employment of gateways or by straight cloaking technology — you will always want to know exactly what you are actually up against. If there's one thing you can do without, it's anonymous, unreferenced search engine spiders.
If you are a freelancing search engine positioning artist, you will require precise and up-to-date information on who and what you are dealing with. Your clients can't wait to see their web sites posted and ranking in the search engines' top range. But how will you get all those new or unknown spider names and IPs updated in time, with additional crawlers and search bots being implemented and combing the net every day?
And how will you effectively decipher your log files to evaluate your online marketing and search engine positioning efforts? How to recognize (and possibly filter or redirect) all those spiders that simply won't let on who they are by refusing to divulge their User Agent or domain name data when knocking on your virtual door? While there's a plethora of services and web sites out there offering sound and solid advice on search and submission issues, occasionally bundled with tons of technical data focusing on search robots, getting hold of a comprehensive list of spiders is well nigh impossible.
Existing lists accessible to the general public are either exclusively biassed towards the major players, blithely ignoring the fact that there are several thousand SEs now, all competing for a share of the cake.
Or, they tend to ignore all but the U.S. based engines, leaving all those webmasters out in the cold who are either themselves foreign based or interested in catering to the ever growing huge international clientele of an expanding, far from saturated global market.
(This is after all, let's not forget, the Internet!)
The botBase!
See what our fantomas spiderSpyTM service offers:
- list of world wide search engine IPs, User Agents and domain names — view here for list of currently covered engines
- with over 8,000 entries probably the world's most comprehensive botBase (appr. 880 spiders verified and referenced for Inktomi alone!)
- database is processed and updated every 6 hours
- full online access to our search engine database 24 hours a day, 7 days a week
- available in four formats: HTML, ZIP/TGZ, XML and CSV.
- free spider verification service: send us your log excerpts, IPs and/or UserAgent data and we will determine whether your site was visited by a search engine spider!
- feel free to submit your own established spider lists for verification and inclusion in the botBase
- invaluable and crucial information for every webmaster and internet entrepreneur
- less headaches keeping up-to-date — more resources to dedicate to your promotional efforts
- highly affordable, reliable service — invest pennies to make (or save) $$$
- free access to our special, subscribers only support forum at SearchEngineBase with its regular announcements of new additions to our botBase and other spider related topics
- the free fantomas spyFetcher™ (included) allows for automatic scheduled download of the botBase to your system. (For Unix/Apache + NT/IIS systems.)
Search Engine Optimization Services
Please have a look at our high end 3D Context Delivery™ search engine positioning service here.
If you wish to contact us directly by email about it, simply drop us a line: here!
Note that we will not sell, rent out or otherwise make available your email address or personal data to third parties.
If in doubt, please read our Privacy Statement.
