buddhapi's right about the meta-tag. But, I think that domaintools ignores those tags, as they're making money serving the copyright trolls these days.
If anyone has the IP address(es) of the domaintools robot spider, I'd like to know.
I want to add those to my .htaccess file, thereby blocking access to my site.
If your web server uses Apache, you can make an .htacess file, too.
S.G.
According to domain tools...
Robots.txt
A. Is SurveyBot compliant? SurveyBot obeys all known guidelines. If SurveyBot is denied access to a site it will not include web content from that website. However it will still record miscellaneous information such as what web server the site is running and the status of the website (active/parked/deleted).
SurveyBot uses a User Agent field to idenfiy itself to websites. The user agent will look like:
SurveyBot/2.3 (DomainTools)
D. Opting-out of Crawling SurveyBot only gathers one page per domain, the default document located at "/". But before we visit your website we will first consult the "/robots.txt" file to see if it has permission to crawl the entire site. SurveyBot bot looks for the following tags and that would stop the crawl and also remove your content from our website. The first tags bans all robots, the second group of tags only exclude SurveyBot.
User-agent: *
Disallow: /
User-agent: SurveyBot
Disallow: /
will post back when I get the ip address, as this would be the preferred method.
::EDIT:: It appears the Ip range for domaintools is 64.246.160.0 - 64.246.191.255