SpyderTrax (=> SpiderTrax => Spider Tracks => Tracking Spiders!) is/was a way to accurately track the activity of search engine robot spiders/crawlers, which is good for SEO. I'm using "is/was" because although it is still used in many places, I haven't been promoting the program much in recent years, hence it has died off quite bit. I'll still give you a copy if you email me though!
SpyderTrax version 1.x and 2.x were programmed in Perl and used a flat-file database format. SpyderTrax 3.x is programmed in php and uses a MySQL database, which means that the program as a whole is much more compatible with a larger number of newer Websites using the LAMP stack.
The SpyderTrax perl/php programs were intended to be added as "includes" into Webpages. The allowed them to execute/run as the page was loaded so that it could process the requests (determine if the hit was coming from a robot/crawler and then record accordingly).
SpyderTrax also has a backend, which allows Webmasters to list all of the crawler hits, sorted by crawler, date, etc. FYI. In a much earlier day, when the script tracked only the Google spider, the program was known as "GoogleTrax"
Find the contact page on this site and ask for a copy!
Free Consultation
1-866-695-3949