Mike Shor: Web Log Customization Files




I use Analog for my log analysis. Over the years, I have developed a rather comprehensive list of search engines (over 10,000). Also, I keep several other types of configuration files. This list is updated (roughly) quarterly.

Last Update: 3 May 2007

Note: the ref-spam list has grown a bit beyond its original use, and now lists quite a few other kinds of baddies (made-for-Google, phishing, etc.)

Currently, the files below contain: The files:



To use these files, simply save them in your analog directory, and add the following to your analog.cfg file:

CONFIGFILE SearchEngines.txt
CONFIGFILE RobotInclude.txt
CONFIGFILE TypeAlias.txt
CONFIGFILE RefSpam.txt

Please send any corrections or additions to: analog AT mikeshor.com
Back to my homepage