Disk Scan Timing Tests

Home      What is a Trojan Horse?      How we reviewed anti-trojans     About us

Procedure

Running a scan timing test sounds simple enough.  Just fire up each scanner, scan the the same set of files and time each run. Then you print out a table ranking the products slowest to fastest.

The reality is a little more complicated:

  • Each anti-trojan program tested scans slightly different types of files and it's not possible to make every product scan exactly the same set of file types

  • Some programs carry out memory scans, registry scans and other non-disk operations before each disk scan and there is no way to defeat this arrangement by option settings

  • Some programs are more thorough in their scanning and consequently run slower because they are doing more

  • Different anti-trojans have differing numbers of trojans in their signature files.  Products with larger files will necessarily run slower.

  • Some products don't even tell you the number of files scanned!

Accepting these difficulties and the problems they present for accurate comparison, we chose to set up each product's scan options to represent the way the product would be likely to used in actual practice. Accordingly each anti-trojan was set up to scan all executables and archives as comprehensively as possible. Each product was then set up to scan the Windows directory on a test PC.  To eliminate disk caching distorting the results, the PC was rebooted before after each scan.

These tests were performed on three separate occasions; in August 2004 , August 2003 and August 2002 using on each occassion, the latest versions of the programs with their latest trojan signature databases.

In 2002 and 2003 the tests were carried out on the same PC, a now defunct P3 machine, using the same dataset which was restored from a disk image.

In 2004 the tests were carried out on a different PC, a modern 3.2Ghz P4 with 1GB of memory.  We also scanned a different data set, the system32  folder of that PC. This was chosen as virtually all files in that directory would be scanned by any of the products tested. This allows a fairer comparison between the products as each tends to scan somewhat different file types.  As in 2002/3, the PC was rebooted between timing tests to avoid disk caching distortion.

The results were as follows:

Scan Test Results - August 2004
  Scan time Files scanned Trojan Database Files/second
The Cleaner V3.5 3' 00" 6437 6641 36
Tauscan V1.6 1' 43" 5974 4562 58
PestPatrol 0' 32" 4663   145
Trojan Hunter V4.0 2' 03" est. 5970 3062 48
TDS-3 V3.2.1 3' 08" 5735 7486 31
a squared 1' 25" 5982   70
Ewido 1' 56" 5963   64

 

Scan Test Results - August 2003
  Scan time Files scanned Trojan Database Files/second
The Cleaner V3.5 41' 58" 22908 6641 9.1
Tauscan V1.6 13' 40" 8220 4562 10.2
PestPatrol 14' 36" 6211   7.1
Trojan Hunter V3.6 08' 21" not reported 3062 n.a.
TDS-3 V3.2.1 28' 35" 10466 7486 6.1

 

Scan Test Results - August 2002
  Scan time Files scanned Trojan Database Files/second
The Cleaner V3.5 33' 01" 20515 5122 10.4
Tauscan V1.6 11' 28" 8106 3430 12.3
PestPatrol V3.2 07' 03" 4051 11093 'pests' 9.6
Trojan Hunter 2.54 03' 08" not reported 959 n.a.
TDS-3 V3.2.1 29' 21" 10666 5041 7.0

 

BoClean could not be tested as it has no file scanning component.

Conclusions

So what does this mean?

We would be confident in saying that TDS-3 was the slowest to scan, however it was also the most thorough and it also scanned for the largest number of possible trojans.

Watching Trojan Hunter run, it appeared to be the quickest to scan but its rules database covers the fewest trojans  Note that Trojans Hunter's scan time has almost doubled between versions 2.54 and 3.6 largely reflecting the huge increase in the number of trojans included in the database from 959 to 3062.

The other products could, in principal, be ranked in the following order for scanning speed, quickest first.  However not too much import should be placed on the result.

  • Tauscan

  • The Cleaner

  • PestPatrol

 


Advertisements:

The Best Backup Software: 18 backup programs reviewed and rated but only one get "Editor's Choice"

Inkjet Printer cartridges: The best places to buy cheap inkjet cartridges. We looked at 47 seven sites but could only recommend eleven.


 

Anti-trojan Software Reviews Home Page