TestWorks Quality Index TM
Table II -- Definitions


Copyright © 1999-2006 by Software Research, Inc.

TestWorks Quality Index (TOP) Assess the quality of your quality process with the TestWorks Quality Index.
Table I -- Software Quality Process Filters Assesses relative advantages and disadvantages of various software quality methods.
Table II -- TestWorks Quality Index Definitions Summarizes the definitions of the factors that make up the TestWorks Quality Index and shows how to compute it for YOUR process.
Table III -- Product Application Profile Gives a recommended composition of use of TestWorks products and indicates likely CMM-like levels and relative overall process efficiencies.

This table shows how to compute the TestWorks Product Quality Index TM -- the "TestWorks Index." The index gives your organization the chance to assess how their internal software quality process is actually used on a particular product level and to compare their indicated product quality against current likely industry standards.

Each factor in the TestWorks Quality Index is evaluated so that a simple point value -- scored between 0 points and 100 points -- can be assigned depending on the guidelines given in the table below. The overall TestWorks Quality Index is the arithmetic average of the individual factors' scores (add up the ten scores and divide by 10).

TestWorks Quality Index: Definitions and Explanations

F#Evaluation Factor 50 Points 60 Points 70 Points 80 Points 90 Points 100 Points MY SCORE ON THIS FACTOR
F1 Cumulative C1 For All Tests > 25% > 40% > 60% > 85% > 90% > 95%
    
F2 Cumulative S1 For All Tests > 50% > 65% > 80% 90% 95% 95%
    
F3 Functions with E(n) < 20 < 25% > 25% > 50% > 75% > 90% > 95%
    
F4 Percent of Functions with "Clean" Static Analysis < 20% > 20% > 30% > 40% > 50% > 60%
    
F5 Last PASS/FAIL Percentage > 25% < 25% > 50% > 75% > 90% > 95%
    
F6 Total Number of Test Cases/KLOC > 10 < 10 > 15 > 20 > 30 > 40
    
F7 Calling Tree Aspect Ratio (Width/Height) > 1.0 < 1.25 < 1.5 < 1.75 < 2.0 > 2.0
    
F8 Number of OPEN Criticality 1 Defects/KLOC > 5 < 5 < 3 < 2 < 1 < 0.5
    
F9 Path Coverage Performed for % of Functions < 1% > 2% > 5% > 10% > 15% > 25%
    
F10 Cost Impact per Defect > $100K > $50K > $25K > $10K > $1K < $1K
    
 
TOTAL POINTS -> -> -> -> -> ->
     

Print this form and use it to compute the TestWorks Quality Index for your own project.