Apdex (Application Performance Index) is an open standard developed by an alliance of companies. It defines a standard method for reporting and comparing the performance of software applications in computing. Its purpose is to convert measurements into insights about user satisfaction, by specifying a uniform way to analyze and report on the degree to which measured performance meets user expectations.
Contents
Problem addressed
When engaging in application performance management, for example in the course of Website monitoring, enterprises collect many measurements of the performance of information technology (IT) applications. However, this measurement data rarely provides a clear and simple picture of how well those applications are performing from a business point of view, a characteristic desired in metrics that are used as key performance indicators. Reducing measurement data to a single well understood metric is the ideal way to track and report on Quality of experience. Reporting several different kinds of data often confuses the picture, rather than clarifying it.
Measurements of application response times, in particular, can be obtained from many different measurement tools, yet once gathered, they are difficult to evaluate because:
The Apdex method seeks to address these problems.
Apdex method
Proponents of the Apdex standard believe that it offers a better way to measure what matters. The Apdex method converts many measurements into one number on a uniform scale of 0-to-1 (0 = no users satisfied, 1 = all users satisfied). The resulting Apdex score is a numerical measure of user satisfaction with the performance of enterprise applications. This metric can be used to report on any source of end-user performance measurements for which a performance objective has been defined.
The Apdex formula is the number of satisfied samples plus half of the tolerating samples plus none of the frustrated samples, divided by all the samples:
where the sub-script t is the target time, and the tolerable time is assumed to be 4 times the target time. So it is easy to see how this ratio is always directly related to users' perceptions of satisfactory application responsiveness.
Example: if there are 100 samples with a target time of 3 seconds, where 60 are below 3 seconds, 30 are between 3 and 12 seconds, and the remaining 10 are above 12 seconds, the Apdex score is:
Apdex Alliance
The Apdex Alliance, headquartered in Charlottesville, Virginia, was founded in 2004 by Peter Sevcik, President of NetForecast, Inc. The Alliance is a group of companies that are collaborating to establish the Apdex standard. These companies have perceived the need for a simple and uniform way to report on application performance, are adopting the Apdex method in their internal operations or software products, and are participating in the work of refining and extending the definition of the Apdex specifications. Alliance contributing members who incorporate the standard into their products may use the Apdex name or logo where the Alliance has certified them as compliant.
In January 2007, the Alliance comprised 11 contributing member companies, and over 200 individual members. While the number of contributing companies has remained relatively stable, individual membership grew to over 800 by December 2008, and reached 2000 in 2010. To support the professional interests of the membership, in 2008 the Alliance began publishing a blog, the Apdex Exchange, and in 2010, instituted a program of educational Webinars. These activities address performance management topics, with an emphasis on how to apply the Apdex methodology.