HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Submit an electronic Letter to the Editor about this paper Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in ISI Web of Science Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via ISI Web of Science (11) Citing Articles via Google Scholar Google Scholar Articles by Remaley, A. T. Articles by Zweig, M. H. Search for Related Content PubMed PubMed Citation Articles by Remaley, A. T. Articles by Zweig, M. H. Related Collections Laboratory Management Evidence Based Laboratory Medicine and Test Utilization

Prevalence-Value-Accuracy Plots: A New Method for Comparing Diagnostic Tests Based on Misclassification Costs

¹ Software to perform PVA analysis can be downloaded from the following website: http://www.cc.nih.gov/cp/Chemistry/DrRemaley.html. Inquiries regarding PVA plot analysis should be addressed to: A.T. Remaley, MD, PhD, National Institutes of Health, Clinical Center, Clinical Pathology Department, Bldg. 10/2C-433, Bethesda, MD 20892. Fax 301-402-1885; e-mail aremaley{at}nih.gov
^a Address correspondence to this author at: National Institutes of Health, Clinical Center, Clinical Pathology Department, Bldg. 10/2C-433, Bethesda, MD 20892. Fax 301-402-1885; e-mail aremaley{at}nih.gov

The clinical accuracy of diagnostic tests commonly is assessed by ROC analysis. ROC plots, however, do not directly incorporate the effect of prevalence or the value of the possible test outcomes on test performance, which are two important factors in the practical utility of a diagnostic test. We describe a new graphical method, referred to as a prevalence-value-accuracy (PVA) plot analysis, which includes, in addition to accuracy, the effect of prevalence and the cost of misclassifications (false positives and false negatives) in the comparison of diagnostic test performance. PVA plots are contour plots that display the minimum cost attributable to misclassifications (z-axis) at various optimum decision thresholds over a range of possible values for prevalence (x-axis) and the unit cost ratio (UCR; y-axis), which is an index of the cost of a false-positive vs a false-negative test result. Another index based on the cost of misclassifications can be derived from PVA plots for the quantitative comparison of test performance. Depending on the region of the PVA plot that is used to calculate the misclassification cost index, it can potentially lead to a different interpretation than the ROC area index on the relative value of different tests. A PVA-threshold plot, which is a variation of a PVA plot, is also described for readily identifying the optimum decision threshold at any given prevalence and UCR. In summary, the advantages of PVA plot analysis are the following: (a) it directly incorporates the effect of prevalence and misclassification costs in the analysis of test performance; (b) it yields a quantitative index based on the costs of misclassifications for comparing diagnostic tests; (c) it provides a way to restrict the comparison of diagnostic test performance to a clinically relevant range of prevalence and UCR; and (d) it can be used to directly identify an optimum decision threshold based on prevalence and misclassification costs.© 1999 American Association for Clinical Chemistry

The following articles in journals at HighWire Press have cited this article:

				R. S. Vasan, E. J. Benjamin, M. G. Larson, E. P. Leip, T. J. Wang, P. W. F. Wilson, and D. Levy Plasma Natriuretic Peptides for Community Screening for Left Ventricular Hypertrophy and Systolic Dysfunction: The Framingham Heart Study JAMA, September 11, 2002; 288(10): 1252 - 1259. [Abstract] [Full Text] [PDF]