| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|
|
|
|||||||
|
|||||||||
Departments of
1
Urology and
2
Medical Biometry, University Hospital Charité, Humboldt University, D-10098 Berlin, Germany.
aAddress correspondence to this author at: Department of Urology, University Hospital Charité, Humboldt University Berlin, Schumannstrasse 20/21, D-10098 Berlin, Germany. Fax 49-30-450-515904; e-mail Klaus.jung{at}charite.de.
Background: ROC analysis is widely accepted to assess and compare diagnostic validity of laboratory tests. Within the last few years, many new ROC programs have become available but have not been systematically evaluated. The aim of this study was to assess different ROC programs regarding their ease of use, mathematical correctness, final output, and their compatibility with other graphics programs.
Methods: Eight available programs running under Windows (AccuROC, Analyse-It, CMDT, GraphROC, MedCalc, mROC, ROCKIT, and SPSS) were evaluated. ROC analyses of prostate-specific antigen and related values were performed from a dataset of 928 men with prostate cancer and benign prostatic hyperplasia and corresponding subsets. Criteria such as data input, data output, and correctness and completeness of results were used to evaluate the practicability of the programs.
Results: Although the programs produced equivalent results (areas under the curves and their characteristics), we observed deficiencies concerning input of data, processing of the output data, and completeness of the results. Analyse-It, AccuROC, and MedCalc exhibited good performance, but each program had different shortcomings. Only GraphROC could compare curves at a certain sensitivity or specificity cutoff.
Conclusions: Adequate ROC analysis and ROC plotting cannot be performed with a single program. Analyse-It, AccuROC, and MedCalc can be recommended with certain limitations. Further improvements of the programs are necessary.
The following articles in journals at HighWire Press have cited this article:
|
|
 |
|
  J-H Choi, D K Cho, Y-B Song, J-Y Hahn, S Choi, H-C Gwon, D-K Kim, S H Lee, J K Oh, and E-S Jeon Preoperative NT-proBNP and CRP predict perioperative major cardiovascular events in non-cardiac surgery Heart, January 1, 2010; 96(1): 56 - 62. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. S. Elliott, R. Shinghal, and J. C. Presti Jr. The Influence of Prostate Volume on Prostate-Specific Antigen Performance: Implications for the Prostate Cancer Prevention Trial Outcomes Clin. Cancer Res., July 15, 2009; 15(14): 4694 - 4699. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K. Soreide Receiver-operating characteristic curve analysis in diagnostic, prognostic and predictive biomarker research J. Clin. Pathol., January 1, 2009; 62(1): 1 - 5. [Full Text] [PDF]
|
|
|
|
|
|
B Kunadian, J Dunning, R Das, A P Roberts, R Morley, A J Turley, D Twomey, J A Hall, R A Wright, A G C Sutton, et al. External validation of established risk adjustment models for procedural complications after percutaneous coronary intervention Heart, August 1, 2008; 94(8): 1012 - 1018. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. Sonego, A. Kocsor, and S. Pongor ROC analysis: applications to the classification of biological sequences and 3D structures Brief Bioinform, May 1, 2008; 9(3): 198 - 209. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 W.S. Waring, A.F.L. Stephen, O.D.G. Robinson, M.A. Dow, and J.M. Pettie Serum urea concentration and the risk of hepatotoxicity after paracetamol overdose QJM, May 1, 2008; 101(5): 359 - 363. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. Florio, L. Bruni, C. De Falco, G. Filardi, M. Torricelli, F. M. Reis, L. Galleri, C. Voltolini, C. Bocchi, V. De Leo, et al. Evaluation of Endometrial Urocortin Secretion for Prediction of Pregnancy after Intrauterine Insemination Clin. Chem., February 1, 2008; 54(2): 350 - 355. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. Florio, R. Abella, E. Marinoni, R. Di Iorio, C. Letizia, M. Meli, T. de la Torre, F. Petraglia, A. Cazzaniga, A. Giamberti, et al. Adrenomedullin Blood Concentrations in Infants Subjected to Cardiopulmonary Bypass: Correlation with Monitoring Parameters and Prediction of Poor Neurological Outcome Clin. Chem., January 1, 2008; 54(1): 202 - 206. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. G. Covell, R. Huang, and A. Wallqvist Anticancer medicines in development: assessment of bioactivity profiles within the National Cancer Institute anticancer screening data Mol. Cancer Ther., August 1, 2007; 6(8): 2261 - 2270. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. Florio, F. M. Severi, C. Bocchi, S. Luisi, M. Mazzini, S. Danero, M. Torricelli, and F. Petraglia Single Serum Activin A Testing to Predict Ectopic Pregnancy J. Clin. Endocrinol. Metab., May 1, 2007; 92(5): 1748 - 1753. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. Florio, R. Felipe Abella, T. de la Torre, A. Giamberti, S. Luisi, G. Butera, A. Cazzaniga, A. Frigiola, F. Petraglia, and D. Gazzolo Perioperative Activin A Concentrations as a Predictive Marker of Neurologic Abnormalities in Children after Open Heart Surgery Clin. Chem., May 1, 2007; 53(5): 982 - 985. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
F.-G. Debray, G. A. Mitchell, P. Allard, B. H. Robinson, J. A. Hanley, and M. Lambert Diagnostic Accuracy of Blood Lactate-to-Pyruvate Molar Ratio in the Differential Diagnosis of Congenital Lactic Acidosis Clin. Chem., May 1, 2007; 53(5): 916 - 921. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. Florio, S. Luisi, B. Moataza, M. Torricelli, I. Iman, M. Hala, A. Hanna, F. Petraglia, and D. Gazzolo High Urinary Concentrations of Activin A in Asphyxiated Full-Term Newborns with Moderate or Severe Hypoxic Ischemic Encephalopathy Clin. Chem., March 1, 2007; 53(3): 520 - 522. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. Florio, E. Marinoni, R. Di Iorio, M. Bashir, S. Ciotti, R. Sacchi, M. Bruschettini, M. Lituania, G. Serra, F. Michetti, et al. Urinary S100B Protein Concentrations Are Increased in Intrauterine Growth-Retarded Newborns Pediatrics, September 1, 2006; 118(3): e747 - e754. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. Florio, S. Perrone, S. Luisi, P. Vezzosi, M. Longini, B. Marzocchi, F. Petraglia, and G. Buonocore Increased Plasma Concentrations of Activin A Predict Intraventricular Hemorrhage in Preterm Newborns Clin. Chem., August 1, 2006; 52(8): 1516 - 1521. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 Y. K. Kim, H. S. Kwak, C. S. Kim, G. H. Chung, Y. M. Han, and J. M. Lee Hepatocellular Carcinoma in Patients with Chronic Liver Disease: Comparison of SPIO-enhanced MR Imaging and 16-Detector Row CT Radiology, December 21, 2005; (2005) 2381042193. [Abstract] [Full Text]
|
|
|
|
 |
|
 N. A. Obuchowski ROC Analysis Am. J. Roentgenol., February 1, 2005; 184(2): 364 - 372. [Full Text] [PDF]
|
|
|
|
|
|
P. Florio, S. Luisi, M. Bruschettini, D. Grutzfeld, A. Dobrzanska, P. Bruschettini, F. Petraglia, and D. Gazzolo Cerebrospinal Fluid Activin A Measurement in Asphyxiated Full-Term Newborns Predicts Hypoxic Ischemic Encephalopathy Clin. Chem., December 1, 2004; 50(12): 2386 - 2389. [Full Text] [PDF]
|
|
|
|
|
|
P. Florio, A. Imperatore, F. Sanseverino, M. Torricelli, F. M. Reis, P. J. Lowry, and F. Petraglia The Measurement of Maternal Plasma Corticotropin-Releasing Factor (CRF) and CRF-Binding Protein Improves the Early Prediction of Preeclampsia J. Clin. Endocrinol. Metab., September 1, 2004; 89(9): 4673 - 4677. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
N. A. Obuchowski, M. L. Lieber, and F. H. Wians Jr. ROC Curves in Clinical Chemistry: Uses, Misuses, and Possible Solutions Clin. Chem., July 1, 2004; 50(7): 1118 - 1125. [Abstract] [Full Text] [PDF]
|
|
Read all eLetters
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
