|
|
||||||||
Clinical Chemistry, Vol 39, 1998-2004, Copyright © 1993 by American Association for Clinical Chemistry
ML Astion, MH Wener, RG Thomas, GG Hunder and DA Bloch
Department of Laboratory Medicine, University of Washington, Seattle 98195.
Backpropagation neural networks are a computer-based pattern- recognition method that has been applied to the interpretation of clinical data. Unlike rule-based pattern recognition, backpropagation networks learn by being repetitively trained with examples of the patterns to be differentiated. We describe and analyze the phenomenon of overtraining in backpropagation networks. Overtraining refers to the reduction in generalization ability that can occur as networks are trained. The clinical application we used was the differentiation of giant cell arteritis (GCA) from other forms of vasculitis (OTH) based on results for 807 patients (593 OTH, 214 GCA) and eight clinical predictor variables. The 807 cases were randomly assigned to either a training set with 404 cases or to a cross-validation set with the remaining 403 cases. The cross-validation set was used to monitor generalization during training. Results were obtained for eight networks, each derived from a different random assignment of the 807 cases. Training error monotonically decreased during training. In contrast, the cross-validation error usually reached a minimum early in training while the training error was still decreasing. Training beyond the minimum cross-validation error was associated with an increased cross-validation error. The shape of the cross-validation error curve and the point during training corresponding to the minimum cross- validation error varied with the composition of the data sets and the training conditions. The study indicates that training error is not a reliable indicator of a network's ability to generalize. To find the point during training when a network generalizes best, one must monitor cross-validation error separately.
The following articles in journals at HighWire Press have cited this article:
![]() |
K. Frank and M. J. Sippl High-performance signal peptide prediction based on sequence alignment techniques Bioinformatics, October 1, 2008; 24(19): 2172 - 2176. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. L. Hortin Can Mass Spectrometric Protein Profiling Meet Desired Standards of Clinical Laboratory Practice? Clin. Chem., January 1, 2005; 51(1): 3 - 5. [Full Text] [PDF] |
||||
![]() |
J. BLACK, G. BENKE, K. SMITH, and L. FRITSCHI Artificial Neural Networks and Job-specific Modules to Assess Occupational Exposure Ann. Hyg., October 1, 2004; 48(7): 595 - 600. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Regeniter, J. U. Steiger, A. Scholer, P. R. Huber, and W. H. Siede Windows to the Ward: Graphically Oriented Report Forms. Presentation of Complex, Interrelated Laboratory Data for Electrophoresis/Immunofixation, Cerebrospinal Fluid, and Urinary Protein Profiles Clin. Chem., January 1, 2003; 49(1): 41 - 50. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. K. Orr Use of a Probabilistic Neural Network to Estimate the Risk of Mortality after Cardiac Surgery Med Decis Making, April 1, 1997; 17(2): 178 - 185. [Abstract] [PDF] |
||||
![]() |
W. Penny and D. Frost Neural Networks in Clinical Medicine Med Decis Making, October 1, 1996; 16(4): 386 - 398. [Abstract] [PDF] |
||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |