|
|
||||||||
Articles |
a Author for correspondence. Fax (49) 663240; e-mail mariopl{at}ux1.unipd.it
| Abstract |
|---|
|
|
|---|
Key Words: indexing terms: total quality management emergency medicine clinical audit
| Introduction |
|---|
|
|
|---|
The application of Total Quality Management to laboratory testing requires that the total process, including preanalytical and postanalytical phases, be managed so as to reduce or, ideally, eliminate all defects within the process. Reports in the literature disagree as to the frequency of mistakes in the clinical laboratory. The error ratio is often stated as 1:1000, but other studies show a frequency of 1:100 (4). As observed by Goldschmidt and Lent (5), to a certain event the difference depends on the fact that ~75% of any test results within the clinical laboratory are, in general, normal and any interchange will be unnoticed and have no effect on the thinking process of physicians or on the well-being of patients. Of the remaining 25% of mistakes, half are so absurd that they are recognized by the requester as useless information, and are therefore not taken into account in any medical decisionmaking. However, the remaining 12.5%, i.e., 1:800 to 1:8000, may cause an erroneous medical decision.
The aim of this study was to evaluate the frequency and types of mistakes in our laboratory so as to identify the most critical steps in the analytical testing process and to plan a corrective strategy. We defined a "mistake" as any defect during the entire testing process, from ordering tests to reporting results, that influenced in any way the quality of the laboratory service.
To overcome some previously described limitations and to ascertain the number and type of medically recognized mistakes, we designed a prospective study, selecting the following: (a) the emergency department of the laboratory, in which the percentage of results in the reference interval is only ~50%, and an immediate clinical evaluation of results is presumed to occur; (b) a highly accurate intralaboratory medical validation of data, taking into account all potential mistakes that cannot usually be detected; and (c) four cooperating departments, in which the physicians and nurses were willing to make an appraisal of laboratory findings, paying maximal critical attention.
We excluded all mistakes identified by routine quality-assurance procedures and amended before the final reporting of results, because they did not lead to giving erroneous information to clinicians.
| Materials and Methods |
|---|
|
|
|---|
The Stat Service, which is a part of the Laboratory Department, performs 1.4 x 106 tests per year with individual spaces, instruments, and staff. Clinical chemistry analyses are performed with Ektachem 950 (Johnson & Johnson Clinical Diagnostics, Milan, Italy) and Synchron CX7 analyzers (Beckman Analyticals, Milan, Italy); hematology is performed with one Coulter STKS and one H3 analyzer (Bayer Divisione Diagnostici, Milan, Italy); coagulation with an ACL 3000 (IL, Milan, Italy); toxicology and drugs with an ACA star (Dade Diagnostics, Milan, Italy) and an Abbott Diagnostics (Rome, Italy) TDx.
Each of these instruments is connected to the laboratory information system, <5% of the results being manually entered into the computer. The laboratory information system allows results to be directly communicated to the care units.
Four different departments (internal medicine, nephrology, surgery, and the intensive care unit) were selected for this study, and all stat laboratory data for these departments were strictly monitored for 3 months. The brevity of the observation period was a prerequisite for the study design, the physicians and the nurses of the four departments involved being asked to pay maximal critical attention to all test results. These personnel were provided with a special notebook in which any "suspect" result was recorded, together with all pertinent clinical information. In addition, every day, a laboratory physician visited the care units to discuss and review any suspect laboratory results. If data were considered clinically questionable, the original request was checked and the specimen was inspected and retested, sometimes with different methods and instruments; finally, a search was made for possible interferents. We considered analytical laboratory mistakes to be all data that exceeded proposed and interim European quality specifications for imprecision and inaccuracy. In particular, imprecision is "less than one-half of the average within-subject biological variation or less than the state of the art achieved by the best 0.20 fractile of laboratories"; inaccuracy is "less than one quarter of the group (within- plus between-subject) biological variation or less than one-sixteenth of the reference interval, when these data do not exist, or less than twice the ideal imprecision, if the ideal imprecision of the above specifications are too demanding" (6). Likewise, we considered as laboratory mistakes all results exceeding by >3 SD the internally defined mean turnaround time. The statistical significance of differences between relative frequencies of mistakes observed in the departments considered was calculated by using the Confidence Interval (CI) Analysis microcomputer program (7).
| Results |
|---|
|
|
|---|
|
|
|
In the analytical phase, we identified 25 mistakes, or 13.3% of the
total mistakes (Table 3
). The most common mistakes were due to
interference or lack of specificity of analytical methods, and to an
unacceptable analytical performance. In two cases, in particular,
aspecific reactions to toxicologic tests caused false-positive results
for opiates and cannabinoids, and five cases involved isolated
instrumental malfunctioning of the hematological analyzer. Other
mistakes were an unacceptable analytical performance in terms of
accuracy or reproducibility (or both), despite satisfactory evidence
from internal quality control. Unacceptable performance was
demonstrated by repeating the test on the same specimen after the
clinician's notification and observing a failure to reproduce the
original value.
In the postanalytical phase, 35 mistakes (relative frequency 18.5%)
were observed (Table 3
). Among other mistakes, improper data entry and
excessive turnaround time were seen. In particular, a comment on
interference from cold agglutinins was overlooked, resulting in an
underestimation of erythrocytes, and other situations were identified
in which the correction of an apparently analytically reliable result
had not been noticed. In other cases, there was a lack of communication
between laboratory and physicians. The distribution of mistakes showed
that toxicological (relative frequency 1.38%) and hematological
(0.82%) tests seem to be more affected by mistakes than were clinical
chemistry tests (0.11%). Analytical and postanalytical mistakes fall
totally under the responsibility of laboratory; therefore, the total
percentage of mistakes for laboratory responsibility was 44.4%.
Finally, we attempted to ascertain the effect of laboratory mistakes on
patients' outcome. Most of the laboratory mistakes (74%) had no
significant clinical effect. In 37 patients (19%) laboratory mistakes
were associated with further inappropriate investigations, thus
resulting in an unjustified increase in costs. In fact, the mistakes
called for repeat laboratory tests, or other more costly examinations
(e.g., echography, magnetic resonance imaging). In 12 patients (6.3%),
laboratory mistakes were found to be associated with inappropriate care
or inappropriate modification of therapy (Table 4
).
|
| Discussion |
|---|
|
|
|---|
In The Netherlands, the Hospitals of Tilburg house a special committee that investigates faults or near accidents (FONA). Any occasion within the hospital that might adversely affect patients' well-being must be reported to the committee, on special forms. Clinical laboratories are involved in the same procedure (external FONA complaints) and also follow a similar procedure for internal mistakes (internal FONA complaints). An arbitrary scale has been designed, ranging from no damage (score 1), minor (score 2), moderate (score 3), severe (score 4), to very severe (score 5) damage to patients' well-being. Over the last 6 years, 31 external and 102 internal FONA complaints have been filed (5). Overall, only a few laboratory mistakes have led to severe clinical damage, the weighted mean for external complaints being 2.5 and for internal complaints 1.9. However, examples of serious mistakes (score 5) have been reported, including one fetal death because of delayed reporting of HELLP syndrome (hemolysis, elevated liver enzymes and low platelets) and one death of a young diabetic patient attributable to erroneously low glucose test results, among others (8). One should also appreciate, of course, that the laboratory has played an important role in helping to save lives by proper and timely reporting of test results.
It has been stated that 70% of faults depend on human mistakes, mainly communication problems, and only 30% are instrumental mistakes (9). In the FONA study, in particular, of the total external complaints, 30 were human and only 1 was instrument-related, whereas for the internal complaints these numbers were 95 and 7, respectively (9397% human, 13% instrumental). However, FONA-type complaints do not appear to be an appropriate means for revealing the real frequency and extent of laboratory mistakes, its main limitations being that it depends on the scrupulousness of clinicians in filling in the special forms, and it tends to identify only the more important clinical mistakes.
The number of mistakes identified in our study and their relative frequency are surprisingly low; this may have partly depended on some limitations of the study itself. In fact, imperfections in the detection methods mean that mistake rates are likely to be somewhat higher than observed by us. Moreover, the frequency of mistakes may differ between one facility and another, and between one time period and another. This is well demonstrated in our study by the higher frequency of mistakes observed in the department of medicine compared with the other departments. This difference is difficult to explain, especially in view of the relative frequency of mistakes observed in the different steps (pre-, post-, and intraanalytical) of laboratory work, being partly due to the different complexities of specific tests required. In spite of such variations, however, the observed mistake rates are great enough to call for some considerations concerning the sources of mistakes and the application of quality-control methods that minimize mistakes in all facilities and in each phase of the testing process.
In particular our findings confirm that, at present, the most frequent source of erroneous results in the clinical laboratory seems to be the pre- and postanalytical steps in the testing process, with fewer mistakes occurring during the actual analytical step. We did not take into account the mistakes identified and amended through the routine quality-assurance procedures designed to reduce the analytical defects. Most of the mistakes (74%) did not affect the quality of patient care. In 12 patients, however, laboratory mistakes were associated with inappropriate therapy. In another 19%, laboratory mistakes were associated with inappropriate further investigations, thus increasing costs of care. Further studies performed on a greater number of cases and using more-effective methods for detecting mistakes (e.g., Shigeo Shingo's mistake proofing) (10) should contribute additional information on the true frequency, nature, and sources of laboratory mistakes, thus keeping laboratory practice in pace with changes in the state-of-the-art for new technology, procedures, tests, and effective information.
If patients' interests are to be safeguarded and quality in laboratory testing promoted, there must be a departure from the conventional view of the laboratory, which focuses on the quality control of the analytical activities within the laboratory. Today, the quality system for clinical laboratories must include promotion of accuracy in the analytical phase as well as the assurance of the reliability of pre- and postanalytical activities. Our finding that a large percentage of laboratory mistakes occurs in the pre- and postanalytical phases indicates that the active monitoring of all potential defects calls for the assistance of nonlaboratory personnel, to enable the inclusion of steps outside the laboratory. Cooperation with clinicians and personnel outside the laboratory is therefore the key to improvement, and a clinical audit is an important component in the quality system for the clinical laboratory (11)(12).
| Footnotes |
|---|
Presented in part at the 2nd European Meeting on the Preanalytical Phase in Laboratory Sciences, Oxford, UK, July 57, 1996.
| References |
|---|
|
|
|---|
The following articles in journals at HighWire Press have cited this article:
![]() |
M. Plebani The detection and prevention of errors in laboratory medicine Ann Clin Biochem, March 1, 2010; 47(2): 101 - 110. [Abstract] [Full Text] [PDF] |
||||
![]() |
A Schattner The unbearable lightness of diagnostic testing: time to contain inappropriate test ordering Postgrad. Med. J., December 1, 2008; 84(998): 618 - 621. [Abstract] [Full Text] [PDF] |
||||
![]() |
A.-S. Schrohl, S. Wurtz, E. Kohn, R. E. Banks, H. J. Nielsen, F. C. G. J. Sweep, and N. Brunner Banking of Biological Fluids for Studies of Disease-associated Protein Biomarkers Mol. Cell. Proteomics, October 1, 2008; 7(10): 2061 - 2066. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Nutt, A. E Zemlin, and R. T Erasmus Incomplete laboratory request forms: the extent and impact on critical results at a tertiary hospital in South Africa Ann Clin Biochem, September 1, 2008; 45(5): 463 - 466. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. J O'Kane, P L M. Lynch, and N. McGowan The development of a system for the reporting, classification and grading of quality failures in the clinical biochemistry laboratory Ann Clin Biochem, March 1, 2008; 45(2): 129 - 134. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Carraro and M. Plebani Errors in a Stat Laboratory: Types and Frequencies 10 Years Later Clin. Chem., July 1, 2007; 53(7): 1338 - 1342. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Lippi, A. Bassi, G. Brocco, M. Montagnana, G. L. Salvagno, and G. C. Guidi Preanalytic error tracking in a laboratory medicine department: results of a 1-year experience. Clin. Chem., July 1, 2006; 52(7): 1442 - 1443. [Full Text] [PDF] |
||||
![]() |
S. Yuan, M. L. Astion, J. Schapiro, and A. P. Limaye Clinical Impact Associated with Corrected Results in Clinical Microbiology Testing J. Clin. Microbiol., May 1, 2005; 43(5): 2188 - 2193. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. J. Vermeer, E. Thomassen, and N. de Jonge Automated Processing of Serum Indices Used for Interference Detection by the Laboratory Information System Clin. Chem., January 1, 2005; 51(1): 244 - 247. [Full Text] [PDF] |
||||
![]() |
U. R. Jahn and H. Van Aken Editorial I: Near-patient testing--point-of-care or point of costs and convenience? Br. J. Anaesth., April 1, 2003; 90(4): 425 - 427. [Full Text] [PDF] |
||||
![]() |
P. Bonini, M. Plebani, F. Ceriotti, and F. Rubboli Errors in Laboratory Medicine Clin. Chem., May 1, 2002; 48(5): 691 - 698. [Abstract] [Full Text] [PDF] |
||||
![]() |
I. D Watson, K Lawton, G. Lindstedt, E. Nystrom, R. Ekman, R. Forberg, A. Isaksson, M. Stridsberg, L. Hard, G. Nordin, et al. Wrong biochemistry results BMJ, February 16, 2002; 324(7334): 422 - 422. [Full Text] |
||||
![]() |
W. P. Oosterhuis, H. J.L.M. Ulenkate, and H. M.J. Goldschmidt Evaluation of LabRespond, a New Automated Validation System for Clinical Laboratory Test Results Clin. Chem., November 1, 2000; 46(11): 1811 - 1817. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. N Weingart, R. M. Wilson, R. W Gibberd, and B. Harrison Epidemiology of medical error BMJ, March 18, 2000; 320(7237): 774 - 777. [Full Text] |
||||
![]() |
P. Carraro, G. Servidio, and M. Plebani Hemolyzed Specimens: A Reason for Rejection or a Clinical Challenge? Clin. Chem., February 1, 2000; 46(2): 306 - 307. [Full Text] [PDF] |
||||
![]() |
R. W. Jenny and K. Y. Jackson-Tarentino Causes of Unsatisfactory Performance in Proficiency Testing Clin. Chem., January 1, 2000; 46(1): 89 - 99. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Shahangian, R. D. Cohn, E. E. Gaunt, and J. M. Krolak System to Monitor a Portion of the Total Testing Process in Medical Clinics and Laboratories: Evaluation of a Split-Specimen Design Clin. Chem., February 1, 1999; 45(2): 269 - 280. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Stahl, E. D. Lund, and I. Brandslund Reasons for a Laboratory's Inability to Report Results for Requested Analytical Tests Clin. Chem., October 1, 1998; 44(10): 2195 - 2197. [Full Text] [PDF] |
||||
![]() |
D. Stockl, M. Plebani, P. Carraro, W. Hoelzel, A. Finke, and K. Miedema Modern Quality Management Misunderstood? The authors of one of the articles referred to above reply: Clin. Chem., May 1, 1998; 44(5): 1066 - 1067. [Full Text] [PDF] |
||||
![]() |
D. Blumenthal The Errors of Our Ways Clin. Chem., August 1, 1997; 43(8): 1305 - 1305. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |