Clinical Chemistry
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


Clinical Chemistry 50: 1396-1405, 2004. First published June 11, 2004; 10.1373/clinchem.2003.029223
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow An erratum has been published
Right arrow All Versions of this Article:
clinchem.2003.029223v1
50/8/1396    most recent
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (10)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Patriarca, M.
Right arrow Articles by Menditto, A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Patriarca, M.
Right arrow Articles by Menditto, A.
Related Collections
Right arrow Laboratory Management
Right arrow Drug Monitoring and Toxicology
Right arrow Automation and Analytical Techniques
(Clinical Chemistry. 2004;50:1396-1405.)
© 2004 American Association for Clinical Chemistry, Inc.


Laboratory Management

Estimate of Uncertainty of Measurement from a Single-Laboratory Validation Study: Application to the Determination of Lead in Blood

Marina Patriarcaa, Marco Castelli, Federica Corsetti and Antonio Menditto

Clinical Biochemistry Laboratory, Istituto Superiore di Sanità, Viale Regina Elena 299, 00161 Rome, Italy

aAuthor for correspondence. Fax 39-0649903686; e-mail marina.patriarca{at}iss.it.


   Abstract
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
Background: Lead is an environmental pollutant, and human exposure is assessed by monitoring lead concentrations in blood. Because the main source of environmental exposure has been the use of leaded gasoline, its phase-out has led to decreased lead concentrations in the general population. Therefore, validated analytical methods for the determination of lower lead concentrations in blood (<150 µg/L) are needed. In addition, new ISO standards require that laboratories determine and specify the uncertainty of their results.

Methods: We validated a method to determine lead in blood at concentrations up to 150 µg/L by electrothermal atomic absorption spectrometry with Zeeman background correction according to EURACHEM guidelines. Blood samples were diluted (1:1 by volume) with 2 mL/L Triton X-100. NH4H2PO4 (5 g/L) and Mg(NO3)2 (0.5 g/L) were used as modifiers. Matrix-matched standards were used for calibration.

Results: We determined the limits of detection (3.1 µg/L) and quantification (9.4 µg/L). Repeatability and intermediate imprecision within the range 35–150 µg/L were <5.5% and <6.0%, respectively. We assessed trueness by use of certified reference materials, by recovery tests, and by comparison with target values of other reference materials (candidate external quality assessment samples). The expanded uncertainty ranged from 20% to 16% (with a confidence level of 95%) depending on concentration.

Conclusions: This study provides a working example of the estimate of uncertainty from method performance data according to the EURACHEM/CITAC guidelines. The estimated uncertainty is compatible with quality specifications for the analysis of lead in blood adopted in the US and the European Union.


   Introduction
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
Lead pollution in the environment and workplace has been an ongoing matter of concern. It has been addressed in national and European legislation and directives (1)(2)(3)(4) aimed at protecting workers, the general population, and especially young children from the potentially harmful effects of exposure to lead (5)(6). The most reliable biomarker of recent lead exposure is the measurement of the concentration of lead in blood, and although invasive, it is still used for both occupational monitoring programs and population surveys. Several techniques can be applied to the determination of lead in blood, such as anodic stripping voltammetry, electrothermal atomic absorption spectrometry (ETAAS),1 and inductively coupled plasma mass spectrometry (ICP-MS) (7)(8).

In most industrialized countries, improvements in working conditions and actions taken to minimize the environmental exposure to lead (such as the phase-out of leaded gasoline and improvements in food preparation and packaging) have led to a substantial reduction of lead concentrations in blood in both workers and the general population (9). In the US, a reduction of 78% in the mean lead concentration in blood (from 128 to 28 µg/L) was observed in phase 1 of the third National Health and Nutrition Examination Survey (1988–1991; n = 12 119) compared with the second such survey (1976–1980; n = 9832) (10), and was later confirmed in additional studies (11). In 1998, blood lead concentrations ranging from 5 to 132 µg/L were reported for a sample of 214 nonexposed British individuals (12). In Italy as well, a recent study (13) reported mean (SD) values for lead in blood of 45.1 (27.4) µg/L for males and 30.6 (16.7) µg/L for females compared with median values of 86 µg/L (2.5th-97.5th centiles, 30–230.5 µg/L) for males and 53.5 µg/L (20–151.5 µg/L) for females between 1992 and 1996 (14).

However, attention is now being given to the potential health effects of long-term exposure to low lead concentrations, such as cognitive disorders and effects on renal function and blood pressure (15)(16)(17)(18)(19). The assessment of such risks is still based on the measurement of the blood lead concentration; therefore, the quality of analytical data at such low concentrations is of the utmost importance. Collaborative work carried out within the framework of the "European Network of Organizers of External Quality Assessment Schemes (EQAS) related to Occupational and Environmental Medicine" (EU Contract SMT 4-CT98-7522) has highlighted large differences in performance among laboratories for the determination of lead in blood at concentrations of 100, 400, and 700 µg/L (20), and few data are available describing the degree of comparability of laboratory results at concentrations <100 µg/L.

Currently, in many fields of analytical work, laboratories are formally required (sometimes by law) to demonstrate their competence by seeking accreditation to the appropriate national or international standards, such as CLIA ’88 in the US (21) and ISO/IEC 17025 (22) or ISO 15189(23) in the European Union and other parts of the world. Such standards require laboratories to use validated analytical methods and well-defined internal quality-control procedures and to participate in proficiency testing schemes. In addition, the ISO standards recommend that traceability to International System (SI) units and the uncertainty (24) of the measurements be established whenever possible.

Additional guidance on the estimate of the uncertainty of measurement in analytical chemistry is detailed in the EURACHEM/CITAC Guide (25), in particular with respect to the use of performance data already available within a laboratory provided that appropriate quality-assurance measures are in place. Such data should generally include information on the overall precision of the method, the assessment of any significant bias, and estimates of the uncertainties associated with other relevant sources, such as residual matrix effects. A key issue in such an approach is the ability to document the size of any systematic bias affecting the measurement and the uncertainty associated with such an estimate. This can be difficult in occupational and environmental laboratory medicine because the concentrations of analytes to be determined in complex matrices are often close to detection limits and few certified reference materials (CRMs) are available. However, laboratories are still required to perform such analyses and to give an indication of their quality.

Our laboratory has been particularly concerned with the quality of analytical results for the determination of lead in blood because of our involvement with the European surveys of the general population (26)(27). This has led us to investigate the performance of analytical methods (28)(29), to evaluate and certify reference materials (RMs) (30)(31), and to organize a national EQAS for lead in blood to assess the performance of Italian laboratories in this field (32)(33). In this context, the aim of the work reported here was to estimate the uncertainty of our own measurements of low concentrations of lead in blood and to provide a practical example of how data from validation studies can be used for such purposes. In addition, we discuss the different approaches taken to demonstrate traceability to SI units.


   Materials and Methods
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
instrumentation
Lead in blood was determined by use of a Perkin-Elmer SIMAA 6000 atomic absorption spectrometer equipped with Zeeman background correction, a transverse-heated graphite atomizer, and an EDL System 2 lamp for lead. This instrument, because it has an Echelle polychromator and a photodiode array detector, is capable of multielement analyses, using up to four different light sources, but was used in its single-element capacity for this work. In addition to UP-grade argon, the instrument was fed with air as the alternative gas to be used in the ashing step. Automatic pipettes (Gilson, France) calibrated at regular intervals and class A volumetric glassware were used for all dilutions.

reagents, reference materials, and solutions
During the study, two certified lead stock standard solutions from Merck KgaA at concentrations (tolerance interval) of 1008 (2) mg/L and 999 (5) mg/L were used. According to the supplier, traceability of the stock solutions to SI units was assured by traceable gravimetric procedures or by measurement with high-precision ICP-optical emission spectroscopy calibrated against SRM 3128 "Lead standard solution" (NIST).

Five working lead standards were prepared by adding to bovine blood, collected in EDTA, known amounts of lead. Intermediate standard solutions at 0, 0.625, 1.25, 2.50, and 3.75 mg/L were prepared in aqueous HNO3 (2 mL/L; 65% Suprapure; maximum lead concentration, 1 ppb; Merck) from the 1008 mg/L stock standard solution. We diluted 2 mL of each intermediate standard solution to 50 mL with bovine blood to obtain matrix-matched lead standards at 0, 25, 50, 100, and 150 µg/L. The blood solutions were divided into 1-mL aliquots in Eppendorf vials and stored at –20 °C. The uncertainty of the concentrations of the working standards, calculated according to the EURACHEM/CITAC guide (25) using the spreadsheet method (34), was 0.6%.

A modifier was prepared by dissolving 2.5 g of NH4H2PO4 (99.999%) and 0.25 g of Mg(NO3)2 · 6 H2O (99.999+%), both from Aldrich, in 150 mL of ultrapure water. The solution was further purified by the addition of 2 mL of 20 g/L ammonium pyrrolidine-dithiocarbamate (Merck) in water and extraction with chloroform (Carlo Erba Reagenti); the purified solution was then brought to a volume of 500 mL. Triton® X-100 (Fluka; 2 mL/L) was used to dilute blood samples. Ultrapure water, at 18.2 M{Omega}/cm, obtained from a Millipore (Elix 3/MilliQ) combined system for water purification, was used throughout the study.

Two CRMs, BCR CRM 194 (Community Bureau of Reference), with a target value of 126 (4) µg/L, (Institute for Reference Materials and Measurements, Geel, Belgium) and NIST SRM 955b, with a target value of 40.4 (1.5) µg/L, were used for validating the method.

Other RMs, SeronormTM Trace Elements Whole Blood, Level 1 (lot no. 404107) and Level 2 (lot no. MR9067), prepared from human blood, were obtained from Sero AS and reconstituted with 5 mL of ultrapure water according to the manufacturer’s instructions. Internal control materials at concentrations of 85 µg/L (medium) and 129 µg/L (high) were prepared by mixing known amounts of Seronorm Trace Elements Whole Blood, Level 1 and Level 2.

Human blood samples, obtained from 50 individuals undergoing screening programs for blood lead and stored frozen at –20 °C, were also included in the validation study. The samples were anonymous and provided by clinicians for the assessment of lead exposure, for which informed consent was provided.

For recovery studies, the 999 mg/L lead stock standard solution was diluted with aqueous 2 mL/L HNO3 to obtain solutions containing 0.62 and 1.24 mg/L. We diluted 1 mL of 2 mL/L HNO3 or 1 mL of each diluted lead solution to 25 mL with bovine blood to obtain a sample with no added lead and two samples, one containing 25 µg/L and the other 50 µg/L of added lead.

Blood samples provided as part of EQAS (35)(36)(37) were also analyzed to provide additional information on the trueness of the method at different concentrations and its long-term performance.

graphite furnace atomic absorption analysis
A blank (ultrapure water), blood samples, and matrix-matched working standards were diluted 1:1 with 2 mL/L Triton X-100 by use of a Gilson automatic pipette and were analyzed in duplicate. The autosampler was programmed to pipette a volume of 15 µL of modifier, followed by 15 µL of the diluted blood sample or standard, and the two (total volume, 30 µL) were simultaneously injected into the furnace. The instrument settings are shown in Table 1 , and the graphite furnace program is shown in Table 2 . A calibration curve was obtained daily as follows: the absorbance given by the blood with no added lead was subtracted from the readings for the other calibration materials, and the regression line of the absorbances (y) vs concentrations of the working standard solutions (x) was calculated, with the condition imposed that the intercept = 0, i.e., the regression line was forced through the origin. This procedure was adopted to improve the precision of measurements of low concentrations of lead because the observed variations of the intercept values (typically, ±0.001 absorbance units x s) would have caused variations >5% at lead concentrations <25 µg/L.


View this table:
[in this window]
[in a new window]
 
Table 1. Instrument settings.


View this table:
[in this window]
[in a new window]
 
Table 2. Graphite furnace program.


   Results
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
limits of detection and quantification
The limits of detection (LoD) (38) and quantification (LoQ) (38) were initially calculated from the results of 10 within-run measurements of a water blank diluted in the same manner as the blood samples (reagent blank). The LoD (mean + 3 SD) was 0.9 µg/L, and the LoQ (mean + 10 SD) was 2.0 µg/L. However, because the presence of a blood matrix is likely to diminish precision, additional information was obtained from the analysis, under the same conditions, of a bovine blood sample with very low lead content (12 µg/L). The SD of these measurements was 0.9 µg/L. Combining this SD value with the mean lead concentration observed in the reagent blank (0.4 µg/L), we calculated the method LoD and LoQ as 3.1 and 9.4 µg/L, respectively.

linear range and sensitivity
We assessed the linearity of calibration curves up to 150 µg/L and the variation in sensitivity over the lifetime (8 different runs and 440 firings) of a graphite tube. The results are shown in Fig. 1 . The correlation coefficient (r) was ≥0.999. The mean (SD) sensitivity as m0 (the mass of the analyte, in pg, required to produce an integrated absorbance of 0.0044 absorbance units x s) was 41.8 (0.9) pg for blood samples and 39.3 (0.8) pg (n = 5) for aqueous standards in 2 mL/L HNO3 analyzed under the same conditions. This accounts for a difference in sensitivity of ~6%. Therefore, calibration with matrix-matched standards was still deemed necessary for accurate measurements.



View larger version (16K):
[in this window]
[in a new window]
 
Figure 1. Calibration curves obtained over the lifetime of a graphite furnace (8 different runs; 440 firings).

precision studies
We assessed repeatability (within-run precision) by analyzing 17 control samples (concentrations range, 12–132 µg/L) 10 times in the same run. The trend of the relative standard deviation (RSD%) with increasing concentration is shown in Fig. 2 . These results are comparable to those obtained in previous studies in our laboratory (28)(29) and to those reported by others (39)(40)(41).



View larger version (6K):
[in this window]
[in a new window]
 
Figure 2. Trend of RSD with increasing concentration in repeatability studies.

The Seronorm Level 1 and the internally prepared medium and high control samples were used to study intermediate precision over a period of ~16 months. The analyses were performed by one operator on 29 occasions. The mean (SD) concentrations (RSD in parentheses) were, respectively, 34.8 (2.6) µg/L (7.5%) for Seronorm Level 1, 85.5 (5.1) µg/L (6.0%) for the medium control, and 128.4 (6.8) µg/L (5.3%) for the high control. The results are plotted as a control chart in Fig. 3 . These values are comparable to those reported in the recent literature for similar concentrations (39)(40)(41).



View larger version (14K):
[in this window]
[in a new window]
 
Figure 3. Intermediate precision study on control samples.

{blacktriangleup}, high control; {blacksquare}, medium control; {diamondsuit}, Seronorm Level 1.

An additional study of intermediate precision was carried out with 50 human blood samples, all of which were analyzed on two different occasions over a period of 2 weeks. The mean (SD) concentration was 44.1 (32.9) µg/L (range, 12.0–139.1 µg/L). Intermediate precision was calculated as the pooled SD (SDp), according to the formula:

and was 2.1 µg/L (4.7%). To compare these data with those obtained on control samples as reported above, we calculated the SDp separately for three concentration intervals (12–35 µg/L, n = 29; >35–90 µg/L, n = 14; and >90–139 µg/L, n = 7); the SDp values were 1.9 µg/L (8.4%), 2.5 µg/L (4.5%), and 2.0 µg/L (1.8%), respectively. For a subset of these samples (n = 20), the results were available for lead determinations carried out 2.5 years before by a different operator using the same procedure and instrumentation. The mean (SD) lead concentration in this subset was 71.2 (34.6) µg/L (range, 17.4–140.5 µg/L), and the SDp was 2.2 µg/L (3.0%). The distribution of the differences between measured values for the same sample as a function of mean lead concentration is shown in Fig. 4 as Bland–Altman plots (42) for the whole group and the subset. These data did not indicate a difference in precision between control and patient samples, and the subset provided additional information on the robustness of the method.



View larger version (15K):
[in this window]
[in a new window]
 
Figure 4. Intermediate precision study on human blood samples.

(A), duplicate analyses, 10–15 days apart; (B), duplicate analyses, 2.5 years apart.

trueness
Trueness was assessed from the analysis of CRMs, from recovery studies, and by comparison with target values of other RMs (candidate EQA samples). All samples were analyzed at least 10 times each within the same run (repeatability conditions).

analysis of CRMS
Two CRMs were available for the determination of lead in blood at concentrations within the range applicable to the present method: BCR CRM 194 (IRMM) and SRM 955b Level 1 (NIST). Both were analyzed in this study to estimate trueness. In addition to different physical states (lyophilized vs frozen liquid), the target values of these CRMs have been assigned by different approaches. For BCR 194, the target value was obtained in 1985 as the consensus mean of the values provided by 23 expert laboratories using different techniques [flame atomic absorption spectroscopy, ETAAS, anodic stripping voltammetry, and isotope-dilution-MS] (31). According to the certificate accompanying SRM 955b, its target values were determined in 1998 by isotope-dilution-ICP-MS, a technique not available in 1985, and confirmed by ETAAS. According to ISO Guide 35 (43), both approaches are valid; however, under appropriate conditions of use, isotope-dilution-ICP-MS has the potential of a "primary method of measurement" (44). The results (mean, SD, and RSD) of the analysis of the two CRMs are reported in Table 3 . For each CRM, the ratio between each measured value and the certified value was calculated. The mean ratio (Rm) and its RSD are also reported in Table 3 . The agreement with the target value was excellent for BCR CRM 194 (Rm1 = 1.001), whereas for NIST SRM 955b Level 1, we observed a Rm2 of 1.139, indicating an apparent positive bias of the method at this concentration.


View this table:
[in this window]
[in a new window]
 
Table 3. Analysis of CRMs.

recovery studies
Recovery studies were performed on blood samples to which lead had been added. The traceability of the added amounts (target values) was documented by use of data from the manufacturer’s certificate for the stock standard solution and from the calibration certificates of volumetric glassware and pipettes. The results of analysis of the sample without added lead and the two blood samples with lead added (25 and 50 µg/L), as the mean (SD), are given in Table 4 . For each lead-enriched sample, the difference between each measured value and the mean concentration of the sample without added lead was calculated. Rm was obtained as the mean of the ratios between each difference and the target value. The Rm value and RSD are given in Table 4 for each sample with added lead. In both recovery studies, Rm was >1.


View this table:
[in this window]
[in a new window]
 
Table 4. Recovery studies.

analysis of other RMS
In addition to the specific experiments designed to document the trueness of the method by comparison with CRMs with stated uncertainty, we examined the information available from the analyses of other RMs. Nine control samples, prepared for two different EQAS, were analyzed as part of homogeneity and/or certification studies before their distribution to the participants. The target values were obtained either from the data provided by reference laboratories (Scheme A) or from the results provided by all participants (Scheme B). The mean measured value, the SD, RSD, the target value, and the ratio between measured and target value (Rs) for each sample are reported in Table 5 . A substantial difference from the target value was observed only for the sample at the lowest lead concentration (16 µg/L). However, in this case, the robustness of the target value assigned from consensus data is questionable because such a concentration would be close to or below the detection limits of many of the analytical methods used for routine purposes.


View this table:
[in this window]
[in a new window]
 
Table 5. Results of analysis of other RMs.

estimate of the uncertainty of lead determinations
According to the EURACHEM/CITAC Guide (25), the uncertainty of measurement can be estimated from the performance data available from validation and monitoring programs, provided that appropriate quality-control measures are in place and care has been taken to include the relevant sources of uncertainty in the validation study. In such a case, the following information can be used to estimate the uncertainty of measurement: (a) the best available estimate of overall precision [u(P)]; (b) the best available estimate of overall bias (Rm) and its uncertainty u(Rm), calculated from the analysis of CRMs and the recovery of amounts of the pure analyte added to samples; and (c) the best estimate of any other components of uncertainty associated with effects incompletely accounted for in the development and validation study, e.g., differences or inhomogeneities in the matrix composition of the real samples submitted for analysis.

For this method, the concentration (c) of lead in blood can be represented by a simple mathematical model:

where A is the absorbance of the sample, A0 is the absorbance of the blank, and b is the slope of a linear calibration function. The main factors affecting the measurement (sample preparation; instrument calibration; day-to-day variation; batches of reagents, standards, and control materials; matrix effects) were expected to be satisfactorily taken into account by the long-term precision studies and detailed studies of the trueness of the method. No other contribution (item c in the previous paragraph) was judged necessary at this stage. The approach followed to combine the information from the performance studies for the estimate of uncertainty of measurement is outlined below. All terms were expressed as RSD (i.e., relative standard uncertainties).

uncertainty associated with the best available estimate of overall precision
u(P) was evaluated from the RSD of the results obtained in the intermediate precision studies. The RSD obtained for the three control samples analyzed for the intermediate precision study were compared by use of the F-test (95% confidence level). Only the RSDs for the control samples Seronorm level 1 and high were found to be significantly different, suggesting that u(P) varied with concentration. This information was integrated with the data available from the studies on human samples described earlier for three corresponding concentration intervals. The following values for u(P) were obtained for each concentration range [u(P)1 = 0.082 (12–35 µg/L); u(P)2 = 0.062 (>35–90 µg/L); and u(P)3 = 0.052 (>90–150 µg/L)] by combining the RSD for each control sample with the relative SDp given above for the human samples (square root of the sum of the squares).

uncertainty of the bias estimate calculated from the analysis of CRMS and recovery tests
Two CRMs were analyzed to estimate trueness. u(Rm) was calculated for each CRM with the following formula, taking into account the relative standard uncertainty of the certified value (first term) and the relative uncertainty of the measured value as the RSD of the mean (RSDM, second term):

For BCR CRM 194, u(Rm1) was calculated as shown below, using the data from Table 3Up .

For NIST SRM 955b Level 1, u(Rm2) was 0.026.

u(Rm) was calculated from the recovery studies by use of the spreadsheet method (34) and taking into account the relative uncertainty of the amount of lead added to samples and the RSDM of the measured values for the samples with and without added lead. u(Rm3) and u(Rm4) were 0.027 and 0.025, respectively, for recovery of 25 and 50 µg/L lead added to blood.

Because four estimates of trueness (Rm) were available, each with its estimated uncertainty [u(Rm)], these were combined according the following formula:

The combined uncertainty was 0.024.

The significance of the mean bias estimated from the analysis of CRMs and lead-enriched samples could be judged against the combined uncertainty associated with such estimate [uc(Rm)], according to:

where k is the coverage factor applied to provide a confidence interval of ~95%, selected from the t-distribution tables for the appropriate number of degrees of freedom, and m is the mean of the four estimates of the trueness (1.101). It was found that the mean positive bias observed was statistically significant when compared with the combined uncertainty associated with its estimate (k = 1.96). Therefore, a correction should be applied to the individual results or, because the difference between measured and target values was small, the uncorrected bias was taken into account by increasing the uncertainty associated with its estimate according to (45):

uncertainty of the bias estimate, evaluated from the analysis of other RMS
For comparison, the results of the analyses performed on other RMs and reported in Table 5Up were also examined to derive information on the uncertainty of the bias estimate.

For the samples with concentrations between 35.2 and 119 µg/L, Rs ranged from 0.958 to 1.127, with a mean (SD) of 1.013 (0.052). This SD value can be taken as an approximate estimate of the uncertainty associated with the assessment of the method bias and compared with that obtained by more rigorous procedures, such as analysis of CRMs and recovery studies.

Similar exercises can be performed on archived EQA samples when other CRMs are not available to obtain at least a first estimate of the trueness of the method and its uncertainty, provided that sufficient confidence can be placed on the target values.

combined uncertainty and expanded uncertainty
The overall relative uncertainty was obtained, according to concentration, by combining the corresponding u(P) contribution with uc(Rm) for the three concentration ranges stated previously, giving values of 0.102, 0.087, and 0.080. The expanded relative uncertainties, for a 95% confidence level, were calculated using k = 1.96 and were 0.20, 0.17, and 0.16 for the concentrations intervals of 9.4–35, >35–90, and >90–150 µg/L.

monitoring of method performance: participation in eqas
Over the period covered by this study, blood samples were received as part of our laboratory’s participation in an EQAS and were analyzed under the conditions applied in our laboratory for any patient specimen (two times each, under repeatability conditions). The individual results obtained for the eight samples with lead concentrations within the scope of this method are presented in Fig. 5 as a plot of the relative differences from the target values (y) vs the target values (x) and compared with the stated expanded uncertainty of the method. Twelve of the 16 results fell within the target value ± expanded uncertainty interval. Only the results for the two samples with concentrations <23 µg/L did not, but as mentioned previously, some doubt could exist for the robustness of target values assigned by consensus from data close to the detection limits of routine methods.



View larger version (12K):
[in this window]
[in a new window]
 
Figure 5. Comparison of measured and target values for EQA samples.


   Discussion
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
We present the results for a study aimed at validating a method for the determination of lead in blood and estimating the uncertainty of these measurements. The method is a further refinement of existing ETAAS methods in our laboratory (28)(29), adapted to the transverse-heated graphite atomizer furnace and focused on the determinations of low (<150 µg/L) lead concentrations similar to those observed at present in samples from the general population. A furnace program was developed that was capable of using a considerably less diluted blood sample (1:1) than is typically analyzed. This was based on longer drying and charring steps and the use of an air-ashing step to prevent carbon build-up. Because the method presented here was intended for the accurate measurement of low blood lead concentrations, it should not be applied to the screening of occupationally exposed individuals. Blood samples with expected lead concentrations >150 µg/L would be better analyzed by other methods that use larger sample dilutions and shorter furnace programs.

The primary aim of the study was to show in practice how data already available to laboratories as a result of their quality-assurance procedures and in-house validation studies could be used to estimate the uncertainty of measurement. To obtain a reliable estimate of the method precision, which is often the main component of uncertainty, we studied intermediate precision over an extended period of time, using both control and patient samples. The contribution to uncertainty attributable to imprecision was estimated as between 8.2% and 5.2%, depending on the lead concentration.

We assessed the bias of the method by different approaches: analysis of CRMs, recovery studies based on the addition to blood samples of lead concentrations with known uncertainties, and analysis of other RMs (e.g., archived EQA samples). This was done with the aim of demonstrating how such different approaches can be applied and to compare their outcomes. The example of the assay of lead in blood by ETAAS was well suited for this purpose because the properties and the state of the art of the technique are well documented, because both CRMs and pure standards are available, and because several well-established EQAS are active. The results of this study highlighted differences between the information provided by the analysis of the two available CRMs, whose target values were certified by different approaches and fell at opposite ends of the stated scope of the method. Recovery studies were then used to confirm the presence of a small positive bias, and the results were cumulated for the evaluation of the uncertainty component associated with bias (±6.0%).

The strength of the traceability chain varies inversely with the uncertainty associated with the reference values used for comparison. However, to provide a valid and unbiased check of the measurement system, the RMs used in the process of validating a method should not only have traceable reference values but should resemble as closely as possible the samples to be analyzed. Several factors, such as chemical species of the analyte, concentration range, matrix effects, potential interferents, and physical state, may have a role and should be considered. As a complementary approach to the analysis of CRMs (or as an alternative, if none is available), the analysis of other RMs allowed assessment of the trueness of the method over the entire range of concentrations within its scope, providing a comparable estimate of the uncertainty component associated with bias (±5.2%). It should be recognized, however, that this approach may not apply to every assay.

The components of uncertainty associated with precision and trueness were of similar size except for the lowest concentration range, where the precision component was 1.4-fold larger than that associated with trueness. This shows that evaluations based solely on precision data are likely to underestimate the actual uncertainty associated with ETAAS measurements of lead in blood.

Because the uncertainty of measurement was estimated globally from the method performance data, rather than from the uncertainty contribution associated with each influence quantity described in the mathematical model of the measurement, further insight on the main factors contributing to the uncertainty of measurement was not possible. However, in a previous report, Kristiansen et al. (46) discussed the estimate of the uncertainty of measurement in ETAAS from its individual components and used the measurement of lead in blood within the range 0.072–2.00 µmol/L (15–415 µg/L) as an example. The uncertainties of the atomic and blank signals accounted for 75–90% of the total variance at low concentrations, whereas at the other end, the uncertainty of the calibration slope gave the largest contribution.

In conclusion, according to our study, an expanded uncertainty (95%) of 17% should be associated with measurements between 35 and 150 µg/L, which increased to 20% between 9.4 and 35 µg/L. This uncertainty value is compatible with the quality specifications for lead in blood adopted by CLIA ’88 (21), which are ± 4 µg/dL or ±10%, whichever is greater, and the Network of European Organisers of EQAS in occupational and environmental medicine (20). It also supports the view that carefully validated methods, using currently available technology, can provide even better results (47) because it is recognized that such limits are still too wide for laboratories investigating lead concentrations in blood of potentially exposed children (4). On the other hand, accurate assessment by ETAAS methods of the current blood lead concentrations for the general population may be difficult because concentrations are now close to the LoQ of this technique. In this case, it would be desirable to apply more sensitive procedures or to confirm the accuracy of data by means of alternative analytical techniques (48).


   Acknowledgments
 
We acknowledge the financial support of the Italian Ministry of Health, Project "Human Exposure to Xenobiotics with Potential Endocrine Activity: Evaluation of Reproductive and Developmental Risks" (Grant 99C/1999); the Italian Ministry of Health, Project "Validation of Strategies, Methods and Markers for Environmental and Biological Monitoring of Occupational Exposure to Xenobiotics" (Grant 176/2001); the Istituto Superiore di Sanità, Project "Metrology and Quality Improvement in Preventive, Environmental and Occupational Laboratory Medicine" (Grant RI 1036/2036); and the Istituto Superiore di Sanità, Project "The Clinical Laboratory in Preventive, Environmental and Occupational Medicine: Biomarkers, and Predictive Factors" (Grant RI1033/2033).


   Footnotes
 
1 ETAAS, electrothermal atomic absorption spectrometry; ICP-MS, inductively coupled plasma mass spectrometry; EQAS, External Quality Assessment Scheme; SI, International System; CRM, certified reference material; RM, reference material; LoD, limit of detection; LoQ, limit of quantification; RSD, relative SD; and SDp, pooled SD.


   References
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 

  1. European Economic Community. Council Directive 82/605/EEC of 28 July 1982 on the protection of workers from the risks related to exposure to metallic lead and its ionic compounds at work (first individual Directive within the meaning of Article 8 of Directive 80/1107/EEC). Off J No L 247;23/8/1982:12–21..
  2. European Economic Community. Council Directive 98/24/EC of 7 April 1998 on the protection of the health and safety of workers from the risks related to chemical agents at work [fourteenth individual Directive within the meaning of Article 16(1) of Directive 89/391/EEC]. Off J No L 131;05/05/1998:11–23..
  3. European Economic Community. Council Directive 77/312/EEC of 29 March 1977 on biological screening of the population for lead. Off J No L 105;28/04/1977:10–7..
  4. . Centers for Disease Control and Prevention. Screening young children for lead poisoning: guidance for state and local public health officials. Appendix C.1 1997 Centers for Disease Control and Prevention Atlanta, GA. .
  5. International Programme on Chemical Safety (IPCS). WHO Task Group on Environmental Health criteria for lead. Lead, Environmental Health Criteria 3 1977 WHO Geneva. .
  6. International Programme on Chemical Safety (IPCS). WHO Task Group on Environmental Health criteria for lead. Inorganic lead, Environmental Health Criteria 165 1995 WHO Geneva. .
  7. . National Committee for Clinical Laboratory Standards. Analytical procedures for the determination of lead in blood and urine; approved guideline. NCCLS document C40-A 2001 NCCLS Wayne, PA. .
  8. Subramanian KS. Determination of lead in blood by graphite furnace atomic absorption spectrometry—a critique. Sci Total Environ 1989;89:237-250.[CrossRef][Medline] [Order article via Infotrieve]
  9. Menditto A, Chiodo F, Patriarca M, Morisi G, eds. Evoluzione dell’esposizione al piombo negli ambienti di vita e di lavoro in Italia. Indagini effettuate nel periodo 1978–1996. Ann Ist Super Sanita 1998;34:1–164..
  10. Pirkle JL, Brody DJ, Gunter EW, Kramer RA, Paschal DC, Flegal KM, et al. The decline in blood lead levels in the United States. The National Health and Nutrition Examination Surveys (NHANES). JAMA 1994;272:284-291.[Abstract/Free Full Text]
  11. Pirkle JL, Kaufmann RB, Brody DJ, Hickman T, Gunter EW, Paschal DC. Exposure of the U.S. population to lead, 1991–1994. Environ Health Perspect 1998;106:745-750.[Web of Science][Medline] [Order article via Infotrieve]
  12. White MA, Sabbioni E. Trace element reference values in tissues from inhabitants of the European Union X. A study of 13 elements in blood and urine of a United Kingdom population. Sci Total Environ 1998;216:253-270.[CrossRef][Medline] [Order article via Infotrieve]
  13. Apostoli P, Baj A, Bavazzano P, Ganzi A, Neri G, Ronchi A, et al. Blood lead reference values: the results of an Italian polycentric study. Sci Total Environ 2002;287:1-11.[CrossRef][Medline] [Order article via Infotrieve]
  14. Menditto A, Chiodo F, Patriarca M, Morisi G. Esposizione al piombo: valutazione del rischio per la popolazione generale italiana negli anni ’90. Ann Ist Super Sanita 1998;34:27-40.[Medline] [Order article via Infotrieve]
  15. Lanphear BP, Dietrich K, Auinger P, Cox C. Cognitive deficits associated with blood lead concentrations <10 µg/dL in US children and adolescents. Public Health Reports 2000;115:521-529.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  16. Payton M, Riggs KM, Avron S, Weiss ST, Howard H. Relations of bone and blood lead to cognitive function: the VA normative aging study. Neurotoxicol Teratol 1998;20:19-27.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  17. Siddiqui MK, Srivastava S, Mehrotra PK. Environmental exposure to lead as a risk for prostate cancer. Biomed Environ Sci 2002;15:298-305.[Web of Science][Medline] [Order article via Infotrieve]
  18. Lin JL, Lin-Tan DT, Hsu KH, Yu CC. Environmental lead exposure and progression of chronic renal disease in patients without diabetes. N Engl J Med 2003;348:277-286.[Abstract/Free Full Text]
  19. Glenn BS, Stewart WF, Links JM, Todd AC, Schwartz BS. The longitudinal association of lead with blood pressure. Epidemiology 2003;14:30-36.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  20. Taylor A, Angerer J, Claeys F, Kristiansen J, Mazarrasa O, Menditto A, et al. Comparison of procedures for evaluating laboratory performance in external quality assessment schemes for lead in blood and aluminum in serum demonstrates the need for common quality specifications. Clin Chem 2002;48:2000-2007.[Abstract/Free Full Text]
  21. . US Department of Health and Human Services. Medicare, Medicaid and the CLIA programs; regulations implementing the Clinical Laboratory Improvement Amendments of 1988 (CLIA). Final rule. Fed Regist 1992;57:149-162.
  22. . International Standards Organization. ISO/IEC 17025. General requirements for the competence of calibrating and testing laboratories 1999 ISO Geneva. .
  23. . International Standards Organization. ISO 15189. Medical laboratories—particular requirements for quality and competence 2003 ISO Geneva. .
  24. . International Standards Organization. ISO guide to the expression of uncertainty in measurement 1995 ISO Geneva. .
  25. EURACHEM/CITAC. Quantifying uncertainty in analytical measurement, 2nd ed (2000). http://www.eurachem.ul.pt (accessed June 2004)..
  26. Morisi G, Patriarca M, Bortoli A, Mattiello G, Gelosa L, Fortuna E, et al. Italian results in a quality control program for the determination of lead in blood. EEC directive 312/29–3-1977. Ann Ist Super Sanita 1983;19:323-334.[Medline] [Order article via Infotrieve]
  27. Morisi G, Patriarca M, Carrieri MP, Fondi G, Taggi F. Lead exposure: assessment of the risk for the general Italian population. Ann Ist Super Sanita 1989;25:423-436.[Medline] [Order article via Infotrieve]
  28. Morisi G, Patriarca M, Macchia T. Caratterizzazione del metodo per la determinazione del piombo nel sangue in assorbimento atomico col fornetto di grafite e la piattaforma di L’vov. Ann Ist Super Sanita 1982;18:587-590.[Medline] [Order article via Infotrieve]
  29. Patriarca M, Morisi G. Metodo raccomandato per la determinazione del piombo nel sangue. G Ital Chim Clin 1987;12:51-56.
  30. Morisi G, Patriarca M, Taggi F. Comparable laboratory performances in the analysis of lead in control samples and in fresh human blood. Ann Ist Super Sanita 1989;25:417-422.[Medline] [Order article via Infotrieve]
  31. Yeoman WB, Colinet E, Griepink B. The certification of lead and cadmium in three lyophilized blood materials. EUR 10380 EN 1985 Commission of the European Communities Luxembourg. .
  32. Morisi G, Patriarca M, Taggi F. The interlaboratorial quality assurance program for blood lead determination. An evaluation of methods and results. Ann Ist Super Sanita 1989;25:405-416.[Medline] [Order article via Infotrieve]
  33. Menditto A, Palleschi S, Minoprio A, Rossi B, Chiodo F, Patriarca M, et al. Quality assurance in biological monitoring of environmental exposure to pollutants: from reference materials to external quality assessment schemes. Microchem J 2000;67:313-337.[CrossRef]
  34. Kragten J. Calculating standard deviations and confidence intervals with a universally applicable spreadsheet technique. Analyst 1994;119:2161-2166.[CrossRef]
  35. Menditto A, Patriarca M, Chiodo F, Morisi G. The Italian external quality assessment scheme for trace element analysis in body fluids. Ann Ist Super Sanita 1996;32:261-270.[Medline] [Order article via Infotrieve]
  36. Taylor A, Briggs RJ. The Guildford trace elements external quality assessment scheme. Ann Ist Super Sanita 1996;32:253-259.[Medline] [Order article via Infotrieve]
  37. Ramm RH, Lehnert G, Angerer J. The German external quality assessment scheme in occupational and environmental medicine. Ann Ist Super Sanita 1996;32:247-251.[Medline] [Order article via Infotrieve]
  38. EURACHEM Working Group. The fitness for purpose of analytical methods. A laboratory guide to method validation and related topics (1998). http://www.eurachem.ul.pt/index.htm (accessed June 2004)..
  39. Parsons PJ, Slavin W. A rapid Zeeman graphite furnace atomic absorption spectrometric method for the determination of lead in blood. Spectrochim Acta 1993;48B:925-939.
  40. Jacobson EB, Lockitch G, Quigley G. Improved sample preparation for accurate determination of low concentrations of lead in whole blood by graphite furnace analysis. Clin Chem 1991;37:515-519.[Abstract/Free Full Text]
  41. Bannon DI, Murashchik C, Zapf CR, Farfel MR, Chisolm JJ, Jr. Graphite furnace atomic absorption spectroscopic measurement of blood lead in matrix-matched standards. Clin Chem 1994;40:1730-1734.[Abstract/Free Full Text]
  42. Bland JM, Altman DG. Statistical methods for assessing agreement between to methods of clinical measurement. Lancet 1986;i:307-310.
  43. . International Standards Organization. ISO Guide 35. Certification of reference material. General and statistical principles, 2nd ed. 1989 ISO Geneva. .
  44. . Consultative Committee for Amount of Substance. Report of the 4th meeting (February 1998) 1998:27,71 Bureau International des Poids et Mesures Paris. .
  45. Barwick JV, Ellison SLR. The evaluation of measurement uncertainty from method validation studies. Accred Qual Assur 2000;5:47-53.
  46. Kristiansen J, Molin Christensen J, Nielsen JL. Uncertainty of atomic absorption spectrometry: application to the determination of lead in blood. Mikrochim Acta 1996;123:241-249.[CrossRef]
  47. Parsons PJ, Geraghty C, Verostek MF. An assessment of contemporary atomic spectroscopic techniques for the determination of lead in blood and urine matrices. Spectrochim Acta 2001;56B:1593-1604.
  48. Patriarca M, Lyon TDB, Delves HT, Howatson AG, Fell GS. Determination of low concentrations of potentially toxic elements in human liver from newborns and infants. Analyst 1999;124:1337-1343.[CrossRef][Medline] [Order article via Infotrieve]



The following articles in journals at HighWire Press have cited this article:


Home page
Clin. Chem.Home page
D. Stockl, K. Van Uytfanghe, D. R. Cabaleiro, L. M. Thienpont, M. Patriarca, M. Castelli, F. Corsetti, and A. Menditto
Calculation of Measurement Uncertainty in Clinical Chemistry * The authors of the article cited above respond:
Clin. Chem., January 1, 2005; 51(1): 276 - 277.
[Full Text] [PDF]


Home page
Clin. Chem.Home page
Correction for Volume 50, Issue , p. 1396
Clin. Chem., January 1, 2005; 51(1): 281 - 281.
[Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow An erratum has been published
Right arrow All Versions of this Article:
clinchem.2003.029223v1
50/8/1396    most recent
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (10)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Patriarca, M.
Right arrow Articles by Menditto, A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Patriarca, M.
Right arrow Articles by Menditto, A.
Related Collections
Right arrow Laboratory Management
Right arrow Drug Monitoring and Toxicology
Right arrow Automation and Analytical Techniques


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS