|
|
||||||||
Laboratory Management |
Clinical Biochemistry Laboratory, Istituto Superiore di Sanità, Viale Regina Elena 299, 00161 Rome, Italy
aAuthor for correspondence. Fax 39-0649903686; e-mail marina.patriarca{at}iss.it.
| Abstract |
|---|
|
|
|---|
Methods: We validated a method to determine lead in blood at concentrations up to 150 µg/L by electrothermal atomic absorption spectrometry with Zeeman background correction according to EURACHEM guidelines. Blood samples were diluted (1:1 by volume) with 2 mL/L Triton X-100. NH4H2PO4 (5 g/L) and Mg(NO3)2 (0.5 g/L) were used as modifiers. Matrix-matched standards were used for calibration.
Results: We determined the limits of detection (3.1 µg/L) and quantification (9.4 µg/L). Repeatability and intermediate imprecision within the range 35150 µg/L were <5.5% and <6.0%, respectively. We assessed trueness by use of certified reference materials, by recovery tests, and by comparison with target values of other reference materials (candidate external quality assessment samples). The expanded uncertainty ranged from 20% to 16% (with a confidence level of 95%) depending on concentration.
Conclusions: This study provides a working example of the estimate of uncertainty from method performance data according to the EURACHEM/CITAC guidelines. The estimated uncertainty is compatible with quality specifications for the analysis of lead in blood adopted in the US and the European Union.
| Introduction |
|---|
|
|
|---|
In most industrialized countries, improvements in working conditions and actions taken to minimize the environmental exposure to lead (such as the phase-out of leaded gasoline and improvements in food preparation and packaging) have led to a substantial reduction of lead concentrations in blood in both workers and the general population (9). In the US, a reduction of 78% in the mean lead concentration in blood (from 128 to 28 µg/L) was observed in phase 1 of the third National Health and Nutrition Examination Survey (19881991; n = 12 119) compared with the second such survey (19761980; n = 9832) (10), and was later confirmed in additional studies (11). In 1998, blood lead concentrations ranging from 5 to 132 µg/L were reported for a sample of 214 nonexposed British individuals (12). In Italy as well, a recent study (13) reported mean (SD) values for lead in blood of 45.1 (27.4) µg/L for males and 30.6 (16.7) µg/L for females compared with median values of 86 µg/L (2.5th-97.5th centiles, 30230.5 µg/L) for males and 53.5 µg/L (20151.5 µg/L) for females between 1992 and 1996 (14).
However, attention is now being given to the potential health effects of long-term exposure to low lead concentrations, such as cognitive disorders and effects on renal function and blood pressure (15)(16)(17)(18)(19). The assessment of such risks is still based on the measurement of the blood lead concentration; therefore, the quality of analytical data at such low concentrations is of the utmost importance. Collaborative work carried out within the framework of the "European Network of Organizers of External Quality Assessment Schemes (EQAS) related to Occupational and Environmental Medicine" (EU Contract SMT 4-CT98-7522) has highlighted large differences in performance among laboratories for the determination of lead in blood at concentrations of 100, 400, and 700 µg/L (20), and few data are available describing the degree of comparability of laboratory results at concentrations <100 µg/L.
Currently, in many fields of analytical work, laboratories are formally required (sometimes by law) to demonstrate their competence by seeking accreditation to the appropriate national or international standards, such as CLIA 88 in the US (21) and ISO/IEC 17025 (22) or ISO 15189(23) in the European Union and other parts of the world. Such standards require laboratories to use validated analytical methods and well-defined internal quality-control procedures and to participate in proficiency testing schemes. In addition, the ISO standards recommend that traceability to International System (SI) units and the uncertainty (24) of the measurements be established whenever possible.
Additional guidance on the estimate of the uncertainty of measurement in analytical chemistry is detailed in the EURACHEM/CITAC Guide (25), in particular with respect to the use of performance data already available within a laboratory provided that appropriate quality-assurance measures are in place. Such data should generally include information on the overall precision of the method, the assessment of any significant bias, and estimates of the uncertainties associated with other relevant sources, such as residual matrix effects. A key issue in such an approach is the ability to document the size of any systematic bias affecting the measurement and the uncertainty associated with such an estimate. This can be difficult in occupational and environmental laboratory medicine because the concentrations of analytes to be determined in complex matrices are often close to detection limits and few certified reference materials (CRMs) are available. However, laboratories are still required to perform such analyses and to give an indication of their quality.
Our laboratory has been particularly concerned with the quality of analytical results for the determination of lead in blood because of our involvement with the European surveys of the general population (26)(27). This has led us to investigate the performance of analytical methods (28)(29), to evaluate and certify reference materials (RMs) (30)(31), and to organize a national EQAS for lead in blood to assess the performance of Italian laboratories in this field (32)(33). In this context, the aim of the work reported here was to estimate the uncertainty of our own measurements of low concentrations of lead in blood and to provide a practical example of how data from validation studies can be used for such purposes. In addition, we discuss the different approaches taken to demonstrate traceability to SI units.
| Materials and Methods |
|---|
|
|
|---|
reagents, reference materials, and solutions
During the study, two certified lead stock standard solutions from Merck KgaA at concentrations (tolerance interval) of 1008 (2) mg/L and 999 (5) mg/L were used. According to the supplier, traceability of the stock solutions to SI units was assured by traceable gravimetric procedures or by measurement with high-precision ICP-optical emission spectroscopy calibrated against SRM 3128 "Lead standard solution" (NIST).
Five working lead standards were prepared by adding to bovine blood, collected in EDTA, known amounts of lead. Intermediate standard solutions at 0, 0.625, 1.25, 2.50, and 3.75 mg/L were prepared in aqueous HNO3 (2 mL/L; 65% Suprapure; maximum lead concentration, 1 ppb; Merck) from the 1008 mg/L stock standard solution. We diluted 2 mL of each intermediate standard solution to 50 mL with bovine blood to obtain matrix-matched lead standards at 0, 25, 50, 100, and 150 µg/L. The blood solutions were divided into 1-mL aliquots in Eppendorf vials and stored at 20 °C. The uncertainty of the concentrations of the working standards, calculated according to the EURACHEM/CITAC guide (25) using the spreadsheet method (34), was 0.6%.
A modifier was prepared by dissolving 2.5 g of NH4H2PO4 (99.999%) and 0.25 g of Mg(NO3)2 · 6 H2O (99.999+%), both from Aldrich, in 150 mL of ultrapure water. The solution was further purified by the addition of 2 mL of 20 g/L ammonium pyrrolidine-dithiocarbamate (Merck) in water and extraction with chloroform (Carlo Erba Reagenti); the purified solution was then brought to a volume of 500 mL. Triton® X-100 (Fluka; 2 mL/L) was used to dilute blood samples. Ultrapure water, at 18.2 M
/cm, obtained from a Millipore (Elix 3/MilliQ) combined system for water purification, was used throughout the study.
Two CRMs, BCR CRM 194 (Community Bureau of Reference), with a target value of 126 (4) µg/L, (Institute for Reference Materials and Measurements, Geel, Belgium) and NIST SRM 955b, with a target value of 40.4 (1.5) µg/L, were used for validating the method.
Other RMs, SeronormTM Trace Elements Whole Blood, Level 1 (lot no. 404107) and Level 2 (lot no. MR9067), prepared from human blood, were obtained from Sero AS and reconstituted with 5 mL of ultrapure water according to the manufacturers instructions. Internal control materials at concentrations of 85 µg/L (medium) and 129 µg/L (high) were prepared by mixing known amounts of Seronorm Trace Elements Whole Blood, Level 1 and Level 2.
Human blood samples, obtained from 50 individuals undergoing screening programs for blood lead and stored frozen at 20 °C, were also included in the validation study. The samples were anonymous and provided by clinicians for the assessment of lead exposure, for which informed consent was provided.
For recovery studies, the 999 mg/L lead stock standard solution was diluted with aqueous 2 mL/L HNO3 to obtain solutions containing 0.62 and 1.24 mg/L. We diluted 1 mL of 2 mL/L HNO3 or 1 mL of each diluted lead solution to 25 mL with bovine blood to obtain a sample with no added lead and two samples, one containing 25 µg/L and the other 50 µg/L of added lead.
Blood samples provided as part of EQAS (35)(36)(37) were also analyzed to provide additional information on the trueness of the method at different concentrations and its long-term performance.
graphite furnace atomic absorption analysis
A blank (ultrapure water), blood samples, and matrix-matched working standards were diluted 1:1 with 2 mL/L Triton X-100 by use of a Gilson automatic pipette and were analyzed in duplicate. The autosampler was programmed to pipette a volume of 15 µL of modifier, followed by 15 µL of the diluted blood sample or standard, and the two (total volume, 30 µL) were simultaneously injected into the furnace. The instrument settings are shown in Table 1
, and the graphite furnace program is shown in Table 2
. A calibration curve was obtained daily as follows: the absorbance given by the blood with no added lead was subtracted from the readings for the other calibration materials, and the regression line of the absorbances (y) vs concentrations of the working standard solutions (x) was calculated, with the condition imposed that the intercept = 0, i.e., the regression line was forced through the origin. This procedure was adopted to improve the precision of measurements of low concentrations of lead because the observed variations of the intercept values (typically, ±0.001 absorbance units x s) would have caused variations >5% at lead concentrations <25 µg/L.
|
|
| Results |
|---|
|
|
|---|
linear range and sensitivity
We assessed the linearity of calibration curves up to 150 µg/L and the variation in sensitivity over the lifetime (8 different runs and 440 firings) of a graphite tube. The results are shown in Fig. 1
. The correlation coefficient (r) was
0.999. The mean (SD) sensitivity as m0 (the mass of the analyte, in pg, required to produce an integrated absorbance of 0.0044 absorbance units x s) was 41.8 (0.9) pg for blood samples and 39.3 (0.8) pg (n = 5) for aqueous standards in 2 mL/L HNO3 analyzed under the same conditions. This accounts for a difference in sensitivity of
6%. Therefore, calibration with matrix-matched standards was still deemed necessary for accurate measurements.
|
precision studies
We assessed repeatability (within-run precision) by analyzing 17 control samples (concentrations range, 12132 µg/L) 10 times in the same run. The trend of the relative standard deviation (RSD%) with increasing concentration is shown in Fig. 2
. These results are comparable to those obtained in previous studies in our laboratory (28)(29) and to those reported by others (39)(40)(41).
|
The Seronorm Level 1 and the internally prepared medium and high control samples were used to study intermediate precision over a period of
16 months. The analyses were performed by one operator on 29 occasions. The mean (SD) concentrations (RSD in parentheses) were, respectively, 34.8 (2.6) µg/L (7.5%) for Seronorm Level 1, 85.5 (5.1) µg/L (6.0%) for the medium control, and 128.4 (6.8) µg/L (5.3%) for the high control. The results are plotted as a control chart in Fig. 3
. These values are comparable to those reported in the recent literature for similar concentrations (39)(40)(41).
|
An additional study of intermediate precision was carried out with 50 human blood samples, all of which were analyzed on two different occasions over a period of 2 weeks. The mean (SD) concentration was 44.1 (32.9) µg/L (range, 12.0139.1 µg/L). Intermediate precision was calculated as the pooled SD (SDp), according to the formula:
![]() |
|
trueness
Trueness was assessed from the analysis of CRMs, from recovery studies, and by comparison with target values of other RMs (candidate EQA samples). All samples were analyzed at least 10 times each within the same run (repeatability conditions).
analysis of CRMS
Two CRMs were available for the determination of lead in blood at concentrations within the range applicable to the present method: BCR CRM 194 (IRMM) and SRM 955b Level 1 (NIST). Both were analyzed in this study to estimate trueness. In addition to different physical states (lyophilized vs frozen liquid), the target values of these CRMs have been assigned by different approaches. For BCR 194, the target value was obtained in 1985 as the consensus mean of the values provided by 23 expert laboratories using different techniques [flame atomic absorption spectroscopy, ETAAS, anodic stripping voltammetry, and isotope-dilution-MS] (31). According to the certificate accompanying SRM 955b, its target values were determined in 1998 by isotope-dilution-ICP-MS, a technique not available in 1985, and confirmed by ETAAS. According to ISO Guide 35 (43), both approaches are valid; however, under appropriate conditions of use, isotope-dilution-ICP-MS has the potential of a "primary method of measurement" (44). The results (mean, SD, and RSD) of the analysis of the two CRMs are reported in Table 3
. For each CRM, the ratio between each measured value and the certified value was calculated. The mean ratio (Rm) and its RSD are also reported in Table 3
. The agreement with the target value was excellent for BCR CRM 194 (Rm1 = 1.001), whereas for NIST SRM 955b Level 1, we observed a Rm2 of 1.139, indicating an apparent positive bias of the method at this concentration.
|
recovery studies
Recovery studies were performed on blood samples to which lead had been added. The traceability of the added amounts (target values) was documented by use of data from the manufacturers certificate for the stock standard solution and from the calibration certificates of volumetric glassware and pipettes. The results of analysis of the sample without added lead and the two blood samples with lead added (25 and 50 µg/L), as the mean (SD), are given in Table 4
. For each lead-enriched sample, the difference between each measured value and the mean concentration of the sample without added lead was calculated. Rm was obtained as the mean of the ratios between each difference and the target value. The Rm value and RSD are given in Table 4
for each sample with added lead. In both recovery studies, Rm was >1.
|
analysis of other RMS
In addition to the specific experiments designed to document the trueness of the method by comparison with CRMs with stated uncertainty, we examined the information available from the analyses of other RMs. Nine control samples, prepared for two different EQAS, were analyzed as part of homogeneity and/or certification studies before their distribution to the participants. The target values were obtained either from the data provided by reference laboratories (Scheme A) or from the results provided by all participants (Scheme B). The mean measured value, the SD, RSD, the target value, and the ratio between measured and target value (Rs) for each sample are reported in Table 5
. A substantial difference from the target value was observed only for the sample at the lowest lead concentration (16 µg/L). However, in this case, the robustness of the target value assigned from consensus data is questionable because such a concentration would be close to or below the detection limits of many of the analytical methods used for routine purposes.
|
estimate of the uncertainty of lead determinations
According to the EURACHEM/CITAC Guide (25), the uncertainty of measurement can be estimated from the performance data available from validation and monitoring programs, provided that appropriate quality-control measures are in place and care has been taken to include the relevant sources of uncertainty in the validation study. In such a case, the following information can be used to estimate the uncertainty of measurement: (a) the best available estimate of overall precision [u(P)]; (b) the best available estimate of overall bias (Rm) and its uncertainty u(Rm), calculated from the analysis of CRMs and the recovery of amounts of the pure analyte added to samples; and (c) the best estimate of any other components of uncertainty associated with effects incompletely accounted for in the development and validation study, e.g., differences or inhomogeneities in the matrix composition of the real samples submitted for analysis.
For this method, the concentration (c) of lead in blood can be represented by a simple mathematical model:
![]() |
where A is the absorbance of the sample, A0 is the absorbance of the blank, and b is the slope of a linear calibration function. The main factors affecting the measurement (sample preparation; instrument calibration; day-to-day variation; batches of reagents, standards, and control materials; matrix effects) were expected to be satisfactorily taken into account by the long-term precision studies and detailed studies of the trueness of the method. No other contribution (item c in the previous paragraph) was judged necessary at this stage. The approach followed to combine the information from the performance studies for the estimate of uncertainty of measurement is outlined below. All terms were expressed as RSD (i.e., relative standard uncertainties).
uncertainty associated with the best available estimate of overall precision
u(P) was evaluated from the RSD of the results obtained in the intermediate precision studies. The RSD obtained for the three control samples analyzed for the intermediate precision study were compared by use of the F-test (95% confidence level). Only the RSDs for the control samples Seronorm level 1 and high were found to be significantly different, suggesting that u(P) varied with concentration. This information was integrated with the data available from the studies on human samples described earlier for three corresponding concentration intervals. The following values for u(P) were obtained for each concentration range [u(P)1 = 0.082 (1235 µg/L); u(P)2 = 0.062 (>3590 µg/L); and u(P)3 = 0.052 (>90150 µg/L)] by combining the RSD for each control sample with the relative SDp given above for the human samples (square root of the sum of the squares).
uncertainty of the bias estimate calculated from the analysis of CRMS and recovery tests
Two CRMs were analyzed to estimate trueness. u(Rm) was calculated for each CRM with the following formula, taking into account the relative standard uncertainty of the certified value (first term) and the relative uncertainty of the measured value as the RSD of the mean (RSDM, second term):
![]() |
For BCR CRM 194, u(Rm1) was calculated as shown below, using the data from Table 3
.
![]() |
For NIST SRM 955b Level 1, u(Rm2) was 0.026.
u(Rm) was calculated from the recovery studies by use of the spreadsheet method (34) and taking into account the relative uncertainty of the amount of lead added to samples and the RSDM of the measured values for the samples with and without added lead. u(Rm3) and u(Rm4) were 0.027 and 0.025, respectively, for recovery of 25 and 50 µg/L lead added to blood.
Because four estimates of trueness (Rm) were available, each with its estimated uncertainty [u(Rm)], these were combined according the following formula:
![]() |
The combined uncertainty was 0.024.
The significance of the mean bias estimated from the analysis of CRMs and lead-enriched samples could be judged against the combined uncertainty associated with such estimate [uc(Rm)], according to:
![]() |
where k is the coverage factor applied to provide a confidence interval of
95%, selected from the t-distribution tables for the appropriate number of degrees of freedom, and
m is the mean of the four estimates of the trueness (1.101). It was found that the mean positive bias observed was statistically significant when compared with the combined uncertainty associated with its estimate (k = 1.96). Therefore, a correction should be applied to the individual results or, because the difference between measured and target values was small, the uncorrected bias was taken into account by increasing the uncertainty associated with its estimate according to (45):
![]() |
uncertainty of the bias estimate, evaluated from the analysis of other RMS
For comparison, the results of the analyses performed on other RMs and reported in Table 5
were also examined to derive information on the uncertainty of the bias estimate.
For the samples with concentrations between 35.2 and 119 µg/L, Rs ranged from 0.958 to 1.127, with a mean (SD) of 1.013 (0.052). This SD value can be taken as an approximate estimate of the uncertainty associated with the assessment of the method bias and compared with that obtained by more rigorous procedures, such as analysis of CRMs and recovery studies.
Similar exercises can be performed on archived EQA samples when other CRMs are not available to obtain at least a first estimate of the trueness of the method and its uncertainty, provided that sufficient confidence can be placed on the target values.
combined uncertainty and expanded uncertainty
The overall relative uncertainty was obtained, according to concentration, by combining the corresponding u(P) contribution with uc(Rm) for the three concentration ranges stated previously, giving values of 0.102, 0.087, and 0.080. The expanded relative uncertainties, for a 95% confidence level, were calculated using k = 1.96 and were 0.20, 0.17, and 0.16 for the concentrations intervals of 9.435, >3590, and >90150 µg/L.
monitoring of method performance: participation in eqas
Over the period covered by this study, blood samples were received as part of our laboratorys participation in an EQAS and were analyzed under the conditions applied in our laboratory for any patient specimen (two times each, under repeatability conditions). The individual results obtained for the eight samples with lead concentrations within the scope of this method are presented in Fig. 5
as a plot of the relative differences from the target values (y) vs the target values (x) and compared with the stated expanded uncertainty of the method. Twelve of the 16 results fell within the target value ± expanded uncertainty interval. Only the results for the two samples with concentrations <23 µg/L did not, but as mentioned previously, some doubt could exist for the robustness of target values assigned by consensus from data close to the detection limits of routine methods.
|
| Discussion |
|---|
|
|
|---|
The primary aim of the study was to show in practice how data already available to laboratories as a result of their quality-assurance procedures and in-house validation studies could be used to estimate the uncertainty of measurement. To obtain a reliable estimate of the method precision, which is often the main component of uncertainty, we studied intermediate precision over an extended period of time, using both control and patient samples. The contribution to uncertainty attributable to imprecision was estimated as between 8.2% and 5.2%, depending on the lead concentration.
We assessed the bias of the method by different approaches: analysis of CRMs, recovery studies based on the addition to blood samples of lead concentrations with known uncertainties, and analysis of other RMs (e.g., archived EQA samples). This was done with the aim of demonstrating how such different approaches can be applied and to compare their outcomes. The example of the assay of lead in blood by ETAAS was well suited for this purpose because the properties and the state of the art of the technique are well documented, because both CRMs and pure standards are available, and because several well-established EQAS are active. The results of this study highlighted differences between the information provided by the analysis of the two available CRMs, whose target values were certified by different approaches and fell at opposite ends of the stated scope of the method. Recovery studies were then used to confirm the presence of a small positive bias, and the results were cumulated for the evaluation of the uncertainty component associated with bias (±6.0%).
The strength of the traceability chain varies inversely with the uncertainty associated with the reference values used for comparison. However, to provide a valid and unbiased check of the measurement system, the RMs used in the process of validating a method should not only have traceable reference values but should resemble as closely as possible the samples to be analyzed. Several factors, such as chemical species of the analyte, concentration range, matrix effects, potential interferents, and physical state, may have a role and should be considered. As a complementary approach to the analysis of CRMs (or as an alternative, if none is available), the analysis of other RMs allowed assessment of the trueness of the method over the entire range of concentrations within its scope, providing a comparable estimate of the uncertainty component associated with bias (±5.2%). It should be recognized, however, that this approach may not apply to every assay.
The components of uncertainty associated with precision and trueness were of similar size except for the lowest concentration range, where the precision component was 1.4-fold larger than that associated with trueness. This shows that evaluations based solely on precision data are likely to underestimate the actual uncertainty associated with ETAAS measurements of lead in blood.
Because the uncertainty of measurement was estimated globally from the method performance data, rather than from the uncertainty contribution associated with each influence quantity described in the mathematical model of the measurement, further insight on the main factors contributing to the uncertainty of measurement was not possible. However, in a previous report, Kristiansen et al. (46) discussed the estimate of the uncertainty of measurement in ETAAS from its individual components and used the measurement of lead in blood within the range 0.0722.00 µmol/L (15415 µg/L) as an example. The uncertainties of the atomic and blank signals accounted for 7590% of the total variance at low concentrations, whereas at the other end, the uncertainty of the calibration slope gave the largest contribution.
In conclusion, according to our study, an expanded uncertainty (95%) of 17% should be associated with measurements between 35 and 150 µg/L, which increased to 20% between 9.4 and 35 µg/L. This uncertainty value is compatible with the quality specifications for lead in blood adopted by CLIA 88 (21), which are ± 4 µg/dL or ±10%, whichever is greater, and the Network of European Organisers of EQAS in occupational and environmental medicine (20). It also supports the view that carefully validated methods, using currently available technology, can provide even better results (47) because it is recognized that such limits are still too wide for laboratories investigating lead concentrations in blood of potentially exposed children (4). On the other hand, accurate assessment by ETAAS methods of the current blood lead concentrations for the general population may be difficult because concentrations are now close to the LoQ of this technique. In this case, it would be desirable to apply more sensitive procedures or to confirm the accuracy of data by means of alternative analytical techniques (48).
| Acknowledgments |
|---|
| Footnotes |
|---|
| References |
|---|
|
|
|---|
The following articles in journals at HighWire Press have cited this article:
![]() |
D. Stockl, K. Van Uytfanghe, D. R. Cabaleiro, L. M. Thienpont, M. Patriarca, M. Castelli, F. Corsetti, and A. Menditto Calculation of Measurement Uncertainty in Clinical Chemistry * The authors of the article cited above respond: Clin. Chem., January 1, 2005; 51(1): 276 - 277. [Full Text] [PDF] |
||||
![]() |
Correction for Volume 50, Issue , p. 1396 Clin. Chem., January 1, 2005; 51(1): 281 - 281. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |