|
|
||||||||
Automation and Analytical Techniques |
1 Department of Clinical Biochemistry and 2
The Regional Endocrine Laboratory, University Hospital Birmingham NHS Foundation Trust, University of Birmingham, Birmingham, United Kingdom.
3 Oxford Centre for Diabetes, Endocrinology & Metabolism, University of Oxford, Oxford, United Kingdom.
4 Diabetes Research Unit, Cardiff University, Cardiff, United Kingdom.
aAddress correspondence to this author at: Clinical Biochemistry, University Hospital Birmingham NHS Foundation Trust, Selly Oak Hospital, Raddlebarn Road, Birmingham B29 6JD, United Kingdom. Fax 44-121-414-0078; e-mail susan.manley{at}uhb.nhs.uk.
| Abstract |
|---|
|
|
|---|
Methods: In 2004, we compared 11 commercially available insulin assays by analyzing 150 serum samples (99 fasting/51 postprandial) from study participants with various degrees of glucose intolerance (exclusions being type 1 diabetes, insulin treatment, or presence of insulin antibodies). All assays were calibrated against International Reference Preparation 66/304. One assay was not specific for insulin and another was an RIA; 10 assays used enzyme/chemiluminescent labels. BlandAltman difference plots were modified to use the mean insulin from all assays on the x-axis as a common comparator.
Results: As in the 1996 study, insulin values from the different assays varied by a factor of 2, with the nonspecific assay ranking in the middle of the distribution. Spearman rank correlation coefficients, for ranking samples vs the mean, were 0.9830.997. Both offsets and concentration-dependent differences were seen in the modified difference plots. Imprecision (mean CV) for automated assays (3%) was not significantly different from manual assays (5%). Similar values were obtained when one automated assay was run in laboratories in both the UK and the US. Results of 1 assay showed lower insulin concentrations in heparinized plasma than in serum.
Conclusions: Assay performance must be considered before comparing insulin results. The 2-fold variation in insulin results may be related to specificity, manufacturers calibration procedures or conversion factors.
| Introduction |
|---|
|
|
|---|
Because of this bias, the task force did not recommend the use of different insulin assays within a population or research study unless their guidelines for assay validation and comparison with other laboratories were followed. To address these issues, major clinical trials (2)(3)(4)(5)(6) have organized comparisons of insulin assays with patient samples or sample exchanges with other laboratories.
Immunometric assays specific for insulin (based on low cross-reactivity to proinsulin/s quoted by the manufacturers) are widely available, commercially, with many assays run on automated platforms (7)(8)(9)(10). These assays, however, may not recognize insulin analogs for treatment of diabetes (11)(12)(13)(14). No international reference method for insulin has as yet been established (15).
External quality assessment schemes still show large differences in insulin values, e.g., the March 2003 UK National External Quality Assessment Service (UK NEQAS) Guildford, which involved 43 assays and 17 methods, found that the trimmed mean insulin concentration in human serum samples for all laboratories was 87 pmol/L, range 40145 pmol/L, and for serum with added human recombinant insulin was 274 pmol/L, range 160475 pmol/L (Gwen Wark, personal communication, March 7, 2006).
Specificity, sensitivity, and working ranges are key issues for measurement of circulating insulin for the clinical investigation of hypoglycemia (7). Calculated indices such as those derived from Homeostasis Model Assessment (HOMA) for insulin resistance and ß-cell function, widely quoted in research, are dependent on the absolute value for insulin and on specificity in particular (16).
We compared commercially available insulin assays by assaying serum samples from study participants with varying degrees of glucose tolerance.
| Materials and Methods |
|---|
|
|
|---|
Ethics approval was obtained from the South East Wales Local Research Ethics Committee and complies with the current revision of the Helsinki Declaration.
patients
Fasting or postprandial blood samples were collected from 138 participants, 1875 years of age. Sample donors were either nondiabetic or had impaired fasting glucose, impaired glucose tolerance, or type 2 diabetes. Patients with type 1 diabetes or type 2 diabetes requiring insulin treatment or who were recorded as insulin antibodypositive were excluded. Anonymized data were collected, including age, ethnicity, height, weight, and whether the sample was taken fasting or postprandial. All patients gave written informed consent.
The 150 blood samples (fasting/nonfasting 99/51) were collected from 43 healthy persons (fasting/nonfasting 14/29), 20 patients diagnosed with impaired fasting glucose or impaired glucose tolerance (fasting/nonfasting 18/2), and 87 patients with type 2 diabetes (fasting/nonfasting 67/20). Both fasting and nonfasting samples were obtained from 12 study participants. The mean (SD) age and body mass index of the normoglycemic study participants were 43.8 (14.3) years and 28.5 (6.2) kg/m2. The corresponding values for those with impaired fasting glucose or impaired glucose tolerance were 62.0 (10.1) years and 31.0 (4.9) kg/m2, and for those with type 2 diabetes 60.0 (9.4) years and 31.9 (5.6) kg/m2.
collection of blood
Over a 12-week period in clinics at the Diabetes Research Unit, Cardiff University, UK, blood samples were obtained from study participants via a vacutainer or intravenous cannula with a 3-way tap and collected into a plain vacutainer (yellow, 3.5 mL, Greiner Vacuette Z Serum Sep Clot Activator, Greiner Bio-One) or lithium heparin vacutainer (green, 4 mL, Greiner Vacuette Lithium Heparin). Samples were placed on a roller immediately and serum left to clot for 30 min. Blood samples were spun at 2000g for 5 min at 4 °C. No samples with hemolysis or lipemia were collected. Immediately after centrifugation aliquots (0.5 mL) were pipetted into tubes (Sarstedt) labeled with laboratory and sample codes. The tubes were frozen immediately at 20 °C and transferred to a 70 °C freezer within 24 h.
qc materials
Trilevel, lyophilized QC material (Lyphochek Immunoassay Plus Control, Bio-Rad Laboratories) was reconstituted according to manufacturer instructions, divided into aliquots, and stored at 20 °C.
shipment and measurement of samples and qcs
Samples were shipped on dry ice by an overnight delivery service. On receipt, laboratories stored samples at 20 °C (or 70 °C if available) immediately and did not allow the samples to thaw.
insulin and proinsulin assays
Study organizers selected the most commonly used, commercially available insulin assays from those used by participants in the UK NEQAS Guildford Peptide Hormone schemes. Assay information obtained from the manufacturers is shown in Table 1
. Manual and automated assays for clinical investigation and research were included; some were approved for research use only. Assays from the US were included, one from the previous comparison (1) and another used for major epidemiological studies (17)(18). The Tosoh ST AIA assay was included twice, once from a US research laboratory and once from a routine UK hospital laboratory. All laboratories requested serum when given the option of serum or heparinized plasma. Both types of samples were analyzed with the Biosource-Invitrogen (previously Medgenix) assay. Participating centers were asked to use their laboratorys standard operating procedures to analyze samples soon after receipt. Serum samples were measured in batches of 30 over a 5-day period. Reconstituted trilevel QC material provided by the study was measured with each batch of samples. Total proinsulin was measured in serum by an ELISA (Linco Total Proinsulin ELISA, Linco Research) at Linco Research, St Charles, MO, with interassay imprecision (CVs) of 2.9%8.3% at concentrations of 6.5280.6 pmol/L.
|
role of the sponsors
The funding organizations had no role in the design of the study, data collection, analysis, or interpretation, or preparation of the manuscript other than diagnostic companies confirming the information published in leaflets for Table 1
, and did not approve or disapprove of, or delay publication of the work.
statistical analysis
Data were analyzed by use of the Statistical Analysis System (SAS Institute) (19). Because there is no consensus regarding statistical methods for comparison of this number of insulin assays without a reference method, we compared individual assays. We found no aberrant assays, so we then compared each of the 12 sets of assay results with the overall mean. The method of Carstensen (20) was not appropriate, as it requires replicate measurements within an assay. Difference plots (21)(22) were modified to use the mean of all results for the x-axis as a common comparator in the Figs. in this paper. BlandAltman difference plots for pairs of assays (one assay compared with one other) are presented in the online Data Supplement (see the Data Supplement that accompanies the online version of this article athttp://www.clinchem.ort/content/vol53/issue5). Each data point, zero (nil difference) lines, mean differences, and 1.96 SD lines are shown. Ordinary least squares linear regression was used for calculation of intercepts and slopes in the modified difference plots; Spearman rank correlation coefficients were calculated for each assay vs the mean.
| Results |
|---|
|
|
|---|
assay imprecision
Imprecision, the mean of CVs for trilevel QC analyzed on 5 days, varied from 1.4% for 1 automated assay to 6.7% for a manual ELISA (Table 1
). The mean CV for automated assays (Table 1
) was 3.0% (range 1.4%5.6%) and 5.4% for manual methods (range 3.9%6.7%), but this difference was not significant. Imprecision for the low QC varied from 1.1% to 12.1% (Table 2
) and for the high QC from 1.1% to 7.3%. CVs were constant across the range for 2 automated assays (mean CVs 1.4% and 2.5%), but imprecision for the low QC in 2 laboratories using the same assay was 9.4% in one laboratory and 3.1% in the other.
|
Insulin values for the low and mid-range QCs varied by a factor of 3, with mean values ranging from 35.9 to 106.5 pmol/L for the low QC and 83.8 to 291.1 pmol/L for the mid-range QC. For the high QC, values varied by a factor of 4, from 167.4 pmol/L to 709.8 pmol/L. One assay (DPC Immulite 1000) consistently reported low values for QCs. The direction and magnitude of bias with reconstituted QCs was not necessarily reflected in the results for serum (Table 2
). The source of insulin (bovine or recombinant human) was not stated by the manufacturer of the QC materials.
insulin measurement in heparinized plasma and serum
Measured insulin concentrations were higher in serum, median (IQ range) 132 (90205) pmol/L, minimum 38 pmol/L, and maximum 1387 pmol/L, than plasma, 121 (85168) pmol/L, minimum 27 pmol/L, and maximum 1402 pmol/L, with differences proportional to the concentration (Fig. 1
). The linear regression equations were:
![]() |
![]() |
![]() |
![]() |
|
insulin and proinsulin
Insulin results for serum from the different assays varied by a factor of 2 for median and maximum values (Table 2
). The median and maximum values for the nonspecific assay ranked in 7th place (starting with the lowest value). Minimum values for insulin in human samples varied by a factor of >20 (Table 2
), with values of <10 pmol/L obtained from 2 automated assays (Tosoh and Roche) and the nonspecific ELISA (Mercodia), and from 11.5 to 38 pmol/L for the others. Spearman correlation coefficients (r2) vs the mean ranged from 0.983 to 0.997 (Table 3
). Similar results were obtained when serum was run on the same automated assay (Tosoh) in 2 laboratories (Table 2
). The results fell on or around the line of identity, with a mean difference of 1.92 pmol/L (95% CI 0.12 to 3.97), P = 0.0647, (Fig. 2
). Total proinsulin ranged from 2 to 168 pmol/L with median (IQ range) 23 (1243) pmol/L.
|
|
difference plots
The modified difference plots (Fig. 3
) and usual difference plots (see Figs. in the online Data Supplement) showed constant differences or differences that were proportional to the concentration. The difference plots for one assay vs another, available electronically, validate the use of the mean value for a common x-axis and will be of interest to laboratories running a particular assay/s.
|
The slope and intercept for differences vs the mean are presented in Table 3
as linear regression equations A, and for insulin values vs mean (scattergrams not shown) in Table 3
as B. Marked differences from the means were found for manual assays from Linco ELISA and Dako, with slopes of 0.32 and 0.20 (Table 3A
), with the Linco RIA giving higher results, slope 0.19. The Biosource-Invitrogen assay that did not report results <38 pmol/L showed high concentration-dependent differences, as did the Mercodia ELISA that was reported to cross-react with total proinsulin, whereas the other 2 ELISAs had negative concentration-dependent differences (Fig. 3
). The MLT assay showed an offset with an intercept of 17 pmol/L. Of the automated assays, Abbott AxSYM and Bayer Advia Centaur showed positive, concentration-dependent differences (N.B., conversion factors >6.0), the DPC Immulite 1000 showed negative differences, and the Roche Elecsys E170 and Tosoh ST AIA had results closest to the mean of the assays.
| Discussion |
|---|
|
|
|---|
Specificity of assays, calibration procedures, specimen type, assay performance, and conversion factors may all contribute to interassay variation. In this study, total proinsulin concentrations were in accord with previously published reports of 10% (proinsulin:insulin) for samples from persons without diabetes and 20% for patients with type 2 diabetes (24), with no samples displaying inappropriate hyperproinsulinemia (25). All assays except 1 were reported by manufacturers to be specific for insulin, and 1 was a specific RIA (Linco) that was included in the previous ADA comparison. The Tosoh assay, run in the US and UK for this study, produced similar results in the different laboratories, in contrast to the previous ADA comparison. In US epidemiological studies this assay was chosen recently to replace the nonspecific Pharmacia RIA100, which had been withdrawn because antibody stocks were exhausted. The nonspecific assay (Mercodia Iso-Insulin) ranked in the middle of the distribution of the assays in this study. This manufacturer, Mercodia, also produces a specific insulin assay with no detectable cross-reactivity with proinsulin and des 3132 and 3233 split proinsulins.
All manufacturers reported that their assays were calibrated against the same insulin reference preparation (IRP 66/304) prepared from human pancreas with a stated number of units per ampule. Details of manufacturers calibration procedures and calibrants (26) were not requested by the authors. Mean (range) recovery of IRP 66/304 in 14 methods has been reported to be 89% (75% to 127%), (27). Some assays showed overrecovery (Abbott AxSYM 127%), some underrecovery (DPC Immulite 75%), and some had recoveries within 10% (Bayer Centaur 100%, Dako 91%, Mercodia ELISA 99%, MLT 98%, and Roche Elecsys 103%). It remains to be seen whether the use of a human recombinant insulin preparation, calibrated in molar and mass terms, will reduce the interassay variability.
All participating laboratories measured insulin in serum, although heparinized plasma was also available. For illustrative purposes, both sample types were compared in 1 assay, and in that case higher insulin values were obtained in serum. Because these differences may be assay specific, individual laboratories should confirm with the assay manufacturer the procedures recommended for specimen collection and compare results for plasma and serum as required (28). The differences observed could be clinically significant when insulin concentrations or derived mathematical functions are compared for patient care or research.
Five assays were run on automated analyzers, and no significant difference in imprecision was observed between automated and manual assays. Bias and imprecision for lyophilized QCs in the individual assays did not always mirror those seen in serum (Table 2
), an important point for external quality assessment schemes. The use of nonhuman insulin in QCs and matrix effects may explain these differences. Although the security of baseline or low concentrations is important (28), sensitivity, as reported by the manufacturers, was determined in a number of ways that were not comparable. Use of the minimum detectable concentration from precision profiles may yield more reliable estimates.
A conversion factor of 6 for recombinant human insulin has been reported (1)(29). In this study, however, the conversion factors used by the manufacturers were found to vary considerably, with the potential to influence insulin values by up to 15%. For 3 of 4 specific assays using conversion factors >6, reported mean values were in the top half of the distribution, and the other value was in the middle. Assays using a factor of 6 ranked mainly in the bottom half, except for the specific RIA (Linco) that gave the highest results. Interestingly, an ELISA from the same company, also using 6 as a factor, gave the lowest results.
Because of potential assay interference, our study has limitations that prohibit the extrapolation of results to patients with insulin antibodies. The results are also not applicable to patients treated with insulin analogs, because these cannot be detected with some specific insulin assays (11)(12)(13)(14). A limited number of batches of reagent and calibrators were used in this study. Because there is no reference method for insulin or consensus on standard statistical techniques for such multiassay analyses (30), the mean insulin value for each sample was used as a common comparator. This approach may not be appropriate for a smaller number of assays.
Various techniques have been used over the years for comparing measurements from different studies and for reducing assay variation. For major research studies, insulin has been measured in central laboratories (3). In some studies data have been divided into ranks, but this method may not be reliable because populations differ (31), and it is not helpful when considering individuals. Results for other analytes such as hemoglobin A1c have been aligned to those reported by major clinical trials while the international reference method was being evaluated (32). In the case of human chorionic gonadotropin, clearly defined calibration procedures for the international standard and careful selection of antibodies reduced assay variation (33). Intermethod differences of 2- to 5-fold in prostate-specific antigen measurement results (34) were eliminated by the introduction of standard calibrators and guidelines, but differences in the recovery of international standards on automated platforms still varied by 5% to +22%. These results may be related to data transfer between the primary standards and master calibrator, and between master calibrator and individual reagent set calibrators, a potential issue for all analytes.
International diabetes and clinical chemistry organizations should be aware of the need for comparability of insulin values for patient care, clinical research studies, and any resulting metaanalyses or clinical research networks (35). Clinicians and researchers should be alerted to the fact that serum insulin measurements from the various assays now available can differ by a factor of 2.
| Acknowledgments |
|---|
Financial disclosures: Dr. P.M. Clark is a member of the Specialist Advisory Group for Immunoassay in UK NEQAS for which she receives no remuneration. Dr. S.E. Manley and Mrs. I.M. Stratton received grant support from the Novo Nordisk Research Foundation, for a study on measures of glycemic control and have subsequently received funding, reagents, and equipment for this study from Bayer and DPC (both now Siemens), Roche, and Tosoh.
Acknowledgements: We would like to thank Diabetes UK for their grant, Professor Doug Altman, University of Oxford, for advising on statistical issues, Dr. Gwen Wark, UK NEQAS Scheme Organiser, for EQA data supplied with permission from the EQA scheme, Mrs. Rachel Round for administration, and Professor Stephen Gough, Miss Janet Smith, Dr. Malcolm Nattrass from University Hospital Birmingham NHS Foundation Trust and Dr. Tim Barrett from Birmingham Childrens Hospital NHS Trust for their helpful comments and support.
Also the following in the UK: A. Powell, P. Griffiths, (Birmingham Childrens Hospital); R. Round; M. Palma, M. Peyton, J. Babrah (Clinical Biochemistry, University Hospital Birmingham); R. Williams, (Derriford Hospital, Plymouth); G. Dunseath, A. Clark (Diabetes Research Unit, Cardiff University); G. Wark (Royal Surrey County Hospital, Guildford); R. DSouza, R. Elms, (St Georges Hospital, Tooting); S. Fell, B. Starling (Walsall Manor Hospital): in the US: H-M. Wiedmeyer, A. Tennill (Diabetes Diagnostic Laboratory, Columbia, University of Missouri Health Care); J. Mistry (Linco Research Inc, St Charles, Missouri).
| Footnotes |
|---|
| References |
|---|
|
|
|---|
The following articles in journals at HighWire Press have cited this article:
![]() |
D. Rodriguez-Cabaleiro, K. Van Uytfanghe, V. Stove, T. Fiers, and L. M. Thienpont Pilot Study for the Standardization of Insulin Immunoassays with Isotope Dilution Liquid Chromatography/Tandem Mass Spectrometry Clin. Chem., August 1, 2007; 53(8): 1462 - 1469. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |