|
|
||||||||
Opinion |
1 Department of Clinical Chemistry, Helsinki University Central Hospital, POB 140, FIN-00029 Helsinki, Finland
aAuthor for correspondence. Fax 358-9-47174804; E-mail ulf-hakan.stenman{at}hus.fi.
| Introduction |
|---|
|
|
|---|
Standardization is a fairly new concept in clinical chemistry. The notion of "comprehensive measurement systems" and various levels of reference methods evolved in the 1970s (1)(2) and was formulated by Tietz in 1979 (8). Pure standards, reference methods, and standard reference materials (SRMs) are now available for many of the most important analytes determined by conventional chemical methods, but immunoassay standardization is less well developed. Immunoassay standardization was extensively discussed at two meetings organized in 1990 and 1992 by the IFCC. At these, two standardization projects were initiated: the one for cortisol was intended to serve as a model for hapten immunoassays, the other project, for standardization of assays for CG, was intended to serve as a pilot study for protein immunoassays.
The problems associated with standardization of protein and hapten assays are different. Pure standards and reference methods based on mass spectrometry (MS) are available for many steroid hormone assays (9). For peptide and protein immunoassay standardization there are no reference methods, value assignment of the standard is problematic, and the analyte is mostly heterogeneous and differs from the standard. Therefore, progress in standardization of protein immunoassays has been slow.
I have served as the chairman of the Working Group for Standardization of CG (5) and been involved in other projects aimed at immunoassay standardization (10)(11). This experience has affected my thinking, but I am solely responsible for the views expressed here. Problems associated with standardization of hapten assays have been dealt with extensively in the recent literature (9)(12) and will only briefly be touched on here. The aim of this opinion is to stimulate discussion rather than to present a comprehensive and balanced review.
| Is Immunoassay Standardization Possible? |
|---|
|
|
|---|
The prerequisites for standardization are availability of standards and reference methods (8)(14). The primary standard should be homogeneous, pure, and identical to the corresponding substance in the sample that is measured. It is obvious that these requirements can be met only for some hapten immunoassays. Reference methods often are classified as primary and secondary (8). The primary method should preferably be a "definitive method", e.g., isotope dilution MS. Such methods are available for steroids (9) and thyroid hormones. Recent developments in MS have made it possible to analyze peptides and proteins, and isotope dilution MS has been used to develop reference methods for two proteins (15)(16) and thyroid hormones (17), but not for the free hormones, which have largely replaced assays for total thyroxine and triiodothyronine. However, MS is not useful for proteins and peptides occurring at low concentrations. In the absence of definitive methods, the best method available may be defined as the primary reference method, but this approach has not been applied in practice.
The problems hampering immunoassay standardization are different for different analytes. With steroid hormones, cross-reactions between closely related forms and complex formation with binding proteins in the sample are major problems. Previously used extraction methods are not compatible with automation, and the use of direct methods with short incubation times on automatic analyzers has actually aggravated the problem (5). Although reference methods are available and standardization possible (12), the accuracy and sensitivity of many automatic steroid assays are disappointing (18). Immunoassay of urinary free cortisol is especially problematic because of the large excess of cross-reacting substances in urine. The use of immunoassay for this purpose is dubious, but urinary free cortisol can be accurately determined by HPLC (19). However, this method is used by only 3 of 118 laboratories participating in the British quality assessment scheme (UKNEQAS) (20). The clinicians in our hospital accept the higher costs of the HPLC assay because falsely increased immunoassay results often lead to much higher additional costs in the form of imaging examinations (21). I believe that we should not give in to pressures to reduce laboratory costs when this leads to unacceptable compromises.
Peptide and protein antigens will always represent a problem for immunoassay standardization because of the heterogeneity of the antigens occurring in biological fluids (13). In its strictest sense, standardization is possible only if standard and analyte are identical. This is the case with only a few small peptides, e.g., angiotensin-1 and -2. With larger peptides and proteins, the problems tend to become more complicated because biological samples often contain proforms, splice variants, fragments, and complexes of the analyte. Most hormones and tumor markers are glycoproteins. These are inherently heterogeneous, and it is virtually impossible to prepare a glycoprotein standard that is identical to the circulating form. There are no universal solutions to these problems, but if we identify them, accept some compromises, and set our ambitions at a realistic level, it is possible to improve the state of standardization of most immunoassays to a clinically adequate level. It is also necessary to identify analytes that cannot be appropriately standardized and to develop other solutions for these.
Many of the typical problems of immunoassay standardization have been
encountered in the CG project, and the solutions that the CG working
group has arrived at may be applicable to other similar assays. Intact
CG is a heterodimer, but free subunits (CG
and CGß) and partially
degraded (nicked) forms (CGn and CGßn) also occur in circulation and
are measured to a variable extent by immunoassays (5).
Furthermore, a core fragment of CGß (CGßcf) occurs in urine and is
a potentially useful tumor marker. International standards are
available for only part of these forms, and the CG standard is
contaminated by nicked forms (22).
primary standards and assignment of values for these
Many of the original hormone standards consisted of partially
purified preparations, the potencies of which were determined by
bioassay and expressed in arbitrary international units (IUs). IUs have
also been assigned to some analytes without known biological activity
(e.g.,
-fetoprotein, carcinoembryonic antigen, CG
, and CGß).
IUs based on bioactivity are important for characterization of
therapeutic hormone preparations and standardization of biological
assays. However, they are not necessarily well suited for immunoassays,
and when new hormone standards are introduced, the ratio between
biological activity and immunoreactivity is likely to change
(5). Furthermore, tracing of the values back to previously
used impure standards loses its scientific basis when assay specificity
is changed by the introduction of methods based on monoclonal
antibodies.
The IFCC recommends the use of International System of Units (SI) units, and this is possible if the standard can be isolated in pure form. The primary structures of all clinically important hormones are known, and they can either be purified from natural sources or expressed by recombinant techniques. Therefore, their molar concentrations can be determined by amino acid analysis, and this should be the primary method for value assignment of new standards. The new CG standards will be assigned values by this method and expressed in substance concentrations, i.e., mol/L (5). This is based on the following arguments:
The new CG standards are currently being evaluated by the National Institute of Biological Standards and Control (NIBSC; United Kingdom) for suitability as international standards. The biological activity will be determined for intact CG, and the standards will be cross-calibrated by immunoassay against the currently used standards. Thus, either IUs or molar concentrations can be used. When new standards need to be prepared, the ratio between molar concentration and immunoreactivity can be maintained, i.e., the determination of protein content by amino acid analysis will guarantee continuity of the value assignment. The molecular weight of the various CG preparations has been determined by MS, and the mass of protein in the standards can be calculated on the basis of the average molecular weight (23).
assay design
Most protein antigens are now determined by sandwich assays using
two monoclonal antibodies or a combination of a monoclonal antibody and
a polyclonal antiserum reacting with different epitopes. This
facilitates tuning of assay specificity, e.g., CG assays can be
designed to detect only heterodimeric CG, only CGß, or both
components at the same time (5). In many cases, the
specificity obtained by sandwich assays improves clinical utility,
e.g., determination of the proportion of free or complexed PSA provides
better cancer specificity than total PSA (24), and assays
specific for CGß provide better sensitivity for nontrophoblastic
cancer than assays that detect both CG and CGß (25).
Assays measuring two components together tend to underestimate either
one (26), but at least for PSA it has been possible to
design assays that recognize free and complexed forms equally
(27). Thus, standardization may be possible even when the
analyte occurs in quite different forms in serum.
Partial proteolytic degradation of the peptide chain or nicking is fairly common among hormones and tumor markers, and this may cause variation in immunoreactivity. Some antibodies recognize intact and nicked forms equally, whereas others underestimate nicked forms of CG (28) and PSA (29). It is therefore important to know the reactivity of the antibodies used in relation to the characteristics of analyte and standard.
epitope mapping
The specificity of an assay is dependent mainly on the epitope
specificity of the antibody used. Detailed epitope maps are available
for CG (30)(31), and this was an important
reason to choose it as a model compound for immunoassay standardization
(5). The International Society for Oncodevelopmental Biology
and Medicine (ISOBM) has recently organized epitope mapping of several
clinically important tumor markers in a series of workshops, in which
the major immunoassay manufacturers have participated
(10)(32)(33)(34). These epitope maps form the basis
for selection of antibodies for routine and reference methods.
reference methods
Reference methods have been established for most clinically
important steroid hormones (9) but only for two proteins,
i.e., hemoglobin A1c (16) and apolipoprotein A-1. These
methods are based on proteolytic digestion of the protein in the crude
sample, which releases a peptide that is determined by MS. Because this
approach is applicable only to proteins occurring at high
concentrations, the working group for CG has planned to develop
immunological reference methods. This is possible principally because
standards (23) and antibodies with well-defined epitope
specificity are available (11). However, the companies
supporting the CG project have not embraced this idea, and unless
accepted by the industry, reference methods are of limited value. The
main argument has been that an immunological reference method may be
too dependent on a certain assay technology. Thus, even with the same
antibodies and standards, different results could be obtained when
shifting from a manual reference method to an automated routine assay.
To be acceptable, a reference method would need to be insensitive to
matrix effects, applicable to some generally available assays formats,
and based on international standards and readily available monoclonal
antibodies with known epitope specificities. It should be possible to
either establish the reference method in any laboratory or to maintain
a network of reference laboratories similar to that established for
cholesterol (3). However, the feasibility of immunological
reference methods first needs to be demonstrated in pilot studies.
serum-based reference materials
Panels of sera in which the content of one or several analytes has
been determined by a definitive method have been prepared for many
chemical and some immunochemical assays. These secondary standards are
called SRMs by the NIST and Certified Reference Materials by
the Institute for Reference Materials and Measurements (IRMM)
(12). Standardization of serum protein
determinations has been accomplished by preparation of a serum-based
standard in which values were assigned to the most commonly determined
serum proteins (35). The CG working group has also
considered distributing calibrated serum samples (23), but
this is feasible only if reference methods are available. The use of
serum-based secondary standards has the advantage that the matrix is
similar to that in clinical samples. However, this does not eliminate
the matrix problem, which varies from one sample to another.
Furthermore, different immunoassays have different matrix problems.
using commercial assays as reference methods
Although assay manufacturers are skeptical about immunological
reference methods, they often use a well-respected commercial assay
or that of the market leader to calibrate their assays (18).
Would it be possible to utilize this principle for standardization?
Could an expert group investigate available assays and declare the best
one a reference method? This approach has several advantages: it is
economical, it could be effectuated rapidly, and the reference method
would be readily available. However, it also carries risks. The life
span of the method might be limited because of changes in assay
technology and company management. Furthermore, having the official
reference method might be considered an unfair advantage by
competitors. Because of this, it appears necessary to establish
reference methods that are independent of commercial companies, but the
use of commercial methods could be an interim solution in selected
cases.
| Who Is Responsible? |
|---|
|
|
|---|
Although quite a few organizations deal with standardization, it is not clear who is responsible for what. Because standardization is an international rather than a national or regional problem, it is desirable that one international organization should be responsible for the coordination of various standardization projects.
| Who Is Capable? |
|---|
|
|
|---|
The actual work on development and validation of standards and reference methods is performed by experts in working groups. A potential problem is that many of the experts either have a vested interest in antibodies and assay principles or they have close collaboration with, or are employed by, companies. If we exclude these, the number of capable experts will be substantially reduced. Utilization of all expertise available, including that in the diagnostic industry, appears both necessary and desirable.
At least for the CG project, the working group has also raised most of the funding from assay manufacturers. This is not a viable long-term solution, and it may be hard to engage capable experts unless funding is guaranteed. Although many aspects of standardization involve pure science, it is not easy to compete for research money with standardization projects. Therefore, these should be funded from other sources. Most laboratories spend considerable resources on quality assurance, which like standardization serves the aim of improving the quality of laboratory results. I think that laboratorians would be willing to pay for better standardization if the mechanisms were available and progress could be guaranteed.
| Alternative Approaches |
|---|
|
|
|---|
leave the problem to the industry
Currently, most of the standardization problems are taken care of
by assay manufacturers, and this situation will not change soon.
Appropriate standardization is an important sales argument, and much
expertise on this subject is found within companies. In spite of this
the results are unsatisfactory, which can be blamed on both the lack of
reference systems and technical difficulties. These problems have
actually become worse because of the inflexibility of automated
analyzers with respect to assay design. Therefore, acceptable
standardization may not be possible for all assays on all instruments.
Although this problem is understandable, it is also a reason not to
leave solving the problem completely to the industry.
harmonization
If standardization is not possible, harmonization can be used to
calibrate various assays to give the same results. However, perfectly
harmonized assays may all be biased. Harmonization would solve some of
the clinical problems, but from a principal point of view it is
dubious, and maintenance of calibration is problematic in the absence
of reference methods. Therefore, standardization should be the goal
whenever possible. For assays of antigens that have not been defined,
e.g., CA 125, only harmonization is possible at present.
method-specific reference values
With the present state of standardization, reference values need
to be determined separately for each assay. The laboratorian is
ultimately responsible for the reference values used, but I believe
that assay manufacturers should be obliged to prepare these according
the recommendations of the IFCC. At present, few companies do this.
Establishment of reference values can be quite demanding, especially
for hormones, the concentrations of which are dependent on
age and sex. Therefore, collaboration among laboratorians, clinicians,
and assay manufacturers is necessary. Ideally, panels of samples from
well-characterized reference populations should be established and made
available to assay manufacturers. This could be accomplished in
multicenter collaborative studies, and it would probably be
economically feasible because of the value of such panels.
Method-specific reference values are necessary because of the
unsatisfactory standardization, but they do not replace
standardization.
risk calculation
The interpretation of laboratory results can be significantly
improved by providing the results not only as concentrations but also
as an estimate of the probability that the result indicates a certain
diagnosis. This approach is especially useful for interpretation of
results of multiple determinations as used in screening for
Down syndrome (37). Recently, risk calculation on
the basis of free and total PSA in combination with clinical data has
been shown to substantially improve the diagnostic accuracy for
prostate cancer (38). Estimation of the risk of
cardiovascular disease can be substantially improved by combing the
results for total and HDL cholesterol and C-reactive protein
(39). The results are not dependent on standardization and
reference values, but the algorithms are valid only for the assays used
to establish them unless the assays are identically standardized.
Development of risk calculation algorithms is demanding because it
requires both reference groups of subjects who do not develop the
disease and large groups of patients with accurately established
diagnoses. Therefore, this process is more demanding than establishment
of reference values, and use of risk calculation algorithms will
increase rather than decrease the need for standardization.
external quality assessment
The results of quality assessment programs provide valuable
information about the comparability of various methods, but they do not
tell whether an assay is properly standardized. More information is
obtained if the quality-control samples have been supplemented
with pure standards or analyzed by a reference method (40).
The results for such samples reflect the state of standardization, but
assay-specific matrix effects and commutability problems make it
impossible to judge the calibration of individual assays on the basis
of the results of a few quality-control samples (41).
| Conclusions |
|---|
|
|
|---|
| References |
|---|
|
|
|---|
1-antichymotrypsin is the major form of prostate-specific antigen in serum of patients with prostatic cancer: assay of the complex improves clinical sensitivity for cancer. Cancer Res 1991;51:222-226.The following articles in journals at HighWire Press have cited this article:
![]() |
R. Sapin Insulin Immunoassays: Fast Approaching 50 Years of Existence and Still Calling for Standardization Clin. Chem., May 1, 2007; 53(5): 810 - 812. [Full Text] [PDF] |
||||
![]() |
S. E. Manley, I. M. Stratton, P. M. Clark, and S. D. Luzio Comparison of 11 Human Insulin Assays: Implications for Clinical Investigation and Research Clin. Chem., May 1, 2007; 53(5): 922 - 932. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. Ljungdahl, M. Haarhaus, C. Linder, and P. Magnusson Comparison of 3 Third-Generation Assays for Bio-intact Parathyroid Hormone. Clin. Chem., May 1, 2006; 52(5): 903 - 904. [Full Text] [PDF] |
||||
![]() |
L. M. Thienpont, K. Van Uytfanghe, J. Marriott, P. Stokes, L. Siekmann, A. Kessler, D. Bunk, and S. Tai Feasibility Study of the Use of Frozen Human Sera in Split-Sample Comparison of Immunoassays with Candidate Reference Measurement Procedures for Total Thyroxine and Total Triiodothyronine Measurements Clin. Chem., December 1, 2005; 51(12): 2303 - 2311. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Panteghini Standardization of Cardiac Troponin I Measurements: The Way Forward? Clin. Chem., September 1, 2005; 51(9): 1594 - 1597. [Full Text] [PDF] |
||||
![]() |
U.-H. Stenman Improving Immunoassay Performance by Antibody Engineering Clin. Chem., May 1, 2005; 51(5): 801 - 802. [Full Text] [PDF] |
||||
![]() |
D. H. Wilson, G. Williams, R. Herrmann, D. Wiesner, and P. Brookhart Issues in Immunoassay Standardization: The ARCHITECT Folate Model for Intermethod Harmonization Clin. Chem., April 1, 2005; 51(4): 684 - 687. [Full Text] [PDF] |
||||
![]() |
M. L. Rawlins and W. L. Roberts Performance Characteristics of Six Third-Generation Assays for Thyroid-Stimulating Hormone Clin. Chem., December 1, 2004; 50(12): 2338 - 2344. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Panteghini and F. Pagani AACC Creatine Kinase MB (CK-MB) Standardization Material Used as Manufacturer's Working Calibrator Is Unable to Harmonize CK-MB Results between Two Commercial Immunoassays Clin. Chem., September 1, 2004; 50(9): 1711 - 1712. [Full Text] [PDF] |
||||
![]() |
N. Binkley, D. Krueger, C. S. Cowgill, L. Plum, E. Lake, K. E. Hansen, H. F. DeLuca, and M. K. Drezner Assay Variation Confounds the Diagnosis of Hypovitaminosis D: A Call for Standardization J. Clin. Endocrinol. Metab., July 1, 2004; 89(7): 3152 - 3157. [Abstract] [Full Text] [PDF] |
||||
![]() |
U.-H. Stenman Standardization of Assays for Human Chorionic Gonadotropin Clin. Chem., May 1, 2004; 50(5): 798 - 800. [Full Text] [PDF] |
||||
![]() |
S. Wesseling, C. Stephan, A. Semjonow, M. Lein, B. Brux, P. Sinha, S. A. Loening, and K. Jung Determination of Non-{alpha}1-Antichymotrypsin-complexed Prostate-specific Antigen as an Indirect Measurement of Free Prostate-specific Antigen: Analytical Performance and Diagnostic Accuracy Clin. Chem., June 1, 2003; 49(6): 887 - 894. [Abstract] [Full Text] [PDF] |
||||
![]() |
U.-H. Stenman Standardization as a Private Enterprise Clin. Chem., April 1, 2003; 49(4): 535 - 536. [Full Text] [PDF] |
||||
![]() |
P. Glendenning Issues of standardization and assay-specific clinical decision limits for the measurement of 25-hydroxyvitamin D Am. J. Clinical Nutrition, February 1, 2003; 77(2): 522 - 523. [Full Text] [PDF] |
||||
![]() |
M. Panteghini Performance of Today's Cardiac Troponin Assays and Tomorrow's Clin. Chem., June 1, 2002; 48(6): 809 - 810. [Full Text] [PDF] |
||||
![]() |
R. M. Lequin and U.-H. Stenman Standardization: Comparability and Traceability of Laboratory Results Dr. Stenman responds: Clin. Chem., February 1, 2002; 48(2): 391 - 393. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |