Clinical Chemistry Siemens Point of Care - Urinalysis
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


Clinical Chemistry 43: 1771-1780, 1997;
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via ISI Web of Science (2)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by O'Kane, D. J.
Right arrow Articles by Tenner, K. S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by O'Kane, D. J.
Right arrow Articles by Tenner, K. S.
Related Collections
Right arrow Laboratory Management
Right arrow Oak Ridge Conference
(Clinical Chemistry. 1997;43:1771-1780.)
© 1997 American Association for Clinical Chemistry, Inc.


Oak Ridge Conference

A laboratorian's perspective on evaluation and implementation of new laboratory tests

Dennis J. O'Kane1,a, Thomas A. Ebert1, Brenda J. Hallaway1, Steven G. Roberts2, Abul K. M. J. Bhuiyan1 and Kathleen S. Tenner1

1 Departments of Laboratory Medicine and Pathology and
2 Urology Research, Mayo Foundation for Medical Education and Research, 730 Hilton Bldg., Rochester, MN 55905.
a Author for correspondence. Fax 507-284-9758; e-mail okand{at}mayo.edu


Abstract

New assay development should be directed toward answering fundamental clinical questions. Caveats that must be considered before initiating assay development projects are: New assays should allow the clinician to interact with and treat a patient more effectively, thereby improving medical outcome; and new assays should facilitate recapture of system resources, enabling cost savings or reinvestment of resources. Defining the clinical questions and consideration of the caveats permit a means of prioritizing assay development activities. Laboratorians are faced with evaluating several types of development activities that lead to assay implementation in routine clinical testing. Assays can be prioritized for up-grading to newer cost-effective technologies, provided the changes maintain or improve analytical and clinical performance. Predicting which research assay will have future value is difficult when clinical performance is not fully validated. However, such assay development has the greatest potential for changing the delivery of healthcare by a clinician.

Assay conversion, assay development, and new assay implementation activities should be directed at answering fundamental clinical questions. These activities may have several identifiable objectives that focus on increasing clinical value of laboratory testing, which will enable clinicians to interact with and treat patients more effectively. Ultimately, these activities should improve the delivery of healthcare and improve patient outcome. Furthermore, assay conversion and implementation activities should facilitate resource allocation or reallocation and should be cost-effective. A large body of research has been developed by national and international organizations pertaining to the generalities and specifics of assay development (1)(2), minimum performance criteria (3)(4), defining reference ranges (5), and standardization of immunoassay (6)(7)(8), urinalysis (9), and molecular diagnostic assays (10)(11)(12). A review of this vast literature is beyond the scope of the present work. Instead, we take a top-down approach, in which general concepts regarding new assays are presented and illustrated with specific examples and actions taken at the Mayo Clinic that are performed within NCCLS and alternative methods guidelines (13). The perspectives presented are not to be construed as "the laboratorians' consensus statement" on new tests. Instead, this is an opportunity to discuss a unique, potentially divergent, practice pattern in which new approaches are attempted to overcome assay performance difficulties and to circumvent obstacles to change. The objectives are: to present specific results and experiences derived from assay conversion and new test implementation in an integrated practice setting that assays patients' samples from the clinic, hospital, and reference laboratories; to consider obstacles to change that impede new assay implementation; and to provide specific examples of new tests developed in basic science and clinical research laboratories that may have enhanced clinical utility. Although the approaches presented may be practiced in a unique setting, the general and specific examples may be modified or adapted for use in other practice settings.


Cost Effectiveness of Assay Conversion, Development, and Implementation Activities

New assay development activities in the past two decades focused mainly on two issues: improving assay performance and quality through development of Reference Methods, defining reference materials, providing assay validation criteria, utilization of consistent nomenclature and terminology (14)(15), and improving analytical sensitivity through introduction of new detection methodologies and instrumentation (16)(17)(18)(19). Both of these efforts have lead to improved clinical utility. Recently, however, healthcare cost effectiveness has become a driver of assay utilization and change (20). Cost effectiveness is normally measured as the ratio between the changes in costs and changes in outcomes obtained after implementation of new procedures (21). Costs are separated into several categories, including:

• direct medical costs

• direct nonmedical costs, such as travel and accommodation costs for a patient's family members

• indirect costs, such as lost income from a patient's inability to work

• intangible costs, such as patient anxiety and stress

Outcomes considered are typically:

• decreased morbidity attributed to assay changes, e.g., implementing assay changes that improve nutrition testing for geriatric presurgery patients

• years of life saved (postponed mortality)

• improved quality of life

This cost-effectiveness approach is useful for retrospective health sciences evaluations that ascertain clinical utility regarding screening populations applied to large populations. Furthermore, this approach drives replacement of tests for older analytes by those for newer analytes, which have improved clinical utility. However, the appropriateness of this cost-efficacy approach is not immediately apparent when the clinical laboratory is confronted with making decisions regarding assay conversion and test implementation. One problem is that the laboratorian may not be involved in assessing these outcomes. Outcomes are generally assessed by health sciences or statistic units. Costs can be quantified or estimated from this model, but some of the outcome endpoints are not readily obtained or may not be amenable to quantification. Although decreased morbidity resulting from an assay change would be easy to quantify, postponed mortality data are more difficult to obtain on a useful time scale. For example, survival data in oncology research on slow-growing cancers may be difficult to acquire. Quality of life outcomes in oncology, for example, are second in importance to years of life saved (22)(23). However, quality of life is difficult to quantify and may be assessed differently by different patients. Consequently, the impact of laboratory testing on the outcomes described above may be difficult to document. It may be better to consider cost effectiveness of assay changes by using different endpoints. Changes in costs could include:

• assay-associated costs

• systems costs

• direct nonmedical costs

• intangible costs such as anxiety

Outcomes in cost-effectiveness studies are improvements realized from the assay conversion activities that can be monitored in terms of:

• changed analytical and clinical performance of the assays

• changes in turnaround time (TAT)1 for performing the new assays

• ability to utilize resources more effectively

With this model, changes in cost are readily quantified and outcomes are readily identified and are objectifiable. Changes in analytical performance include improved detectability limits, improved linearity upon dilution, improved precision, and reduced CVs. Reducing CVs is important in guarding against generating requests for unnecessary patient testing. With some assays in the Mayo practice setting, an increased assay CV may result in results being reported for some patients that erroneously exceed a decision threshold. This may automatically trigger these patients to be scheduled for unnecessary additional testing by a subspecialty area. Consequently, emphasis has been placed on improving analytical performances of assays.

Emphasis has also been placed on decreasing TAT: At Mayo, at least 10% of the multiday tests are required to be replaced by same-day testing each year. The changes in TAT are important for several reasons. The requested TAT for assay results from clinicians varies with the setting. Immunosuppressive drug monitoring results are not needed until 1600, so a TAT of 6 h is acceptable for cyclosporin and FK506 assay reports. In contrast, glycohemoglobin results are requested to be reported to the Diabetes Clinic within 15 min of blood draw. In this case, patient monitoring and follow-up are closely linked temporally. This linkage avoids writing follow-up letters and scheduling revisits, and provides an opportunity for assuring tighter compliance with treatment and diet. Improved TAT may also permit clinicians to deliver healthcare to patients more rapidly. It permits assessment of whether a patient should remain in the hospital for additional care or may be legitimately dismissed. It may permit a clinician in a clinic to perform initial patient test ordering and reschedule a follow-up patient's visit on the same day. It may reduce unnecessary waiting caused by delayed test results and also reduce the number of patients' complaints. In this sense, improved TAT is a real-time quality of life indicator for the patient and a real-time customer service marker for the medical institution that can be readily identified and quantified.


Types of Assay Conversion, Development, and Implementation Activities

Several different types of activities contribute to assay conversion, development, and implementation, including:

1. Replacing an assay for a particular analyte with an assay for a more useful analyte that has improved clinical value.

2. Converting existing assays for an analyte to new methodologies.

3. Reducing assay testing by introducing a screening procedure that eliminates patients' samples from the workstream.

4. Developing new assays through translational research activities.

The first three assay conversion activities can be regarded as continuous improvement projects. These activities improve the quality and cost effectiveness of assays but do not offer the greatest chance at changing how a clinician will interact with a patient. The fourth, translational research activities, may be defined as the process of implementing promising research discoveries for clinical intervention through prevention, improved diagnosis or prognosis, or implementing smart, rational therapies, and, within the context of this discussion, new assays (24)(25)(26). Translational research offers an excellent chance of changing how the clinician will either treat a patient or be able to interact with a patient through the introduction of tests for new clinical markers or through introduction of new technologies (27). The potential gains offered through translational research activities are balanced by the risks that the research may subsequently be demonstrated to be nonproductive. Introducing new tests or new methodologies has to be regarded as a managed risk situation in which many assays that are developed may ultimately prove not to be useful. An example of this is translational research on cytokine growth factors used to reduce neutropenia after chemotherapy (28). Although this process is now widely utilized, a recent report indicates that granulocyte colony-stimulating factor should not be administered to afebrile patients because of the lack of clear-cut clinical benefit (29).

replacing an existing assay by an assay for a more clinically useful analyte
Established analytes may be slowly displaced from use by assays for new analytes that have greater clinical utility. This assay replacement activity takes place over a long period and is driven by health sciences research evaluation of clinical utility and cost effectiveness. Clinical utility of assays for established analytes should be reassessed periodically to determine whether a more useful test exists that should be considered for introduction. This reassessment function is performed in our practice by a Clinical Pathology Work Group (CPWG in Fig. 1 ) composed of representatives from all aspects of laboratory medicine, administration, core and reference laboratories, and technology. In addition, experts in clinical areas are invited to contribute to the development of clinical utility guidelines for assays. This offers a mechanism to introduce assays for a new, more clinically useful analyte, to replace existing analyte assays. This assay implementation activity frequently sparks vigorous, healthy debate on the clinical utility of the old and the new assays. Obstacles encountered in replacing assays for older analytes with new analyte assays include entrenched personal agendas and biases that must be capable of being overturned if these positions are not supported by impartial data. Classical examples of this type of assay conversion activity are: use of total creatine kinase (CK) and CK-MB as early markers of myocardial infarction instead of lactate dehydrogenase isoenzyme analysis (30), and replacement of the LE (lupus erythematosus) cell assay by testing for antibodies against double-stranded DNA for diagnosis of systemic lupus erythematosus (31). An evolving example of this activity may be the use of assays for serum tryptase in mast cell disease (32) in place of assays for histamine or 11ß-prostaglandin F2{alpha}.



View larger version (23K):
[in this window]
[in a new window]
 
Figure 1. Flow diagram of the process for conversion of an existing assay to new methodologies.

The Clinical Pathology Work Group (CPWG) advises on clinical utility issues.

converting existing assays for analytes to new methodologies
The forces driving conversion of existing assays to newer methods may differ with the analyte or medical environment, but generally this activity is directed at reducing assay-associated costs and improving analytical performance and improving TAT. The obstacles to implementing this type of change may include embedded personal agendas, as well as lack of support from clinicians if the new assay reports in units different from those in the old assay, or if there is a change in reference intervals. Another obstacle to change that may be unique to large organizations is that multiple laboratories may be interested in utilizing assays for a single analyte. This may result in competing assay conversion efforts, which will inappropriately consume development resources. To reduce the obstacles to assay conversion, we have developed a defined process to coordinate and facilitate these activities. An Assay Conversion Team has been implemented to identify assays that have high priority for conversion from manual RIAs to nonisotopic and automated immunoassays (Fig. 1Up ). After discussions between the clinical chemist or laboratory leader and the potentially affected clinicians, the process is started with a decision about whether the current assay for the analyte has sufficient clinical value to warrant continued performance of the test. Advice is solicited from the CPWG if concerns are raised about the clinical utility of the existing test.

Assays judged to have sufficient clinical utility are then assessed for their potential for automation, either with an existing commercial kit or a reagent system or with in-house assay development activities when necessary. Assays compatible with automation are then prioritized for conversion/development on the basis of several factors, including the annual volume of the test, potential TAT improvement, and potential reductions in assay and system costs. Analytical and platform performance characteristics of the old assay are compared with those of the new format, and clinician input is solicited at this stage. This is similar to the method selection, evaluation, and development loop presented in Fig. 1Up of Koch and Peters (33). The clinicians who utilize the assay must agree that the new assay and its performance characteristics are satisfactory and meet the clinical need. Subsequently, a preliminary financial impact analysis is performed for the several automated immunoassay platforms available. Approval to proceed with assay conversion is given with assignment of development personnel after having achieved consensus that the assay and clinical performance characteristics are acceptable for a given platform and that there is a positive financial impact.

Not infrequently, problems are encountered in converting an old assay to a new methodology. This topic has been dealt with regarding specific analyte assay conversions (cortisol and human chorionic gonadotropin), and summaries of the many difficulties and approaches taken to overcome them are provided (34)(35). Often, there is a change in reference interval values because epitope recognition by antibodies in the old and new immunoassays may differ. A second problem is that the new assay methodology may not adequately assay all of the patients' samples from a given patient population. Some patients' samples may fall below the range that the new assay was designed to measure. This problem is aggravated by the use of 2 SD above the mean of the zero standard as the detection limit in kit information inserts, which is inappropriate for analytical validation. The functional sensitivity of the assay, i.e., the concentration of analyte at an interassay CV of 20%, provides a better estimate of the limit of quantification in routine practice. Furthermore, some patients may have interfering substances that the manufacturer has not considered.

A specific example of this is a recent conversion of testosterone from an organic extraction-based assay to a direct immunoassay on a random-access automated platform. The existing assay, involving extraction with methylene chloride, eliminates interferences from many of the water-soluble testosterone conjugates. The direct immunoassay for testosterone that we recently implemented correlates well with the extraction assay except at testosterone concentrations <650 ng/L (Fig. 2 ). Accuracy in quantification of these low concentrations of testosterone is required in several clinical contexts, including deciding the sex of a child born with ambiguous genitalia and in suppression of precocious puberty. Part of the inaccuracy of the direct assay, and poor correlation with the extraction assay, is attributable to the presence of testosterone conjugates in patients' samples. Testosterone sulfate competes stoichiometrically with testosterone in this direct immunoassay (unpublished). A second problem is that triglycerides (36) show a small but significant interference in the direct assay after extraction. These problems can be minimized if the samples are pretreated with lipase to reduce triglyceride interference and an organic extraction step is implemented on samples with low amounts of testosterone (unpublished). This eliminates the reporting of high outliers for samples containing water-soluble conjugates of testosterone and reduces the positive bias noted with lipemic samples (36).



View larger version (19K):
[in this window]
[in a new window]
 
Figure 2. Methods comparison of testosterone immunoassays: a direct chemiluminescence immunoassay for testosterone evaluated as a replacement for the organic extraction-based RIA that had been in use for many years.

The dashed line is the line of identity. Unsatisfactory correlation was obtained.

Evaluation of the testosterone assay conversion from an extraction-based RIA to chemiluminescence on a random-access platform showed the conversion was cost-effective. The cost reduction of ~45% came predominately from a decrease in personnel utilization on this assay. Furthermore, TAT was improved from second-day reporting to a same-day reporting with a TAT of ~<4 h, which meets institutional goals and clinicians' expectations. Analytical performance was improved, the imprecision (CV) improving slightly from 20% at 100 ng/L with the original extraction assay to 13% at 50 ng/L with the new direct immunoassay. There was better utilization of the random-access platform, and clinicians were able to interact more readily with patients on a same-day basis. Overall, this was a cost-effective assay conversion, although imperfect because sample preprocessing (lipase treatment and extraction) could not be eliminated and so were incorporated into the assay protocol. The preprocessing steps are now the subject of an automation feasibility study.

introduction of new screening procedures
Introduction of inexpensive prescreening techniques to eliminate normal samples from the work flow is the last type of continuous improvement activity now being considered. A specific example of this is in urine screening. A routine urinalysis may be performed on every urine sample submitted even with no evidence of clinical justification. At Mayo, ~80% of urine specimens have normal values for erythrocytes and leukocytes, whereas ~10% contain abnormal numbers of either cell type. However, all urine specimens are evaluated either by automated imaging or by a manual microscopic evaluation. Routine urinalysis represents an opportunity to reduce the number of specimens that require additional testing, i.e., to reduce the number of normal samples that enter the work stream and require additional work-up by automated imaging or manual microscopic assessment. The second objective is to obtain a cost-effective improvement in clinical sensitivity of leukocyte detections in urine. Leukocytes may be present in urine for a variety of reasons, including cystitis, various forms of nephritis, autoimmune diseases, reaction to drugs, and Chlamydia infections (37). The goal is to detect leukocytes that may indicate conditions other than urinary tract infections.

Although leukocyte esterase used in conjunction with nitrite dipsticks may sensitively detect urinary tract infections (38), use of the dipsticks alone may not be sufficiently sensitive for detecting urinary leukocytes in the absence of infection (39). The chemistry used to detect leukocytes involves dehydrogenation of an acridan substrate by peroxidase and hydrogen peroxide, giving rise to an acridinium molecule that then undergoes thermal decomposition and gives rise to chemiluminescence (40). A microhematuria/hemoglobinuria assay performed at the same time utilizes the pseudoperoxidase activity of hemoglobin. In this assay, the erythrocytes are first lysed and then reacted with hydrogen peroxide and a luminol derivative that also gives rise to chemiluminescence emission (41). These screening assays are set in parallel at present.

In terms of sensitivity and specificity, the leukocyte screen has 88% clinical sensitivity for detecting a minimun of 5 leukocytes per high-powered field and a specificity of 92%. Of those samples tested for leukocyte chemiluminescence, only 20% are sent on for additional analysis. Of these, 62% have >5 leukocytes per high-powered field, but the other 38% are false positives. The microhematuria assay has a clinical sensitivity of 99% and a specificity of 96%. Of those samples tested, only 15% are sent on for additional analysis, including microscopic examination or automated imaging. Of these 15%, 74% are abnormal, having >3 erythrocytes per high-powered field, and 26% are false positives. The minimum number of samples eliminated by utilizing the leukocyte and erythrocyte prescreens is ~68%—a marked reduction in the amount of work that has to be redirected to definitive testing by manual or automated imaging.

The cost effectiveness of the urine prescreens has allowed deferring the purchasing of additional automated imaging equipment, reduced reagent costs compared with dipsticks costs, and reduced personnel costs. In addition, resource utilization of the automated imaging system is improved. TAT is improved slightly and there is no degradation of analytical performance. Overall, this is a cost-effective development project.


Implementation of New Tests Through Translational Research

The greatest potential for changing how a clinician fundamentally interacts with a patient can be provided through introduction of new assays. This can be achieved by translating results from basic research or clinical research into the clinical protocols (24)(25)(26). Translational research activities related to new test introduction can be divided into two areas: new markers for clinical conditions, and utilization of new technologies.

new markers
Clinical research produces a large number of markers that have potential clinical utility. A recent Medline search for prognostic markers for breast cancer management produced a list of >30 potential candidates that might have clinical impact. If the past is an indicator of future laboratory utilization, most of these potential markers will not be implemented in clinical practice (42). However, a few may find acceptance based on clinical utility within a limited medical context. An example of this is the present situation with c-erbB2/HER2/neu. Although this marker has been demonstrated to be a prognostic marker in breast cancer, it has since been determined not to be an independent prognostic marker, in effect providing redundant information (43). c-erbB2/HER2/neu has not been implemented widely for prognosis of molecular staging in breast cancer. More recently, clinical utility for c-erbB2/HER2/neu assays may have been demonstrated in a more tightly constrained medical context, in that a cytotoxic antibody to c-erbB2/HER2/neu has demonstrated therapeutic utility in a subpopulation of women with recurrent breast cancer (44). Implementation of the assay for c-erbB1/HER2/neu may be considered clinically useful, pending evaluation of the ongoing clinical trial.

From the above, one may infer that clinical research and translational research carry with them certain fiscal risks. However, managed risks must be taken to improve disease detection, management, and patient care. The key to successfully managing these risks is to first define the question to be addressed by an assay for a new marker in a tightly constrained clinical context. Assuming collection of favorable clinical data, the tight constraints imposed permit an estimation of potential changes in clinical outcomes resulting from utilization of the new marker assay.

As an example of ongoing work in this area, let us consider telomerase, a new oncologic marker that has received considerable interest in the last 3 years (45)(46)(47)(48). A ribonucleoprotein, telomerase extends the ends of chromosomes (telomeres) both in vivo and in vitro through reverse-transcription. Telomeres are degraded during each cell division because of replication problems inherent to linear chromosomes; the continued loss of telomeric DNA is believed to ultimately trigger cell death. The absence of telomerase from most normal cells results in these cell lineages having a finite life span. However, telomerase activity is present in most immortal cells, including most malignancies (typically >90%) (45)(46). For reasons similar to those discussed above, telomerase would be difficult to introduce as a new oncologic marker in a broad clinical context, despite its prevalence in malignancies. A major reason for this is that many oncologic diagnoses are rendered after visual examination for differences in histology and nuclear morphology of either paraffin-embedded sections or frozen sections intraoperatively. Frozen sectioning takes only a few minutes to perform, and diagnostic information is conveyed to the surgical team by telecom or face to face (49). The rapid TAT facilitates scheduling appointments for surgery patients with medical and radiation oncologists. It would be difficult to replace evaluation of permanent or frozen sections with a telomerase assay because:

1. Telomerase assay results may provide redundant information when compared with conventional histologic and microscopic evaluations of samples obtained by invasive sampling; meanwhile, microscopic detection of neoplastic cells is efficacious.

2. The error rate for pathological diagnosis by intraoperative frozen section evaluation is ~0.1%; telomerase activity, however, is present in at most 95% of tumors, resulting in a false-negative rate of at least 5%.

3. TAT for the telomerase assay would be ~6 h, including transport, sample preparation, and report generation and verification.

However, telomerase may be a useful marker if the clinical context is constrained. Telomerase detection may yet find use with fine-needle biopsies. Telomerase may find utility for detection of micrometastases to the axillary lymph nodes in "node-negative" breast cancer (48). Micrometastases are frequently missed with frozen sections and necessitate an additional day for inspection of permanent fixed sections for confirmation. Potentially, the detection of telomerase in this context may alter how the medical oncologist will treat the patient with hormonal, chemo-, or adjuvant therapy.

A more immediate example of how telomerase may prove clinically useful is in the limited context of noninvasive sampling (50)(51): Can telomerase be used for minimally invasive or noninvasive early detection of malignant neoplasia? Primary transitional cell carcinoma (TCC) is usually detected by using urine cytology and cystoscopy after a patient presents with hematuria or discomfort. Although FDA-approved tests are available for detecting recurrent TCC (52)(53)(54)(55), none for detecting primary TCC is available. Telomerase activity in bladder washes and spot urines containing shed uroepithelium is under evaluation for detection of primary TCC (50)(56)(57). Telomerase activity is measured in vitro by the enzymatic extension of a synthetic DNA primer, followed by PCR amplification (58). The telomerase amplification products are separated by electrophoresis on miniDNA sequencing gels and visualized by Sybr Green staining. The analytical time is 4.5–5 h. Typically, a 6-bp ladder is visualized in the presence of active telomerase, whereas no visible gel products are observed in the absence of telomerase activity. Urines containing cells from TCC produce easily detectable telomerase-extension ladders, whereas these are absent when unaffected urines are examined. Clinical sensitivity for detecting TCC with telomerase as a marker in urines or bladder washes collected at the time of cystoscopy range from 62% to 73%. In a more limited ongoing study of primary TCC, we obtained 94% sensitivity (15 of 16) by utilizing telomerase detection with bladder washes (57). This suggests that telomerase should be further investigated in a larger study to ascertain if it is be a useful marker for minimally invasive identification of primary TCC in patients with a consistent presentation. If successful when used with voided urines, positive telomerase assay results may initiate a reflex of those patients for cystoscopy. Other potential applications based on the clinically constrained context of noninvasive or minimally invasive sampling may be: early detection or stratification of pancreatic cancer patients by using ductal cells in secretin-induced pancreatic secretions; early detection or stratification of cholangiocarcinoma by using ductal cells in cholecystokinin-induced bile duct secretions; and colorectal cancer screening by using shed colonic epithelium (51).

Utilization of telomerase cannot be viewed as cost-effective at this time; clinical utility has yet to be fully demonstrated and only potential changes in cost are available. There are potentials for major cost-reductions in healthcare from early detection capabilities and high clinical sensitivity. The major anticipated outcome, however, would be increased quality-adjusted years. Unfortunately, no evidence at this time indicates that early detection will decrease mortality from these cancers.

new technologies
How a clinician interacts with a patient or the patient's family may also be affected by the implementation of new assay technologies. The detection of heterozygous carriers of genetic diseases is an example. Provided patient's record confidentiality can be maintained, there is promise of reducing medical costs by identifying those patients who have a genetic predisposition to a disease, or who are carriers of such traits, and providing the appropriate medical surveillance. The difficulty is eliminating a large number of normal patients from the screening protocol to make the testing procedures cost-effective.

Hemochromatosis presents an example of the need to reduce the number of patients evaluated for a particular mutation. Carriers of the trait for hemochromatosis are not rare (~1 in 14 Caucasians), but penetrance is low. It would be difficult to justify screening every Caucasian for the polymorphism(s) giving rise to hemochromatosis. A more effective approach might be to prescreen the population to enrich for patients who may benefit from monitoring and treatment by prophylactic phlebotomy (59). The approach taken once again is to define a narrow clinical context and to implement an inexpensive screening assay that reduces the number of potential positive samples sent on for additional definitive mutational analyses.

Cystic fibrosis (CF) is the model genetic disease we are using to assess the utility of the mutation detection systems. CF is a rather common autosomal recessive genetic disease with a carrier frequency of ~1 in 30 in European populations. Although many mutations result in the CF phenotype, 70% of patients have mutations in exon 10 of the cftr gene. Most CF patients are diagnosed readily by clinical presentation, confirmed by sodium sweat-conductance tests, whereas heterozygous carriers are asymptomatic. The clinical question becomes: Is a family member of a patient a carrier? The approach taken is hierarchical: Develop an inexpensive, rapid, highly sensitive/moderately specific screening procedure that will identify likely carriers, and evaluate potential carrier samples by definitive mutational analysis with a more costly, exacting technique such as direct sequencing.

Several new methodologies are available for mutational screening. The characteristics of the most promising technologies are rapid TAT, compatibility with future automation, and sensitive detection of a wide variety of mutations, including single-base mismatches, insertions, and deletions. A homogeneous mismatch detection technique has been developed by combining the mutational mismatch-stabilization of cruciform DNA structures (Holliday Junctions) with photoexcited chemiluminescence. Branch migration, the process by which homologous DNA duplexes exchange strands, is inhibited by mismatches in the presence of high concentrations of Mg2+ (60). Consequently, alleles can be detected by the inhibition of branch migration. Following exon-specific amplification, cohybridization of the allelic amplicons will result in formation of cruciform DNA structures (Fig. 3 ). Separation of the cruciform structures into two DNA duplexes is inhibited if a mismatch is present in both strands of the cruciform structure. Detection of the mutation in the heterozygous carrier is accomplished through using modified primers with biotin and digoxigenin incorporated at the 5'-ends. This permits attaching photosensitizer beads through streptavidin bridges and chemiluminogenic beads through anti-digoxigenin to the cruciform structures, allowing homogeneous detection through photoexcitation (16). Laser excitation generates singlet oxygen. If a chemiluminogenic bead is in close proximity because of the presence of a mutation, then a chemiluminescence signal is generated (Fig. 4 ). If branch migration has occurred, only a background signal is obtained because of the short mean diffusional path of singlet oxygen.



View larger version (26K):
[in this window]
[in a new window]
 
Figure 3. Inhibition of branch migration for detecting allelic variants.

After exon-specific amplification, the amplicons are denatured and cohybridized. A small percentage of reannealed products form cruciform DNA structures (Holliday Junctions). Mutation-generated mismatches in base-pairing are stabilized in the presence of high [Mg2+]. The cruciform structures dissociate in the absence of mismatches or at low [Mg2+] with the exchange of DNA strands (branch migration).



View larger version (13K):
[in this window]
[in a new window]
 
Figure 4. Detection of mismatch-stabilized cruciform structures by photoexcited chemiluminescence.

Primers with 5'-incorporated biotin and digoxigenin are used for exon-specific amplification. Photosensitizer (PS) beads conjugated with streptavidin and chemiluminogenic (CL) beads conjugated with anti-digoxigenin are added after branch migration and bind to available biotin and digoxigenin groups in the cruciform DNA structures and dissociated DNA duplexes. Excitation by a diode laser generates singlet oxygen from the PS beads, which can elicit chemiluminescence from the CL beads (61). Singlet oxygen has a short mean diffusion path in solutions containing nucleic acids and precursors, proteins, and organic buffer salts due to oxygen adduct formation. Consequently, chemiluminescence signals are produced predominately from PS and CL beads that are brought into close proximity by the cruciform DNA structures. Beads attached to dissociated DNA duplexes are not close enough to permit chemiluminescence. Thus, cruciform DNA and DNA duplexes do not have to be separated for mutational analysis.

An initial trial of this technology was performed by assaying a panel of 50 encoded DNA samples that included samples heterozygous for exon 10; homozygous for normal exon 10 (no mutations); homozygous for exon 10 mutation; and homozygous for exon 11 mutation. All heterozygous carriers were correctly identified with this technology. Homozygous mutations should not be detected directly by using the carrier identification format because of the lack of mismatch potential, but one homozygous exon 10 mutation was detected as a false positive.

The excellent sensitivity and specificity obtained in the pilot study indicates that this technology merits investment of additional effort and resource. The mismatch-stabilized inhibition of the branch migration assay has potential for automation by laboratory robots for performance in 96-well microplates. This would decrease the costs associated with genetic screening. Potential improvements in outcomes would be improved TAT as well as better resource utilization of the more costly DNA sequencing equipment. These potentials will be more readily apparent once DNA extractions are automated.


Obstacles to Assay Conversion, Development, and Implementation

Several obstacles to assay conversion/implementation activities may be raised, in part from a general resistance to change. Objections to changing analytes or assay methodologies are frequently raised in part because such changes may negatively affect routine laboratory testing in the short-term. The conversion of existing assays to modern technologies is often viewed as consuming valuable development resources in an effort to reinvent the wheel: Why redevelop an assay that already works well? Furthermore, personal agendas and biases may predispose an assay conversion activity to failure. The most effective argument to overcoming these objections is compelling data that validate the cost-effectiveness of the activity proposed. This should be performed at least for the first several assay change projects to help develop easier acceptance for additional activities.

Other arguments may be raised in objection to translation research activities aimed at implementing new tests. The argument that new markers and new technologies are unproven may be countered with the generation of validation data. However, the major obstacle limiting new test implementation is the concern by manufacturers of legal liability. Few clinical DNA amplification-based tests have been marketed today because of this concern. One approach to avoid this obstacle is to utilize new technologies for in-house development activities, in which the requirement for assay performance validation, and liabilities, become the responsibility of the medical institution performing the assay.

In summary, several assay implementation activities may impact healthcare in a cost-effective manner. The easiest manner to perform these activities successfully is to:

1. Define the clinical question that is driving the specific assay conversion/development/implementation process.

2. Tightly constrain the clinical context in which the impact of assay changes will be evaluated.

3. Evaluate potential cost-effectiveness resulting from the assay changes.

4. Obtain supporting analytical performance data.

5. Perform outcomes and cost accounting of the new vs old assay after implementation of the new assay.

Following these steps will maintain the focus of laboratory testing on improving the delivery of healthcare for the patient.


Acknowledgments

We gratefully acknowledge the contributions to this work from several collaborators: Pai C. Kao and George G. Klee, Mayo Clinic, for assistance with steroid assay conversion; David M. Wilson, Timothy S. Larson, Robert Liedke, and Bernice Stevens, Renal Function Laboratory, Mayo Clinic, for their help with developing urine prescreening assays; Steven N. Thibodeau, Molecular Genetics Laboratory, for provision of samples for mutation screening; Henry H. Homburger for helpful discussion; and Edwin Ullman, Alla Lishansky, and Nurith Kurn, Behring Diagnostics, San Jose, CA, for their generous provision of reagents and instrumentation for mutation screening. Telomerase assay development activities were supported in part by an R21 grant from the National Cancer Institute.


Footnotes

1 Nonstandard abbreviations: TAT, turnaround time; CPWG, Clinical Pathology Work Group; TCC, transitional cell carcinoma; and CF, cystic fibrosis.


References

  1. Magid E. Some concepts and principles of clinical test evaluation. Scand J Clin Lab Invest 1992;52(Suppl 208):9-13. [Web of Science][Medline] [Order article via Infotrieve]
  2. National Committee for Clinical Laboratory Standards. Precision performance of clinical chemistry devices, 2nd ed.; tentative guideline. NCCLS Publ. EP5–T2. Villanova, PA: NCCLS, 1992:12(4)..
  3. Møller-Petersen J. Evaluation of diagnostic tests. Design phases. Scand J Clin Lab Invest 1992;52(Suppl 208):35-50. [Web of Science][Medline] [Order article via Infotrieve]
  4. Stöckl D, Reinauer H. Development of criteria for the evaluation of reference method values. Scand J Clin Lab Invest 1993;53(Suppl 212):16-18. [Web of Science]
  5. National Committee for Clinical Laboratory Standards. How to define, determine, and utilize reference intervals in the clinical laboratory; approved guideline. NCCLS Publ. C28-A. Villanova, PA: NCCLS, 1995:12(2)..
  6. National Committee for Clinical Laboratory Standards. Glossary and guidelines for immunodiagnostic procedures, reagents and reference materials, 2nd ed.; approved guideline. NCCLS Publ. DI1–A2. Villanova, PA: NCCLS, 1992:16(16)..
  7. Miyaki K, Price CP. Problems for improving performance in immunoassays. J IFCC 1992;4:154-165.
  8. National Committee for Clinical Laboratory Standards. Specifications for immunological testing for infectious diseases; proposed guidelines. NCCLS Publ. I/LA18-P. Villanova, PA: NCCLS, 1992:11(19)..
  9. National Committee for Clinical Laboratory Standards. Routine urinalysis and collection, transportation, and preservation of urine specimens; approved guideline. NCCLS Publ. GP16-A. Villanova, PA: NCCLS, 1995:15(5)..
  10. Waegner C. Genes in the diagnosis of malignant diseases. J IFCC 1992;4:222-227.
  11. National Committee for Clinical Laboratory Standards. Immunoglobulin and T-cell receptor gene rearrangements assays; approved guidelines. NCCLS Publ. MM2-A. Villanova, PA: NCCLS, 1995:15(18)..
  12. National Committee for Clinical Laboratory Standards. Molecular diagnostic methods for infectious diseases; approved guideline. NCCLS Publ. MM3-P. Villanova, PA: NCCLS, 1995:14(4)..
  13. Rhoads DG. Implementation of NCCLS and alternative method-evaluation protocols. Clin Chem 1991;37:1528-1530. [Free Full Text]
  14. Dybkaer R, Jordal R, Jorgensen PJ, Hannson P, Hjelm M, Kaihola HL, et al. A quality manual for the clinical laboratory including elements of a quality system. Proposed guidelines. Scand J Clin Lab Invest 1993;53(Suppl 212):60-80. [Web of Science]
  15. Hertz HS. Development of an international directory of reference methods and reference materials. Eur J Clin Chem Clin Biochem 1995;33:999-1002. [Web of Science][Medline] [Order article via Infotrieve]
  16. Bastiani RJ, Phillips RC, Schneider RS, Ullman EF. Homogenous immunochemical drug assays. Am J Med Technol 1973;39:211-216. [Web of Science][Medline] [Order article via Infotrieve]
  17. Weeks I, Beheshti I, McCapra F, Campbell AK, Woodhead JS. Acridinium esters as high-specific-activity labels in immunoassay. Clin Chem 1983;29:1474-1479. [Abstract/Free Full Text]
  18. Mullis K, Faloona F, Scharf S, Saiki R, Horn G, Erlich H. Specific enzymatic amplification of DNA in vitro: the polymerase chain reaction. Cold Spring Harbor Symp Quant Biol 1986;51(Pt 1):263-273.
  19. Romer M, Haeckel R, Capelli M, Rocipon J. The analytical performance of the Ciba Corning ACS:180 automated immunoassay system. A multicentre evaluation. Eur J Clin Chem Clin Biochem 1994;32:395-407. [Web of Science][Medline] [Order article via Infotrieve]
  20. Powe NR, Danese MD, Ladenson PW. Decision analysis in endocrinology and metabolism. Endocrinol Metab Clin North Am 1997;26:89-111. [Web of Science][Medline] [Order article via Infotrieve]
  21. Anonymous. Cost-effectiveness analysis. A new paradigm for decision making. Clin Lab Strategies 1997;2:3–6..
  22. Anonymous. Outcomes of cancer treatment for technology assessment and cancer treatment guidelines. J Clin Oncol 1996;14:671–9..
  23. Richards MA, Ramirez AJ. Quality of life: the main outcome measure of palliative care. Palliat Med 1997;11:89-92. [Free Full Text]
  24. Srivastava S, Rossi SC. Early detection research program at the NCI. Int J Cancer 1996;69:35-37. [Web of Science][Medline] [Order article via Infotrieve]
  25. Minna JD, Gazdar AF. Translation research comes of age. Nature Med 1996;2:975-975.
  26. Li FP. Translational research on hereditary colon, breast, and ovarian cancers. J Natl Cancer Inst Monogr 1995;17:1-4.
  27. Fontina P, Cheng J, Shoffner MA, Surrey S, Hitchcock WM, Kricka LJ, Wilding P. Diagnosis of Duchenne/Becker muscular dystrophy and quantitative identification of carrier status by use of entangled solution capillary electrophoresis. Clin Chem 1997;43:745-751. [Abstract/Free Full Text]
  28. Lifton R, Bennett JM. Clinical use of granulocyte-macrophage colony-stimulating factor and granulocyte colony-stimulating factor in neutropenia associated with malignancy. Hematol Oncol Clin North Am 1996;10:825-839. [Web of Science][Medline] [Order article via Infotrieve]
  29. Hartmann LC, Tschetter LK, Habermann TM, Ebbert LP, Johnson PS, Maillard JA, et al. Granulocyte colony-stimulating factor in severe chemotherapy-induced afebrile neutropenia. N Engl J Med 1997;336:1776-1780. [Abstract/Free Full Text]
  30. Lee THE, Garrets G, Cook E, Weinberg MC, Roan GO, Brand DA, et al. Ruling out acute myocardial infarction: a prospective multicenter validation of a 12-hour strategy for patients at low risk. N Engl J Med 1991;324:1239-1246. [Abstract]
  31. Gay L, Barr J. Laboratory procedures used in the review of systemic lupus erythematosus: a review. Am J Med Technol 1977;43:856-863. [Web of Science][Medline] [Order article via Infotrieve]
  32. Prin L. Mast cells, basophils, eosinophils: analysis of laboratory markers. Rev Fr Allergol Immunol Clin 1996;36:889-896.
  33. Koch DD, Peters T, Jr. Selection and evaluation of methods. Burtis CA Ashwood ER eds. Tietz textbook of clinical chemistry 2nd ed. 1994:508-525 WB Saunders Philadelphia. .
  34. Gosling JP, Middle J, Siekmann L, Read G. Standardization of hapten immunoprocedures: total cortisol. Scand J Clin Lab Invest 1993;53(Suppl 216):3-41.
  35. Stenman U-H, Bidart J-M, Birken S, Mann K, Nisula B, O'Connor J. Standardization of protein immunoprocedures: chorianogonadotropin (CG). Scand J Clin Lab Invest 1993;53(Suppl 216):42-78. [Web of Science]
  36. Wheeler MJ, D'Souza A, Matadeen J, Croos P. Ciba Corning ACS:180 testosterone assay evaluated. Clin Chem 1996;42:1445-1449. [Abstract/Free Full Text]
  37. Ringsrud KM, Linné JJ. Urinalysis and body fluids: a color text and atlas. St Louis, MO: Mosby, 1995:249pp..
  38. Robertson AW, Duff P. The nitrite and leukocyte esterase tests for the evaluation of asymptomatic bacteriuria in obstetric patients. Obstet Gynecol 1988;71:878-878. [Web of Science][Medline] [Order article via Infotrieve]
  39. Hallaway BJ, Copeman ME, Liedke RR, Stevens BS, Larson TS, Wilson DM, et al. Comparison of dipstick detection of urinary white blood cells with chemiluminescence screening assay [Abstract]. Clin Chem 1997;43:S117.
  40. Hallaway BJ, Copeman ME, Stevens BS, Larson TS, Wilson DM, O'Kane DJ. Chemiluminescence screening assay for leukocytes in urine. Hastings JW Kricka LJ Stanley PE eds. Bioluminescence and chemiluminescence: molecular reporting with photons 1997:517-520 John Wiley Chichester, UK. .
  41. Ogbonna G, Larson TS, Wilson DM, O'Kane DJ. An ultrasensitive chemiluminescence assay for the measurement of hemoglobin in urine [Abstract]. Clin Chem 1995;41:S98.
  42. Wold LE, Ingle JN, Pisansky TM, Johnson RE, Donohue JH. Prognostic factors for patients with carcinoma of the breast. Mayo Clin Proc 1995;70:678-679. [Web of Science][Medline] [Order article via Infotrieve]
  43. Hartmann LC, Ingle JN, Wold LE, Farr GH, Grill JP, Su JQ, et al. Prognostic value of c-erbB2 overexpression in axillary lymph-node positive breast cancer. Results from a randomized adjuvant treatment protocol. Cancer 1994;74:2956-2963. [Web of Science][Medline] [Order article via Infotrieve]
  44. Pietras RJ, Fendly BM, Chazin VR, Pegram MD, Howell SB, Slamon DJ. Antibody to HER-2/neu receptor blocks DNA repair after cisplatin in human breast and ovarian cancer cells. Oncogene 1994;9:1829-1838. [Web of Science][Medline] [Order article via Infotrieve]
  45. Chiu CP, Harley CB. Replicative senescence and cell immortality: the role of telomeres and telomerase. Proc Soc Exp Biol Med 1997;214:99-106. [Medline] [Order article via Infotrieve]
  46. Bachetti S. Telomere maintenance in tumor cells. Canc Surv 1996;28:197-216.
  47. Dahse R, Fiedler W, Ernst G. Telomeres and telomerase: biological and clinical importance. Clin Chem 1997;43:708-714. [Abstract/Free Full Text]
  48. Hiyama E, Gollahon L, Kataoka T, Kuroi K, Yokoyama T, Gazdar AF, et al. Telomerase activity in human breast tumors. J Natl Cancer Inst 1996;88:116-122. [Abstract/Free Full Text]
  49. Ferreiro JA, Myers JL, Bostwick DG. Accuracy of frozen section diagnosis in surgical pathology: review of a 1-year experience with 24 880 cases at Mayo Clinic Rochester. Mayo Clin Proc 1995;70:1137-1141. [Abstract]
  50. Yoshida K, Sugino T, Tahara H, Woodman A, Bolodeoku J, Nargund V, et al. Telomerase activity in bladder carcinoma and its implications for noninvasive diagnosis by detection of exfoliated cells in urine. Cancer 1997;79:362-369. [Web of Science][Medline] [Order article via Infotrieve]
  51. Yoshida K, Sugino T, Goodison S, Warren BF, Nolan D, Wadsworth S, et al. Detection of telomerase activity in exfoliated cancer cells in colonic luminal washes and its related clinical implications. Br J Cancer 1997;75:548-553. [Web of Science][Medline] [Order article via Infotrieve]
  52. Carpinito GA, Stadler WM, Briggman JV, Chodak GO, Church PA, Lamm DL, et al. Urinary nuclear matrix protein as a marker for transitional cell carcinoma of the urinary tract. J Urol 1996;156:1280-1285. [Web of Science][Medline] [Order article via Infotrieve]
  53. Soloway MS, Briggman JV, Carpinito GA, Chodak GO, Church PA, Lamm DL, et al. Use of a new tumor marker, urinary NMP22, in the detection of occult or rapidly recurring transitional cell carcinoma of the urinary tract following surgical treatment. J Urol 1996;156:363-367. [Web of Science][Medline] [Order article via Infotrieve]
  54. Ianari A, Sternberg CN, Rossetti A, Van rijn A, Deidda A, Giannarelli D, et al. Results of Bard BTA test in monitoring patients with a history of transitional cell cancer of the bladder. Urology 1997;49:786-789. [Web of Science][Medline] [Order article via Infotrieve]
  55. Sarosdy MF. The use of the BTA test in the detection of persistent or recurrent transitional-cell cancer of the bladder. World J Urol 1997;15:103-106. [Web of Science][Medline] [Order article via Infotrieve]
  56. Muller M, Heine B, Heicappell R, Emrich T, Hummel M, Stein H, et al. Telomerase activity in bladder cancer, bladder washes, and in urines. Int J Oncol 1996;9:1169-1173. [Web of Science]
  57. Bhuiyan J, Roberts S, Thibodeau SN, O'Kane DJ. Telomerase activities in urine, bladder washes, and bladder tissues from patients with transitional cell carcinoma [Abstract]. Clin Chem 1997;43:S221-S222.
  58. Kim NW, Piatyszek MA, Prowse KR, Harley CB, West MD, Ho PL, et al. Science 1994;266:2011–5..
  59. Balan V, Baldus WP, Fairbanks VF, Michels VV, Burritt MF, Klee GG. Screening for hemochromatosis: a cost-effectiveness study based on 12 258 patients. Gastroenterology 1994;107:453-459. [Web of Science][Medline] [Order article via Infotrieve]
  60. Panyutin IG, Hsieh P. Formation of a single base mismatch impedes spontaneous DNA branch migration. J Mol Biol 1993;230:413-424. [Web of Science][Medline] [Order article via Infotrieve]
  61. Ullman E, Kirakossian H, Switchenko AC, Ishkanian J, Ericson M, Wartchow CA, et al. Luminescent oxygen channeling assay (LOCITM): sensitive, broadly applicable homogeneous immunoassay method. Clin Chem 1996;42:1518-1526. [Abstract/Free Full Text]




This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via ISI Web of Science (2)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by O'Kane, D. J.
Right arrow Articles by Tenner, K. S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by O'Kane, D. J.
Right arrow Articles by Tenner, K. S.
Related Collections
Right arrow Laboratory Management
Right arrow Oak Ridge Conference


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS