Clinical Chemistry
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
QUICK SEARCH:   [advanced]


     

Clinical Chemistry 52: 1584-1591, 2006. First published June 1, 2006; 10.1373/clinchem.2005.066019
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow 066019.Supplemental Data
Right arrow All Versions of this Article:
clinchem.2005.066019v1
52/8/1584    most recent
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (4)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Ramsden, S. C.
Right arrow Articles by Verderio, P.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Ramsden, S. C.
Right arrow Articles by Verderio, P.
Related Collections
Right arrow Molecular Diagnostics and Genetics
Right arrow Laboratory Management
(Clinical Chemistry. 2006;52:1584-1591.)
© 2006 American Association for Clinical Chemistry, Inc.

Laboratory Management

EQUAL-quant: An International External Quality Assessment Scheme for Real-Time PCR

Simon C. Ramsden1,a, Sarah Daly2, Wolf-Jochen Geilenkeuser3, Graeme Duncan4, Fabienne Hermitte4, Ettore Marubini5, Michael Neumaier6, Claudio Orlando7, Vladimir Palicka8, Angelo Paradiso9, Mario Pazzagli7, Sara Pizzamiglio10 and Paolo Verderio10

1 National Genetics Reference Laboratory (Manchester), St. Mary’s Hospital, Manchester, UK.
2 Molecular Diagnostic Centre, Manchester Royal Infirmary, Manchester, UK.
3 DGKL-Reference Institute for Bioanalytics, Bonn, Germany.
4 Ipsogen, Luminy Biotech Enterprises, Marseilles, France.
5 Institute of Medical Statistics and Biometry, University of Milan, Milan, Italy.
6 Institute for Clinical Chemistry, University Hospital Mannheim of the University of Heidelberg, Mannheim, Germany.
7 Clinical Biochemistry Unit, Department of Clinical Physiopathology, University of Florence, Florence, Italy.
8 Institute for Clinical Biochemistry and Diagnostics, School of Medicine, University Hospital Sokolska, Hradec Králové, Czech Republic.
9 National Cancer Institute, Bari, Italy.
10 Operative Unit of Medical Statistics and Biometry, Instituto Nazionale per lo Studio e la Cura dei Tumori, Milan, Italy.

aAddress correspondence to this author at: National Genetics Reference Laboratory (Manchester), St. Mary’s Hospital, Hathersage Road, Manchester, M13 0JH, UK. Fax 44-161-276-6606; e-mail simon.ramsden{at}cmmc.nhs.uk.


   Abstract
Top
 Abstract
Introduction
 the EQUAL program
 real-time pcr
 Materials and Methods
 Results
 Discussion
 References
 
Background: Quantitative gene expression analysis by real-time PCR is important in several diagnostic areas, such as the detection of minimum residual disease in leukemia and the prognostic assessment of cancer patients. To address quality assurance in this technically challenging area, the European Union (EU) has funded the EQUAL project to develop methodologic external quality assessment (EQA) relevant to diagnostic and research laboratories among the EU member states. We report here the results of the EQUAL-quant program, which assesses standards in the use of TaqManTM probes, one of the most widely used assays in the implementation of real-time PCR.

Methods: The EQUAL-quant reagent set was developed to assess the technical execution of a standard TaqMan assay, including RNA extraction, reverse transcription, and real-time PCR quantification of target DNA copy number.

Results: The multidisciplinary EQA scheme included 137 participating laboratories from 29 countries. We demonstrated significant differences in performance among laboratories, with 20% of laboratories reporting at least one result lacking in precision and/or accuracy according to the statistical procedures described. No differences in performance were observed for the >10 different testing platforms used by the study participants.

Conclusions: This EQA scheme demonstrated both the requirement and demand for external assessment of technical standards in real-time PCR. The reagent design and the statistical tools developed within this project will provide a benchmark for defining acceptable working standards in this emerging technology.


   Introduction
Top
 Abstract
 Introduction
the EQUAL program
 real-time pcr
 Materials and Methods
 Results
 Discussion
 References
 
Molecular genetic techniques are now central to clinical research and diagnostics. To maintain patient confidence in this rapidly expanding field and to provide the highest standard of analysis, strict laboratory quality assurance procedures must be followed. External quality assessment (EQA), 1 also known as laboratory proficiency testing, is a well-established means to monitor and improve the quality of laboratory output (1). Accrediting and scientific bodies such as the IFCC recognize participation in EQA schemes as a key tool for quality assurance in clinical diagnostics (2)(3).

Numerous disease-specific EQA schemes have been designed to address standards in molecular genetics (4)(5)(6)(7)(8)(9)(10); however, with more than 800 genetic tests currently available or in development [data from GeneTest web site (11)], disease-specific EQA is unlikely to meet the increasing demand. In addition, disease-specific EQA schemes are not applicable to research laboratories, which as a consequence have lacked this external oversight. The development of generic EQA schemes relevant to all testing laboratories is a possible solution to this problem.


   the EQUAL program
Top
 Abstract
 Introduction
 the EQUAL program
real-time pcr
 Materials and Methods
 Results
 Discussion
 References
 
The EQUAL scheme [Full program title: Multinational external quality assay (EQA) programs in clinical molecular diagnostics based on performance and interpretation of PCR assay methods including dissemination and training (http://www.ec-4.org/equal/04_projectpresentation.htm)] arose under the auspices of the European Communities Confederation of Clinical Chemistry and Laboratory Medicine (EC4) from a successful application to the European Union (EU) Sixth Framework Program. A primary aim of the EQUAL program was to develop and implement novel methodologic EQA programs applied to PCR-based technologies used in research and diagnostic laboratories across Europe. As part of this work package, EQA schemes were designed and implemented for general DNA analysis (EQUAL-qual), quantitative PCR (EQUAL-quant), and sequencing (EQUAL-seq). The results of the EQUAL-seq work package have been described elsewhere (12); here we describe the EQUAL-quant project.


   real-time pcr
Top
 Abstract
 Introduction
 the EQUAL program
 real-time pcr
Materials and Methods
 Results
 Discussion
 References
 
Quantitative PCR is currently used in a wide range of clinical and research applications, including the measurement of gene dosage, detection of residual disease in hematologic malignancies, and detection of bacterial and viral infection. Real-time PCR, first described in 1993 (13), is now a widely used procedure that in many areas has replaced end-point analysis. As a result of the widespread use of this technology, commercial reagents specifically designed and optimized for real-time PCR applications are now used extensively to enhance measurement sensitivity, precision, and accuracy.

The in vitro diagnostic medical device (IVD) directive of the European Communities (98/79/EC) requires that manufacturers of in vitro diagnostics assure the traceability of values assigned to their calibrators and control materials through available reference measurement procedures and/or available reference materials of a higher order. Currently, no certified reference materials are available for molecular genetic testing, and consequently, commercial providers of diagnostic devices must consider EQA performed by their client base as an essential means of postmarket monitoring of the analytical validity of their product.

A previous national interlaboratory comparison (14)(15) identified high variability in performance among laboratories using TaqMan probes in conjunction with real-time platforms. The aim of the EQUAL-quant program was to demonstrate the feasibility and scientific validity of methodologic proficiency testing for measuring real-time PCR performance throughout the EU.


   Materials and Methods
Top
 Abstract
 Introduction
 the EQUAL program
 real-time pcr
 Materials and Methods
Results
 Discussion
 References
 
participants
Laboratories were invited to participate in the EQUAL-quant scheme by national and international scientific bodies by overland mail and web site advertisements. All applications to participate were made via the project web site. On registration, all participants were allocated a unique identification code. A total of 137 laboratories from 29 countries applied to take part in the EQUAL-quant scheme (participating centers are listed in Table 1 of the Data Supplement that accompanies the online version of this article at http://www.clinchem.org/content/vol52/issue8/).

choice of target
The target chosen for the EQUAL-quant scheme was the ABL protooncogene, assayed by use of primer and probe sets developed within the Europe Against Cancer program (16) (primer details are given in Table 2 of the online Data Supplement). Wild-type ABL is a ubiquitously expressed housekeeping gene with expression detectable by real-time PCR.

scheme design and reagent sets
Participants received detailed instructions regarding the actions required to carry out the EQUAL-quant EQA exercise. All participants were provided with the following reagents:

Using the reagents provided, participants were asked to:

Reagents for mRNA extraction and reverse transcription were not provided. The cDNAs (T1, T2, and T3) were intermediate dilutions of the ABL plasmid; their concentrations were measured on a spectrophotometer (absorbance) and confirmed by real-time PCR. The K562 cell line was grown according to American Type Culture Collection conditions. For C1 and C2, a single batch of culture was amplified in bulk to obtain 2 x 109 cells. The cells were then washed with phosphate-buffered saline (137 mM NaCl; 10 mM PO4; 2.7 mM KCl; pH 7.4), resuspended in RNAlater, and divided into aliquots, each tube containing 1 mL of RNAlater + 5 x 106 cells. The reagent sets were designed to be stable at room temperature and were shipped by guaranteed 24-h delivery. Participants were advised to store the reagent sets at –40 °C on arrival and were given 8 weeks to complete the analysis and submit their results. Before the full distribution, 5 pilot reagent sets were manufactured and validated by independent reference laboratories (in 3 countries) to ensure stability and suitability of the contents.

collection of results
Participants were free to define the cycle interval for calculation of the fluorescence baseline and the cycle threshold (Ct) value for calculations. Ct values for the no-template control, the calibrators, and all unknown samples were collected, as were details on the testing platforms used. Participants were required to provide all Ct measurements in triplicate and to 3 decimal places. All results were collected via a password-protected web site accessed with the unique laboratory identification number allocated at registration. Of the 137 laboratories that received the EQUAL-quant reagent set, 24 (18%) did not submit results and did not contact the scheme organizer to explain their nonparticipation. Ten (7%) other laboratories informed the scheme organizer that they would be unable to submit results in the time scale of the survey. Thus, the results from 103 laboratories (75%; laboratories L001–L103) were available for analysis. To protect participant anonymity, the laboratory codes L001–L103 used here are different from those used during the course of the project.

statistical methods
Among the 103 laboratories that provided data, 10 failed to meet the acceptance criteria for consideration. Specifically: 4 laboratories gave insufficient data, 3 laboratories provided Ct values for the no-template control that indicated assay contamination, and 3 laboratories did not provide Ct values for 1 of the 5 standard dilutions. Therefore, data from 93 laboratories were included in the final analysis.

To evaluate the precision and accuracy of laboratory results, we considered all Ct values provided for the standard dilutions, cDNA samples (T1, T2, and T3), and biological samples (C1 and C2). A calibration curve was fitted to the data provided by each laboratory by plotting the mean Ct numbers as a function of the known starting concentration of the standard dilutions. This curve was then used to estimate the unknown starting concentration in the test samples. Only concentration values included within the range of calibration data (interpolation) were taken into consideration for the subsequent analysis; concentration values falling outside the range of standard dilutions (extrapolation) were omitted. Consequently, we cannot assume that the linear model on which the calibration is based will hold true outside the range of the standard dilutions.

The 95% confidence intervals (95% CIs) of the cDNA concentrations of the unknown samples were the pivotal statistics adopted for analysis. These intervals were computed by means of Fieller’s theorem as described elsewhere (17), and for laboratories providing at least one Ct value per sample are depicted graphically in Figs. 1 and 2 as rectangles. The upper and lower borders of the rectangles correspond to the upper and lower limits, respectively, of each CI.


Figure 1
View larger version (26K):
[in this window]
[in a new window]
  		Figure 1. Fieller 95% CIs for the unknown cDNA samples T1, T2, and T3.

The horizontal line corresponds to the trimmed mean of the copy number: T1, 5.621 x 10; T2, 5.442 x 102; and T3, 5.804 x 104. Figure 1 and Figure 1 indicate laboratories lacking in precision and accuracy, respectively.


Figure 2
View larger version (24K):
[in this window]
[in a new window]
  		Figure 2. Fieller 95% CIs for unknown biological samples C1 and C2.

The horizontal line corresponds to the trimmed mean of the copy number: C1, 4.887 x 104; C2, 5.652 x 104. Figure 2 and Figure 2 indicate laboratories lacking in precision and accuracy, respectively.

To evaluate the precision of the concentration estimates, the 90th centiles of the cumulative distribution of 95% CI lengths were calculated by considering all available 95% CIs for each sample. Intervals with lengths exceeding this threshold are depicted in the graphs as lacking in precision.

Ideally, accuracy is assessed by comparison to a known reference value (i.e., the "true" cDNA concentration), but in the present context this value is unknown and must be estimated from the data. For this purpose, a trimmed mean was adopted as a robust estimate of the true value. For each sample, the trimmed mean was calculated from those laboratories for which the concentrations were within the 12.5th to 87.5th centiles of the cumulative distribution of all concentrations; consequently the outlying 25% of concentrations do not contribute to this value.

Sampling theory predicts that the true cDNA concentration of each sample lies between the 2 confidence limits with a probability of 95%. Therefore, a laboratory with a 95% CI that fails to include the trimmed mean is regarded as lacking in accuracy. The trimmed means are indicated as horizontal continuous lines in Figs. 1Up and 2Up .

We used the Fisher exact test to assess possible associations between analytical platforms and observed performance and performed all statistical analyses with the SAS System (18).


   Results
Top
 Abstract
 Introduction
 the EQUAL program
 real-time pcr
 Materials and Methods
 Results
Discussion
 References
 
The minimum, median, and maximum values of the distributions of the cDNA copy numbers in the 5 unknown samples, together with the expected concentrations and the number of laboratories taken into consideration for statistical analysis, are reported in Table 1 . The 95% CIs computed for each laboratory on the 5 test samples are shown in Figs. 1Up and 2Up .


View this table:
[in this window]
[in a new window]
  		Table 1. Distribution of copy number for each unknown samples.

CDNA samples t1, t2, and t3
For the unknown cDNA samples (Fig. 1Up ), 74 of 93 laboratories met the performance criteria (i.e., provided both precise and accurate estimates for all 3 unknown samples tested).

For 9 laboratories, the 95% CI length exceeded, in at least 1 sample, the (arbitrary) threshold adopted to identify the imprecise determinations. Overall, inaccuracy increased from the higher (sample T3) to the lower (sample T1) copy number; in fact, 9, 1, and 0 CIs did not cover the trimmed mean for samples T1, T2, and T3, respectively. For all 3 cDNA samples, the trimmed means closely agreed with the expected concentrations (see Table 1Up ); therefore, the trimmed means can be viewed as unbiased estimate of the true concentrations.

cell suspension samples c1 and c2
Samples C1 and C2 were included in the scheme to assess the ability to perform all of the steps necessary to estimate RNA copy number. Because this is not a routine procedure for many laboratories carrying out real-time PCR, analysis of these samples was optional. Specifically, 75 laboratories provided Ct values for sample C1 and 74 for sample C2. In 27 of 75 and 25 of 74 laboratories for sample C1 and C2, respectively, both 95% CI limits fell outside the range of standard dilutions. The 95% CIs for 48 (sample C1) and 49 (sample C2) laboratories are reported in Fig. 2Up . The 95% CI length for 4 laboratories exceeded the threshold adopted to pick up the imprecise determinations for both samples. The CIs of 20 participants did not cover the trimmed mean for at least 1 biological sample, and for 10 participants, the CIs did not cover the trimmed mean for both samples.

analytical platforms
More than 10 different testing platforms were used to carry out this scheme (Table 2 ), and laboratories that reported at least 1 inaccurate or imprecise result for T1, T2, or T3 were distributed evenly among them. To achieve sufficiently large groups for analysis, we grouped users according to whether they used the ABI platforms (n = 58), LightCycler (Roche; n = 15), or other platforms (n = 20). As reported in Table 2 , no associations were observed between performance and platform categories (Fisher exact test, P = 0.71).


View this table:
[in this window]
[in a new window]
  		Table 2. Analytical platforms used in the EQUAL-quant scheme.1


   Discussion
Top
 Abstract
 Introduction
 the EQUAL program
 real-time pcr
 Materials and Methods
 Results
 Discussion
References
 
Unlike disease-specific EQA schemes, EQUAL-quant does not set out to assess the performance of in-house assays. By reviewing performance in a manner independent of local specialties, we are not limiting participation. In addition, by using fully validated reagent sets manufactured to commercial standards and providing detailed written procedures, we have minimized issues of reagent performance and concentrated instead on platform performance and technical implementation of this analytical procedure, essential measures of laboratory performance that currently have little external quality control in the context of this technology.

We have designed and manufactured a reagent set suitable for the external assessment of real-time PCR with TaqMan probes. This EQA scheme has been implemented successfully by a wide variety of laboratories across the EU and beyond, as well as across numerous clinical disciplines within both diagnostic and research settings. This EQA of real-time PCR has been well received by participants, many of whom have had no prior experience with such a scheme. We focused on real-time PCR by evaluating the performance in testing gene expression (samples T1, T2, and T3) or including the pre-PCR steps (samples C1 and C2). With samples C1 and C2, we have been unable to determine the cause of the wide variation in the laboratory results (including RNA extraction, reverse transcription, and real-time PCR).

Continual demonstration of satisfactory performance is a requirement of laboratory accreditation, and we have identified a lack of precision and/or accuracy in the determination of cDNA copy number in a small but significant number of laboratories. Of the 103 laboratories that provided data, 74 gave both precise and accurate results for all cDNA samples, 19 were lacking in precision and/or in accuracy for at least 1 sample, and 10 were not included in the statistical analysis for one of the following reasons: (a) presence of one or more values for the negative samples, indicating contamination of the assay; (b) presence of at least one standard with all Ct values missing; or (c) all Ct values missing for all samples.

In a previous national EQA scheme in real-time PCR, significantly higher variability than described here occurred among participating laboratories (14). Using statistical procedures equivalent to those described above, Casini Raggi et al. (14) found that only 12 of 40 (30%) participating laboratories that provided a full set of results were both precise and accurate for all samples tested, compared with 74 of 93 (80%) in our current analysis. This difference most likely reflects the different approaches to EQA design rather than genuine differences in laboratory performance. For example, in the previous study test (14), cDNA samples were retrieved from pools of total RNA, whereas in the current scheme cloned cDNA was provided to control the starting copy number. In addition, in the current scheme the full range of standard controls were provided ready-made, whereas in the previous exercise (14), a single standard cDNA solution was provided, from which participants were asked to make serial dilutions to construct a calibration curve. This action is likely to have introduced an additional source of variability. We provided ready-made standard dilutions and observed lower variability and better assessment of analytical steps critical to the assay execution.

For samples C1 and C2, it is less valid to define performance on the basis of results lacking in accuracy or precision in the same way as for samples T1, T2, and T3. The reasons for this are as follows: (a) existing participant in-house procedures may not be optimized for cells in the medium provided, and (b) because RNA extraction and cDNA synthesis are highly variable in efficiency, deviation above the mean might reflect more rather than less efficient procedures. Good laboratory practice will take this variability into account; however, it is important that participants be given the opportunity to compare their own procedures against others. For the sake of completeness, we describe the results for 48 and 49 laboratories for sample C1 and C2, respectively. Undoubtedly, copy number estimates consistently below the mean should warrant further consideration. In future EQA schemes, we recommend that a more extensive calibration curve prepared with standard dilutions be considered to minimize invalid results (extrapolation).

Participants must consider the results from samples C1 and C2 and attempt to explain any deviation from the mean. Because C1 and C2 represent independent samplings from a common culture, they cannot be regarded as identical samples. Consequently, a statistical comparison is not appropriate. However, these samples would have been sufficiently similar that the results will give laboratories a picture of the reliability of their pre-PCR procedures. In the light of the results from samples C1 and C2, we suggest that in future EQA exercises participants should be asked to compensate for differences between samples attributable to material losses, PCR inhibition, and differences in reverse transcriptase yields by standardizing target copy number estimates by parallel amplification with 1 or more control genes (19)(20).

With the data presented here, we can begin to investigate common sources of error in real-time PCR procedures. In regard to accuracy and precision, most problems were encountered with the lowest target cDNA numbers. Inaccurate results for T1 (50 copies/5 µL) were reported by 9 laboratories, and for 7 of these laboratories this was the only inaccurate result. In addition, 8 laboratories obtained imprecise results for 2 or more samples. Pipetting is the most likely source of error, emphasizing the need for well-calibrated and robust pipettes for real-time PCR.

There are now a wide range of platforms available for real-time PCR, a situation reflected by the participation in the EQUAL-quant scheme. More than 10 different platforms were used to carry out this scheme, and laboratories reporting both accurate and precise results were distributed evenly among them. Specifically, 79% of ABI platform users, 87% of LightCycler users, and 75% of the others achieved accurate and precise measurements for all 3 cDNA samples, T1, T2, and T3.

In this report attention has focused on copy number estimation. More detailed analysis of possible sources of errors related to calibration curves will be presented in a future report.

EQA is now regarded as an indispensable aspect of laboratory activity, and we must consider the financial implications of providing a scheme such as this. We estimate that the cost of participation in the EQUAL-quant scheme, taking into account scheme design, reagent set manufacture, and analysis of the results, to be approximately {euro}526 per participant. It is hoped that with experience the unit costs of future schemes could be reduced.

In conclusion, real-time PCR has opened new horizons in molecular clinical diagnostics. However, minor variations in sample handling and test execution can lead to large changes in the overall amount of amplified product, which may compromise the appropriate clinical interpretation of results. The availability of reference materials is an unrealistic goal for the vast majority of applications, because different genes have unpredictable expression and the cost of target-specific materials would be prohibitive. Methodologic EQA offers independent assessment of internal quality-control procedures essential to the reliable execution of this technically demanding technology.


   Acknowledgments
 
We gratefully acknowledge the contribution of all of the partners and participant laboratories (see Table 1Up in the online Data Supplement) in the EQUAL project. This program has been supported by the EU Sixth Framework Program (Contract 504842).


   Footnotes
 
1 Nonstandard abbreviations: EQA, external quality assurance; EU, European Union; Ct, cycle threshold; and 95% CI, 95% confidence interval.


   References
Top
 Abstract
 Introduction
 the EQUAL program
 real-time pcr
 Materials and Methods
 Results
 Discussion
 References
 

  1. Libeer JC. Role of external quality assurance schemes in assessing and improving quality in medical laboratories. Clin Chim Acta 2001;309:173-177.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  2. Neumaier M, Braun A, Wagener C. Fundamentals of quality assessment of molecular amplification methods in clinical diagnostics. International Federation of Clinical Chemistry Scientific Division Committee on Molecular Biology Techniques. Clin Chem 1988;44:12-26.
  3. Burkardt HJ. Standardisation and quality control of PCR analyses. Clin Chem Lab Med 2000;38:87-91.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  4. Dequeker E, Cassiman JJ. Genetic testing and quality control in diagnostic laboratories. Nat Genet 2000;25:259-260.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  5. Losekoot M, Bakker B, Laccone F, Stenhouse S, Elles R. A European pilot quality assessment scheme for molecular diagnosis of Huntington’s disease. Eur J Hum Genet 1999;7:217-222.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  6. Mueller CR, Kristoffersson U, Stoppa-Lyonnet D. External quality assessment for mutation detection in the BRCA1 and BRCA2 genes: EMQN's experience of 3 years. Ann Oncol 2004;15(Suppl 1):i14-i17.[Abstract]
  7. Taruscio D, Falbo V, Floridia G, Salvatore M, Pescucci C, Cantafora A, et al. Quality assessment in cytogenetic and molecular genetic testing: the experience of the Italian Project on Standardisation and Quality Assurance. Clin Chem Lab Med 2004;42:915-921.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  8. Hofgartner WT, Tait JF. Frequency of problems during clinical molecular-genetic testing. Am J Clin Pathol 1999;112:14-21.[Web of Science][Medline] [Order article via Infotrieve]
  9. Preston FE, Kitchen S, Jennings I, Woods TA. A UK National External Quality Assessment scheme (UK NEQAS) for molecular genetic testing for the diagnosis of familial thrombophilia. Thromb Haemost 1999;82:1556-1557.[Web of Science][Medline] [Order article via Infotrieve]
  10. Tripodi A, Peyvandi F, Chantarangkul V, Menegatti M, Mannucci PM. Relatively poor performance of clinical laboratories for DNA analyses in the detection of two thrombophilic mutations—a cause for concern. Thromb Haemost 2002;88:690-691.[Web of Science][Medline] [Order article via Infotrieve]
  11. University of Washington, Seattle. GeneTests home page. http://www.geneclinics.org (accessed December 10, 2005)..
  12. Ahmad-Nejad P, Dorn-Beineke A, Pfeiffer U, Brade J, Geilenkeuser WJ, Ramsden S, et al. Methodologic European external quality assurance for DNA sequencing: the EQUALseq program. Clin Chem 2006;52:716-727.[Abstract/Free Full Text]
  13. Higuchi R, Fockler C, Dollinger G, Watson R. Kinetic PCR analysis: real-time monitoring of DNA amplification reactions. Biotechnology 1993;11:1026-1030.[CrossRef][Medline] [Order article via Infotrieve]
  14. Casini Raggi C, Verderio P, Pazzagli M, Marubini E, Simi L, Pinzani P, et al. An Italian program of external quality control for quantitative assays based on real-time PCR with Taq-ManTM probes. Clin Chem Lab Med 2005;43:542-548.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  15. Marubini E, Verderio P, Casini Raggi C, Pazzagli M, Orlando C. Statistical diagnostics emerging from external quality control of real-time PCR. Int J Biol Markers 2004;19:141-146.[Web of Science][Medline] [Order article via Infotrieve]
  16. Beillard E, Pallisgaard N, van der Velden VH, Bi W, Dee R, van der Schoot E, et al. Evaluation of candidate control genes for diagnosis and residual disease detection in leukemic patients using ‘real-time’ quantitative reverse-transcriptase polymerase chain reaction (RQ-PCR)—a Europe Against Cancer program. Leukemia 2003;17:2474-2486.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  17. Verderio P, Orlando C, Casini Raggi C, Marubini E. Confidence interval estimation for DNA and mRNA concentration by real-time PCR: A new environment for an old theorem. Int J Biol Markers 2004;19:76-79.[Web of Science][Medline] [Order article via Infotrieve]
  18. . SASInstitute Inc. SAS OnlineDoc®, Version 8 1999 SAS Institute Inc. Cary, NC. .
  19. Wang C, Gao D, Vaglenov A, Kaltenboeck B. One-step real-time duplex reverse transcription PCRs simultaneously quantify analyte and housekeeping gene mRNAs. Biotechniques 2004;36:508-516, 518–9.[Web of Science][Medline] [Order article via Infotrieve]
  20. Lion T. Current recommendations for positive controls in RT-PCR assays. Leukemia 2001;15:1033-1037.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]



The following articles in journals at HighWire Press have cited this article:


Home page
 Clin. Chem.Home page
S. A. Bustin, V. Benes, J. A. Garson, J. Hellemans, J. Huggett, M. Kubista, R. Mueller, T. Nolan, M. W. Pfaffl, G. L. Shipley, et al.
The MIQE Guidelines: Minimum Information for Publication of Quantitative Real-Time PCR Experiments
Clin. Chem., April 1, 2009; 55(4): 611 - 622.
[Abstract] [Full Text] [PDF]

Home page
 Clin. Chem.Home page
C. Orlando, P. Verderio, R. Maatman, J. Danneberg, S. Ramsden, M. Neumaier, D. Taruscio, V. Falbo, R. Jansen, C. Casini-Raggi, et al.
EQUAL-qual: A European Program for External Quality Assessment of Genomic DNA Extraction and PCR Amplification
Clin. Chem., July 1, 2007; 53(7): 1349 - 1357.
[Abstract] [Full Text] [PDF]

Home page
 Clin. Chem.Home page
A. Dorn-Beineke, P. Ahmad-Nejad, U. Pfeiffer, S. Ramsden, M. Pazzagli, and M. Neumaier
Improvement of Technical and Analytical Performance in DNA Sequencing by External Quality Assessment-Based Molecular Training
Clin. Chem., November 1, 2006; 52(11): 2072 - 2078.
[Abstract] [Full Text] [PDF]

This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow 066019.Supplemental Data
Right arrow All Versions of this Article:
clinchem.2005.066019v1
52/8/1584    most recent
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (4)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Ramsden, S. C.
Right arrow Articles by Verderio, P.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Ramsden, S. C.
Right arrow Articles by Verderio, P.
Related Collections
Right arrow Molecular Diagnostics and Genetics
Right arrow Laboratory Management

HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS