|
|
||||||||
Cancer Diagnostics |
Departments of1 Urology and 2 Clinical Chemistry, Erasmus MC, Rotterdam, The Netherlands.
aAddress correspondence to this author at: Department of Clinical Chemistry (AKC), Erasmus MC—Rm. L134, s Gravendijkwal 230, 3015 CE Rotterdam, The Netherlands. Fax +31(0)10-43 67894; e-mail r.vanschaik{at}erasmusmc.nl.
| Abstract |
|---|
|
|
|---|
Methods: tPSA concentrations were measured in 106 serum samples with both Hybritech and WHO calibrations. The established relationships were used for an in silico experiment with a cohort of 5865 men. Differences in prostate biopsy rates, PCa detection, and characteristics of missed cancers were calculated at biopsy thresholds of 3.0 and 4.0 µg/L.
Results: A linear relationship was observed between the 2 calibrations, with a 20.3% decrease in tPSA values with the WHO standard compared with the Hybritech calibration. Applying the WHO calibration to the cohort of 5865 men yielded a 20% or 19% decrease in prostate biopsies and a 19% or 20% decrease in detected cancers compared with the Hybritech calibration, at a cutoff for biopsy of 3.0 or 4.0 µg/L, respectively. The decrease in detected cancers declined to 9% or 11% if an abnormal result in a digital rectal examination or a transrectal ultrasound evaluation was used as trigger for prostate biopsy (cutoff of 3.0 or 4.0 µg/L, respectively).
Conclusions: Application of the WHO standard for tPSA assays with commonly used tPSA thresholds leads to a significant decrease in PCa detection. Careful assessment of the relationship between the WHO standard and the thresholds used for prostate biopsy is hence necessary.
| Introduction |
|---|
|
|
|---|
If the assay method applied and the specific reference range for the assay are unknown to the clinician, tPSA values may be misinterpreted, possibly influencing the decision to recommend that patients undergo a prostate biopsy for PCa detection (3). There may be clinical implications if serial tPSA measurements are used to calculate tPSA velocity or doubling time for the purpose of indicating PCa aggressiveness or treatment failure (8)(9)(10)(11)(12)(13). In addition, the lack of interchangeability of the various assays may prevent objective judgment and unbiased comparison of the results of previous studies.
The First Stanford Conference was convened in 1992 to improve the interchangeability of tPSA assays. The Second Stanford Conference resulted in a reference standard consisting of 90% purified PSA–antichymotrypsin and 10% free PSA on a molar basis (14). The WHO adoption of this standard resulted in the First International Standard for tPSA under the National Institute of Biological Standards and Control, also known as WHO 96/670 (15)(16). Later, the WHO also introduced a standard for free PSA (15)(16). Differences among tPSA assays seem to have decreased since the introduction of the WHO 96/670 calibration, but they have not been completely resolved and eliminated (14)(17)(18). Therefore, the term "harmonization" has become favored instead of "standardization," because not all assays perform equally, even after standardization (19)(20). To minimize the likelihood of clinical errors, several countries now require their laboratories to report tPSA concentrations in accordance with the WHO 96/670 preparation (21).
Although most clinicians are familiar with the fact that different tPSA assays produce different results, they may not be aware that restandardization from a historical standard to the WHO calibration causes a shift in mass units, which yields a potential for underestimating tPSA values. If this shift is not fully appreciated, especially with respect to the tPSA threshold value for biopsy, a resulting decrease in PCa detection may produce life-altering consequences for individual patients. Thus, different cutoff values are required for the historical standard and the WHO calibration to achieve the same clinical performance.
With the introduction of the WHO 96/670 calibration for tPSA, however, the question has arisen as to how this calibration would influence the clinical outcomes for the current tPSA thresholds. It is clear that the thresholds and methods used to measure tPSA are coupled; therefore, maintaining the established clinical validity requires that significant changes in the assay be evaluated for changes in reference values and cutoff thresholds. We describe our study focusing on the effects of implementing the WHO standard on the Beckman Coulter tPSA assay. This assay, the first tPSA assay to be approved by the US Food and Drug Administration, established the conventional 4.0-µg/L cutoff value for prostate biopsy on the basis of a large multicenter prospective study by applying the gold standard Hybritech tPSA assay (22). Although age-specific reference intervals are now available for tPSA, the 4.0-µg/L tPSA threshold for prostate biopsy is well known, not only by health care professionals but also by the general public. We also applied a cutoff value of 3.0 µg/L because this concentration is currently used as indication for prostate biopsy by the European Randomized Study of Screening for Prostate Cancer (ERSPC) (23).
| Materials and Methods |
|---|
|
|
|---|
|
The resulting formula was then used to perform an in silico calculation of the tPSA concentrations based on the WHO 96/670 standard for a cohort of men selected from the database of the Rotterdam center of the ERSPC. Patients were eligible for inclusion if they had undergone sextant biopsy of the prostate. Men were biopsied in the study either because of a Hybritech tPSA concentration
3.0 µg/L or because of a Hybritech tPSA concentration of <3.0 µg/L at a repeat screening during a side study to test the value of free PSA for PCa detection (26)(27). Digital rectal examination (DRE) and transrectal ultrasound (TRUS) results were known for all men. All of the 5865 men included in the study were unbiopsied at the start of the study and were 55 to 75 years of age. The median tPSA concentration was 4.0 µg/L (range, 0.1–315.7 µg/L; see Fig. 1
in the Data Supplement that accompanies the online version of this article at http://www.clinchem.org/content/vol54/issue12). On the basis of the sextant biopsy results, PCa was diagnosed in 1539 patients (26%) in this cohort, 539 of whom eventually underwent a radical prostatectomy (RP). The characteristics of the PCa patients within the cohort are summarized in Table 1
. This cohort of 5865 men was used in an in silico experiment that evaluated cutoff values for prostate biopsy of
3.0 µg/L and
4.0 µg/L for both the Hybritech and WHO 96/670 calibrations. We subsequently calculated differences in prostate biopsy rates, PCa detection, and characteristics of the missed cancers. The SPSS 12.0 software package was used for statistical analyses.
|
| Results |
|---|
|
|
|---|
|
Use of this formula to calculate the WHO 96/670 tPSA concentrations for the cohort of previously unbiopsied men (characteristics summarized in Table 1
) yielded a 20.3% decrease in tPSA concentrations compared with the known Hybritech tPSA concentrations. A tPSA biopsy threshold of
3.0 µg/L for the Hybritech calibration yielded 4419 biopsied patients from the 5865 cases (75%), leading to a total of 1430 detected PCa cases (92%) (Table 2
). A tPSA biopsy threshold of
4.0 µg/L for the Hybritech calibration yielded 3004 biopsied patients (51%), leading to a total of 1073 detected PCa cases (70%).
|
Without adjusting the cutoffs for the WHO 96/670 tPSA calibration (i.e.,
3.0 or
4.0 µg/L, which is equal to a Hybritech tPSA cutoff of
3.6 or
4.8 µg/L, respectively), one obtains 3218 men (55%) as candidates for prostate biopsy, leading to 1130 detected cases of PCa (73%) with a cutoff of
3.0 µg/L (Table 2
). Nonadjustment yields a 20% decrease in the number of prostate biopsies (from 75% to 55%) and a 19% decrease in detected cancers (from 92% to 73%). Thus, a tPSA biopsy threshold of
3.0 µg/L for the WHO 96/670 calibration would miss 300 PCa cases that would have been detected with the Hybritech tPSA calibrator at the same threshold for prostate biopsy. At a cutoff of
4.0 µg/L for the WHO 96/670 tPSA calibration, 1873 men (32%) were candidates for prostate biopsy, leading to 767 detected cases of PCa (50%) and yielding a 19% decline in the biopsy rate and a subsequent 20% decrease in PCa detection.
In the group of patients who underwent an RP, 507 (94%) of 539 cancers were detected by applying the Hybritech tPSA calibration at a biopsy threshold of
3.0 µg/L, in contrast with the WHO calibration detecting 406 (75%) of 539 PCa cases, a decrease of 19%. Thus, use of the WHO calibration with a tPSA biopsy threshold of
3.0 µg/L specifically missed 101 RP cases that would have been detected with the Hybritech tPSA calibrator at the same threshold for prostate biopsy. At a cutoff of
4.0 µg/L, application of the Hybritech tPSA calibration detected 386 (72%) of 539 cancers, in contrast with 272 (50%) of 539 PCa cases detected with the WHO calibration.
The clinical and pathologic stages and the biopsy and RP sample Gleason scores of the missed cancers are depicted in Tables 3
and 4
. At biopsy thresholds of
3.0 µg/L and
4.0 µg/L, there are significant differences in cancer characteristics between the cancers that are missed by application of the WHO 96/670 standard and the cancers that are detected with the Hybritech calibration. Overall, the group of missed cancers consists of tumors with lower clinical and pathologic tumor stages and lower biopsy and RP Gleason scores.
|
|
At a 3.0-µg/L cutoff, an abnormal DRE result is found in 109 (36%) of the 300 missed cancer cases, and an abnormal TRUS result is present in 97 (32%) of the 300 missed cancer cases. When an abnormal DRE or TRUS result is used as a trigger for prostate biopsy, 146 (49%) of the 300 missed cancer cases will be detected despite the application of the WHO 96/670 reference standard. This approach yields a decrease in PCa detection of 9% compared with the Hybritech calibration. At a threshold of 4.0 µg/L, an abnormal DRE result and an abnormal TRUS result are found in 111 cases (36%) and 90 cases (29%), respectively, of the 306 missed PCa cases. Use of an abnormal DRE or TRUS result as a trigger for prostate biopsy results in the detection of 139 (45%) of the 306 missed cancer cases, leading to a decrease in PCa detection of 11% compared with the Hybritech calibration.
Biopsy frequencies and PCa-detection rates were similar after the linear relationship between the 2 calibrations was used to correct the biopsy threshold for the WHO 96/670 calibration to 2.4 or 3.2 µg/L.
| Discussion |
|---|
|
|
|---|
3.0 µg/L or
4.0 µg/L. Biopsy and PCa-detection rates were similar after the linear relationship between the WHO and Hybritech calibrations was used to correct the biopsy threshold for the WHO 96/670 calibration to 2.4 µg/L or 3.2 µg/L, respectively. One possible limitation of our study is that the second part is based on in silico calculations of WHO 96/670 tPSA concentrations, instead of on direct measurements of serum concentrations. This in silico calculation was based on the linear relationship established in a study of a smaller cohort (n = 106) that used both calibrations for actual serum measurements; however, the 20.3% negative shift in tPSA values that is introduced by application of the WHO calibration is virtually identical to the findings of earlier studies by Kort et al. and Roddam et al., who found a 22% and 19% difference, respectively, in tPSA concentrations (mean, 20.5%) between the WHO 96/670 and Hybritech calibrations (18)(21). Whereas we used an in silico experiment to evaluate the clinical effects of applying the WHO standard for tPSA, the actual relationship between the WHO calibration and the original Hybritech calibration was established with clinical serum samples. Because tPSA assays are known to be highly sensitive to the matrix of the sample, the use of clinical samples avoids biases that arise from the use of artificial samples (19).
A second limitation is that a cohort of screen-detected PCas in asymptomatic men was used instead of a cohort of clinically detected PCa cases to assess the clinical impact of the new WHO calibration. Implications for a cohort of clinically detected PCas will be similar, more or less, with probably fewer missed PCa cases because of initially higher tPSA concentrations.
We did not investigate the relationships between other tPSA assays and the new WHO standard in this study. This choice was partly because tPSA measurements made within the screening program of the ERSPC have always been based on the Hybritech system. The strategy has been to use the same method during the entire study to minimize errors in medical decision making. Such errors may occur if different assays are used during patient monitoring. Kort et al. recently concluded that the results of other assays also deviate from expected tPSA values if the WHO 96/670 reference preparation is applied (regression slopes between 0.99 and 1.08), showing that further efforts are needed to improve the interchangeability of tPSA assays (17)(18)(21). In addition, we emphasize that although use of a biopsy cutoff of 3.0 or 4.0 µg/L is common practice, tPSA is a continuous, not a dichotomous, biomarker; therefore, the risk of PCa increases as the PSA concentration increases (28).
As far as we know, this study is the first to evaluate the clinical effects of the WHO 96/670 calibration for tPSA in a large screening cohort. Therefore, we have not been able to compare the number of missed cancers and the shifts in PCa characteristics with those of previous studies. Significant changes in PCa detection and PCa characteristics have also been observed in studies that have assessed the interchangeability of various tPSA assays, although a study by Yurdakul et al. concluded that different tPSA assays detected PCa cases with identical histologic features (4)(13)(29)(30). This study and others, however, evaluated the effects of different tPSA assays, which have different performance characteristics. This approach contrasts with that of our study, in which the only difference was the reference standard. For the present study, the difference in cancer characteristics between the cancers missed by the WHO 96/670 calibration and the cancers detected by the Hybritech calibration can be explained by the distribution of tumor stages and Gleason scores in the entire population of the screening cohort. The group of missed cancers has Hybritech tPSA values of 3.0– 3.6 µg/L or 4.0–4.8 µg/L and contains fewer high-stage and high-grade tumors than the cohort of all PCa cases with Hybritech tPSA concentrations
3.0 µg/L or
4.0 µg/L, respectively.
The finding of a decrease in cancer detection caused by application of the WHO 96/670 calibration may also have positive implications in light of the current discussions on limiting PCa overdetection and subsequent overtreatment (31)(32)(33)(34). Because the group of missed cancers contains significantly fewer tumors with a high stage or a high Gleason score and more tumors with favorable characteristics (Tables 3
and 4
), missing these cancers may not have clinical consequences and so may limit the overdetection and overtreatment of PCa.
Furthermore, we have shown that the decrease in detected PCa cases caused by application of the WHO 96/670 standard is less dramatic when abnormal DRE or TRUS results are applied as triggers for prostate biopsy. Given the limited predictive value of an abnormal DRE or TRUS result in a screening setting, however, especially in the low tPSA range of approximately 3.0 µg/L or 4.0 µg/L, the actual decrease in PCa detection most likely will be closer to 19% or 20%, respectively, than to 9% or 11% (35)(36)(37)(38)(39).
The recalibration is also expected to affect PCa detection through effects on other PSA threshold values for biopsy. Adaptation to the WHO 96/670 reference standard will also affect tPSA-derived variables, such as tPSA velocity, tPSA doubling time, and age-adjusted tPSA values, with potential consequences for the individual patient.
In conclusion, the present study has shown that a decision to adapt tPSA testing to the WHO 96/670 reference standard requires both careful assessment of the relationship between the historical standard and the WHO standard and subsequent establishment of a new threshold for prostate biopsy. In this study, we found that the threshold for prostate biopsy shifted from 3.0 µg/L or 4.0 µg/L with the historical Hybritech calibration to 2.4 µg/L or 3.2 µg/L, respectively, after application of the WHO 96/670 calibration. If not adjusted, this leads to a 19% or 20% decrease in PCa detection. Hence, if clinicians are unaware of the replacement of their historical tPSA standard with the WHO 96/670 reference preparation and do not adapt the threshold concentration for prostate biopsy, the number of prostate biopsies and subsequent PCa-detection rates will shift considerably in their clinic.
| Acknowledgments |
|---|
Authors Disclosures of Potential Conflicts of Interest: Upon manuscript submission, all authors completed the Disclosures of Potential Conflict of Interest form. Potential conflicts of interest:
Employment or Leadership: None declared.
Consultant or Advisory Role: C.H. Bangma, member of an advisory group to Beckman Coulter.
Stock Ownership: None declared.
Honoraria: None declared.
Research Funding: None declared.
Expert Testimony: None declared.
Other: An educational grant for this study was provided by Beckman Coulter International.
Role of Sponsor: The funding organizations played no role in the design of study, choice of enrolled patients, review and interpretation of data, or preparation or approval of manuscript.
Acknowledgments: The authors are indebted to Dr. Axel Semjonow for a critical review of this manuscript.
| Footnotes |
|---|
| References |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |