Clinical Chemistry
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


Clinical Chemistry 47: 2146-2148, 2001;
This Article
Right arrow Extract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (6)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Biosca, C.
Right arrow Articles by Hyltoft Petersen, P.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Biosca, C.
Right arrow Articles by Hyltoft Petersen, P.
Related Collections
Right arrow Laboratory Management
Right arrow General Clinical Chemistry
(Clinical Chemistry. 2001;47:2146-2148.)
© 2001 American Association for Clinical Chemistry, Inc.


Articles

Reference Change Value Concept Combining Two Delta Values to Predict Crises in Renal Posttransplantation

Carmen Biosca1a, Carmen Ricós2, Ricardo Lauzurica1, Román Galimany1 and Per Hyltoft Petersen3

1 Hospital Universitari "Germans Trias i Pujol", 08916 Barcelona, Spain;
2 Hospital "Vall d’Hebron", 08035 Barcelona, Spain;
3 Odense University Hospital, 5000 Odense, Denmark

aaddress correspondence to this author at: Department of Biochemistry, Hospital "Germans Trias i Pujol", Ctra. de Canyet s/n, 08916 Barcelona, Spain. Fax 34-34-978-843, e-mail cbiosca{at}ns.hugtip.scs.es


   Introduction
Top
Introduction
References
 
The concept of reference change value (RCV) was developed by Harris and Yasaka (1)(2) to identify significant changes in the state of patients when monitoring their pathology. This concept can be applied to the laboratory data routinely acquired for renal posttransplantation patients to detect potential crises before clinical indications are manifested. The RCV takes into account the within-subject biological variation as well as the analytical (3)(4)(5)(6)(7) when:

In previous work using data from kidney transplantation patients (6)(8), we noted that the analytes most suitable for detecting significant changes during posttransplantation follow-up are serum creatinine, urate, and urea. We hypothesized that the predictive power of these analytes might greatly increase if more than one showed simultaneous and independent changes before the clinical manifestations of reduced kidney function became apparent.

We developed an objective analytical indicator (using these analytes) to detect potential subclinical crises in renal transplant recipients based on the RCV concept. To make the model relevant for use in daily practice, we attempted to include nephrologists’ criteria in the final values proposed by determining the factors they consider crucial when monitoring their transplant patients (9)(10). The underlying goal of this effort was to extract the most information possible from routine laboratory data and offer the clinician an improved tool for patient care.

To test whether the concentrations of creatinine, urea, and urate were independent, pairs of data from the three quantities in the same individuals and the same samples during the stable period obtained in the previous study (8), were associated using Pearson’s correlation coefficient (r). The pairs, creatinine/urea and urea/urate, gave r values >0.50 in the majority of patients, whereas the pair creatinine/urate gave r values symmetrically distributed around zero for all patients. This fact suggested independence between serum creatinine and urate in renal recipients during the stable period condition.

We established the diagnostic validity of significant changes in these quantities according to the evolution of a population of transplant patients.

Among the 75 renal transplant recipients included, two subgroups were established: (a) 57 patients who were clinically stable and showed no evidence of crisis for more than 3 years after transplantation (nonrejection group); (b) 18 patients who suffered acute rejection after a short period of clinical stability lasting 2–5 weeks (rejection group). Rejection had been confirmed by clinical observation, analytical profile, Doppler ultrasound study in 7 patients and by histologic study in 11 patients.

Permission for enrollment in the study was obtained from all patients, as required by the Helsinki II protocol.

Serum specimens were collected according to the standard hospital follow-up protocol designed by nephrologists for renal transplant recipients (6)(8). Under this protocol the samples studied in the present work were collected at different intervals of time, ranging from once per week to once per month (for the nonrejection group) (6).

The RCVs for creatinine and urate, at various probabilities and applied to a single quantity or the two quantities combined, were calculated according to the formula:

where zp is the covering factor for a certain probability, and CVw+a is the within-subject biological plus analytical CV.

If there is no correlation between two quantities in a subject, then under stable conditions, each quantity has less than a given probability for error when detecting changes, depending on the zp selected (e.g., if the probability for one quantity to exceed the reference change is 5%, the probability of two quantities combined is 1/20 x 1/20 = 1/400 (0.25%).

The criteria commonly used to judge the diagnostic performance of a biochemical test are diagnostic sensitivity, diagnostic specificity, and predictive values of the positive and the negative tests (11)(12). The diagnostic performance of the RCV for creatinine and urate combined was calculated from the group of 75 patients studied. The sensitivity is the fraction of all true-positive test values from posttransplantation patients that preceded an acute rejection, and the specificity is the fraction of all true-negative test values for all testings of all stable posttransplantation patients (without any results above the RCV assigned). The prevalence of acute rejection (n = 18) in the patients deemed eligible for the study in our hospital (n = 75) was 0.24.

The RCVs between creatinine and urate combined were calculated using the RCV formula described above. The application of this formula to the CVw+a values for creatinine of 12.3% and urate of 13.5% (6), using zp = 1.04 [which yields a 2.25% false-positive (FP) probability for two independent quantities combined 1 ] gives RCVs of 18.1% for creatinine and 19.8% for urate.

The percentages of difference between consecutive results for creatinine and urate found in the 57 patients from the nonrejection group and in the 18 patients from the rejection group are shown in Fig. 1 . The horizontal and vertical boundaries represent the RCVs for creatinine and urate, respectively, based on the predetermined theoretic FP probability of 2.25% (85% covering interval for each). The inverted triangles represent consecutive combined differences higher than the respective RCVs, indicating FP and true-positive results, respectively. The filled circles indicate true-negative and false-negative results in Fig. 1, A and B , respectively. In Fig. 1A , only one randomly chosen consecutive combined difference for each patient was plotted to simplify the value. In Fig. 1B , the open circles correspond to all remaining consecutive combined differences available for the rejection group of patients.



View larger version (31K):
[in this window]
[in a new window]
 
Figure 1. Double reference change (nonrejection and rejection groups) at 85% covering interval for each creatinine and urate.

(A), {blacktriangledown}, FP results; •, true-negative results. (B), {blacktriangledown}, true-positive results; •, false-negative results; {circ}, remaining consecutive combined differences.

Table 1 shows the sensitivity, specificity, and predictive values for the prevalence of kidney rejection in the patients studied with a short period of stability in this study (0.24) at the 95%, 85%, and 80% covering intervals.


View this table:
[in this window]
[in a new window]
 
Table 1. Diagnostic validity for the patients (based on our prevalence of kidney rejection) for three covering intervals.

According to the questionnaire directed to nephrologists (10), a >25% difference between consecutive creatinine determinations when creatinine concentrations were outside the reference interval was the relevant signal for impending crisis. The clinicians requested urate analysis to evaluate immunosuppressant concentration but did not use it as an indicator of rejection.

When the specialists were asked for their opinions on the consequences of false-negative prediction of crises, their answers were related to patient safety and the cost of treatment. Regarding the patient, graft loss means a return to dialysis, and this implies a high cost, both in discomfort to the patient and in the expense of dialysis.

The consequences of FP prediction of crisis were related to excessive immunosuppression, which has repercussions for the patient as physiologic stress and susceptibility to opportunistic infections. Cost considerations depend on the immunosuppressant used and possible complications from infection. The clinicians emphasized that false positives have to be minimized.

We found that RCVs of 18.1% for creatinine together with 19.8% for urate at an 85% covering interval showed the best combination of sensitivity, specificity, and positive and negative predictive values for the purpose of detecting potential rejections. When we compared the 25% criterion used by the nephrologists with the combined RCV criterion in the population of 75 patients studied, we found that the number of rejections detected and false negatives were the same (sensitivity = 0.722; confidence interval, 0.433–0.905; see Table 1Up ). However, eight more FP predictions were obtained with the >25% criterion than with the combined RCV criterion. In the nonrejection group (n = 57), 10 patients were falsely classified as experiencing rejection with the >25% criterion and 2 with the combined RCV criterion, giving specificities of 0.825 (confidence interval, 0.677–0.916) and 0.965 (0.851–0.995), respectively.

We found that when RCVs from creatinine and urate combined were used to predict crises, the FP probability was reduced and there was a considerable increase in diagnostic specificity.

The methodology used in this work pointed out the need to improve laboratory reports (13) as follows:

A limitation of our RCV model to detect changes in the evolution of kidney graft recipients during monitoring is that it can only be applied to patients who have experienced a certain period of favorable clinical evolution. Regarding the usefulness of the model, we mention a few points. First, although the model can benefit only patients who have achieved an interval of clinical stability, these are precisely the ones in whom surveillance may be more relaxed (the patient has recovered from the operation and feels better; analyses are less frequent), and a specific, objective biochemical marker could be of greatest value. Second, the constituents providing an early indicator of rejection are among those analyzed in the standard protocol and at exactly the same frequency. Thus, no additional cost, effort, or discomfort to the patient is implied by the use of this approach (14).


   Footnotes
 
1 For zp = 1.04, the tail area of distribution for one quantity is 15%. Thus, 3 false positives would be expected on average for each 20 results. For two quantities combined, the probability is 3/20 x 3/20 = 9/400 = 0.0225, or 2.25%.


   References
Top
Introduction
References
 

  1. Harris EK. Some theory of reference values. Comparison of some statistical models of intraindividual variation in blood constituents. Clin Chem 1976;22:1343-1350.[Abstract/Free Full Text]
  2. Harris EK, Yasaka T. On the calculation of a "reference change" for comparing two consecutive measurements. Clin Chem 1983;29:25-30.[Abstract/Free Full Text]
  3. Fraser CG, Harris EK. Generation and application of data on biological variation in clinical chemistry. Crit Rev Clin Lab Sci 1989;27:409-437.[Web of Science][Medline] [Order article via Infotrieve]
  4. Lassen JF, Kjeldsen J, Antonsen S, Hyltoft Petersen P, Brandslund I. Interpretation of serial measurements of international normalized ratio for prothrombin times in monitoring oral anticoagulant therapy. Clin Chem 1995;41:1171-1176.[Abstract/Free Full Text]
  5. Fraser CG, Hyltoft Petersen P, Lytken Larsen M. Setting analytical goals for random analytical error in specific clinical monitoring situations. Clin Chem 1990;36:1625-1628.[Abstract/Free Full Text]
  6. Biosca C, Ricós C, Jiménez CV, Lauzurica R, Galimany R. Are equally spaced specimen collections necessary to assess biological variation? Evidence from renal transplant recipients. Clin Chim Acta 2000;301:79-85.[Web of Science][Medline] [Order article via Infotrieve]
  7. Magid E, Hyltoft Petersen P, Christensen M. A note on the theory of reference changes. Magid E eds. Some concepts and principles of clinical test evaluation 1992:95-101 Nordkem Nordkem. .
  8. Biosca C, Ricós C, Jiménez CV, Lauzurica R, Galimany R. Model for establishing biological variation in non-healthy situations: renal posttransplantation data. Clin Chem 1997;43:2206-2208.[Free Full Text]
  9. Sandberg S, Thue G. Quality specifications derived from objective analyses based upon clinical needs. Scand J Clin Lab Invest 1999;59:531-534.[Web of Science][Medline] [Order article via Infotrieve]
  10. Biosca C, Ricós C, Lauzurica R, Bonet J, Bayés B, Galimany R. Reference change value using specific enquiry in renal post-transplantation. Bioquimia 2000;25:85.
  11. Henderson AR. Assessing test accuracy and its clinical consequences: a primer for receiver operating characteristic curve analysis. Ann Clin Biochem 1993;30:521-539.
  12. Zweig MH, Campbell G. Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem 1993;39:561-577.[Abstract/Free Full Text]
  13. Werner M. Linking analytic performance goals to medical outcome. Clin Chim Acta 1997;260:99-115.[Web of Science][Medline] [Order article via Infotrieve]
  14. Heiss H, Wild W, Margreiter R, Pfaller W, Kotanko P. Noninvasive diagnosis of renal allograft rejections-application of an information-theoretical model. Klin Wochenschr 1988;66:32-36.[Web of Science][Medline] [Order article via Infotrieve]



The following articles in journals at HighWire Press have cited this article:


Home page
J. Clin. Pathol.Home page
F. Omar, G. F van der Watt, and T. S Pillay
Reference change values: how useful are they?
J. Clin. Pathol., April 1, 2008; 61(4): 426 - 427.
[Full Text] [PDF]


This Article
Right arrow Extract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (6)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Biosca, C.
Right arrow Articles by Hyltoft Petersen, P.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Biosca, C.
Right arrow Articles by Hyltoft Petersen, P.
Related Collections
Right arrow Laboratory Management
Right arrow General Clinical Chemistry


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS