Clinical Chemistry AACC Online Job Center
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


Clinical Chemistry 51: 1307-1309, 2005; 10.1373/clinchem.2005.050393
This Article
Right arrow Extract Freely available
Right arrow Full Text (PDF)
Right arrow Submit an electronic Letter to
the Editor about this paper
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (4)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Fraser, C. G.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Fraser, C. G.
Related Collections
Right arrow General Clinical Chemistry
Right arrow Evidence Based Laboratory Medicine and Test Utilization
Right arrow Lipids, Lipoproteins, and Cardiovascular Risk Factors
(Clinical Chemistry. 2005;51:1307-1309.)
© 2005 American Association for Clinical Chemistry, Inc.


Letters to the Editor

Quality Specifications for Imprecision of B-Type Natriuretic Peptide Assays

Callum G. Fraser

Department of Biochemical Medicine, NHS Tayside, Ninewells Hospital and Medical School, Dundee DD1 9SY, Scotland

aE-mail callum.fraser{at}tuht.scot.nhs.uk


To the Editor:

Apple et al. (1), on behalf of the Committee on Standardization of Markers of Cardiac Damage of the IFCC, recently reviewed and abstracted the scientific literature to provide recommendations pertaining to the quality specifications for B-type natriuretic peptide (BNP) and N-terminal proBNP (NT-proBNP) assays (together abbreviated here as NPs). They stated that a decision concerning what is acceptable imprecision is needed and concurred with the goals derived using the model proposed by Cotlove et al. (2) based on the concept that analytical imprecision (CVA) should not significantly affect clinical use. This model suggests that this desired negligible clinical impact can be obtained when CVA is lower than or equal to one-half the intraindividual biological variation (CVI). The mathematical explanation of this and the many other models available for the setting of quality specifications for analytical performance characteristics have been described in detail (3). The authors state that, because of high biological variation for NPs (CVI, 30%–50%), very low CVA may be unnecessary: however, for monitoring of therapy with serial BNP measurements in clinical cases, it may be desirable to minimize CVA (1).

Furthermore, Apple et al. (1) state that a desirable CVA of <15% at NP concentrations within the reference interval is recommended. If an eventual goal is to rely on monitoring of marker trends over time, then an optimal imprecision of <10% is advocated.

It is interesting that those who produce allegedly evidence-based guidelines, recommendations, and scientific statements always seem to end up with "round numbers" such as 15%, 10%, and 5% as goals for CVA (3). Using readily available data on CVA and CVI, it is easy to work out whether the recommendations are cogent, particularly the latter, because the model of Cotlove et al. (2) is actually concerned with the clinical setting of monitoring individuals.

Consider that CVI is 40%, as suggested by Apple et al. (1) and recently studied in detail (4). A significant change in serial results occurs only if the reference change value (RCV), sometimes called the critical difference, is exceeded. RCVs are easily calculated as 21/2 x Z x (CVA2 + CVI2)1/2 (3), where Z is the number of standard deviations appropriate to the probability selected. If CVA was 15%, then the RCV for P <0.05 would be 118%, and if CVA was 10%, the RCV would be 114%. Thus, the statement made by Apple et al. (1) that an optimal CVA of 10% would be advocated for monitoring individuals is not evidence based. If CVI is much larger than CVA, then it is simply not worthwhile reducing CVA to less than one-half of CVI, even in this clinical use of results.

Whether the RCV can be reduced to make NPs more useful for monitoring individuals over time is a question not addressed by Apple et al. (1) but is discussed briefly by Bruins et al. (4). In particular, do replicate assays or replicate samples, as advocated for cholesterol and high-sensitivity C-reactive protein (5), help in this regard to improve the utility of a test in monitoring individuals? This again can be calculated easily because:

where nA is the number of replicate assays, and nS is the number of patient samples (5). If each sample was analyzed twice, a good and simple way to reduce CVA, if CVA was 15%, RCV would become 115%, and if CVA was 10%, RCV would become 113%. Thus, reducing CVA even further through duplicate analyses has very little effect on RCV because CVI is much larger than CVA. Lowering CVA from 15% to 10% and lower is simply not worthwhile, and the recommendations (1) seem less than objective. In contrast, if duplicate samples were taken, the RCV would be 89% if CVA was 15%, and RCV would be 83% if CVI was 10%. If CVI is larger than CVA, then taking multiple samples is the strategy to adopt to reduce RCV.

It is also easy to calculate the number of samples required to obtain an estimate within a certain percentage of the true individual homeostatic set point of the individual from the formula based on a simple standard error of the mean estimate (3):

where D is the percentage deviation allowed from the true homeostatic set point. Thus, if CVA was 15%, 70 samples (clearly an untenable number) would be needed to estimate the homeostatic set point of an individual within 10% at P <0.05. Reducing CVA to 10% does not make much difference: 65 samples would be required.

NPs are very like high-sensitivity C-reactive protein when the relative magnitudes of CVI and CVA are considered objectively, and it has been suggested that professional guidelines on the latter are less than objective (5). It is not difficult (6) to calculate the effects of CVA on RCV, on the results of analyzing a sample more than once and/or taking more than 1 sample, and on the number of samples needed to obtain an estimate of an individual’s homeostatic set point within a stated closeness at a predetermined probability.

The above does assume that the variation in NP concentrations can be described as random variation around a homeostatic set point, and this widely used model (3) has been implicitly and explicitly used by Apple et al. (1). However, it may be that this model is not totally appropriate for NPs. It could be argued that any change in BNP concentration in an individual should be considered as potentially and clinically relevant, even when smaller than the RCV calculated from the CVI derived using the homeostatic model, because such a change would reflect an alteration in activation of the neuroendocrine system as a result of specific pathophysiologic mechanisms. In this alternative model, any change in NP concentrations in an individual should be interpreted by taking into account clinical history and examination, including the response to specific treatments, as well as laboratory findings. Perhaps clinical criteria should be used to evaluate the pathophysiologic relevance of a "significant" variation in NP concentrations (which can be mathematically defined as (21/2 x Z x CVA) in an individual patient. If this alternative model is considered appropriate, then the recommendation that it may be desirable to minimize CVA (1) has considerable merit, but not just to CVA of 10% as recommended. The lower the CVA, the higher Z will be for any specific change, and the more significant will be the observed changes in NP. This consideration is not discussed by Apple et al. (1).

I again strongly suggest that those who produce allegedly evidence-based guidelines, recommendations, and scientific statements be urged to do all the calculations outlined here and think on their ramifications on clinical utility before disseminating their work.


References

  1. Apple FS, Panteghini M, Ravkilde J, Mair J, Wu AHB, Tate J, et al. Quality specifications for B-type natriuretic peptide assays. Clin Chem 2005;51:486-493.[Abstract/Free Full Text]
  2. Cotlove E, Harris EK, Williams GZ. Biological and analytical components of variation in long term studies of serum constituents in normal subjects. III. Physiological and medical implications. Clin Chem 1970;16:1028-1032.[Abstract]
  3. Fraser CG. Biological variation: from principles to practice 2001:151pp AACC Press Washington, DC. .
  4. Bruins S, Fokkema MR, Römer JWP, DeJongste MJL, van der Dijs FPL, van den Ouweland JM, et al. High intraindividual variation of B-type natriuretic peptide (BNP) and amino-terminal proBNP in patients with stable chronic heart failure. Clin Chem 2004;50:2052-2058.[Abstract/Free Full Text]
  5. Fraser CG. Test result variation and the quality of evidence-based clinical guidelines. Clin Chim Acta 2004;346:19-24.[CrossRef][ISI][Medline] [Order article via Infotrieve]
  6. Fraser CG. Are scientific statements the scientific truth? www.westgard.com/guest23.htm (accessed March 1, 2005)..



The following articles in journals at HighWire Press have cited this article:


Home page
Clin. Chem.Home page
M. R. Fokkema, Z. Herrmann, F. A.J. Muskiet, and J. Moecks
Reference change values for brain natriuretic peptides revisited.
Clin. Chem., August 1, 2006; 52(8): 1602 - 1603.
[Full Text] [PDF]


This Article
Right arrow Extract Freely available
Right arrow Full Text (PDF)
Right arrow Submit an electronic Letter to
the Editor about this paper
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (4)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Fraser, C. G.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Fraser, C. G.
Related Collections
Right arrow General Clinical Chemistry
Right arrow Evidence Based Laboratory Medicine and Test Utilization
Right arrow Lipids, Lipoproteins, and Cardiovascular Risk Factors


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS