Clinical Chemistry Link to Randox Laboratories Web Site
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
QUICK SEARCH:   [advanced]


     

Clinical Chemistry 48: 994-1003, 2002;
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Submit an electronic Letter to
the Editor about this paper
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (25)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Skeie, S.
Right arrow Articles by Sandberg, S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Skeie, S.
Right arrow Articles by Sandberg, S.
Related Collections
Right arrow Evidence Based Laboratory Medicine and Test Utilization
(Clinical Chemistry. 2002;48:994-1003.)
© 2002 American Association for Clinical Chemistry, Inc.

Instruments for Self-Monitoring of Blood Glucose: Comparisons of Testing Quality Achieved by Patients and a Technician

Svein Skeiea1, Geir Thue1, Kari Nerhus1 and Sverre Sandberg1

1 NOKLUS, Norwegian Center for Quality Improvement of Primary Care Laboratories, Division of General Practice, Department of Public Health and Primary Care, Ulriksdal 8c, University of Bergen, N-5009 Bergen, Norway.

aAddress correspondence to this author at: Department of Medicine, Rogaland Central Hospital, PO Box 8100, 4068 Stavanger, Norway. Fax 47-51-51-99-06; e-mail svskeie{at}online.no.


   Abstract
Top
 Abstract
Introduction
 Materials and Methods
 Results
 Discussion
 References
 
Background: Instruments for self-monitoring of blood glucose (SMBG) are increasingly used by patients with diabetes. The analytical quality of meters in routine use is poorly characterized.

Methods: We compared SMBG performance achieved by patients and by a medical laboratory technician. Imprecision was calculated from duplicate measurements, and deviation as the difference between the first measurement and the mean of duplicate laboratory-method results (calibrated with NIST material). Analytical quality for five groups of SMBG instruments was compared with quality specifications for BG measurements. All participants completed a questionnaire assessing both SMBG training and use of the meters.

Results: We recruited 159 SMBG users from a hospital outpatient clinic and 263 others from 65 randomly selected general practices (total of 422). Most (two thirds) used insulin. CVs for the five meter types were 7%, 11%, 18%, 18%, and 20% in the hands of patients and 2.5–5.9% for the technician. For three of five meter types, patients’ BG measurements had larger deviations from the laboratory results than did the technician’s results. The technician’s performance could not predict the patients’. No instrument when used by patients (but two operated by the technician) met published quality specifications. The analytical quality of patients’ results was not related to whether they had chosen the instruments on advice from healthcare personnel (one-third of patients), were only self-educated in SMBG (50%), or performed SMBG fewer than seven times/week (62%).

Conclusions: The analytical quality of SMBG among patients was poorer than, and could not be predicted from, the performance of the meters in the hands of a technician. We suggest that new instruments be tested in the hands of patients who are trained on meter use in a routine way.


   Introduction
Top
 Abstract
 Introduction
Materials and Methods
 Results
 Discussion
 References
 
Self-monitoring of blood glucose (SMBG)1 with portable instruments became available for persons with diabetes mellitus in the mid-1970s and has been used on a regular basis in developed countries since 1980. Early published reports indicated benefits for the patient with improved metabolic control when blood glucose (BG) was measured at home (1)(2)(3). Studies specifically designed to evaluate the association between SMBG and metabolic control are few (4)(5)(6). On the other hand, large and well-controlled studies have shown the benefit of near-normal BG control for both type 1 and 2 patients (7)(8)(9). Achieving this goal is regarded as difficult or impossible without SMBG, and the two largest randomized clinical diabetes trials both used frequent SMBG as a part of intensive treatment arm interventions (7)(9).

Improving diabetes control using SMBG relies, in part, on the analytical quality and robustness of the instrument in the hands of the user. Studies performed to assess instrument quality have focused on technical and analytical performance, but testing has been performed by trained personnel, by manufacturing company representatives, or by patients who underwent special educational efforts before the evaluation (10)(11)(12)(13)(14)(15)(16)(17)(18)(19)(20)(21)(22). These studies did not address the analytical quality in the hands of patients. Issues such as the influence of manufacturers or health professionals on instrument choice and purchase, the type of education when initiating SMBG, or patients’ analytical quality control and their beliefs about instrument performance were also poorly examined. It is possible that such factors also can influence a patient’s ability to obtain and maintain recommended metabolic control. It is also well known that user error accounts for a large proportion of the total error in BG measurements performed with hand-held instruments (23)(24).

We aimed to describe and evaluate the analytical quality of different instruments in the hands of patients as well as the associations between a personal diabetes profile, patterns of SMBG use, and the analytical quality of self-measured BG. We hypothesized that estimates of analytical quality for different instruments used in SMBG would fall short of current standards (25)(26) and patient-derived quality goals (27). An essential question is whether it is possible to predict the analytical quality of a SMBG instrument in the hands of diabetic patients from results obtained under controlled conditions.


   Materials and Methods
Top
 Abstract
 Introduction
 Materials and Methods
Results
 Discussion
 References
 
During the period from June 1997 to February 1998, patients performing SMBG were enrolled in a cross-sectional study. Patients were recruited consecutively from the outpatient clinic at Haukeland University Hospital (Bergen, Norway) and from 65 randomly selected general practices in the county of Hordaland, Norway. A total of 572 patients being seen by general practitioners and 213 from the hospital outpatient clinic were asked to participate. Of the patients recruited from general practices, 227 did not perform SMBG, 48 were unwilling to participate in the study, and 34 never showed up, giving a total of 263 included patients. If the patients recruited from the hospital clinic, 20 did not perform SMBG, 15 were unwilling to participate in the study, and 19 never showed up, giving a total of 159 included patients. All individuals signed a written informed consent describing the study background and aims and answered questions about age, sex, diabetes type and duration, and treatment. They also stated whether they performed SMBG. Consenting persons who performed SMBG were included in the study and were asked to come back for a specifically scheduled study visit. The visits took place at the hospital diabetes outpatient clinic or in a general practice surgery and were all attended by the same medical laboratory technician.

During the study visit, diabetic patients first performed two unassisted self-measurements using their own instruments and strips with blood from one lancet prick on their finger. Shortly afterward, the laboratory technician pricked the patient once in a different finger. With this blood sample, glucose measurements were performed twice on two different instruments and twice using the laboratory method (see INSTRUMENTS). For practical reasons, the numbers of measurements varied somewhat from instrument to instrument. Venous blood for hemoglobin A1c (HbA1c) and hematocrits was obtained after the patients had performed their BG measurements. HbA1c was analyzed on a Diamat HPLC (Bio-Rad Laboratories) calibrated to give values similar to the Diabetes Control and Complications Trial method (28). Total analysis time on the portable instruments was <5 min.

The analytical deviation (total error) for BG measurements was calculated for each patient, using the percentage of absolute deviation between the first BG measurement and the mean laboratory method result. The analytical precision of BG measurements was calculated from the difference between patients’ duplicate glucose measurements.

All participants completed a questionnaire at the end of the visit (after the blood tests had been performed). The technician was available to clarify questions. In the questionnaire, participants were asked about their first year of BG measurements, their first year using a SMBG device, and the type of BG instrument. In addition, they reported details on the use of BG instruments, frequency, perceived instrument quality, and use of controls. The questionnaire was reviewed by senior academic faculty and by general practitioners. No revision of the questionnaire was necessary after a pilot phase of the study. The study plan was reviewed and approved by the Norwegian Regional Committee for Medical Research Ethics.

instruments
The subgroups of instruments from the same manufacturer (e.g., MediSense QID vs other MediSense models) had largely the same technology and used similar strips. BG results were similar among models from the same manufacturer, and the results were pooled accordingly. The comparability of results was assessed by comparing imprecision and number of results outside the quality specification limits within each subgroup. The following instruments were used by the patients: (a) in the MediSense group (Abbott Laboratories), the MediSense Companion 2, MediSense Card, MediSense Pen, and Precision QID; (b) in the Accutrend group (Roche Diagnostics), the Accutrend, Accutrend Mini, and Accutrend Alpha; (c) in the One Touch group (Lifescan), the One Touch II and One Touch Basic; (d) different models in the Glucometer Elite group (Bayer Diagnostics); and (e) the Gluco Touch (Lifescan). In addition, six or fewer patients used the Accutrend sensor, the Exactech, various older Glucometer models, Reflolux types, or manual visual strips. The analytical results for the patients using these instruments were not analyzed further. The technician used the following instruments and strips: Precision QID, Accutrend alpha, One Touch Basic, Glucometer Elite, and Gluco Touch. Only one batch of strips was used for each of the instruments in the technician testing. All instruments measure plasma glucose, and all but the Gluco Touch recalculate the results to BG. The Gluco Touch results reported here were recalculated from plasma values to whole blood values (15% lower) to be comparable to the conventional true values (29). Measured hematocrits were all within the manufacturers’ acceptable limits for individual instruments.

The conventional true value was established using the whole-blood glucose 6-phosphate dehydrogenase method on a Cobas Fara centrifugal analyzer (Roche Diagnostics). The method was calibrated with NIST standards and is called the laboratory method in this report. For two quality-control samples monitored throughout the study (4.2 and 13.5 mmol/L in lyophilized human serum; Roche), the imprecision (CVa) of the method was 1.8% and 1.7%, respectively (n = 54). External quality-control material (fresh serum) from the Norwegian center for quality improvement of primary healthcare laboratories (NOKLUS) was examined twice. This material was targeted with the isotope-dilution-gas chromatography-mass spectrometry laboratory method for glucose (30). Results were within ±2% of the target value.

recommendations for analytical quality
The American Diabetes Association (ADA) has stated that all SMBG systems should have a total error (bias and imprecision in the hands of the user) of <10% (25). In a study estimating patient-derived quality specifications for instruments used in SMBG, it was concluded that most diabetic patients interpret analytical results as if the instruments had an analytical imprecision (CV) of <5% and an analytical bias of <5%, i.e., a total error of ~13% (27). The draft of the International Organization for Standardization (ISO) standard for quality specifications for instruments used for self-monitoring of glucose has suggested that 95% of the measurements should be within ±20% for glucose concentrations >4.2 mmol/L and within ±0.83 mmol/L for concentrations <=4.2 mmol/L (26). In a recent study where quality specifications for glucose meters were addressed by a simulation modeling errors in insulin dose, it was concluded that a total error of <5–6% rarely leads to major errors in insulin dosage (31). We compared our findings with these recommendations and standards.

statistical analysis
The imprecision of the instruments when handled by the patients or the technician as well as the imprecision of the laboratory method was calculated from the differences (as a percentage) of the duplicate samples for each of the instruments, using the formula:

where d is the difference between measurements, and n is the number of duplicate samples.

The imprecision was calculated from the percentage differences because the CVs were more constant than the SDs throughout the measurement range. Differences larger than k x SDdiff (k is sample size dependent) were considered as outliers and excluded from calculation of the CVs (32). Differences between continuous variables were analyzed using a two-tailed t-test or a nonparametric test; proportions were compared using the {chi}2 test.

A multiple logistic regression model was established to evaluate the association between both patient and SMBG characteristics, with the percentage of deviation between the BG results obtained with the SMBG instruments and those obtained with the laboratory method (deviation <10% = 0; deviation >=10% = 1) as the dependent variable. The percentage of deviation chosen indicated the cutoff for "optimum" analytical quality as recommended by the ADA (25). In developing the model, we evaluated the following independent variables: SMBG duration, SMBG educational mode, SMBG frequency, SMBG importance, questioning of SMBG results, instrument controls, type of instrument, diabetes type, diabetes duration, practice location, HbA1c concentration, age, and sex. Multiple logistic regression analysis was also performed to evaluate the association between the same characteristics, with the HbA1c concentration as the dependent variable (HbA1c <7.5% = 0; HbA1c >=9% = 1). A level of significance of 5% was chosen.


   Results
Top
 Abstract
 Introduction
 Materials and Methods
 Results
Discussion
 References
 
study population
The study involved one recruitment visit and one inclusion visit. Age and diabetes duration were not significantly different among the 20 hospital patients not performing SMBG and the patients studied. Of the 227 nonperformers in general practice, 96% had type 2 diabetes; their mean age was higher (70 vs 54 years) and diabetes duration shorter (7 vs 12 years) than for the patients from general practice (P <0.001) who participated in the study.

A total of 53 (12.5% of consenting patients) patients dropped out between recruitment and the scheduled inclusion visit. Dropouts were younger [mean (SD) age, 46 ± 18 vs 54 ± 18 years; P <0.01] and included more patients with type 1 diabetes (51% vs 42%; P <0.05) than did the included group.

Patient characteristics and data on the different instruments used are shown in Table 1 . Most patients used the MediSense type of instruments; One Touch was the least used instrument. Of the patients who attended the hospital clinic, 17% had type 2 diabetes compared with 80% of the patients monitored in general practice, and 67.5% of all patients in the study were treated with insulin injections (alone or in combination with tablets). Among type 2 patients, the proportion receiving insulin-containing treatments was higher in the group attending the hospital clinic than in those in general practice (74% vs 39%; P = 0.002). The HbA1c results were higher in type 2 patients attending the hospital outpatient clinic compared with those treated by general practitioners (8.9% vs 7.9%; P = 0.001). Otherwise, no statistically significant differences were found in mean HbA1c or other variables for the two types of diabetes, and the main results are not divided by diabetes type, but by hospital clinic vs general practice.


View this table:
[in this window]
[in a new window]
  		Table 1. Characteristics of patients included and instruments used.

analytical quality
The relationship between the measurements (first sample) by the diabetic patients for each instrument and the conventional true value (mean of the two samples) is shown in Fig. 1A . In the same manner, the relationship between the result obtained by the technician for each instrument and the conventional true value is shown in Fig. 1B . More than 90% of the BG results were in the range 3.8–17.2 mmol/L. The regression lines and 95% prediction intervals for the differences (regression line ± 1.96CVtotal; see Table 2 ) are plotted in Fig. 1 , which also shows the regression equation, including the SE, based on the formula: y = [a(SEa) x x] + b(SEb).



View larger version (19K):
[in this window]
[in a new window]
  		Figure 1. Difference plots for instruments (first sample) and the laboratory method (mean of two samples) plotted against the laboratory method for patients (A) and the technician (B).

The regression line y = ax + b is plotted with the estimated theoretical total imprecision (± 1.96CVtotal) for the technician and patients for the different instruments (see Table 2Up ). Slopes and intercepts are given for each regression line according to the formula: y = [a(SEa) x x] + b(SEb).


View this table:
[in this window]
[in a new window]
  		Table 2. Imprecision as calculated from duplicate samples from diabetic patients or from the technician.

The percentages of results obtained by diabetic patients and the technician that deviated from the conventional true value by more than the ADA criterion of 10% (25) or by more than the differences allowed in the proposed ISO standard (26) are shown in Table 3 . Clearly, none of the instruments could satisfy the ADA recommendation. For different instruments, 19–58% of patients’ measurements deviated more than the 10% allowed in the ADA recommendation, whereas 15–97% of the technician’s results were outside this limit. All the studied instruments failed to reach the ISO standard quality goal that 95% of measurements by diabetic patients be within ±20% of the laboratory method (or within ±0.83 mmol/L for BG <=4.2 mmol/L). The values obtained by the technician were better overall, with the Glucometer Elite and Gluco Touch instruments fulfilling the criteria of the ISO standard. The results obtained by the technician with the One Touch instrument were systematically lower than the laboratory values (Fig. 1BUp ). This was probably attributable to the specific batch of strips that was provided by the manufacturer. For the MediSense and One Touch instruments, the BG results showed a decrease with increasing hematocrit compared with the laboratory method (results not shown). Thus, in these cases hematocrits influenced the results, although the hematocrits were within the acceptable limits stated by the manufacturer.


View this table:
[in this window]
[in a new window]
  		Table 3. Percentage of measurements by patients or the technician that deviated from the laboratory method by >10% or by more than the difference allowed by the ISO standard.

The imprecision with and without outliers, as calculated from the differences of the duplicate samples for each of the instruments or the laboratory method, is shown in Table 2Up . In the hands of the diabetic patients, the Glucometer Elite and Gluco Touch instruments had an imprecision <5%, although in these cases 10% of the results were excluded because they were outliers. The imprecision was <5% for all the instruments used by the technician except for MediSense. For the Glucometer Elite, Accutrend, and Gluco Touch instruments, the CVs for the technician’s measurements were markedly lower than the CVs for diabetic patients’ measurements. Only the Glucometer Elite and Gluco Touch could meet the patient-derived quality specifications of 5% (27).

smbg by diabetic patients
Approximately 50% of the patients started SMBG based on a purchase recommendation from healthcare personnel, ~30% decided on their own, and the rest had been influenced by advertising (including recommendations from salespeople) or other reasons. Hospital patients based their choice to start SMBG more on recommendations from healthcare personnel and less on advertisements or recommendations from salespeople than did patients in general practice (55% and 4% vs 45% and 11%, respectively; P <0.001). When asked about the reasons for their current instrument choice, approximately one third had chosen their current instrument based on recommendations from healthcare personnel or pharmacies, approximately one third had based their choice on advertising, and approximately one third had based their choice on personal initiative and various other reasons. Thus, for the majority of patients, the choice of a specific instrument was not related to whether it was based on advice from healthcare personnel (data not shown).

The results obtained on the questionnaire concerning SMBG characteristics and patterns are shown stratified for practice site in Table 4 . A total of 51% of the patients claimed to be self-educated in performing SMBG, and doctors educated only 2%. Of the responders, 74% never or rarely questioned the correctness of their instruments. Instrument controls were performed by 37% of the patients, but only a minority of them performed an internal quality control using commercial control materials. Comments revealed that controls were mainly performed by measuring twice or by comparing results from self-monitoring with results obtained at a doctors’ office or on different instruments. Independent of diabetes type, patients performing SMBG more frequently rated the importance of SMBG significantly higher (P <0.001) than did individuals performing SMBG less frequently. Individuals performing SMBG frequently had performed SMBG for a longer time period (P <0.05).


View this table:
[in this window]
[in a new window]
  		Table 4. SMBG characteristics and patterns of patients reported in the questionnaire.

analytical deviation and metabolic control
In the multiple logistic regression model we investigated whether background characteristics, SMBG characteristics, or type of instrument used could influence the probability of a having a BG measurement that deviated <10% or >=10% from the laboratory method. Adjusting for other variables, patients from the hospital setting had an odds ratio of 1.9 (1.2–3.1) for a deviation >=10% compared with patients who were monitored by a general practitioner, i.e., the analytical quality of measurements performed by the hospital patients was poorer. Treatment category and SMBG frequency did not seem to be associated with deviation. Other background or SMBG factors did not show any association.

In a second multiple logistic regression model, only diabetes duration showed a significant influence on the probability of having HbA1c >=9% compared with HbA1c <7.5% (results not shown).


   Discussion
Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
References
 
Describing and assessing SMBG performance among diabetes patients can be done through observation or by asking the SMBG users. Our design included planned visits, which possibly could influence patients to prepare for the study. However, the questionnaire was designed and formulated to avoid the impression that a particular answer was correct. If anything, user-related errors involved in performing SMBG are likely to be underestimated in this research setting. No significant differences in analytical quality could be demonstrated between type 1 and 2 patients. This was an unexpected finding because SMBG generally is more important to and strongly recommended to type 1 patients.

When we compared instrument analytical quality with the ADA recommendation, all instruments failed to reach this criterion. We therefore focused mainly on the quality specifications of the ISO draft standard. This ISO standard (26) proposes quality specifications for instruments and strips examined under controlled conditions. It seems reasonable that similar quality specifications should also be relevant when diabetic patients use the instruments and strips, and we have applied the specifications to both situations. Overall, a total of 86% of the BG measurements performed by patients showed deviation within the limits recommended by the ISO standard (Table 3Up ). This is lower than the ISO standard recommendation of 95% of measurements performed being within ±20% deviation (26). None of the studied instruments reached this goal in the hands of the patients. When BG was measured by the technician, both the Glucometer Elite and Gluco Touch fulfilled the criteria of the ISO standard (Table 3Up ). Many of the instruments seem to overestimate glucose at low concentrations (Fig. 1Up ). This might be a problem when patients become hypoglycemic.

The precision of the BG results obtained using the Glucometer Elite, Accutrend, and Gluco Touch was significantly better for the technician than for the patients (Table 2Up ). On the basis of patient-derived quality specifications, it has been suggested that imprecision should be <5% (27), and a simulation study showed that imprecision below this value rarely leads to major errors in insulin dosing (31). When the precision of an instrument is better in the hands of the technician than for the diabetic patients, quality improvement might be achieved through patient education (23)(24)(25)(33)(34). For the Glucometer Elite and Gluco Touch, this is underlined by the large number of outliers, which probably reflect user errors. As expected and shown in Table 2Up , the inclusion of outliers increased some of the CVs substantially. In addition, the results would probably have been poorer if instrument testing was moved even further into patients’ daily life, i.e., performed in locations other than the hospital clinic or general practitioners’ office.

It has been argued that in method comparisons, the between-method difference should be plotted against the average value of the two methods, thus avoiding a negative correlation between the differences and the laboratory method (35). However, in method comparison studies in clinical chemistry, the imprecision in the laboratory method is often very low compared with the new method. Therefore, it can be an advantage to plot the between-method difference against the laboratory method because this will reduce the uncertainty along the x axis (36). This has been done in the present study, but our conclusions would not have been different if we had used the between-method difference along the x axis, although the negative correlation would have been slightly less.

If all the differences between the instruments and the laboratory method could have been explained by the total imprecision of the methods, i.e., been within the prediction interval, only 5% of the results (plus the outliers) would have been located outside the limits shown in Fig. 1Up . Matrix and hematocrit effects can probably explain the situation when approximately the same number of results are located outside the limits independent of whether the diabetic patients or the technician analyzed the samples. This is the situation for the MediSense, One Touch, and Gluco Touch groups of instruments. This finding was confirmed in a recent study with the MediSense QID (22). To reduce the hematocrit effects and to be able to compare results from instruments for self-measurements with results from larger laboratories, all measurements should be made in plasma and reported as such. When the number of results outside the limits is larger for results from patients, batch-to-batch variation, user errors, or instrument-to-instrument variation might be the explanation. This may be the situation for the Glucometer Elite.

It is obvious that testing of BG under controlled conditions does not necessarily reflect the quality of the measurements obtained in the hands of ordinary patients. An important question is, however, whether results obtained under controlled conditions can predict results obtained from diabetic patients using the same instruments. The percentages of results deviating more than the limits given in the ISO standard for each instrument for both the technician and patients are shown in Fig. 2 . As can be seen, there was no relationship between results obtained by patients and the technician and no differences between instruments when tested by the patients. Similarly, the correlation between imprecision (CV) for measurements obtained by patients and the technician is shown in Fig. 3 . Again a poor relationship was found. Thus, it is not possible to predict patients’ analytical quality performance from results obtained by the technician in this study.



View larger version (24K):
[in this window]
[in a new window]
  		Figure 2. Relationship between the percentage of results [with 95% confidence intervals (error bars)] outside the limits of the ISO standard obtained by the technician and the diabetic patients (see Table 3Up ).

Shaded areas denote the quality goal that only 5% of the results can be outside the ISO standard recommendations (26).



View larger version (44K):
[in this window]
[in a new window]
  		Figure 3. Relationship between the imprecision [with 95% confidence intervals (error bars)] obtained by the technician and the diabetic patients (see Table 2Up ).

Shaded areas denote the 5% imprecision quality goal.

Only one instrument and one lot of strips were used by the technician, in contrast to many lots of strips and instruments by the diabetic patients. This could explain some of the systematic differences found by the technician (e.g., One Touch). If the technician had used more batches and/or instruments, the deviation of results from the laboratory method, as shown in Fig. 1BUp , could have been larger. It is not obvious, however, whether more or fewer results would have been within the limits for the quality specifications. The (within-batch) precision (Table 2Up ) probably would have been unchanged. It is still probable that user errors and lack of instrument robustness, both of which are dependent on the specific instrument used, accounted for most of the differences between technician and patient results. Further studies are necessary to address this issue in more detail. On the basis of the present study, we suggest that, before being marketed, such instruments should also be tested among diabetic patients and that quality specification should be set for performance. These "pragmatic" quality specifications probably have to change over time as both instrument robustness and patient education improve. However, only when testing under controlled conditions is satisfactory should instruments be tested among diabetic patients. We currently are designing a protocol for user evaluation that includes 100 diabetic patients and three lots of strips.

Recommendations from the ADA and others encourage SMBG for all patients treated with insulin or sulfonylurea drugs to monitor BG to prevent hypoglycemia (25)(37)(38). In addition, SMBG is recommended for all patients taking insulin to achieve near-normal glucose values, although adherence to this is known to be variable (39)(40). For type 1 patients, the ADA recommends SMBG three or more times daily (38), whereas patients in our study measured BG only 1.6 times daily (mean value) (27). It is unknown what optimal SMBG frequency is and whether increased frequency leads to better metabolic control (38)(41)(42).

Among the patients asked to participate, we found that as many as 91% of patients at the hospital clinic and 60% in general practice performed SMBG. This illustrates the need for tailored SMBG information and education, not only in specialized centers but also in general practice. The finding that 51% of patients claim to be self-educated together with the fact that one-third of the patients’ chose their current instrument on the basis of commercial influence can also illustrate a potential for improved patient education. Many patients have poor instrument quality-control routines. The necessity and value of establishing such routines should be examined.

After adjusting for other variables, multiple logistic regression analysis for BG deviations >=10% (compared with <10%) showed significance only for practice site, subgroups of treatment category, and SMBG frequency. For SMBG frequency, the multivariate results were not convincing for all subgroups. Overall, the analysis did not give us definite clues on characteristics or factors favoring a better analytical quality outcome. In addition, other factors not examined might be more important than those evaluated in this study.

Studies designed to show a specific benefit of SMBG on metabolic control have not been convincing (43)(44)(45)(46)(47)(48). SMBG does not automatically lead to changes in treatment or behavior, and many patients are reluctant to adjust therapy on their own and seem to use SMBG mainly to monitor for hypoglycemia (49)(50). We found that diabetes duration, but not SMBG factors, overall significantly influences the chance of having HbA1c >=9% compared with <7.5%.

In conclusion, when a technician can perform BG measurements with lower deviation and better precision, the potential to improve performance among the patients is demonstrated. All meters tested failed to reach the ADA recommendations, the ISO standard for BG measurements, and patient-derived quality specifications (25)(26)(27) when tested in the hands of the patients. In this study, instrument analytical quality performance in the hands of randomly selected patients could not be predicted from the results obtained by a trained technician. To give patients better instrument recommendations, we suggest testing of new instruments in the hands of a population of patients who are educated and instructed (for the instrument in question) according to the usual procedure in the region where they live. We are currently developing a protocol where 50% of the patients are trained and the other 50% only get the instruction manual. The majority of patients seem to be influenced by commercial interests and other nonhealthcare personnel when choosing an instrument and initiating SMBG. Many patients do not receive structured education in SMBG. Educational efforts can possibly improve patient SMBG performance (10)(24)(34). We believe that healthcare professionals should be more strongly involved in SMBG initiation, education, and follow-up.


   Acknowledgments
 
The BG instruments and strips used and tested by the technician in the study were kindly supplied by the different manufacturers. We thank Per Hyltoft Petersen for valuable comments on the manuscript.


   Footnotes
 
1 Nonstandard abbreviations: SMBG, self-monitoring of blood glucose; BG, blood glucose; HbA1c, hemoglobin A1c; ADA, American Diabetes Association; and ISO, International Organization for Standardization.


   References
Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 References
 

  1. Walford S, Gale EAM, Allison SP, Tattersall RB. Self-monitoring of blood-glucose. Improvement of diabetic control. Lancet 1978;1:732-735.[ISI][Medline] [Order article via Infotrieve]
  2. Sönksen PH, Judd SL, Lowy C. Home monitoring of blood-glucose. Lancet 1978;1:729-732.[Medline] [Order article via Infotrieve]
  3. Cohen M, Zimmet P. Self-monitoring of blood glucose levels in non-insulin-dependent diabetes mellitus. Med J Aust 1983;2:377-380.[ISI][Medline] [Order article via Infotrieve]
  4. Gallichan MJ. Self monitoring of glucose by people with diabetes: evidence base practice. BMJ 1997;314:964-967.[Free Full Text]
  5. Oki JC, Flora DL, Isley WL. Frequency and impact of SMBG on glycemic control in patients with NIDDM in an urban teaching hospital clinic. Diabetes Educ 1997;23:419-424.
  6. Coster S, Gulliford MC, Seed PT, Powrie JK, Swaminathan R. Self-monitoring in type 2 diabetes mellitus: a meta-analysis. Diabet Med 2000;17:755-761.[ISI][Medline] [Order article via Infotrieve]
  7. . DCCT Research Group. The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med 1993;329:977-986.[Abstract/Free Full Text]
  8. . UKPDS Group. Effect of intensive blood-glucose control with metformin on complications in overweight patients with type 2 diabetes. Lancet 1998;352:854-865.[ISI][Medline] [Order article via Infotrieve]
  9. . UKPDS Group. Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes. Lancet 1998;352:837-853.[ISI][Medline] [Order article via Infotrieve]
  10. Heinemann L, Overmann H, Mühlhauser I. How well do patients with type 1 diabetes measure their blood glucose in daily life? [Letter]. Diabetes Care 1998;21:461-462.
  11. Johnson RN, Baker JR. Accuracy of devices used for self-monitoring of blood glucose. Ann Clin Biochem 1998;35:68-74.
  12. Kilpatrick ES, McLeod MJ, Rumley AG, Small M. A ward comparison between the One Touch II and Glucometer II blood glucose meters. Diabet Med 1994;11:214-217.[ISI][Medline] [Order article via Infotrieve]
  13. Chan J, Wong R, Cheung C-K, Lam P, Chow C-C, Yeung V, et al. Accuracy, precision and user-acceptability of self blood glucose monitoring machines. Diabetes Res Clin Pract 1997;36:91-104.[ISI][Medline] [Order article via Infotrieve]
  14. Plessis MD, Ubbink JB, Veermaak WJH. Analytical quality of near-patient blood cholesterol and glucose determinations. Clin Chem 2000;46:1085-1090.[Abstract/Free Full Text]
  15. North DS, Steiner JF, Woodhouse KM, Maddy JA. Home monitors of blood glucose: comparison of precision and accuracy. Diabetes Care 1987;10:360-366.[Abstract]
  16. Brunner GA, Ellmerer M, Sendlhofer G, Wutte A, Trajanoski Z, Schaupp L, et al. Validation of home blood glucose meters with respect to clinical and analytical approaches. Diabetes Care 1998;21:585-590.[Abstract]
  17. Johnson RN, Baker JR. Analytical error of home glucose monitors: a comparison of 18 systems. Ann Clin Biochem 1999;36:72-79.
  18. Moberg E, Lundblad S, Lins P-E, Adamson U. How accurate are home blood-glucose meters with special respect to the low glycemic range?. Diabetes Res Clin Pract 1993;19:239-243.[ISI][Medline] [Order article via Infotrieve]
  19. Trajanoski Z, Brunner GA, Gfrerer RJ, Wach P, Pieber TR. Accuracy of home blood glucose meters during hypoglycemia. Diabetes Care 1996;19:1412-1415.[Abstract]
  20. Weitgasser R, Gappmayer B, Pichler M. Newer portable glucose meters—analytical improvement compared with previous generation devices?. Clin Chem 1999;45:1821-1825.[Abstract/Free Full Text]
  21. Chance JJ, Li DJ, Jones KA, Dyer KL, Nichols JH. Technical evaluation of five glucose meters with data management capabilities. Am J Clin Pathol 1999;111:547-556.[ISI][Medline] [Order article via Infotrieve]
  22. Lehmann R, Kayrooz S, Greuter H, Spinas GA. Clinical and technical evaluation of a new self-monitoring blood glucose meter: assessment of analytical and user error. Diabetes Res Clin Pract 2001;53:121-128.[ISI][Medline] [Order article via Infotrieve]
  23. Nettles A. User error in blood glucose monitoring. Diabetes Care 1993;16:946-948.[ISI][Medline] [Order article via Infotrieve]
  24. Eye KL, Janney L. Identification of need for education in self-monitoring of blood glucose [Letter]. Am J Health Syst Pharm 1996;33:1456-1457.
  25. . American Diabetes Association. Self-monitoring of blood glucose. Diabetes Care 1996;19:S62-S66.
  26. . International Organization for Standardization. Requirements for in vitro blood glucose monitoring systems for self-testing in managing diabetes mellitus. ISO/TC 212/WG 3. Draft International Standard ISO/DIS 15197 2001 ISO Geneva, Switzerland. .
  27. Skeie S, Thue G, Sandberg S. Patient-derived quality specifications for instruments used in self-monitoring of blood glucose. Clin Chem 2001;47:67-73.[Abstract/Free Full Text]
  28. Little RR, Wiedmeyer HM, England JD, Wilke AL, Rohlfing CL, Wians FH, et al. Interlaboratory standardization of measurements of glycohemoglobins. Clin Chem 1992;38:2472-2478.[Abstract/Free Full Text]
  29. Burrin JM, Alberti KG. What is blood glucose: can it be measured?. Diabet Med 1990;7:199-206.[ISI][Medline] [Order article via Infotrieve]
  30. Thienpont LM, Van Nieuwenhove B, Stockl D, Reinauer H, De Leenheer AP. Determination of reference method values by isotope dilution-gas chromatography/mass spectrometry: a five years’ experience of two European Reference Laboratories. Eur J Clin Chem Clin Biochem 1996;34:853-860.[ISI][Medline] [Order article via Infotrieve]
  31. Boyd JC, Bruns DE. Quality specifications for glucose meters: assessment by simulation modeling of errors in insulin dose. Clin Chem 2001;47:209-214.[Abstract/Free Full Text]
  32. Burnett RW. Accurate estimation of standard deviations for quantitative methods used in clinical chemistry. Clin Chem 1975;21:1935-1938.[Abstract]
  33. . The National Steering Committee for Quality Assurance in Capillary Blood Glucose Monitoring. Proposed strategies for reducing user error in capillary blood glucose monitoring. Diabetes Care 1993;16:493-498.[Abstract]
  34. Kabadi UM, O’Connell KM, Johnson J, Kabadi M. The effect of recurrent practice at home on the acceptability of capillary blood glucose readings. Diabetes Care 1994;10:95-99.[ISI][Medline] [Order article via Infotrieve]
  35. Bland JM, Altman DG. Comparing methods of measurement: why plotting difference against standard method is misleading. Lancet 1995;346:1085-1087.[ISI][Medline] [Order article via Infotrieve]
  36. Dahler-Eriksen BS, Lassen JF, Petersen PH, Lund ED, Lauritzen T, Brandslund I. Evaluation of a near-patient test for C-reactive protein used in daily routine in primary healthcare by use of difference plots. Clin Chem 1997;43:2064-2075.[Abstract/Free Full Text]
  37. Claudi T, Cooper JG, Midthjell K, Furuseth K, Hanssen K, Hestvold P-I, et al. NSAM’s action program for diabetes in general practice 1995 Norsk Selskap for Allmennmedisin, Norges Diabetesforbund, Statens Helsetilsyn, Statens Institutt for Folkehelse, Den Norske Lægeforening Oslo. .
  38. . American Diabetes Association. Tests of glycemia in diabetes [Position Statement]. Diabetes Care 2001;24:S80-S82.
  39. Fox C, Wade G, Fox A. What makes people with diabetes measure their own blood glucose?. Pract Diabetes 1994;11:244-246.
  40. Harris MI. Self-monitoring of blood glucose by adults with diabetes in the United States population. Diabetes Care 1993;16:1116-1123.[Abstract]
  41. Wysocki T. Impact of blood glucose monitoring on diabetic control: obstacles and interventions. J Behav Med 1989;12:183-205.[ISI][Medline] [Order article via Infotrieve]
  42. Willey KA, Twigg SM, Constantino MI, Yue DK, Turtle JR. Home glucose monitoring: how often?. Pract Diabetes 1993;10:22-25.
  43. Fontbonne A, Billaut B, Acosta M, Percheron C, Varenne P, Besse A, et al. Is glucose self-monitoring beneficial in non-insulin-treated diabetic patients? Results of a randomized comparative trial. Diabetes Metab 1989;15:255-260.
  44. Ziegler O, Kolopp M, Louis J, Musse JP, Patris A, Debry G, et al. Self-monitoring of blood glucose and insulin dose alteration in type 1 diabetes mellitus. Diabetes Res Clin Pract 1993;21:51-59.[ISI][Medline] [Order article via Infotrieve]
  45. Halimi S. Benefit of self-monitoring blood glucose in the management of insulin- and non-insulin-dependent diabetic patients. Analysis of the literature shows mixed results. Diabetes Metab 1998;24:35-41.
  46. Ikeda Y, Tsuruoka A. Self-monitoring of blood glucose, as a means of self-management. Diabetes Res Clin Pract 1994;24:S269-S271.
  47. Faas A, Schellevis FG, van Eijk JTM. The efficacy of self-monitoring of blood glucose in NIDDM subjects. Diabetes Care 1997;20:1482-1486.[Abstract]
  48. Klein CE, Oboler SK, Prochazka A, Oboler S, Frank M, Glugla M, et al. Home blood glucose monitoring: effectiveness in a general population of patients who have non-insulin-dependent diabetes mellitus. J Gen Intern Med 1993;8:597-601.[ISI][Medline] [Order article via Infotrieve]
  49. Leese GP, Jung RT, Newton RW. Home glucose monitoring in patients aged over 40 years with diabetes mellitus. Pract Diabetes 1994;11:32-34.
  50. Potter RD. Self-monitoring of blood glucose—who does, and why? [Letter]. Pract Diabetes Int 1996;13:63.



The following articles in journals at HighWire Press have cited this article:


Home page
 Clin. DiabetesHome page
R. J. Schrot, K. T. Patel, and P. Foulis
Evaluation of Inaccuracies in the Measurement of Glycemia in the Laboratory, by Glucose Meters, and Through Measurement of Hemoglobin A1c
Clin. Diabetes, April 1, 2007; 25(2): 43 - 49.
[Abstract] [Full Text] [PDF]

Home page
 Clin. Chem.Home page
G. B.B. Kristensen, K. Nerhus, G. Thue, and S. Sandberg
Results and Feasibility of an External Quality Assessment Scheme for Self-Monitoring of Blood Glucose
Clin. Chem., July 1, 2006; 52(7): 1311 - 1317.
[Abstract] [Full Text] [PDF]

Home page
 Clin. Chem.Home page
G. B.B. Kristensen, N. G. Christensen, G. Thue, and S. Sandberg
Between-Lot Variation in External Quality Assessment of Glucose: Clinical Importance and Effect on Participant Performance Evaluation
Clin. Chem., September 1, 2005; 51(9): 1632 - 1636.
[Abstract] [Full Text] [PDF]

Home page
 Clin. Chem.Home page
S. Skeie, C. Perich, C. Ricos, A. Araczki, A. R. Horvath, W. P. Oosterhuis, T. Bubner, G. Nordin, R. Delport, G. Thue, et al.
Postanalytical External Quality Assessment of Blood Glucose and Hemoglobin A1c: An International Survey
Clin. Chem., July 1, 2005; 51(7): 1145 - 1153.
[Abstract] [Full Text] [PDF]

Home page
 Clin. Chem.Home page
H. W. Vesper, E. Archibold, K. H. Porter, and G. L. Myers
Assessment of a Reference Procedure to Collect and Analyze Glucose in Capillary Whole Blood
Clin. Chem., May 1, 2005; 51(5): 901 - 903.
[Full Text] [PDF]

Home page
 Clin. Chem.Home page
W. E. Winter
A Rosetta Stone for Insulin Treatment: Self-Monitoring of Blood Glucose
Clin. Chem., June 1, 2004; 50(6): 985 - 987.
[Full Text] [PDF]

Home page
 Clin. Chem.Home page
G. B.B. Kristensen, K. Nerhus, G. Thue, and S. Sandberg
Standardized Evaluation of Instruments for Self-Monitoring of Blood Glucose by Patients and a Technologist
Clin. Chem., June 1, 2004; 50(6): 1068 - 1071.
[Full Text] [PDF]

Home page
 Diabetes CareHome page
D. C. Klonoff
The Need for Separate Performance Goals for Glucose Sensors in the Hypoglycemic, Normoglycemic, and Hyperglycemic Ranges
Diabetes Care, March 1, 2004; 27(3): 834 - 836.
[Full Text] [PDF]

Home page
 Journal of Pharmacy PracticeHome page
A. L. Briggs and S. Cornell
Self-monitoring Blood Glucose (SMBG): Now and the Future
Journal of Pharmacy Practice, February 1, 2004; 17(1): 29 - 38.
[Abstract] [PDF]

Home page
 Clin. Chem.Home page
J. S. Krouwer
Proposal to Add an Optional Recommendations Section to Clinical Chemistry Abstracts
Clin. Chem., December 1, 2002; 48(12): 2292 - 2292.
[Full Text] [PDF]

Home page
 Clin. Chem.Home page
M. Nattrass
Improving Results from Home Blood-Glucose Monitoring: Accuracy and Reliability Require Greater Patient Education as Well as Improved Technology
Clin. Chem., July 1, 2002; 48(7): 979 - 980.
[Full Text] [PDF]

This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Submit an electronic Letter to
the Editor about this paper
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (25)
Right arrow Citing Articles via Google Scholar
Google Scholar