Clinical Chemistry AACC Online Job Center
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


Clinical Chemistry 52: 1284-1293, 2006. First published May 11, 2006; 10.1373/clinchem.2006.067595
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
clinchem.2006.067595v1
52/7/1284    most recent
Right arrow Submit an electronic Letter to
the Editor about this paper
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via ISI Web of Science (7)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Kofoed, K.
Right arrow Articles by Eugen-Olsen, J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Kofoed, K.
Right arrow Articles by Eugen-Olsen, J.
Related Collections
Right arrow Molecular Diagnostics and Genetics
Right arrow Proteomics and Protein Markers
Right arrow Automation and Analytical Techniques
(Clinical Chemistry. 2006;52:1284-1293.)
© 2006 American Association for Clinical Chemistry, Inc.


Molecular Diagnostics and Genetics

Development and Validation of a Multiplex Add-On Assay for Sepsis Biomarkers Using xMAP Technology

Kristian Kofoed1,2,a, Uffe Vest Schneider1, Troels Scheel1, Ove Andersen1,2 and Jesper Eugen-Olsen1

1 Clinical Research Unit and2 Department of Infectious Diseases, Copenhagen University Hospital Hvidovre, Hvidovre, Denmark.

aAddress correspondence to this author at: Clinical Research Unit 136, H:S Hvidovre Hospital, Kettegaard Allé 30, DK-2650 Hvidovre, Denmark. Fax 45-3632-3797; e-mail kristian.kofoed{at}hh.hosp.dk.


   Abstract
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
Background: Sepsis is a common and often fatal disease. Because sepsis can be caused by many different organisms, biomarkers that can aid in diagnosing sepsis and monitoring treatment efficacy are highly warranted. New sepsis markers may provide additional information to complement the currently used markers.

Methods: We used a combination of in-house and commercially available multiplex immunoassays based on Luminex® xMAP technology to assay biomarkers of potential interest in EDTA-plasma samples.

Results: A 3-plex assay for soluble urokinase plasminogen activator receptor (suPAR), soluble triggering receptor expressed on myeloid cells-1 (sTREM-1), and macrophage migration inhibiting factor (MIF) was developed and validated in-house. This 3-plex assay was added to a commercially available interleukin-1ß (IL-1ß), IL-6, IL-8, granulocyte/macrophage colony-stimulating factor, and tumor necrosis factor-{alpha} human cytokine panel. No cross-reactivity was observed when the assays were combined. Correlation between values obtained with the 8-plex, the 5-cytokine panel, the 3 in-house 1-plex assays, and a suPAR ELISA ranged from 0.86 to 0.99. Mean within- and between-run CVs were 8.0% and 11%, respectively. Recoveries of suPAR, sTREM-1, and MIF calibrators were 108%, 88%, and 51%, respectively. In plasma collected from 10 patients with bacterial sepsis confirmed by blood culture, the assay detected significantly increased concentrations of all 8 analytes compared with healthy controls.

Conclusions: A commercially available xMAP panel can be expanded with markers of interest. The combined multiplex assay can measure the 8 analytes with high reproducibility. The xMAP technology is an appealing tool for assaying conventional cytokines in combination with new markers.


   Introduction
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
Sepsis, a common and often fatal disease, is defined as the presence of infection in the context of systemic inflammatory response syndrome (1). To reduce sepsis mortality and morbidity, fast and reliable diagnosis is important; however, the complex pathology of the disease makes this difficult. These facts fueled the search for a reliable sepsis marker. Many potential biomarkers have been investigated, but only C-reactive protein and procalcitonin are used routinely (2)(3)(4). The search for a single "magic bullet" marker might be misguided, however; instead of a single marker, a combination of markers might be needed to improve diagnosis, prognosis, treatment efficacy, and ultimately, survival (2).

The majority of studies on new sepsis biomarkers have examined one biomarker at a time. Individual measurements of the plasma concentration of each putative marker incur considerable time, cost, and sample volume, limiting the systematic examination of multiple markers. However, the recently introduced xMAP technology from Luminex allows multiplexing of analytes in solution with flow cytometry. Using a proprietary technique, Luminex internally color-codes xMAP microspheres with 2 fluorescent dyes. With different ratios of these dyes, 100 distinctly colored bead sets are produced, and each bead set can be conjugated with a different capture antibody. The use of R-phycoerythrin–labeled detection antibodies allows quantification of antigen–antibody reactions occurring on the microsphere surface by measurement of the relative fluorescence intensity. The system is potentially capable of measuring 100 different analytes in a single 50-µL plasma sample. This capability allows the laboratorian to simultaneously profile multiple markers for diagnostic and prognostic purposes and to monitor temporal changes in the markers during treatment.

A sepsis biomarker that has attracted attention recently is the soluble triggering receptor expressed on myeloid cells-1 (sTREM-1).1 This member of the immunoglobulin superfamily is up-regulated on phagocytic cells in the presence of bacteria or fungi (5). Studies conducted in intensive care units indicated that sTREM-1 is more sensitive and specific than either C-reactive protein or procalcitonin in diagnosing sepsis in patients with systemic inflammatory response syndrome (6)(7)(8)(9).

Another novel infectious disease biomarker is soluble urokinase-type plasminogen activator receptor (suPAR). Blood concentrations of suPAR are increased in conditions characterized by immune activation, and studies have shown that high suPAR concentrations predict a poor clinical outcome for diverse infections, including HIV, tuberculosis, malaria, and pneumococcal bacteremia (10)(11)(12)(13)(14). The utility of suPAR in diagnosing and monitoring sepsis patients remains to be determined.

Finally, circulating concentrations of the cytokine macrophage migration inhibitory factor (MIF) may be a valuable marker of microbiologically confirmed infection after cardiac surgery (15), and increased MIF concentrations may be an early indicator of poor outcome in septic patients (16). The use of MIF as a biomarker for the diagnosis of sepsis in other settings is an interesting subject that has not yet been addressed.

There are several commercial multiplex panels available for the measurement of multiple biomarkers of inflammation. However, to take full advantage of the xMAP technology, it is necessary to be able to add new markers to a commercially available panel. The aims of the current study were to develop and validate a multiplex panel to measure suPAR, sTREM-1, and MIF and to use this panel in combination with a commercially available interleukin-1ß (IL-1ß), IL-6, IL-8, granulocyte/macrophage colony-stimulating factor (GM-CSF), and tumor necrosis factor-{alpha} (TNF-{alpha}) 5-plex assay. The resulting 8-plex panel was used to assay plasma samples from sepsis patients and controls.


   Materials and Methods
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
antibodies, calibrators, buffers, and reagents
MIF and sTREM-1 calibrators and antibodies were purchased from R&D Systems. Calibrators were recombinant human MIF (289-MF-002) and recombinant human TREM-1/Fc Chimera (1278-TR-050). The MIF and sTREM-1 capture antibodies were mouse anti-human monoclonals (MAB289 and MAB1278), and the MIF and sTREM-1 detection antibodies were affinity-purified, biotinylated goat anti-human polyclonals (BAF289 and BAF 1278).

Recombinant human suPAR (residues 1–277) was expressed and purified from culture supernatants of transfected Chinese hamster ovary cells by use of an anti-suPAR antibody column (clones VG-1, V11.5, and V12.3). The suPAR capture antibody was a rat anti-human monoclonal antibody (VG-1) targeting the D3 domain of suPAR. The suPAR detection antibody was an affinity-purified, biotinylated rabbit polyclonal antibody. ViroGates donated the suPAR antibodies. Fluorescently labeled microspheres were obtained from Luminex Corporation.

IL-1ß, IL-6, IL-8, GM-CSF, and TNF-{alpha} beads, antibodies, antigens, and assay buffers (LHC0003) were purchased from BioSource International. Polyclonal R-phycoerythrin–labeled goat anti-mouse F(ab')2 immunoglobulins were obtained from DakoCytomation. 1-Ethyl-3-[3dimethylaminopropyl]carbodiimide hydrochloride (EDC) and N-hydroxysulfosuccinimide were purchased from Pierce Biotechnology. MES [2-(N-morpholino) ethanesulfonic acid] phosphate-buffered saline (PBS; 138 mmol/L NaCl, 0.0027 mol/L KCl, 0.01 mol/L phosphate), PBS containing 10 g/L bovine serum albumin (BSA), and Tween 20 were obtained from Sigma-Aldrich.

equipment
The Luminex100 was obtained from Luminex Corporation. STarStation (Ver. 2.0; Applied Cytometry Systems) was used as the acquisition and analysis software.

Washes were performed with 96-well, multiscreen filter plates (MABVN1250), a multiscreen vacuum manifold, and a Chemical Duty Pump (Millipore). During incubation, the plates were placed on a titer plate shaker (Titertek). Liquid handling was performed with calibrated, adjustable, precision pipettes.

suPAR elisa
Maxisorp 96-well plates (Nunc) were incubated overnight at 4 °C with 300 ng/well of anti-suPAR clone VG-1 capture antibody. Plates were then washed with PBS containing 1 mL/L Tween 20, blocked 1 h at room temperature with StabilGuard Biomolecule Stabilizer (SurModics), diluted 1 to 1 in PBS, and dried. Samples and calibrators were diluted 1 to 10 in PBS containing 10 g/L BSA and 1 mL/L Tween 20. After the plates had been incubated at 37 °C for 1 h and washed 5 times, 100 ng of affinity-purified rabbit anti-suPAR antibody was added to each well. The plates were incubated 1 h at 37 °C and washed 5 times, after which 100 ng of horseradish peroxidase–conjugated donkey anti-rabbit IgG antibody (Amersham Biosciences) was added to each well. After the plates had been incubated for 1 h at 37 °C and washed 10 times, 100 µL of horseradish peroxidase reagent (DY999; R&D Systems) was added to each well. After the plates had been allowed to sit for 15 min at room temperature, the color reaction was stopped by addition of 1 mol/L H2SO4 and the absorbance was read at 450 nm. All measurements were performed in duplicate. The suPAR ELISA had within- and between-run CVs of 4.0% and 9.3%, respectively, and the limit of detection (LOD) was calculated to be 63 ng/L.

plasma samples
Blood samples were collected from 10 patients who were admitted to Copenhagen University Hospital, Hvidovre, with blood culture-confirmed bacterial sepsis during spring 2005. Whole blood from the patients was drawn on the second day of their hospital stay and placed in a 6-mL dipotassium EDTA-containing Vacutainer Tube (Becton Dickinson). Pneumococcus pneumonia was isolated from the blood of 6 patients and Escherichia coli from 4 patients. All patients fulfilled at least 2 of the systemic inflammatory response syndrome diagnostic criteria. Two patients were admitted to the intensive care unit, and the remaining 8 were admitted to the Department of Infectious Diseases. One patient died after 1 week of hospitalization. Donor plasma was drawn from healthy members of the research group and placed in 6-mL dipotassium EDTA-containing Vacutainer Tubes and 2.7-mL citrate-containing Vacutainer Tubes (Becton Dickinson). After a maximum of 2 h, the samples were separated by centrifugation, and plasma was stored at –20 °C until the following morning, when the samples were placed at –80 °C. The Scientific Ethical Committee of Copenhagen and Frederiksberg Communes approved sample collection on the basis of informed consent (KF01-108/04).

microsphere conjugation
Monoclonal antibodies were covalently conjugated to carboxylated Luminex beads according to the procedure suggested by the manufacturer, with minor modifications (17).

Briefly, to determine optimal antibody conjugation concentration, we pelleted stock microsphere solutions containing 4 x 106 beads by centrifugation at 13 000g for 2 min, removed the supernatant, and resuspended the beads in distilled H2O. We repeated the centrifugation, removed the supernatant, and resuspended the beads in 80 µL of 100 mmol/L monobasic sodium phosphate. We then added 10 µL each of 50 g/L N-hydroxysulfosuccinimide and 50 g/L EDC (both diluted in distilled H2O). After vortex-mixing, the microspheres were incubated for 20 min in the dark at room temperature. The microspheres were then washed twice in 50 mmol/L MES buffer (pH 5.0) and aliquoted into 8 tubes with ~500 000 beads in each tube. To determine the optimal conjugation efficiency, we added 0, 0.5, 1, 2.5, 5, 10, 20, or 40 µg of monoclonal antibody in 500 µL of MES buffer. The coupling reaction was incubated for 2 h at room temperature with rotation. After washing the beads twice with PBS containing 0.5 mL/L Tween 20, we resuspended the beads in PBS containing 10 g/L BSA and 0.5 g/L sodium azide and stored them in the dark at 2–8 °C.

The antibodies were conjugated to the following bead sets: suPAR to bead 33, TREM-1 to bead 38, and MIF to bead 56. We determined the concentration of beads by counting, on the Luminex100, 0.5 µL of beads diluted 1 to 400 in PBS containing 10 g/L BSA. We determined the conjugation efficiency by incubating 5000 beads resuspended in PBS containing 10 g/L BSA with 400 ng/well of R-phycoerythrin–conjugated goat anti-mouse F(ab')2 immunoglobulins for 30 min. After determining the optimal conjugation concentration, we conjugated a bulk of 5 x 106 beads.

calibration curve preparation
The lyophilized MIF and sTREM-1 calibrators were reconstituted in PBS–10 g/L BSA, mixed with the suPAR-containing calibrator to form a 3-component concentrate, and stored in 10-µL aliquots at –80 °C. We prepared calibrators daily by adding 1 mL of assay diluent to the lyophilized IL-1ß, IL-6, IL-8, GM-CSF, and TNF-{alpha} recombinant human cytokines. The 5-cytokine cocktail was calibrated against the respective National Institute for Biological Standards and Control calibration standards, according to the manufacturer’s specifications. We then added 5 µL of the 3-component calibrator to 445 µL of reconstituted 5-cytokine cocktail. We prepared the 7 individual calibrators by performing 1 to 3 serial dilutions. Calibration curves for each analyte were generated by STarStation software.

assay protocol
We followed the BioSource assay protocol (18) when using the premixed human inflammatory 5-plex alone, but made minor modifications when using the 3-plex alone or when combining the 3- and 5-plexes.

Briefly, to each designated, prewetted well on the filter plate, we added bead suspension (5-plex premixed beads and/or 5000 microspheres coated with suPAR, sTREM-1, or MIF antibody). The beads were washed twice with wash solution, and incubation buffer was added. Samples (50 µL) were diluted 1 to 1 in assay diluent. Individual calibrators were not further diluted. The plate was incubated for 2 h at room temperature on a titer plate shaker (600 rpm). After 2 washes, 100 µL of a detection antibody cocktail (5-plex premixed antibodies and/or suPAR, sTREM-1, or MIF biotinylated antibody) was added per well, and the plate was incubated for 1 h at room temperature on a titer plate shaker. After 2 washes, 100 µL of streptavidin–R-phycoerythrin solution was added to each well. Finally, after incubation for 30 min at room temperature on a titer plate shaker and 3 washes, 100 µL of wash solution was added to each well. The plate was then placed in the XY platform of the Luminex100. In each well, a minimum of 100 analyte-specific beads was analyzed for both bead designation and R-phycoerythrin fluorescence.

validation
On the basis of guidelines from the US Food and Drug Administration, we developed a validation program (19) that entailed full validation of the suPAR, sTREM-1, and MIF multiplex assay and partial validation of the IL-1ß, IL-6, IL-8, GM-CSF, and TNF-{alpha} assay. The program included assessment of selectivity, linear range, LOD, lower limit of quantification (LLOQ), upper limit of quantification (ULOQ), precision, absolute recovery, freezing/thawing stability, and stability at room temperature.

We evaluated assay selectivity by adding all possible combinations of beads, antigens, and detection antibodies. The highest calibrator (calibrator 7) was used. Because IL-1ß, IL-6, IL-8, GM-CSF, and TNF-{alpha} were delivered in a premade mixture, it was only possible to test all 5 cytokines against the add-on assay. We further assessed selectivity by analyzing 6 human EDTA-plasma samples, enriched or not enriched, with twice the LLOQ concentration.

We calculated the LOD by adding 3 SD to the mean median fluorescence intensity (MFI) of 10 blanks. Estimation of the LLOQ for TREM-1 and MIF was based on measurements of 15 plasma samples in the concentration ranges of 120–725 ng/L sTREM-1 and of 178–697 ng/L MIF. It was not possible to establish the LLOQ for suPAR with plasma samples because endogenous suPAR concentrations were well above the predicted LLOQ in all plasma samples; thus, we based the suPAR LLOQ on measurements of 15 calibrator samples in the concentration range from 4.1 to 108 ng/L. The ULOQ for all analytes were defined as calibrator 7. The criterion for acceptance of LLOQ and ULOQ values was CVs <20%.

We determined assay linearity by diluting with assay buffer 4 plasma samples prepared by enriching 2 plasmas each from 2 healthy donors. Two plasmas were diluted in a series of eight 2-fold dilutions from 1/2 to 1/256, and the other 2 were first diluted 1/1.5 and thereafter in a series of seven 2-fold dilutions from 1/2 to 1/128.

To assess within- and between-run precision, we prepared 4 validation samples by enriching pooled donor EDTA-plasma with the calibrators. The MIF concentrations in the low validation sample were below the LLOQ; therefore, assessment of MIF assay precision was based on 3 validation samples. The samples were analyzed 3 times over 3 days with 5 repetitive determinations per concentration. The acceptance criterion for precision was a mean CV <15%.

We conducted recovery experiments by enriching single donor plasma samples with the following concentrations of pure calibrator: 0, 46, 139, 417, 1250, and 3750 ng/L suPAR and 0, 188, 563, 1688, 5063, and 15 188 ng/L sTREM-1 and MIF. Enriched and nonenriched samples were run on the same plate in duplicate.

We determined freeze/thaw stability by measuring 3 patient EDTA-plasma samples containing the following concentrations: 2.54, 5.34, and 10.94 µg/L suPAR; 5.74, 14.60, and 39.54 µg/L sTREM-1; and 0.28, 0.37, and 1.20 µg/L MIF. suPAR and MIF occurred naturally in the stated concentrations, whereas the sTREM-1 concentrations were achieved by enriching with recombinant sTREM-1 protein. Each cycle consisted of unassisted thawing at room temperature followed by refreezing for 23 h at –80 °C. We determined the short-term temperature stability in plasma at room temperature by removing 200 µL of EDTA-plasma pooled from 2 patient samples after 0, 0.5, 1, 1.5, 2, 3, 5, 7, and 24 h at room temperature and freezing at –80 °C. The index concentrations were 8.98 µg/L suPAR, 12.82 µg/L sTREM-1, and 2.09 µg/L MIF. The day after freezing, aliquots were thawed and analyzed in duplicate.

statistical analysis
Statistical analyses were carried out using SPSS data analysis software (Ver.12.0; SPSS Inc.).

Bland–Altman analyses were performed to calculate systematic differences and limits of agreement (20). Ideally, the limits of agreement need to be defined a priori and are considered the maximum width of limits that does not impair clinical decision-making. We arbitrarily defined these limits as ~50%.

The Pearson correlation coefficient (r2) was calculated to determine correlation between values measured by the different assays. The Mann–Whitney test was used for comparing values from patients and donors.


   Results
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
assay development
The effect of capture antibody concentration on conjugation efficiency varied. sTREM-1 conjugation efficiency reached a plateau at 5 µg of antibody per 500 000 beads. MIF conjugation efficiency showed a slight decrease when the antibody concentration exceeded 5 µg of antibody per 500 000 beads, whereas suPAR conjugation efficiency increased along the entire interval tested. We therefore chose 5 µg of MIF and sTREM-1 antibodies and 20 µg of suPAR antibody per 500 000 beads for conjugation. MFI values obtained for the chosen suPAR, sTREM-1, and MIF conjugation concentrations were 11 156, 17 598, and 17 978, respectively. MFI values obtained for BioSource IL-1ß, IL-6, IL-8, GM-CSF, and TNF-{alpha} beads conjugated at unknown antibody concentrations were 21 392, 14 800, 12 999, 14 780, and 24 170, respectively.

Using calibrators 7, 5, 3, and a blank, and testing 6 different antibody concentrations in the interval from 0–8 mg/L, we determined the optimum concentrations of suPAR, sTREM-1, and MIF detection antibodies. The signals for the calibrators plateaued at 2–4 mg/L, whereas the signal for the blank kept increasing. We therefore chose detection antibody concentrations of 2 mg/L for MIF and sTREM-1 and 4 mg/L for suPAR.

Shown in Fig. 1 is a comparison of calibration curves for the suPAR, sTREM-1, and MIF 3-plex (top); the IL-1ß, IL-6, IL-8, GM-CSF, and TNF-{alpha} 5-plex (middle); and the 2 assays combined (bottom). The shapes of the different calibration curves did not change when the 3-plex and the 5-plex were combined, but the maximum MFI decreased by a mean of 28%. The best calibration curve fit was for the 5-parameter logistic equation: y = d + (ad)/(1 + x/c)b,g, where x is the concentration; y is the MFI; a is the estimated MFI at zero concentration; b is the slope of the tangent midpoint; c is the midpoint; d is the estimated MFI at infinite concentration; and g is the asymmetry parameter.


Figure 1
View larger version (11K):
[in this window]
[in a new window]
 
Figure 1. Calibration curves for the suPAR, sTREM-1, and MIF 3-plex (A), the BioSource 5-plex (B), and the 2 assays combined as an 8-plex (C).

Blank values are not subtracted.

assay validation
Evaluation of assay selectivity showed that the background fluorescence values for all 8 beads in the absence of bead-specific antigen were below the LOD and that the assay was able to differentiate between enriched and nonenriched samples for all 8 markers in the 6 samples tested.

The established LLOQ for suPAR, sTREM-1, and MIF are shown in Table 1 . The ULOQ for suPAR and sTREM-1 were defined as the calibrator 7 concentrations (22 500 and 91 125 ng/L respectively). However, MIF calibrator 7 could not fulfill the precision criteria (within-run CV was 26%); therefore, calibrator 6 (30 375 ng/L) was used as the ULOQ for MIF.


View this table:
[in this window]
[in a new window]
 
Table 1. Characteristics of the 8-plex xMAP assay for human EDTA-plasma.1

The linearity of the 3-plex is shown in Fig. 2 . The LOD for the commercial panel was calculated to be <3 ng/L for all 5 cytokines. The LLOQ was defined as the concentration of calibrator 1 and the ULOQ as the concentration of calibrator 7. For all 5 cytokines, the precision criteria at both the LLOQ and ULOQ were fulfilled. The mean within- and between-run CVs were 8.0% and 11%, respectively (Table 2 ).


Figure 2
View larger version (5K):
[in this window]
[in a new window]
 
Figure 2. Linearity of the suPAR (top), sTREM-1 (middle), and MIF (bottom) assays.

Dilution tests using 4 plasma samples. For sTREM-1 and MIF, only 3 plasma samples are shown because in one of the plasma samples, these 2 analytes were measurable only in the first 2 dilutions. The y axis shows the analyte concentration as determined with the 3-plex.


View this table:
[in this window]
[in a new window]
 
Table 2. Concentrations of analytes in quality-control samples and within-/between-assay CVs.1

Mean recoveries of suPAR, sTREM-1, and MIF calibrators added to plasma were 108%, 88%, and 51%, respectively (Table 1Up ). Because of the low MIF recovery, the experiment was repeated with citrate- and EDTA-plasma from 3 donors. The results were the same.

The Pearson correlation coefficient (r2) between added and measured concentrations of the analytes in enriched samples was 1.00 for all 3 analytes.

As shown in Fig. 3 , suPAR concentrations in plasma remained stable for 24 h at room temperature and for at least 5 repeated freeze/thaw cycles, with a measured concentration within 20% of the control. sTREM-1 loss exceeded 20% after 1.5 h at room temperature or 3 freeze/thaw cycles, and MIF loss exceeded 20% after 5 h at room temperature or 1 freeze/thaw cycle.


Figure 3
View larger version (17K):
[in this window]
[in a new window]
 
Figure 3. Stabilities of suPAR, sTREM-1, and MIF at room temperature (A), and effects of repeated freezing/thawing on measured suPAR, sTREM-1, and MIF concentrations (B).

{blacksquare}, suPAR; {blacktriangleup}, sTREM-1; {blacktriangledown}, MIF. We collected 3 plasma samples. For the freezing/thawing experiments (B), 200-µL aliquots were frozen (–80 °C) and thawed 1 to 6 times and analyzed batch-wise. Values were normalized to those from samples frozen once (100%) and represent the mean (SD; error bars).

assay application
We analyzed EDTA-plasma samples from 10 patients and 10 donors in parallel for all 8 markers, using the three 1-plex assays, the 5-plex, the 8-plex, and a standard suPAR ELISA. When we compared the concentrations of the 8 analytes analyzed as one 8-plex with those measured by the "stand-alone" assays, the Pearson correlation coefficients ranged from 0.86 to 0.99 (mean, 0.95; Table 1Up ). The MIF values in samples from all 10 donors, sTREM-1 values in samples from 5 donors, IL-8 values in samples from 4 donors, and the TNF-{alpha} value in a sample from 1 donor were below the LLOQ and therefore not included in the correlation analysis. The correlation coefficient between suPAR concentrations obtained with the 8-plex assay and the standard suPAR ELISA was 0.95.

The Bland–Altman plots of differences and means of results obtained from the assays showed that the standard deviation of the differences increased with analyte concentration. The values were therefore log-transformed before differences and means were calculated and plotted. The 95% limits of agreement between the 8 analytes measured by the 8-plex and the stand-alone assays were as follows: IL-1ß, 93%–138%; IL-6, 99%–121%; IL-8, 103%–131%; GM-CSF, 92%–131%; TNF-{alpha}, 104%–144%; suPAR, 84%–125%; sTREM-1, 56%–147%; and MIF, 97%–136%. The 95% limits of agreement between suPAR values measured by the 8-plex and by the ELISA were 99%–140%. The suPAR plots are shown in Fig. 4 . The 8-plex assay measured systematically higher concentrations than the 1-plex and 5-plexes and the suPAR ELISA. Because of this result, we conducted another experiment that consisted of testing for cross-reactivity between the analytes in pooled donor EDTA-plasma, using the same approach as for testing cross-reactivity with assay buffer. We saw no cross-reactivity when we used EDTA-plasma.


Figure 4
View larger version (14K):
[in this window]
[in a new window]
 
Figure 4. Bland–Altman analysis showing agreement between log-transformed suPAR values obtained from the Luminex 8-plex and the suPAR ELISA (A) or 1-plex (B).

Solid lines are mean values; dotted lines are 2 SD.

All 8 markers were significantly increased (P <0.001) in the 10 patients compared with the 10 healthy donors. Individual concentrations and medians of all 8 markers obtained from the 8-plex assay are plotted in Fig. 5 .


Figure 5
View larger version (18K):
[in this window]
[in a new window]
 
Figure 5. Plasma concentrations of IL-1ß, IL-6, IL-8, GM-CSF, TNF-{alpha}, suPAR, sTREM-1, and MIF in 10 patients with blood culture-confirmed bacterial sepsis ({triangleup}) and in 10 healthy controls ({circ}).

Individual values are plotted. The {blacktriangleup} indicates the patient who died, and Figure 5 indicates the 2 patients who were admitted to the intensive care unit. Lines represent medians.


   Discussion
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
To take full advantage of the xMAP technology, it is important to be able to add new markers to the commercially available panels. In this study, we demonstrate that it is feasible to make an add-on assay work in combination with a commercially available cytokine panel.

The first step is bead–antibody conjugation. Our in-house conjugation efficiency is within the range for the beads in the commercial panel. Others have obtained 10-fold less bound antibody than the commercially available beads (21). Of particular importance is the storage and handling of EDC (21). We were always careful to store EDC under the proper conditions and to have excess EDC in the conjugation solution. Interestingly, we observed a decrease in MIF conjugation efficiency when the antibody concentration exceeded 5 µg per 500 000 beads, whereas suPAR conjugation efficiency was still increasing at 40 µg of antibody per 500 000 beads. Giavadoni (21) experienced a similar decrease in bound antibody when the amount of interferon-{gamma} antibody exceeded 2.5 µg per 500 000 beads. The rather high concentration of suPAR antibodies required to achieve acceptable conjugation was probably the result of insufficient removal of azide from the antibody solution, which has been reported to influence conjugation efficiency (22).

Research groups have used different protocols for validating their Luminex assays (21)(22)(23)(24)(25)(26)(27)(28). We followed the minimal criteria outlined in the Food and Drug Administration guidance document for industry on bioanalytical method validation (19), with the exceptions that we were not able to obtain suitable analyte-free plasma and that we chose to use only 4 validation samples covering the working range instead of the 5 suggested in the guidance document. The analytical sensitivity and precision were comparable to those reported by others (21)(22)(23)(24)(25)(26)(27)(28).

Recoveries of suPAR and sTREM-1 were in the expected range, but the mean MIF recovery of 51% in both EDTA- and citrate-plasma was lower than expected. It is well established that cytokines interact with many plasma proteins that may interfere with antibody binding, including heterophilic antibodies, serum-binding proteins, and soluble and membrane-bound receptors. The low recovery of MIF may be a result of its ability to bind human albumin (29). A recent study demonstrated that a MIF ELISA, using the same commercially available antibody combination that we used, detected <1% of the total serum MIF detected by Western blot (30). The same study showed that use of diluent buffers that included BSA led to MIF serum immunoassay interference. Lui et al. (26) studied recoveries of MCP-1 from human serum, using Luminex assays from 3 different manufacturers and a standard ELISA. Mean recovery was ~55% with the Luminex system, whereas ELISA gave a mean recovery ~100% (26). This low recovery with the Luminex system could be, in part, a result of a typical matrix effect, which might be avoided by further dilution of plasma samples as is often done in ELISAs. Multiplexing is a balance between finding the right dilution factor for a single analyte and an acceptable universal dilution factor for multiple analytes.

Although we did not observe any cross-reactivity among the 8 analytes, either when the pure recombinant proteins were added in different combinations or when we combined the 8 calibration curves, the determined concentrations of all 8 analytes were higher when analyzed as an 8-plex vs the stand-alone assays. It was even possible for the 8-plex to quantify sTREM-1 in samples unquantifiable by the 1-plex. This raises the question of the true concentration of sTREM-1 in plasma. To our knowledge, 4 studies have quantified sTREM-1 in plasma/serum (7)(22)(31)(32). There is a 400-fold difference in the LOD among the assays used in the 4 studies, but this difference did not influence their abilities to quantify sTREM-1 in serum samples. The assays used the same primary sTREM-1 antibody but different analytical methods (immunoblot, ELISA, and Luminex technology).

A reference assay is needed, but such an assay is lacking even for cytokines known and analyzed for years (28)(33). In the 8-plex assay, the cytokine values measured in plasma from donors and patients were higher than we expected, especially for IL-1ß, TNF-{alpha}, and GM-CSF. We analyzed potassium EDTA–plasma several times with the BioSource panel without any add-ons, and the results were consistent. According to the manufacturer, the EDTA-plasma validation experiments were performed with sodium EDTA. Because of this difference, BioSource is currently investigating the correlation between Luminex and standard ELISA measurements using potassium EDTA–plasma samples. A study comparing Luminex panels from different manufacturers found that the BioSource IL-1ß multiplex assay measured higher values than the other panels tested when samples were analyzed in parallel (25), and newly published results showed up to a 12-fold difference in determined cytokine concentrations between 2 commercially available Luminex panels (24). Nevertheless, the relative differences in IL-1ß, IL-6, and TNF-{alpha} between sepsis patients and controls observed in our study are comparable to the relative differences found in an earlier study (34).

We have not found any multiplex studies that report changes in measured analyte concentrations when combining different assays. Further examination of the mechanisms behind these changes exceeded the scope of this study. One might speculate that cross-reactions between the different antibodies included in the assay are a factor, although we observed no cross-reactivity between the assay components when tested in assay buffer or in plasma. The naturally occurring analytes might act immunogenically differently from the recombinant proteins, and many plasma proteins likely interact with the analytes. These complications make it impossible to compare exact analyte concentrations obtained from the different combinations of assays. Nevertheless, a mean correlation coefficient of 0.95 is impressive and allows comparison of relative changes within and between groups rather than exact concentration differences.

Analyte stability is another important issue to assess during validation. Earlier studies of suPAR stability and MIF half-life yielded results similar to the ones presented here (35)(36). To our knowledge, there are no earlier assessments of sTREM-1 stability or MIF freezing/thawing stability. Short-term storage stability under conditions other than the ones investigated in this study (e.g., in whole blood and at different temperatures) and long-term storage stability need to be evaluated. Our conclusions based on the storage experiments is that the suPAR assay is very robust to differences in sample handling, whereas handling procedures need to be rigorously homogeneous to obtain reliable results for sTREM-1 and MIF. However, it is important to note that stability assessments are specific for the antibody pairs tested and should therefore accompany validations of new assay components (28).

Some of the advantages of multiplexing compared with measuring the same analytes by traditional ELISA are a reduction in pipetting error; a reduction in hands-on time and, therefore, cost; and improved quality of results because freezing/thawing would typically be required for the measurement of multiple analytes by ELISA. Another advantage is the reduced amount of sample needed, which is of particular importance in children, from whom small amounts of plasma are usually obtained, and in critically ill sepsis patients, for whom there is a need for monitoring immune status at several time points. In addition to the immune markers described here, it is possible to add on beads detecting other types of proteins, such as diagnostic molecules (e.g., viral proteins), therapeutic drugs, and human antibodies.

In conclusion, there are pitfalls when using either commercially available panels or in-house–developed assays. Several issues require further study, such as the presence of interfering heterophilic antibodies and other plasma proteins that might skew results, optimization of the pairing of capture and detection antibodies, the best working buffer systems, and the ideal matrix for preparation of calibrators. When combining 2 assays, laboratorians should consider that results are not always directly comparable to those obtained from the 2 individual assays. Therefore, the same assay should be used to analyze all samples in a clinical study.


   Acknowledgments
 
We thank laboratory technician Anja Stausgaard for skillful help with the suPAR ELISA setup, biostatistician Dr. Klaus Larsen for assistance with the statistical analysis, and Dr. Troels Bygum Knudsen for help with graph design. This study was supported in part by a grant from the research foundation at Hvidovre Hospital. The suPAR antibodies and the suPAR ELISA were gifts from ViroGates (Cape Town, SA).


   Footnotes
 
1 Nonstandard abbreviations: (s)TREM-1, (soluble) triggering receptor expressed on myeloid cells; suPAR, soluble urokinase-type plasminogen activator receptor; MIF, macrophage migration inhibitory factor; IL, interleukin; GM-CSF, granulocyte/macrophage colony-stimulating factor; TNF, tumor necrosis factor; EDC, 1-ethyl-3-[3-dimethylaminopropyl]carbodiimide hydrochloride; PBS, phosphate-buffered saline; BSA, bovine serum albumin; LOD, limit of detection; LLOQ, lower limit of quantification; ULOQ, upper limit of quantification; and MFI, median fluorescence intensity.


   References
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 

  1. Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, et al. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine. Chest 1992;101:1644-1655.[Abstract/Free Full Text]
  2. Carrigan SD, Scott G, Tabrizian M. Toward resolving the challenges of sepsis diagnosis. Clin Chem 2004;50:1301-1314.[Abstract/Free Full Text]
  3. Meisner M. Biomarkers of sepsis: clinically useful?. Curr Opin Crit Care 2005;11:473-480.[Medline] [Order article via Infotrieve]
  4. Mitaka C. Clinical laboratory differentiation of infectious versus non-infectious systemic inflammatory response syndrome. Clin Chim Acta 2005;351:17-29.[Medline] [Order article via Infotrieve]
  5. Colonna M, Facchetti F. TREM-1 (triggering receptor expressed on myeloid cells): a new player in acute inflammatory responses. J Infect Dis 2003;187(Suppl 2):S397-S401.
  6. Gibot S, Cravoisy A, Levy B, Bene MC, Faure G, Bollaert PE. Soluble triggering receptor expressed on myeloid cells and the diagnosis of pneumonia. N Engl J Med 2004;350:451-458.[Abstract/Free Full Text]
  7. Gibot S, Kolopp-Sarda MN, Bene MC, Cravoisy A, Levy B, Faure GC, et al. Plasma level of a triggering receptor expressed on myeloid cells-1: its diagnostic accuracy in patients with suspected sepsis. Ann Intern Med 2004;141:9-15.[Abstract/Free Full Text]
  8. Bouchon A, Dietrich J, Colonna M. Cutting edge: inflammatory responses can be triggered by TREM-1, a novel receptor expressed on neutrophils and monocytes. J Immunol 2000;164:4991-4995.[Abstract/Free Full Text]
  9. Bouchon A, Facchetti F, Weigand MA, Colonna M. TREM-1 amplifies inflammation and is a crucial mediator of septic shock. Nature 2001;410:1103-1107.[CrossRef][Medline] [Order article via Infotrieve]
  10. Eugen-Olsen J, Gustafson P, Sidenius N, Fischer TK, Parner J, Aaby P, et al. The serum level of soluble urokinase receptor is elevated in tuberculosis patients and predicts mortality during treatment: a community study from Guinea-Bissau. Int J Tuberc Lung Dis 2002;6:686-692.[Medline] [Order article via Infotrieve]
  11. Ostergaard C, Benfield T, Lundgren JD, Eugen-Olsen J. Soluble urokinase receptor is elevated in cerebrospinal fluid from patients with purulent meningitis and is associated with fatal outcome. Scand J Infect Dis 2004;36:14-19.[Medline] [Order article via Infotrieve]
  12. Perch M, Kofoed P, Fischer TK, Co F, Rombo L, Aaby P, et al. Serum levels of soluble urokinase plasminogen activator receptor is associated with parasitemia in children with acute Plasmodium falciparum malaria infection. Parasite Immunol 2004;26:207-211.[Medline] [Order article via Infotrieve]
  13. Sidenius N, Sier CF, Ullum H, Pedersen BK, Lepri AC, Blasi F, et al. Serum level of soluble urokinase-type plasminogen activator receptor is a strong and independent predictor of survival in human immunodeficiency virus infection. Blood 2000;96:4091-4095.[Abstract/Free Full Text]
  14. Wittenhagen P, Kronborg G, Weis N, Nielsen H, Obel N, Pedersen SS, et al. The plasma level of soluble urokinase receptor is elevated in patients with Streptococcus pneumoniae bacteraemia and predicts mortality. Clin Microbiol Infect 2004;10:409-415.[Medline] [Order article via Infotrieve]
  15. Mendonca-Filho HT, Gomes GS, Nogueira PM, Fernandes MA, Tura BR, Santos M, et al. Macrophage migration inhibitory factor is associated with positive cultures in patients with sepsis after cardiac surgery. Shock 2005;24:313-317.[CrossRef][ISI][Medline] [Order article via Infotrieve]
  16. Bozza FA, Gomes RN, Japiassu AM, Soares M, Castro-Faria-Neto HC, Bozza PT, et al. Macrophage migration inhibitory factor levels correlate with fatal outcome in sepsis. Shock 2004;22:309-313.[CrossRef][ISI][Medline] [Order article via Infotrieve]
  17. . Luminex Corporation. Protein coupling protocol http://www.luminexcorp.com/uploads/data/Protein%20Coupling%20Protocol%2097.pdf (accessed May 2006).
  18. . BioSource International. Human inflammatory 5-plex protocol http://www.biosource.com (accessed May 2006).
  19. . US Department of Health and Human Services. Food and Drug Administration. Center for Drug Evaluation and Research (CDER). Center for Veterinary Medicine (CVM). Guidance for industry. Bioanalytical method validation May 2001http://www.fda.gov/cder/guidance/4252fnl.pdf.
  20. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986;1:307-310.[CrossRef][ISI][Medline] [Order article via Infotrieve]
  21. Giavedoni LD. Simultaneous detection of multiple cytokines and chemokines from nonhuman primates using Luminex technology. J Immunol Methods 2005;301:89-101.[CrossRef][ISI][Medline] [Order article via Infotrieve]
  22. Skogstrand K, Thorsen P, Norgaard-Pedersen B, Schendel DE, Sorensen LC, Hougaard DM. Simultaneous measurement of 25 inflammatory markers and neurotrophins in neonatal dried blood spots by immunoassay with xMAP technology. Clin Chem 2005;51:1854-1866.[Abstract/Free Full Text]
  23. de Jager W, Te VH, Prakken BJ, Kuis W, Rijkers GT. Simultaneous detection of 15 human cytokines in a single sample of stimulated peripheral blood mononuclear cells. Clin Diagn Lab Immunol 2003;10:133-139.
  24. Dupont NC, Wang K, Wadhwa PD, Culhane JF, Nelson EL. Validation and comparison of Luminex multiplex cytokine analysis kits with ELISA: determinations of a panel of nine cytokines in clinical sample culture supernatants. J Reprod Immunol 2005;66:175-191.[CrossRef][ISI][Medline] [Order article via Infotrieve]
  25. Khan SS, Smith MS, Reda D, Suffredini AF, McCoy JP, Jr. Multiplex bead array assays for detection of soluble cytokines: comparisons of sensitivity and quantitative values among kits from multiple manufacturers. Cytometry B Clin Cytom 2004;61:35-39.[Medline] [Order article via Infotrieve]
  26. Liu MY, Xydakis AM, Hoogeveen RC, Jones PH, Smith EO, Nelson KW, et al. Multiplexed analysis of biomarkers related to obesity and the metabolic syndrome in human plasma, using the Luminex-100 system. Clin Chem 2005;51:1102-1109.[Abstract/Free Full Text]
  27. Prabhakar U, Eirikis E, Davis HM. Simultaneous quantification of proinflammatory cytokines in human plasma using the LabMAP assay. J Immunol Methods 2002;260:207-218.[CrossRef][ISI][Medline] [Order article via Infotrieve]
  28. Ray CA, Bowsher RR, Smith WC, Devanarayan V, Willey MB, Brandt JT, et al. Development, validation, and implementation of a multiplex immunoassay for the simultaneous determination of five cytokines in human serum. J Pharm Biomed Anal 2005;36:1037-1044.[CrossRef][ISI][Medline] [Order article via Infotrieve]
  29. Zeng FY, Kratzin H, Gabius HJ. Migration inhibitory factor-binding sarcolectin from human placenta is indistinguishable from a subfraction of human serum albumin. Biol Chem Hoppe Seyler 1994;375:393-399.[Medline] [Order article via Infotrieve]
  30. Meyer-Siegler KL, Iczkowski KA, Vera PL. Further evidence for increased macrophage migration inhibitory factor expression in prostate cancer. BMC Cancer 2005;5:73.[Medline] [Order article via Infotrieve]
  31. Determann RM, Millo JL, Gibot S, Korevaar JC, Vroom MB, van der Poll T, et al. Serial changes in soluble triggering receptor expressed on myeloid cells in the lung during development of ventilator-associated pneumonia. Intensive Care Med 2005;31:1495-1500.[Medline] [Order article via Infotrieve]
  32. Routsi C, Giamarellos-Bourboulis EJ, Antonopoulou A, Kollias S, Siasiakou S, Koronaios A, et al. Does soluble triggering receptor expressed on myeloid cells-1 play any role in the pathogenesis of septic shock?. Clin Exp Immunol 2005;142:62-67.[Medline] [Order article via Infotrieve]
  33. Mire-Sluis AR, Gaines-Das R, Thorpe R. Immunoassays for detecting cytokines: what are they really measuring?. J Immunol Methods 1995;186:157-160.[CrossRef][ISI][Medline] [Order article via Infotrieve]
  34. Casey LC, Balk RA, Bone RC. Plasma cytokine and endotoxin levels correlate with survival in patients with the sepsis syndrome. Ann Intern Med 1993;119:771-778.[Abstract/Free Full Text]
  35. Meyer-Siegler K. Increased stability of macrophage migration inhibitory factor (MIF) in DU-145 prostate cancer cells. J Interferon Cytokine Res 2000;20:769-778.[CrossRef][ISI][Medline] [Order article via Infotrieve]
  36. Riisbro R, Christensen IJ, Hogdall C, Brunner N, Hogdall E. Soluble urokinase plasminogen activator receptor measurements: influence of sample handling. Int J Biol Markers 2001;16:233-239.[Medline] [Order article via Infotrieve]




This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
clinchem.2006.067595v1
52/7/1284    most recent
Right arrow Submit an electronic Letter to
the Editor about this paper
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via ISI Web of Science (7)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Kofoed, K.
Right arrow Articles by Eugen-Olsen, J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Kofoed, K.
Right arrow Articles by Eugen-Olsen, J.
Related Collections
Right arrow Molecular Diagnostics and Genetics
Right arrow Proteomics and Protein Markers
Right arrow Automation and Analytical Techniques


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS