Abstract
We describe a statistical approach to compare absolute antibody concentrations, both within and across subjects, derived from a multidimensional measurement of IgG binding to the influenza surface receptor hemagglutinin (HA). This approach addresses a fundamental problem in the field of vaccine immunology: how to accurately compare the levels of antibodies against multiple influenza strains. The mPlex-Flu assay can simultaneously measure the concentration of IgG antibodies against up to 50 influenza strains with only of serum. It yields mean fluorescence intensity (MFI) over a 4-log range with low inter- and intrasample variability. While comparison of IgG binding to a single HA between subjects is straightforward, variations in binding behavior across influenza strains, coupled with reagent variations, make quantifying and comparing binding between multiple HA subtypes within subjects challenging. In this paper, we first treat such HA variations as an independent antigen and calculate each subtype antibody concentration using its own standard curve, normalizing variations in HA binding. We applied this method to the analyses of data from an H5 influenza clinical vaccine study. The results demonstrated that there are differences in coefficient estimates and in results of “comparing groups” between those with versus those without consideration of subtype antibody variations. Then, we used simulation studies to show the importance of taking the subtype antibody variations into account in HA strain antibody data analysis. Using a common standard curve for all subtype antibodies resulted in both inflated type I error and lowered specificity when comparing different treatment groups. Our results suggest that using individual standard curves for each influenza HA strain, and independently calculating anti-HA IgG concentrations, allows for adjustment of influenza HA subtype variations in treatment group comparisons in clinical vaccine studies. This method facilitates the direct comparison of serum anti-HA IgG concentrations against different influenza HA subtypes for multiplex assays.
1. Introduction
Estimating the concentration of antibodies directed against the major influenza viral surface protein hemagglutinin (HA) is critical for studies of antibody-mediated influenza immunity and especially for vaccine development [1]. Because the influenza virus mutates frequently, new strains are always emerging that can evade prior anti-HA IgG-mediated immunity, necessitating new vaccine formulations each year. Recently, emphasis has been placed on creating vaccines that generate broadly cross-reactive antibodies, protecting against many influenza strains [2]. Thus, the ability to simultaneously measure antibody binding against multiple influenza HA and to accurately compare antibody binding across many influenza strains, especially within and between subject binding distributions, is highly desirable. However, a major impediment to such comparisons is the variability of such multiple comparisons across many HA reagents, both for technical and statistical reasons.
We have previously described a multiplex-based method that simultaneously measures antibody binding against up to 50 influenza strain hemagglutinin proteins, the mPlex-Flu assay [3, 4]. HA proteins mediate viral attachment and entry into target cells [5]. Antibodies that bind to influenza HA can prevent or attenuate the severity of influenza infection. In mPlex-flu assay, each recombinant influenza strain HA couples to fluorescent microbeads; then, the mixtures of the HA-coated beads are used to simultaneously detect antibodies binding to multiple influenza strains. This multidimensional analytic method generates a continuous value for the mean fluorescence intensity (MFI), accurate over a 4-log range, reflecting antibody binding.
As a multidimensional assay, mPlex-flu assay is different from traditional titer-based assays such as the hemagglutinin inhibition (HAI) [6, 7] and microneutralization (MN) [8, 9] assays that measure IgG antibody binding to single-HA proteins. Importantly, this feature allows for the measurement of multidimensional cross-reactive immunity [4, 10], which is crucial when assessing whether a vaccine will provide broad protection against many influenza strains. This assay provides accurate concentrations of anti-HA IgG against different influenza strains and is able to detect statistically significant variations between experimental groups in clinical vaccine studies, compared to the HAI and MN assays.
Translating MFI measured by multiplex assay into absolute concentrations of anti-HA antibodies creates unique challenges compared to standard monoplex semiquantitative assays (e.g., ELISA, HAI). First, mPlex-Flu assay uses influenza strain-specific rHA coupling microbeads to detect the anti-HA antibodies. However, traditional quantitative assays (e.g., ELISA [11], Luminex assay [12]) use immunoglobulin-specific capture antibody to couple microbeads to estimate the antibodies concentrations. Second, between-strain differences in HA molecular properties can cause slight variations in the density of the different HA’s coating multiplex beads, resulting in slightly altered HA saturation and IgG binding characteristics [3, 4] (Figure 1). In addition, the assay is used to measure binding of a mixture of antibodies in sera that bind to multiple different sites on the HA protein, each with different affinities. The assessed antibody responses are polyclonal, but creating a precise mixture of monoclonal antibodies, targeting 20–40 different subtypes of influenza HA protein for 40–50 different HA, is technically unfeasible. Thus, a mixture of polyclonal sera with reactivities against all HA strains must be used. Finally, traditional statistical methods for analyzing concentration data [11, 13], using one common standard curve for all subtypic HAs [12], do not account for reagent binding differences between captured proteins. This may lead to increased Type I statistical errors and lowered specificity, when comparing treatment groups in clinical vaccine studies.
To address these issues, to accurately calculate the concentration unit of influenza virus HA-specific antibodies, and to normalize the differences between subtype strains, we calculated individual standard curves for each recombinant HA coupled bead set. Using this method, we derived the absolute anti-HA antibody concentration for each influenza strain using a five-parameter logistic regression model. Importantly, we estimated strain-specific parameters for each of the different HA subtype strains in the assay. We then applied this method to data from mPlex-Flu analysis of treatment groups of an influenza vaccine clinical trial (DMID 08-0059 [14]).
The results demonstrated differences in longitudinal estimates and comparisons from linear mixed effects models when comparing different treatment groups. Simulation studies showed that taking HA subtype variations into account in influenza anti-HA multiplex vaccination analysis lowered false discovery rates (FDR) and improved the specificity of the comparisons between treatment groups. Establishing individual standard curves for each influenza virus HA subtype will be extremely useful for the development of broadly cross-reactive influenza vaccines. This method is generalizable to multiplex assays of polyclonal, antibody-mediated immunity against viruses with significant strain variation.
2. Methods
2.1. Human Subjects Ethics Statement
This study was approved by the Research Subjects Review Board at the University of Rochester Medical Center (RSRB approval number RSRB00012232). The clinical samples were analyzed under secondary use consent, and written informed consent was obtained from all participants and kept on file per RSRB regulations. Research data were coded such that subjects could not be identified, directly or through linked identifiers, in compliance with the Department of Health and Human Services Regulations for the Protection of Human Subjects (45 CFR 46.101(b) [14]. Subject identification numbers were reencoded for publication.
2.2. Vaccine Study Design and Sample Collection
Data and serum samples used in this report were obtained from stored samples generated by a prospective clinical trial of H5 influenza vaccination (DMID 08-0059) [14]. Briefly, 64 previously H5 influenza-vaccinated (PR) and 30 healthy adults not previously vaccinated against H5 influenza strains (UP) were vaccinated with an intramuscular inactivated A/Indonesia/5/05 (A/Ind05) vaccine in two doses (Figure 2). The antibody concentration data from the different doses within the same vaccine treatment group were adjusted in the statistical analysis using linear mixed effects models [15]. All of the PR group received the intramuscular inactivated A/Vietnam/1203/04 (A/Vie04) vaccine in 2005-2006. Of these subjects, 16 had received a vaccine containing the rHA of A/Hong Kong/156/97(A/HK97) in 1997-1998 and are designated as the multiply primed group (MPR). Subjects of PR and MPR groups were administrated single doses of the A/Ind05 influenza vaccine. Subjects in MPR group received 2 identical vaccinations separated by 28 days. Serum samples were collected before vaccination (Day0) and on days 3, 7, 14, 28, 56, and 180 after vaccination. Serum samples were also collected from the UPR group on days 3, 7, 14, and 28 days after the second immunization.
2.3. mPlex-Flu Analysis
We estimated concentrations of IgG antibodies against 45 HA strains of influenza viruses in the serum samples from the DMID 08–0059 vaccine study using the mPlex-Flu assay [3]. All recombinant HA (rHA) proteins were produced by our lab, with trimerization domain on the end of C-terminal, including the HA heads. All rHAs were in trimer structure. Briefly, a panel of rHAs coupled mPlex-Flu beads listed on Table 1 were mixed and incubated with 20 µl of diluted human sera for 2 hours, at 500 beads per each bead’s region in the 96-well filtration plates (Millipore, Billerica, MA) at 4°C, on a rotary shaker (500 rpm) in the dark. The wells were washed twice and then incubated with 1 : 400 diluted PE conjugated anti-human IgG (γ chain specific) secondary antibodies (SouthernBiotech, AL) in the dark at room temperature for 2 hours with gentle agitation (500 RPM). After three additional washes, the beads in each well were suspended in Luminex Magpix Drive Fluid (Luminex, Austin, TX) and analyzed on a MagPix multiplex reader (Luminex, Austin, TX), and the results obtained were measured in median fluorescence intensity (MFI).
2.4. Standard Serum and Standard Curves of mPlex-Flu Assay
Positive control serum for the seasonal influenza virus mPlex-Flu (STD02) was created by pooling four positive sera from the subjects who had confirmed high concentrations of IgG antibodies against all H1, H3 seasonal influenza virus strains and most H5 avian influenza virus strains. The total IgG concentration of this serum was 9.07 mg/ml, as estimated by ELISA using a purified IgG standard (Abcam INC, MA, USA). Using this control serum, the traditional standard curve of total IgG concentrations was found using a goat-anti-human IgG Fc specific capture antibody (Sigma-Aldrich, MO, USA) coupled to Luminex beads. We assayed serial dilutions of STD02 serum to create the total IgG standard curve, beginning with an initial dilution of 1 : 1000, followed by serial four-fold dilutions and a blank control [3]. STD02 serum at the same dilutions was then used to generate individual standard curves for each of the 45 influenza strain subtypes [3].
2.5. Dose-Response Curve
The MFI-IgG concentration relationship was modeled using four-parameter and five-parameter logistic regression models [16, 17]. For the mPlex-Flu assay, we assume is the response corresponding to dilution level for sth the strain subtype. Then and are described by the nonlinear functionwhere follows normal distribution with mean μ = 0 and variance where is a function of . The functions are different for four-parameter logistic regression models and five-parameter logistic regression models. The four-parameter logistic regression model is given bywhile the five-parameter model iswhere parameters for the strain subtype are denoted by for the minimum and for the maximum responses, is the concentration that results in 50% response, is the relative slope at the 50% response, and denotes the asymmetry in the dose-response relationship. When we use a common standard curve for all strain subtypes, the four-parameter and five-parameter logistic regression models will be given bywhere all θs will take the same value for all strain subtypes. Previous studies have found that the five-parameter logistic regression model is superior to the four-parameter model with respect to the accuracy of concentration estimates [18]. Thus, in our simulation studies, we used five-parameter logistic regression model to estimate the mean concentration.
3. Results
3.1. Standard Curve Generation for Each Strain Subtype
Traditional immunoassays (e.g., ELISA) generally fit one common five-parameter logistic regression model standard curve to all results of antibody binding to influenza HA strain subtypes. For example, when measuring human immune responses, an anti-human IgG capture antibody is often used to bind serial dilutions of IgG from a solution of known concentration, and a secondary indicator antibody is used to measure the mean fluorescence intensity (MFI) versus the IgG concentration for a standard curve [11, 13]. The principle of assays is shown in Figure 1. However, we have found that using this same procedure to generate a single standard curve is problematic for the multiple assay (mPlex-Flu).
We found that the traditional standard curve (Figure 3(a)) generated from the IgG capture antibodies is different from the individual standard curves (Figures 3(b)–3(d) show three influenza strains as examples) generated from each specific influenza HA strain in mPlex-Flu assay, shown as different parameters in the fitted five-parameter logistic regression models. The traditional standard curve has parameters of in the fitted five-parameter logistic regression model (Figure 3(a)).
(a)
(b)
(c)
(d)
The multiple assay approach allowed us to fit a five-parameter logistic regression model for each strain subtype with different parameters for each strain subtypes. For the three strain subtype examples, the estimated parameters in the fitted five-parameter logistic regression models were different as shown in Table 2 and Figures 3(b)–3(d). Table 2 also shows the SEM of those estimated parameters for the three strain subtypes. Therefore, we hypothesize that influenza strain subtype variations (e.g., sequence, density on multiplex bead surface, glycosylation, and charge) could account for or cause inaccuracy during subsequent immunoassay data analysis when comparing different treatment groups in clinical vaccine studies. In addition, with the influenza strain subtype variations being taken into account, it is likely that variations between the strains could be mathematically adjusted for at same time. The data after such adjustment should allow us compare the absolute concentration of IgG anti-influenza between subtype strains. Besides statistical methodology, one can also prepare Ag-specific pools for each of the antigen. This can be done by affinity purification or calibration-free concentration analysis on a BiaCore SPR machine. This is a critical technical problem for the assessment of influenza antibody cross-reactivity in most antibody response and vaccine studies.
3.2. Differences in Statistical Inferences with and without considering Strain Subtype Variations
In order to test our hypothesis, we compared the differences in antibody concentrations across three different vaccine treatment groups with data generated by mPlex-Flu assay. First, we used the linear mixed effects model to adjust IgG titres to 21 strains of H5 influenza viruses with the effects of age at enrollment, gender, ethnicity, dosages, and batches. Autoregressive 1 correlation structure was used in the linear mixed effects model to take into account the within-subject correlations [19]. Then, we compared the antibody concentration data against 21 strains of H5 influenza viruses using either (1) a traditional common standard curve used for all strain subtypes (Figure 3(a)) (without considering strain differences) or (2) an individual standard curve for all H5 strain subtypes to consider the strains’ difference. The longitudinal concentration data in the logarithm were from three immunization treatment groups: unprimed (UP), primed (PR), and multiple primed (MPR). The data included 21 H5 vaccine strain subtypes with 18606 total observations from 3 different groups, 2 different dosages (15 mcg and 90 mcg), 5 different batches, 7 or 10 different days, and 93 different subjects. The concentration in the logarithm was checked to follow an approximately normal distribution; thus, linear mixed effects models were used to fit the log transformed concentration data to compare the three different vaccine groups with and without considering the H5 vaccine strain subtype variations [20, 21].
For the group comparisons, the Kenward–Roger method was used to estimate the standard error for fixed effects and the degrees of freedom for each parameter [22]. Restricted maximum likelihood estimators were used to obtain the parameter estimates in the linear mixed effects model. Figure 4 shows the longitudinal estimates of the three different vaccine treatment groups from linear mixed effects models with and without consideration of the H5 strain subtype variations. We noticed that the estimated mean concentrations in the logarithm are different, especially at baseline and end of study measurements. Thus, biases might be introduced to the estimated mean concentrations when strain subtype variations are not taken in account in the data analysis when comparing different treatment groups in clinical vaccine studies. The results shown in Figure 4 suggest that the parameters relating MFI to protein concentration estimated parameters from the five-parameter logistic regression models are different for different H5 strain subtypes and are also different from the estimated parameters in the common standard curve used for all H5 strain subtypes.
Then, we conducted pairwise comparisons between different treatment groups across different time points within the framework of the linear mixed effects model (Figure 5). Among the 276 pairwise comparisons resulting from the linear mixed effects models conducted in SAS v9.4 (SAS Institute Inc., Cary, NC), 234 pairwise comparisons showed significant differences when the strain subtype variation was taken into account. Meanwhile, 230 out of 276 pairwise comparisons showed significant differences when the strain subtype variation was not taken into account in the data analysis. Although there were only 4 differences in the total number of rejections, there were 22 pairwise comparisons having inconsistent results between the analysis taking the strain subtype variation into account and the analysis not taking the strain subtype variation into account. Table 3 gives some examples of inconsistent results in those pairwise comparisons. It is noticeable from Table 3 that some significant differences might be missed and some significant differences might be false positives if subtype variation is not taken into account in the data analysis. Examples from Table 3 indicate the results of group comparisons in vaccine studies will be affected when strain subtype variation is not taken into account in vaccine data analysis.
3.3. Simulation Study
Monte Carlo simulation studies [23] were conducted to assess the importance of including strain subtype variation in immunoassay when comparing different treatment groups. We suspect that both false positives and false negatives will be inflated if strain subtype variations are not taken into account in vaccine data analysis when comparing different treatment groups, given what we have observed in our analysis of the H5 vaccine data (Table 3). Therefore, the FDR, sensitivity, and specificity were compared between group differential analyses with and without considering strain subtype variations.
3.4. Simulation Description
Using above mPlex-Flu assay data from H5 clinical trial, we estimated the overall mean concentration from the five-parameter logistic regression model with coefficients estimates of , which gave an overall mean concentration of 12.35 in the simulation. The logarithm of IgG antibody reactivity levels from ith treatment group, jth influenza virus strain subtype, and kth sample (; ; ) was simulated according to the following linear regression models:where , denotes the difference between the first treatment group and the second treatment group that takes sequential values from 1 to 2 for true difference situation and takes a value of 0 for no difference situation, and is set at 0 in the simulation. The strain subtype difference was denoted by . For simplicity, three strain subtypes were included in the simulation. The parameter denoted the difference between strain subtype 1 and strain subtype 3, which follows a random normal distribution with mean and standard deviation of 0.08. Similarly, denotes the difference between strain subtype 2 and strain subtype 3, which follows a random normal distribution with mean and standard deviation . The parameter is set at 0 in the model.
In the simulations, we used four sets of combinations of and in the simulation studies: (1) ; (2) ; (3) ; and (4) . The parameter denotes random errors that have independently identical normal distributions with mean and variance . According to the experimentally measured IgG concentration data, plausible values for σ could be and plausible values for τ could be sequential values from 0.5 to 1.2 with an interval of 0.1. We used to obtain a mean variance value of 0.06, i.e., .
We simulated random samples of paired data from the linear regression equation, where is the design matrix for the linear regression model. Among the random samples, the proportion with true differences between the treatment groups was set at (). When , there are random samples having true differences between the treatment groups. The magnitude of the true differences ranged from 1-2 with an increment of from the first to the 250th random sample. The true difference between the treatment groups is 0 for the remaining 750 samples in the simulation. The sample size for each random sample was set at for each of the treatment groups.
Traditional approaches to quantify the IgG antibodies against different influenza HA subtypes in human serum use a common standard curve to estimate the IgG concentration across all strains and subtypes. Such approaches generally test for a statistically significant difference between treatment groups without considering subtype antibody binding variations. The following regression models are commonly used to fit the logarithm of the concentration data:where denotes the logarithm of the concentration data for ith group and kth sample within the ith group, denotes the differences between treatment groups and . is assumed to have independent identical distribution of .
Our approach takes the variation in subtype antibodies and reagents into account. We fit a standard curve for each of the viral HA subtypes using a five-parameter logistic regression model with strain-specific parameters fitted to the logarithm of the concentration data:where denotes the logarithm of the concentration data for ith group, jth strain, and kth sample within the ith group jth strain, denotes the differences between treatment groups and , denotes the difference between strain subtypes 1 and 3, denotes the difference between strain subtypes 2 and 3, and . is assumed to have independent identical distribution of . To simplify our simulation studies, we assumed that the correlations among the three subtypes were zero.
3.5. Simulation Results: Improved FDR Control and Specificity with Strain Subtype Variation Considered
Figure 5 shows the simulation results comparing the treatment groups with and without strain subtype differences taken into account. We next sought to determine if accounting for influenza HA strain variation would affect the statistical comparison of vaccine response treatment groups from a clinical influenza vaccine study. The data were generated from an mPLEX-flu assay of samples collected during a previous study of responses to an H5 influenza vaccine (DMID 08-0059) [14]. The goal of the trial was to determine if there were significant differences in the anti-HA influenza antibody response between three groups that received intramuscular anti-A/Indonesia/5/05 H5 influenza vaccine: UPR—no previous exposure to any H5 vaccine, PR—had been vaccinated once previously against a different H5 influenza strain (either A/Vietnam/1203/04 or a recombinant HA vaccine against A/Hong Kong/156/97(A/HK97)), and MPR—received two sequential vaccinations against the A/Indonesia/5/05 H5 influenza virus.
The FDRs for comparisons between different treatment groups were markedly smaller and the specificity much greater, when the strain subtype differences were taken into account. When differences in strain subtype were not accounted for, the probability of finding differences between treatment groups was much higher with more significant differences identified between the treatment groups. In contrast, considering strain subtype variation did not affect the sensitivity of statistical comparison between different treatment groups.
We also observed a noticeable decrease in FDRs as the proportion of true differences between the treatment groups increased. In contrast, the differences in specificities did not change even as the proportion of true differences between the treatment groups increased. When the variation in influenza HA subtype differences decreased, we found a concomitant decrease in FDRs and an increase in specificity (Table 4). Even when the mean concentration difference between strain subtypes was zero, the FDRs were still much larger and the specificities were still much smaller when comparing differences between the treatment groups. The inflated FDRs appeared largely due to ignoring strain subtype variations and increased as the proportion of true differences between the treatment groups became smaller.
When the sample size in the simulation studies increased to 30, 60, and 120 in each treatment group, we obtained similar results for the number of total rejections, FDR, sensitivity, and specificity (Supplementary Figures 1–3). Thus, only the results from sample size of 15 in each treatment group are presented in Figure 5.
4. Discussion
Every year, the WHO selects influenza vaccine strains trying to pick the best influenza virus strains that would be able to represent the circulating virus strains in same or similar antigenicity of HA protein, on the surface of virus. Furthermore, the traditional way for determination of the antigenicity of one influenza virus is to let this virus isolation to react against a panel of ferret antisera, and each antiserum is generated from naive ferret after the infection of one single-specific influenza virus [2]. However, antigenic data or immunological patterns in human sera are more complicated and difficult to interpret due to exposure histories and cross-reactivity between influenza virus strains [1]. In addition, some important studies showed that early lifetime exposure of influenza virus (imprinting) might provide cross-protection against infection of H5, H7 novel subtype influenza viruses [24]. It is essential to develop an efficient and high throughput assay for the evaluation of those cross-reactive antibodies. This novel technique, mPlex-Flu assay, allows us be able to quickly and accurately estimate the humoral immune response after influenza infection or vaccination and rapidly characterize comprehensive individual- and population-level heterosubtypic immunity of a broad range of influenza strains.
However, how to quantify the antibodies and their cross-reactivities against influenza virus is always a challenge in influenza vaccine studies. The mFlex-Flu assay couples beads with analyte-specific rHAs (antigens) to detect the specific antibodies binding influenza strain-specific HAs. To quantify the amount of active HA-specific antibodies, mPlex-Flu assay assesses both the amount and affinity of antibodies against influenza viral HAs at the same time. Furthermore, there are many modest differences between the replication and infection of subtypes of influenza viruses [25] and the diversity of HA structure and characters between individual subtypes of influenza viruses [26]. In addition, the slight differences in batch, time, and other experiment conditions can also introduce variation from assay to assay. Traditional assays to evaluate specific antibodies against influenza subtype virus or HA, such as HAI [27], MN [28], and ELISA [29], are semiquantitative. They use the highest dilution or endpoint of dilution of serum to determine the titer of the antibodies. Those discrete-ranked readouts of one of 8–14 titer values could introduce imprecision and increase false discoveries. The major problem is that they are not able to provide a precise evaluation normalized by the difference in strains of influenza virus. This presents a big challenge for directly comparing the anti-HA IgG levels against different influenza viruses, within or between subtype of influenza virus, when studying the frequency and binding of cross-reactive antibodies against multiple influenza strains.
In order to generate precise continuous values of antibody levels, which rely on the appropriate standard sample to generate a good standard curve, initially, we set up an ELISA assay with the anti-human IgG antibody standard curve, as described previously [11, 13]. Although using one standard curve can adjust for variation caused by experiment conditions, we still could not determine the types of imprecisions introduced by the variations of deferent strains HAs of influenza virus. In our previous publication [3, 4], we introduced a novel multiplex method to quantitatively measure the concentration of rHA-specific antibodies by using the standard reference serum (STD02), similar to SDT01 [3], which is a mixture serum from four subjects having high titer antibodies against seasonal influenza viruses, based on a study of the estimation of weight-based antibody unite, published by Dr. Quataert [12]. Importantly, we also set up independent standard curves for each analyte (influenza virus HA strain) to convert the MFI units of mPlex-Flu assay into concentration-based antibody units.
Within the mPLEX-Flu assay, the HA from various strains do not directly interact. The one class of interactions that could influence the assay is that of competition for antibodies that bind to regions of different HA strains having the same antigenic sequence (epitopes). In our experimental setting, we use excess serum (with antibodies to multiple antigens) or monocloncal antibodies (bind to a single antigenic site) to minimize or eliminate the binding competition between influenza virus strains. Under these conditions, the binding of anti-HA IgG to one HA variation does not affect binding of another HA variation given there are more than enough antibodies available. Similarly, the standard curve of each subtype antibody concentration can be generated to obtain the antibody concentration for each HA subtype. Thus, the binding of each HA variation with antibodies can be treated as independent binding. We are aware that these conditions may not hold true at much lower antibody concentrations but have found such concentrations to be below the usual range for serum antibody. However, it is important to note that the independence assumption gives us more conservative results for our statistical evaluation than dependent assumption. Thus, the simulation results we obtained using the independent assumption are still valid for dependent situation.
The results of this study showed significant variations in IgG-rHA binding model parameter estimates among different rHA strains. This finding is likely due to differences in reagent surface density and staeric hinderence between subtypic recombinant HA proteins (rHAs). When different standard curves were used for each strain subtype, the concentration differences between different strain subtypes could be taken into account when comparing different treatment groups. When one common standard curve was used for all strain subtypes, the concentration differences between different strain subtypes were embedded in the random errors.
Our simulation studies have shown that without considering the variation in strain subtypes, the Type I error associated with testing differences between treatment groups will be inflated and the specificity will be lowered, compared to analysis with the strain subtype variation taken into account. Our case studies also showed inconsistent results in pairwise group comparisons when we took or did not take the variations in strain subtypes into account. Therefore, the estimated differences of interested group comparisons are less biased if the strain subtype variations are taken into account in the data analysis by estimating concentrations from the individual standard curves of each strain subtype. Meanwhile, the type I error of testing interested group differences will be reduced and the specificity will also be increased. Thus, we recommend taking strain subtype variations into account in clinical vaccine research.
This study provides solid statistic evidence to support our published method to quantify the concentration unit of antibodies in mPlex-Flu assay. It also suggests that it is more accurate to directly compare the concentration units between subtype analytes after adjustment by each individual standard curve.
Data Availability
The data used to support the findings of this study are available from the corresponding author upon request.
Disclosure
The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. None of the above funders had any role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Conflicts of Interest
The authors declare that there are no conflicts of interest.
Authors’ Contributions
DL, JW, and MZ conceived and designed the study. JT directed the influenza vaccine clinical trial (DMID 08-0059) and provided samples. DL conducted simulation studies and analyzed the clinical trial data. DL, JW, and MZ wrote and edited the manuscript. All the authors approved the final version of the manuscript. DL and JW equally contributed to this work.
Acknowledgments
The authors would like to thank Shannon Hilchey for critical reading of the manuscript and Judy Grastorf for her excellent editorial assistance. The authors would like to thank Enago (http://www.enago.com) for the English language review. This work was supported by grants from the National Institutes of Health, National Institute of Allergy and Infectious Diseases, including AI098112 and AI069351 (MZ, JW, and JG) and R21AI138500 (MZ, JW, and JG). The project described in this publication was also supported by the University of Rochester Clinical and Translational Science Award UL1 TR002001 from the National Center for Advancing Translational Sciences of the National Institutes of Health (DL, MZ, JW, and JG).
Supplementary Materials
Supplementary Figures 1–3: simulation study results with total rejections, FDR, sensitivity, and specificity when the sample size is 30, 60, or 120 in each treatment group. (Supplementary Materials)