Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Clinical predictors of severe forms of influenza A(H1N1)pdm09 in adults and children during the 2009 epidemic in Brazil

  • Jose Ueleres Braga

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Writing – original draft, Writing – review & editing

    ueleres@gmail.com

    Affiliations Department of Epidemiology, Social Medicine Institute, Rio de Janeiro, Rio de Janeiro, Brazil, Department of Epidemiology and Quantitative Methods, National School of Public Health, Oswaldo Cruz Foundation, Rio de Janeiro, Rio de Janeiro, Brazil

Abstract

The World Health Organization (WHO) raised the global alert level for the A(H1N1) influenza pandemic in June 2009. However, since the beginning of the epidemic, the fight against the epidemic lacked foundations for managing cases to reduce the disease lethality. It was urgent to carry out studies that would indicate a model for predicting severe forms of influenza. This study aimed to identify risk factors for severe forms during the 2009 influenza epidemic and develop a prediction model based on clinical epidemiological data. A case-control of cases notified to the health secretariats of the states of Rio de Janeiro, São Paulo, Minas Gerais, Paraná, and Rio Grande do Sul was conducted. Cases had fever, respiratory symptoms, positive confirmatory test for the presence of the virus associated with one of the three conditions: (i) presenting respiratory complications such as pneumonia, ventilatory failure, severe acute respiratory distress syndrome, sepsis, acute cardiovascular complications or death; or respiratory failure requiring invasive or non-invasive ventilatory support, (ii) having been hospitalized or (iii) having been admitted to an Intensive Care Unit. Controls were individuals diagnosed with the disease on the same date (or same week) as the cases. A total of 1653 individuals were included in the study, (858 cases/795 controls). These participants had a mean age of 26 years, a low level of education, and were mostly female. The most important predictors identified were systolic blood pressure in mmHg, respiratory rate in bpm, dehydration, obesity, pregnancy (in women), and vomiting (in children). Three clinical prediction models of severity were developed, for adults, adult women, and for children. The performance evaluation of these models indicated good predictive capacity. The area values under the ROC curve of these models were 0.89; 0.98 and 0.91 respectively for the model of adults, adult women, and children respectively.

Introduction

In April 2009, the World Health Organization (WHO) communicated to all countries the occurrence of a public health emergency of international concern (April 2009) caused by infection with a new influenza A H1N1 virus. This infection was believed to be related to the febrile respiratory illness epidemic that had begun in Mexico in March 2009. The virus was finally detected in tests performed on two children in California, United States, on April 17 [1].

This situation led the WHO to raise the pandemic alert level to level 5 and adopt recommendations aimed at reducing the effects of the infection based on the activation of national preparedness plans for the H5N1 influenza pandemic adapted to the new epidemic. The characteristics of this epidemic showed a predominance in children and young adults and a low lethality (<1%), with the majority of cases being of mild-to-moderate influenza-like illness and a higher frequency of deaths in patients with an underlying chronic disease; most cases recovered without specific treatment. Transmission occurred through direct contact or with the respiratory secretions of infected persons. The first estimates based on the analysis of cases in Mexico indicated a lower transmissibility than estimated for previous influenza pandemics [2] and for the severe acute respiratory syndrome (SARS).

Until June 2009, suspected cases of this disease in Brazil were linked to travel abroad or some type of close contact. However, in mid-July 2009, after concluding the epidemiological investigation of a suspected case in São Paulo, the country presented sustained transmission. This led to changes in the identification, investigation, and management of cases of flu syndrome, since any person who had flu symptoms would also be considered a suspected case of influenza A H1N1 infection. These changes were included in the “Influenza Clinical Management and Epidemiological Surveillance Protocol” [3]. Following the recommendation of the World Health Organization (WHO), this scenario indicated the need to prioritize the notification, investigation, laboratory diagnosis, and treatment of cases with severe acute respiratory syndrome (SARS) and those people with risk factors for disease complications; these included individuals under 2 and over 60 years of age, pregnant women, those with chronic diseases, and immunosuppressed people. The new phase of studying the epidemic required monitoring cases in groups at risk of developing serious illness. Knowing the predictors of severe clinical forms of Influenza could help with this monitoring. At the time, Brazil was classified as a country that had a regional spread of this disease.

This study aims to identify the risk factors for the occurrence of severe forms during the 2009 influenza A H1N1 epidemic as well as to propose a prediction model based on clinical epidemiological data of cases notified to the Brazilian Epidemiological Surveillance System.

Materials and methods

The research used a case-control study design [4] of cases of influenza A H1N1 reported to the Health Surveillance of the health departments in the states of Rio de Janeiro, São Paulo, Minas Gerais, Paraná, and Rio Grande do Sul. The target population consisted of children, pregnant women, and adults with symptoms compatible with suspected infection by the influenza A H1N1 virus treated at the Health System.

Cases considered for this investigation were individuals with confirmed infection by the influenza A H1N1 virus with fever, respiratory symptoms, and a positive confirmatory test for the presence of the virus associated with one of the three conditions: (i) presenting respiratory complications such as pneumonia, ventilatory failure, severe acute respiratory distress syndrome, sepsis, acute cardiovascular complications, or death; or respiratory failure requiring invasive or non-invasive ventilatory support (CPAP, BIPAP, NIV, intubation) [4]; (ii) having been hospitalized; or (iii) having been admitted to an intensive care unit.

To study the risk factors for the occurrence of severe cases of influenza A H1N1, three controls were chosen for each case. The criterion used was that they were individuals diagnosed with the disease on the same date (or in the same week) as the cases [5]. Moreover, they should have been treated in the same health unit, hospital, or even intensive care unit if the case was treated there.

The minimum sample size was calculated for an alpha error of 5%, beta of 80%, and three controls for each case, resulting in 500 severe cases and 1,500 controls [6].

This study was approved by the Research Ethics Committee of the Institute of Social Medicine of Rio de Janeiro State University on December 4, 2009 (CAEE 0030.1.259.000–09). It was an observational study with secondary data extracted from medical records in a standardized way in which access to the records respected the precepts of secrecy and confidentiality of data and had the consent of the person responsible for the health institution where the patient received care. So, the need for consent was waived by the ethics committee.

Results

The research was based on data extracted from hospital records. It began in February 2010 with an initial review of the medical records of all patients with a confirmed diagnosis of influenza A H1N1 infection who were hospitalized in the selected cities.

This study included 1,653 individuals. The number of cases and controls distributed among the federative units were as follows: Paraná (253 cases and 154 controls), Rio Grande do Sul (73 cases and 67 controls), Minas Gerais (55 cases and 188 controls), São Paulo (387 cases and 111 controls), and Rio de Janeiro (90 cases and 275 controls).

These participants had a mean age of 26 years, and the study population ranged from newborns to older individuals. They had a low level of education and were mostly women. However, a large proportion of the sample did not reveal their education level, and no differences were observed in this profile when samples from the five federated units were compared. The proportion of pregnant women ranged from 8% to 43% of the samples, but the lack of information was between 30% and 60%; thus, the samples from the federated units showed homogeneity.

Regarding laboratory confirmation, it is worth mentioning that practically all the samples consisted of individuals who had given nasopharyngeal samples collected directly by swab. As for treatment outcomes, over 90% had favorable results, and mortality was 10% among those enrolled in this investigation.

Obesity was found in about 10% of patients, and it was the second most prevalent morbid condition. Only hypertension was more prevalent, affecting almost 14% of patients on average. Cystic fibrosis, tuberculosis, and rheumatoid arthritis were less prominent than the abovementioned diseases, and other less frequent morbid conditions included cerebrovascular disease, Lupus, and acute liver disease.

A small number of patients had some level of immunosuppression, and it included those who had undergone a transplant and were using corticosteroids. This group also comprised those with morbid conditions of intermediate prevalence such as chronic obstructive pulmonary disease (COPD) and diabetes, with proportions close to 5%. In addition, no significant variation was observed in the previous history of disease of the samples from the various federated units.

As for health care, one in every five patients was admitted to the ICU and had an average stay of nine days. More than a fifth of these patients were transferred from other units for hospitalization purposes.

The illness of the study population showed a highly diversified clinical picture. Cough and fever were the most prevalent signs and symptoms at the time of patient admission; convulsion, conjunctivitis, irritability, and drowsiness were the least frequent findings. More than half of the patients had dyspnea, while about a third had headaches, runny nose myalgia, and other symptoms.

Regarding the characteristics of the cases and controls classified by the severity condition adopted by the study, no significant differences were observed between the groups. The participants had similar age, gender, and level of education (Table 1).

thumbnail
Table 1. Biological and social characteristics, diagnostic conditions and outcomes of patients in the case-control study of risk factors for severity of H1N1 influenza, Brazil.

https://doi.org/10.1371/journal.pone.0291843.t001

Laboratory conditions for confirming the disease in H1N1 cases and controls were similar. However, patient outcomes differed between these groups, and the proportion of deaths was five times greater among cases than controls, which is a statistically significant difference. The other characteristics were similar (Table 1).

Obesity, which was prevalent in 10% of patients, and hypertension were similar between cases and controls. The other morbid conditions studied were similar in both groups. Less frequent morbid conditions that were similar among participants in both groups were cystic fibrosis, tuberculosis, and rheumatoid arthritis as well as cerebrovascular diseases, Lupus, and acute liver diseases (Table 2). Other past diseases also had similar distributions in the studied groups.

thumbnail
Table 2. History of previous illnesses of cases and controls of the case-control study of risk factors for severity of H1N1 influenza, Brazil.

https://doi.org/10.1371/journal.pone.0291843.t002

Regarding the history of assistance received, the groups showed important differences. For the presence of signs and symptoms upon hospital admission, severe cases had more important respiratory symptoms, such as dyspnea and cough, compared to controls; they also showed a greater occurrence of fever. The other symptoms did not show a higher frequency among severe cases. In fact, for less specific clinical symptoms, these patients had a highly similar profile (Table 3).

thumbnail
Table 3. Symptoms reported on hospital admission of cases and controls from the case-control study of risk factors for severity of H1N1 influenza, Brazil.

https://doi.org/10.1371/journal.pone.0291843.t003

Initially, exploratory analyses were conducted to identify the main factors related to the severity of cases of Influenza A(H1N1)pdm09. The factors described in the literature and those aspects whose frequency of evaluation and registration in the medical records allowed for analysis were taken as a basis. The first model studied and constructed was the one related to the severity of cases in adults (Table 4).

thumbnail
Table 4. Risk factors associated with the severity of influenza A (H1N1) in adults, Brazil.

https://doi.org/10.1371/journal.pone.0291843.t004

Considering only adult patients, the factors most strongly associated with severity in the bivariate analysis were drowsiness and mental confusion. Only the signs of systolic blood pressure and respiratory rate were associated with statistical significance at the 5% level. Obesity was associated with severity when putative confounders were not considered.

After adjustment for the set of clinical factors, it was observed that only systolic blood pressure, respiratory rate, and dehydration remained associated when multiple logistic regression was used. In addition to these aspects, biological factors such as age and sex were evaluated and were not associated with severity (Table 4).

As pregnancy is considered a condition that may be associated with severity, it was necessary to make a specific model for women. In this case, in addition to the aspects used for the general adult population, the condition of pregnancy was included among the factors studied (Table 4).

Similar to the prediction model studied for adults in general, in pregnant women, most of the factors described in the literature were associated with severity in the bivariate context, which draws attention to the importance of dehydration appearing in this adult model. However, the aspects that should be emphasized the most are obesity, which gains importance for predicting severity, and pregnancy, which appears to be the second most important factor for predicting this clinical condition (Table 4).

As we considered the elaboration of a specific model for women, we also decided to construct a specific one for the group of patients under 13 years of age as the factors that influence the occurrence of severity in this group are different from those affecting adults.

The specific literature on risk factors for severe forms of Influenza A(H1N1)pdm09 indicates a set of factors seemingly more specific to this age group, such as the existence of clinical signs of intercostal retraction and nasal flaring, in addition to classic ones such as dehydration.

Similar to the models built for predicting severity in adults, exploratory analyses were initially performed to identify important associations with all the factors described in the literature, using data extracted from the medical records.

In patients younger than 13 years, despite the large number of factors associated with the severity of Influenza A(H1N1)pdm09 in the bivariate context, no strong associations were found with the factors observed in adult models. Biological aspects such as age and gender were not associated, even when considered without adjustment for the other factors; the same occurred for obesity. It is noteworthy that, as in the adult model, only respiratory rate and the occurrence of vomiting were associated with severe disease in the multivariate context (Table 4).

The models built in this work show good performance as they included performance measures that indicate good predictive capacity. The area under the ROC curve values of these models were 0.89, 0.98, and 0.91 for the model of adults, adult women, and children, respectively.

Discussion

The main research findings were the prediction models of severe forms of Influenza A(H1N1)pdm09 specific for adults, adult women, and children. These models showed a high ability to discriminate severe forms since they have high values of area under the curve. However, the fact that these models were produced based on the occurrence of the 2009 influenza epidemic in Brazil could bring limitations about the external validity of this prediction capacity [7]. The most important predictors identified in our research were systolic blood pressure in mmHg, respiratory rate in bpm, dehydration, obesity, pregnancy (in women), and vomiting (in children). It is worth noting that the good performance of these models can help improve approaches to surveillance, case management, and coping with future epidemics.

The need to overcome the difficulties of constructing and validating prediction models to predict the most severe clinical conditions during the epidemic has mobilized several researchers to disseminate epidemiological methods applied to the construction and validation of these models [8]. Even so, the absence of external validation in the development process does not make models less important than those produced in our work.

The literature shows few studies of construction and validation of prediction related to influenza. Two stand out—a study on the prediction of respiratory infection by the influenza virus [9] and a systematic review of models for predicting this viral infection [10]. However, no publication is available on the development and validation of a prediction model for severe forms including adults, adult women, and children.

Concerning risk factors for severe forms of Influenza A(H1N1)pdm09, it should be noted that few studies have been published in the literature. Many studies have described the characteristics of severe cases and reported that underlying chronic diseases, delay in antiviral therapy, pregnancy, and obesity may be risk factors [1113].

A study conducted in the United Kingdom [14] that used an epidemiological design (case note-based investigation) whose control was the population of London and Northern Ireland (> 70% of cases) sought to identify risk factors for hospitalization and outcomes unfavorable conditions during the first wave of the 2009 Influenza A(H1N1)pdm09 pandemic. The authors concluded that an abnormal chest X-ray or an elevated CRP level indicates a potentially serious outcome, especially in patients registered as obese or who have lung diseases other than asthma or COPD. They also indicated that these findings support the use of the pandemic vaccine in pregnant women, children < 5 years of age, and people with chronic lung disease. Similarly, Myles et al. [15] sought to identify predictors of clinical outcomes in a national cohort hospitalized during both waves of the 2009–2010 Influenza A(H1N1)pdm09 epidemic in the United Kingdom, using a profile comparison of patients with seasonal winter admissions by acute respiratory infection. They concluded that independent predictors of severe outcome were age between 55 and 64 years, chronic lung disease (not asthma, non-chronic obstructive pulmonary disease), neurological disease, registered obesity, late admission (≥ 5 days after illness onset), pneumonia, C-reactive protein ≥ 100 mg/liter, and the need for supplemental oxygen or intravenous fluid replacement on admission.

Fang et al. [16] conducted a case-control study to explore risk factors for severe cases of the 2009 Influenza A(H1N1)pdm09, with mild cases as controls. They randomly selected mild and severe cases (230 cases each) from nine cities in Zhejiang Province, China, and performed a case-control study. They found that it took an average of five days for severe 2009 Influenza A(H1N1)pdm09 cases to start antiviral therapy far from baseline—two days after mild cases. Having underlying chronic illnesses and poor psychological health combined with underlying chronic illnesses were two important risk factors for severe cases, and timely antiviral therapy was a protective factor. The authors concluded that psychological health education and intervention, as well as timely antiviral therapy, could not be ignored in the prevention, control, and treatment of 2009 Influenza A(H1N1)pdm09.

Ren et al. [17] conducted a case-control study with 343 critically ill hospitalized patients and 343 randomly selected mild controls. The diagnosis was established by assessing clinical symptoms and confirmed by real-time reverse transcriptase polymerase chain reaction assay. Severe or mild patients were classified according to uniform criteria issued by the Chinese Ministry of Health. According to the authors, multivariate logistic regression analysis showed that overweight or obese individuals admitted to the hospital with H1N1 flu were more likely to have severe manifestations of the disease. Moreover, individuals younger than 5 years old or older than 60 years old had an increased risk of severe manifestations. They also observed an increased risk among individuals with a longer time interval from the onset of symptoms to hospital admission and found that those with chronic illnesses were at increased risk of severe manifestations of the H1N1 flu.

Studies on the risk factors for hospitalization for Influenza A(H1N1)pdm09 have been conducted in several countries, finding the causes of hospitalization to be many stools as a result of severe evolution of clinical conditions. Launes et al. [18] conducted a multicenter study (case-control design) to compare sociodemographic data and preexisting medical conditions of risk in patients with 2009 Influenza A(H1N1)pdm09 infection who required hospitalization and those treated on an outpatient basis. Cases were patients aged 6 months to 18 years hospitalized for influenza syndrome, for whom infection with the 2009 Influenza A(H1N1)pdm09 was confirmed using transcription polymerse chain reaction (TR-PCR). Controls were patients aged between 6 months and 18 years with confirmed 2009 Influenza A(H1N1)pdm09, treated as outpatients. Cases were 195 and controls 184. Launes et al. concluded that hospitalization was more frequent in children aged < 2 years, in those with neurological and/or neuromuscular diseases, and those whose parents had an education level lower than high school. Children younger than 2 years old, with neurological diseases, and from families with a lower level of education were at higher risk of hospitalization due to infection with 2009 Influenza A(H1N1)pdm09.

Another study of risk factors for hospitalization was conducted by Ward et al. [19] in Sydney, Australia, which included included 302 cases and 603 controls. In a logistic regression model, after adjusting for age and sex, risk factors for hospitalization were pregnancy, immunosuppression, pre-existing lung disease, asthma requiring regular preventive medication, heart disease, diabetes, and current smoker or former smoker.

Some investigations have sought to answer whether obesity is a predictor of the evolution of influenza cases that occur during an epidemic. A case-control study was conducted in seven regions of Spain to investigate the association between body mass index (BMI) and the risk of hospitalization for influenza in 2009–2010 and 2010–2011. Martín et al. [20] selected cases among patients hospitalized for > 24 h with influenza-like illness, acute respiratory infection, septic shock, or multiple organ failure among whom 2009 Influenza A(H1N1)pdm09 virus infection was confirmed by reaction in polymerase chain with real-time reverse transcription (RT-PCR). Hospitalized patients (n = 755) with laboratory-confirmed influenza were individually matched by age, date of admission/appointment, and province, with an outpatient (n = 783) with laboratory-confirmed influenza and an outpatient control (n = 950). Higher BMI was associated with an increased risk of hospitalization compared with outpatient cases and outpatient controls. Compared with normal weight, type I obesity, type II obesity, and type III obesity were associated with a higher likelihood of hospitalization compared with outpatient cases. Compared with normal weight, type II obesity and type III obesity were associated with a higher likelihood of hospitalization compared with outpatient controls.

A condition not investigated in our study was whether the vaccination status for the specific influenza vaccine would be a predictor of severe forms of the disease. This was not possible because no vaccination was conducted in Brazil during the investigation’s field phase. However, enough studies are available for systematic reviews with meta-analyses to be produced. The systematic review conducted by Rondy et al. [21] included case-control studies; the authors identified 3,411 publications, of which 30 met the inclusion criteria. Between 2010–11 and 2014–15, vaccine effectiveness was 41% (95% CI: 34; 48) for any flu (51%–95% CI: 44; 58).

We consider that the three prediction models of severe clinical forms of Influenza A(H1N1)pdm09 specific for adults, adult women, and children can be used to address future influenza epidemics—at least to guide the investigation of cases with a greater probability of evolving into severe forms.

Acknowledgments

We appreciate the help of collaborators Ana Freitas Ribeiro, Guilherme Loureiro Werneck, Bernardino Claudio de Albuquerque, Sonia Raboni and, Ricardo Kuchenbecker.

References

  1. 1. Centers for Disease Control and Prevention CDC. Swine influenza A (H1N1) infection in two children—Southern California, March-April 2009. MMWR. 2009;58: 400–2. pmid:19390508
  2. 2. Fraser C, Donnelly CA, Cauchemez S, Hanage WP, Van Kerkhove MD, Hollingsworth TD, et al. Pandemic Potential of a Strain of Influenza A (H1N1): Early Findings. Science. 2009;324: 1557–1561. pmid:19433588
  3. 3. BRASIL, Ministério da Saúde, Secretaria de Vigilância em Saúde, Gabinete Permanente de Emergências de Saúde Pública. PROTOCOLO DE MANEJO CLÍNICO E VIGILÂNCIA EPIDEMIOLÓGICA DA INFLUENZA. 2009 p. 32.
  4. 4. Schlesselman JJ, Stolley PD. Case-control studies: design, conduct, analysis. New York: Oxford University Press; 1982.
  5. 5. Wacholder S, McLaughlin JK, Silverman DT, Mandel JS. Selection of controls in case-control studies. I. Principles. Am J Epidemiol. 1992;135: 1019–28. pmid:1595688
  6. 6. Wacholder S, Silverman DT, McLaughlin JK, Mandel JS. Selection of controls in case-control studies. III. Design options. Am J Epidemiol. 1992;135: 1042–50. pmid:1595690
  7. 7. Chen L. Overview of clinical prediction models. Ann Transl Med. 2020;8: 71. pmid:32175364
  8. 8. Steyerberg EW, Vergouwe Y. Towards better clinical prediction models: seven steps for development and an ABCD for validation. Eur Heart J. 2014;35: 1925–1931. pmid:24898551
  9. 9. Vuichard-Gysin D, Mertz D, Pullenayegum E, Singh P, Smieja M, Loeb M. Development and validation of clinical prediction models to distinguish influenza from other viruses causing acute respiratory infections in children and adults. PloS One. 2019;14: e0212050. pmid:30742654
  10. 10. Ebell MH, Rahmatullah I, Cai X, Bentivegna M, Hulme C, Thompson M, et al. A Systematic Review of Clinical Prediction Rules for the Diagnosis of Influenza. J Am Board Fam Med JABFM. 2021;34: 1123–1140. pmid:34772768
  11. 11. Echevarría-Zuno S, Mejía-Aranguré JM, Mar-Obeso AJ, Grajales-Muñiz C, Robles-Pérez E, González-León M, et al. Infection and death from influenza A H1N1 virus in Mexico: a retrospective analysis. The Lancet. 2009;374: 2072–2079. pmid:19913290
  12. 12. Falagas M, Koletsi P, Baskouta E, Rafailidis P, Dimopoulos G, Karageorgopoulos D. Pandemic A (H1N1) 2009 influenza: review of the Southern Hemisphere experience. Epidemiol Infect. 2011;139: 27–40. pmid:20920380
  13. 13. Enstone JE, Myles PR, Openshaw PJ, Gadd EM, Lim WS, Semple MG, et al. Nosocomial Pandemic (H1N1) 2009, United Kingdom, 2009–2010. Emerg Infect Dis. 2011;17: 592. pmid:21470446
  14. 14. Nguyen-Van-Tam JS, Openshaw PJM, Hashim A, Gadd EM, Lim WS, Semple MG, et al. Risk factors for hospitalisation and poor outcome with pandemic A/H1N1 influenza: United Kingdom first wave (May-September 2009). Thorax. 2010;65: 645–651. pmid:20627925
  15. 15. Myles PR, Semple MG, Lim WS, Openshaw PJ, Gadd EM, Read RC, et al. Predictors of clinical outcome in a national hospitalised cohort across both waves of the influenza A/H1N1 pandemic 2009–2010 in the UK. Thorax. 2012;67: 709–717. pmid:22407890
  16. 16. Fang L, Lin J, Chai C, Yu Z. Risk factors for severe cases of 2009 influenza A (H1N1): a case control study in Zhejiang Province, China. PLoS One. 2012;7: e34365. pmid:22470561
  17. 17. Ren Y, Yin Y, Li W, Lin Y, Liu T, Wang S, et al. Risk factors associated with severe manifestations of 2009 pandemic influenza A (H1N1) infection in China: a case–control study. Virol J. 2013;10: 1–7.
  18. 18. Launes C, García-García J-J, Martínez-Planas A, Moraga F, Astigarraga I, Arístegui J, et al. 2009 H1N1: risk factors for hospitalization in a matched case-control study. Eur J Pediatr. 2012;171: 1127–1131. pmid:22430351
  19. 19. Ward K. Case-Control Study of Risk Factors for Hospitalization Caused by Pandemic (H1N1) 2009. Emerg Infect Dis. 2011 [cited 23 Aug 2023]. pmid:21801617
  20. 20. Martín V, Castilla J, Godoy P, Delgado-Rodríguez M, Soldevila N, Fernández-Villa T, et al. High Body Mass Index as a Risk Factor for Hospitalization Due to Influenza: A Case–Control Study. Arch Bronconeumol Engl Ed. 2016;52: 299–307.
  21. 21. Rondy M, El Omeiri N, Thompson MG, Levêque A, Moren A, Sullivan SG. Effectiveness of influenza vaccines in preventing severe influenza illness among adults: A systematic review and meta-analysis of test-negative design case-control studies. J Infect. 2017;75: 381–394. pmid:28935236