http://orcid.org/0000-0003-4816-4728
Figures
Abstract
Background
Previous studies have shown maternal, inflammatory, and socioeconomic variables to be associated with growth and neurodevelopment in children from low-income countries. However, these outcomes are multifactorial and work describing which predictors most strongly influence them is lacking.
Methodology/Principal findings
We conducted a longitudinal study of Bangladeshi children from birth to two years to assess oral vaccine efficacy. Variables pertaining to maternal and perinatal health, socioeconomic status, early childhood enteric and systemic inflammation, and anthropometry were collected. Bayley-III neurodevelopmental assessment was conducted at two years. As a secondary analysis, we employed hierarchical cluster and random forests techniques to identify and rank which variables predicted growth and neurodevelopment. Cluster analysis demonstrated three distinct groups of predictors. Mother’s weight and length-for-age Z score (LAZ) at enrollment were the strongest predictors of LAZ at two years. Cognitive score on Bayley-III was strongly predicted by weight-for-age (WAZ) at enrollment, income, and LAZ at enrollment. Top predictors of language included Rotavirus vaccination, plasma IL 5, sCD14, TNFα, mother’s weight, and male gender. Motor function was best predicted by fecal calprotectin, WAZ at enrollment, fecal neopterin, and plasma CRP index. The strongest predictors for social-emotional score included plasma sCD14, income, WAZ at enrollment, and LAZ at enrollment. Based on the random forests’ predictions, the estimated percentage of variation explained was 35.4% for LAZ at two years, 34.3% for ΔLAZ, 42.7% for cognitive score, 28.1% for language, 40.8% for motor, and 37.9% for social-emotional score.
Conclusions/Significance
Birth anthropometry and maternal weight were strong predictors of growth while enteric and systemic inflammation had stronger associations with neurodevelopment. Birth anthropometry was a powerful predictor for all outcomes. These data suggest that further study of stunting in low-income settings should include variables relating to maternal and prenatal health, while investigations focusing on neurodevelopmental outcomes should additionally target causes of systemic and enteric inflammation.
Author summary
Children from low-income settings experience linear growth faltering and neurodevelopmental delay that have been associated with maternal, socioeconomic, and infectious/inflammatory variables. Given the interdependent nature of these associations, understanding which variables are the best predictors of poor outcomes has been difficult. We conducted a longitudinal study of Bangladeshi children from birth to two years and collected predictors assessing maternal, inflammatory, and socioeconomic aspects of early childhood in Bangladeshi children. We conducted a random forests analysis to rank predictors associated with growth and neurodevelopment. Linear growth was best predicted by birth anthropometry and maternal weight. Cognitive function was predicted by birth anthropometry, socioeconomic status, and systemic inflammation. The receipt of the rotavirus vaccine and a combination of systemic inflammatory, maternal, and socioeconomic variables predicted language score. Motor score was predicted by systemic inflammation with enteric inflammatory markers having a reverse relationship. Social-emotional development was predicted by systemic inflammation, birth anthropometry, and economic means. This work demonstrates that specific pathways are responsible for different aspects of growth and development. Our data suggest that studies investigating pediatric stunting in low-income settings should focus on maternal and prenatal variables while those focused on neurodevelopmental outcomes should additionally target causes of systemic and enteric inflammation.
Citation: Donowitz JR, Cook H, Alam M, Tofail F, Kabir M, Colgate ER, et al. (2018) Role of maternal health and infant inflammation in nutritional and neurodevelopmental outcomes of two-year-old Bangladeshi children. PLoS Negl Trop Dis 12(5): e0006363. https://doi.org/10.1371/journal.pntd.0006363
Editor: Zulfiqar A. Bhutta, The Hospital for Sick Children, CANADA
Received: September 8, 2017; Accepted: March 4, 2018; Published: May 29, 2018
Copyright: © 2018 Donowitz et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data used used in this analysis is available in Supporting Information files S1–S3 Datasets.
Funding: This work was supported by a grants to WP from the Bill & Melinda Gates Foundation (https://www.gatesfoundation.org) and from NIH (https://www.niaid.nih.gov/; R01 AI043596) and to JRD from the Pediatric Scientist Development Program (https://www.cincinnatichildrens.org/education/research/psdp; 5K12HD000850). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
159 million children under five years old, or 23.8% of the world’s population in this age range, are stunted (length-for-age Z score [LAZ] < -2 standard deviations [SD]) [1]. In a pooled analysis, stunting conferred a hazard ratio of 2.28 for mortality prior to five years of age with severe stunting (LAZ < -3 SD) having a hazard ratio of 5.48 [2]. It has also been suggested that growth deficits early in life lead to obesity, type II diabetes, and metabolic disturbances later in life [3]. Height has been positively associated with earnings suggesting that early life adversity affecting growth leads to an immense loss of “human capital” throughout much of the world [4]. Additionally, stunting and infection have been associated with neurodevelopmental deficits, compounding the loss to productivity [3].
Both growth and neurodevelopment are multifactorial, which makes designing effective interventions difficult, especially in low- and middle- income countries (LMICs) where a variety of interconnected insults are present. Systemic inflammation, febrile episodes, lack of primary vaccines, lower socioeconomic status, and poor sanitation have all been directly associated with stunting in children from LMICs [5–11]. Environmental enteric dysfunction (EED), hallmarked by enteric inflammation, has also been shown to be associated with deficits in linear growth [6, 12–14]. Importantly, EED has been identified as a distinct entity from diarrheal disease although pathogen carriage may play a role in its development [15–18].
In addition to postnatal factors such as nutrition and inflammation, prenatal and maternal factors have also been correlated with growth. Maternal anthropometrics and maternal education have both been associated with stunting in children living in LMICs [7, 9, 19, 20]. In a multinational study, a 1 cm increase in maternal height was associated with a 1.2% decrease in risk of child mortality [21]. Additionally, birth anthropometry is a strong predictor of postnatal growth suggesting prenatal insults effect stunting [6, 9].
Associations between aspects of childhood life in LMICs and neurodevelopmental outcomes have also been described. Lower neurodevelopmental scores have been associated with diarrheal disease in some studies [22–24] but not in others [25]. The effect of enteric infection on neurodevelopment may be pathogen-specific as deficits have been associated with giardiasis and cryptosporidiosis specifically [23, 26]. Early childhood systemic inflammation and febrile illness have also been associated with poor neurodevelopmental outcomes [27, 28]. On a population level, average national IQ was associated with overall burden of infectious diseases suggesting an inflammatory pathway mediating effects on neurodevelopment [29]. Additionally, stunting has been associated with poor neurodevelopmental outcomes although the nature of this relationship remains undefined [3, 30–33].
Different types of insults affect separate aspects of neurodevelopment [34]. Prenatal and maternal factors including maternal malnutrition have been associated with decreased problem solving and motor function [35, 36]. Early life anthropometrics have been associated with cognitive and language function [34]. In one study breastfeeding was associated with improved language skills but not social-emotional/behavioral skills [37]. Neonatal sepsis has been linked to decreased motor and cognitive function but not social-emotional function [38, 39]. Systemic inflammation in animal models and increased intestinal permeability in humans has been linked to social-emotional function [40, 41]. The combination of these findings suggest a need to assess neurodevelopment directly and with subscale analysis.
Many of the variables associated with poor growth and neurodevelopment are not independent but rather interdependent [42, 43]. This has made analysis of their individual importance in these outcomes difficult. Our objective was to clarify which aspects of childhood in LMICs are the strongest predictors of both growth and neurodevelopment.
Methods
We conducted a longitudinal study from birth to two years in Bangladeshi infants and collected data assessing maternal health, socioeconomic status, sanitary conditions, and enteric and systemic inflammation in early childhood. We utilized random forests analysis, an ensemble machine learning method, to identify and rank predictors of linear growth and neurodevelopment. The predictability of top variables from random forests was estimated from a linear model and expressed as the percentage of variation. To validate our findings, the same set of predictive variables used for random forests were also analyzed in a penalized linear model with smoothly clipped absolute deviation (SCAD) penalty.
Study design
The Performance of Rotavirus and Oral Polio Vaccines in Developing Countries (PROVIDE) study is a longitudinal study of Bangladeshi infants. The primary objective of the PROVIDE study was to determine if there was an association between EED and the underperformance of oral vaccines with the analysis described here being secondary. Detailed methods of this study have been published elsewhere [6, 44]. Briefly, 700 children were enrolled within one week of birth. Participants were randomized to receive the Rotarix oral rotavirus vaccine or not and all children received the oral polio vaccine. A rolling admission spanned from May 2011 through November 2014. Results of this study examining the association of biomarkers of EED and oral polio vaccine failure, rotavirus vaccine failure, growth through one year of age, small intestine bacterial overgrowth, the impact of enteropathogens on oral rotavirus and polio vaccination, and the association of Rotarix vaccination and serum zinc levels with severe rotavirus diarrhea have been published elsewhere [6, 45–47].
Study population
PROVIDE was conducted in the urban borough of Mirpur in Dhaka, Bangladesh. The area is densely populated with a mean of 5 people living in 1.5 rooms. Over 95% of the construction is of tin or mud brick. Uncovered sewer drains flow throughout the area and abut 59% of dwellings. Our subjects tended to come from the lower socioeconomic strata of Mirpur due to the area in which recruitment occurred and the location of our study clinic.
Rotavirus vaccination
All children received vaccines, administered by the study staff, included in the Bangladesh Expanded Programme on Immunization, including the oral polio vaccine. Children were randomized after enrollment to receive the oral rotavirus vaccine Rotarix (GlaxoSmithKline plc., Middlesex, UK) or not. Children randomized to the Rotarix vaccine arm received two doses at 10 and 17 weeks of age. Rotavirus vaccination was assessed as a dichotomous predictor, either receiving the vaccine or not.
Biomarker, socioeconomic, anthropometric, and Bayley assessments
Stool and serum for biomarker analysis was collected within 7 days of the scheduled study visit and were immediately stored at 4°C. Samples were transported from our field office to The International Centre for Diarrhoeal Disease Research, Bangladesh Parasitology Laboratory and stored at -80 °C within 4 hours of collection. They were then pulled and analyzed in batches.
Plasma activin, plasma ferritin, plasma anti-lipopolysaccharide (LPS) antibody, plasma retinol binding protein (RBP), plasma soluble cluster designation 14 (sCD14), plasma zinc, fecal myeloperoxidase, fecal calprotectin, fecal alpha-1 antitrypsin, fecal neopterin, fecal Reg 1B, plasma vitamin D, plasma C-reactive protein (CRP), and Cytomegalovirus (CMV) status were assessed via commercially available ELISA kits. CMV status was dichotomized to positive or negative per manufacturer’s specifications (Abcam, inc. Cambridge, Ma USA). Mannitol recovery was assessed via urine high performance liquid chromatography after giving children a standardized mannitol load. Plasma cytokine analysis was conducted via a commercially available Human BioPlex Pro assay [6, 44].
Plasma activin, plasma cytokines, and plasma CRP were chosen as markers of systemic inflammation. Plasma ferritin, RBP, and zinc were chosen as both acute phase reactants and key nutritional variables. Vitamin D was also selected as a key nutritional measure. Fecal myeloperoxidase, fecal calprotectin, fecal alpha-1 antitrypsin, fecal neopterin, and fecal Reg 1B were selected as markers of enteric inflammation and damage. Mannitol recovery, anti-LPS Ab, and sCD14 were selected as markers of intestinal permeability.
Diarrheal surveillance to calculate days of diarrhea was conducted by field research assistants who visited the homes of the participants twice per week. Maternal and socioeconomic data were collected at the time of enrollment via questionnaire. Mother’s level of education achieved was collected then dichotomized to any formal education or no formal education. Presence of an open drain directly outside the home, family’s use of a septic tank or toilet (as opposed to slab latrines, pit latrines, open latrine, hanging latrines, or open defecation), use of a toilet shared by other families, and use of any method of improved water treatment were also assessed via questionnaire. Anthropometric assessment (including maternal anthropometry) was conducted by study physicians trained in the procedure using measuring boards, measuring tape, and calibrated scales as appropriate for size and age. Anthropometry was measured at enrollment and at 16 scheduled study visits throughout the 2-year study period.
A trained psychologist assessed neurodevelopmental scores at two years of age using a version of the Bayley Scales of Infant and Toddler Development, Third Edition (Bayley-III) that was adapted to be culturally appropriate to Bangladeshi children. Despite cultural adaptation, this version was not normalized to the Bangladeshi population. This version of the Bayley III has been used in other studies by our group and was shown to have high short term (within 7 days) retest reliability (r > 0.80) and high inter-observer reliability (r = 0.99) [27, 28].
Statistical analysis
LAZ, weight-for-age Z score (WAZ), and weight-for-height Z score (WHZ) were calculated using the World Health Organization software WHO Anthro (version 3.2.2). CRP was measured at 4 time points (6, 18, 40, and 53 weeks). The variable “CRP index” was created as a measure of sustained inflammation. For each measurement, if a child was in the top 50th percentile for that time point, they were given a score of 1. “CRP Index” was created by summing the scores given for all four CRP measurements and thus ranged from 0 to 4. Cytokines were discretized into <50th percentile, the 50th– 75th percentile, and >75th percentile. All other variables were either dichotomous or continuous based on the nature of the variables.
Separate datasets were created for anthropometric and neurodevelopmental outcomes. Any child with an incomplete data set for the specified outcome was removed from the analysis. Outliers in predictors, defined as any value > 5 SD from the mean, were excluded from the analysis. 28 subjects for anthropometric analysis and 22 subjects for neurodevelopmental analysis were excluded. Outliers were not assessed in outcome measurements. Differences in enrollment characteristics between the remaining subjects and the original cohort who had complete enrollment data were assessed via Mann-Whitney U tests and χ2 tests as appropriate.
Pearson correlation for all predictive variables was calculated using the dataset constructed for anthropometry. Hierarchical clustering to examine relationships between variables was performed and depicted as a cluster dendrogram. A dissimilarity index of 1.75 was chosen for the clustering cutoff in order to describe how larger groups of the variables were related. Each variable was color-coded based on which of the three clusters it was in and this color-coding was used to identify variables in the random forests plots.
Outcomes of interest for the predictive models included LAZ at two years of age, the change in LAZ from enrollment to two years (ΔLAZ), and the four components of the Bayley-III (cognitive, language, motor, and social-emotional). A separate random forests analysis was conducted for each of our outcomes of interest to select and rank predictive variables. Conditional random forests analyses were performed to account for the correlations between predictors with a threshold of Pearson’s correlation coefficient ≥0.2. Variable importance values (VIMP) were calculated for all predictors and then scaled based on the predictor with the highest VIMP in that analysis (sVIMP). In order to determine the direction of the association between variables and outcomes, dependence plots between predictors and outcomes of interest were generated for the top 15 predictors.
As a validation, penalized linear regression analyses with SCAD penalty were performed on the same datasets. For SCAD analyses, dummy variables for cytokine measurements were created and if either the 50th– 75th or the >75th percentile was selected, the other was forced into the model.
To assess the predictability from the random forests analyses, for each outcome, a mean squared error was calculated using the predicted value from the random forests model and the observed values, and then percentage of variation explained by the predictors was calculated. Percentage of variation explained was also calculated from the SCAD model. All analyses were done using R software. The statistical package ‘party’ version 1.2–2 from February 27, 2017 was used for conditional random forests. The statistical package ‘grpreg’ version 3.0–2 from July 11, 2016 was used for variable selection with SCAD.
Ethics statement
The PROVIDE study was approved by the Research Review and Ethics Review Committees at The International Centre for Diarrhoeal Disease Research, Bangladesh and by the Institutional Review Boards at the University of Virginia and the University of Vermont. Informed consent was obtained from parents for their child’s participation in this study. All data analyzed were anonymized.
Results
Complete data sets of predictors included in this study were available for 371 subjects for anthropometry and 308 subjects for Bayley-III neurodevelopmental assessment once outliers were removed (Table 1). 661 subjects had complete enrollment datasets. There was no significant difference in enrollment characteristics between either the anthropometry dataset or the neurodevelopmental dataset used in this analysis and the original cohort except for maternal education (Table 2). The average LAZ at two years was -1.7±1.6 SD. The average ΔLAZ from enrollment to two years was -0.9±1.6 SD. 33.3% of children had an LAZ <-2 SD by two years of age (Fig 1). The average Bayley-III scores were 90.7±5.8, 98.6±8.5, 94.9±7.4, and 91.2±5.8 for cognitive, language, motor, and social-emotional, respectively.
Height and weight were taken at 3-month intervals and transformed to standardized Z scores. The X-axis depicts the child’s age while the Y-axis depicts the percentage of children in the cohort who had a LAZ, WAZ, or WHZ <-2 SD.
Hierarchical clustering
The hierarchical cluster analysis demonstrated three distinct major clusters, similar to previous analysis of this data [6] (S1 Fig). Systemic cytokines continued to cluster tightly as in the previous analysis. However, enrollment anthropometry, as opposed to week 18 anthropometry used previously, more closely correlated with sanitation. Economic status (income and expenditure) closely clustered with biomarkers of enteric inflammation. CRP index was also in this cluster. Overall, variables from each cluster tended to represent that cluster across our random forests analyses.
Predictors identified by random forests analysis
sVIMP values from the conditional random forests analyses are depicted for the top ranked variables in Fig 2 and dependence plots for all outcomes in S2–S7 Figs. For LAZ at two years as a static measure, maternal weight (index sVIMP, 1.0) and LAZ at enrollment (sVIMP 0.57) were substantially stronger predictors than the remainder. There was a substantial drop in sVIMP between LAZ at enrollment and the next highest predictor, which was mannitol recovery at week 12 (sVIMP 0.15). For ΔLAZ from enrollment to two years, LAZ at enrollment became the strongest predictor (index sVIMP, 1.0), followed by maternal weight (sVIMP 0.33). Overall, birth anthropometry and maternal weight far surpassed all other variables in terms of their ability to predict anthropometry at two years and growth (Fig 2A & 2B).
Random forests models were constructed for LAZ at two years (A), the change in LAZ from enrollment to two years (B), and Bayley-III scores at two years of age. The Bayley-III is comprised of 4 components, namely cognitive (C), language (D), motor (E), and social-emotional (F). Color-coding correlates to the three clusters identified when all variables were analyzed using Pearson’s correlation (S1 Fig).
In analysis of Bayley-III outcomes, in general, inflammation was of greater importance. For cognitive score WAZ at enrollment was the top predictor (index sVIMP, 1.0), followed by income (sVIMP 0.77), and LAZ at enrollment (sVIMP 0.71). Inflammatory variables such as TNFα at 18 weeks (sVIMP 0.41), sCD14 at week 18 (sVIMP 0.33), and ferritin at week 18 (sVIMP 0.27), as well as the economic variable expenditure (sVIMP 0.36) were weaker predictors (Fig 2C).
Language scores were predicted by presence/absence of the rotavirus vaccine (index sVIMP, 1.0), IL 5 at week 18 (sVIMP 0.87), sCD14 at week 18 (sVIMP 0.75), maternal weight (sVIMP 0.64), TNFα at week 18 (sVIMP 0.63), male gender (sVIMP 0.60), and WHZ at enrollment (sVIMP 0.56). Language scores were influenced by a diverse combination of factors ranging across all three groups of our cluster analysis (Fig 2D).
For motor function, predictors included calprotectin at 12 weeks (index sVIMP, 1.0) followed by WAZ at enrollment (sVIMP 0.95), neopterin at week 12 (sVIMP 0.79), CRP index (sVIMP 0.68), TNFα at week 18 (sVIMP 0.56), days of diarrhea at week 18 (sVIMP 0.51), IL 5 at week 18 (sVIMP 0.50), sCD14 at week 18 (sVIMP 0.49), alpha-1 antitrypsin at week 12 (sVIMP 0.47), and mannitol recovery at week 12 (sVIMP 0.40). Motor score was strongly predicted by variables that grouped tightly in our hierarchical cluster analysis and included biomarkers of enteric inflammation. Biomarkers of systemic inflammation and birth anthropometry were also strong predictors (Fig 2E).
The highest-ranking predictor of social-emotional function was sCD14 (index sVIMP, 1.0) followed by income (sVIMP 0.95), WAZ at enrollment (sVIMP 0.77), LAZ at enrollment (sVIMP 0.69), and TNFα at week 18 (sVIMP 0.47). Social-emotional score appeared to be influenced by gut barrier integrity, economic means, systemic inflammation, and birth anthropometrics (Fig 2F).
The estimates of the percentage of variance explained in our outcomes at two years of age from the conditional random forests analyses were 35.4% and 34.3% for LAZ and ΔLAZ respectively; 42.7% for cognitive score, 28.1% language score, 40.8% for motor score, and 37.9% for social-emotional score.
Predictors identified by variable selection using smoothly clipped absolute deviation (SCAD)
In order to identify risk factors that independently predicted outcomes, variable selection utilizing SCAD was done. Overall, SCAD selected 18 of 23 (78%) of predictors that random forests assigned sVIMP values >0.50. For anthropometry alone, SCAD selected 3 of 3 (100%) of predictors with sVIMP values >0.50. This included LAZ at enrollment for both LAZ at two years and ΔLAZ from enrollment to two years. For LAZ at two years it also included mother’s weight.
For Bayley-III outcomes alone, SCAD selected 15 of 20 (75%) of variables with random forests sVIMP values >0.50. For the cognitive component both WAZ at enrollment and income were selected while LAZ at enrollment was not. For language, only WHZ at enrollment was not selected. SCAD confirmed the importance of rotavirus vaccine status, IL 5, sCD14, mother’s weight, TNFα, and male gender in predicting language scores. SCAD analysis of Bayley-III motor scores selected calprotectin, WAZ at enrollment, neopterin, TNFα, and IL 5, all of which random forests selected with sVIMP >0.50. However SCAD failed to select CRP index and days of diarrhea at week 18. For social-emotional predictors, SCAD overlapped with random forests on 3 of 4 variables with sVIMP >0.50 including sCD14, income, and WAZ at enrollment. LAZ at enrollment was not selected (Table 3).
Linear regression models created by SCAD for each outcome produced estimates of variability for each outcome that were 18.0% for LAZ at two years, 17.9% for ΔLAZ, 17.5% for cognitive score, 12.9% for language score, 13.6% for motor score, and 17.6% for social-emotional score.
Discussion
The key discovery of this work was ranking the importance of putative predictors of infant growth and neurodevelopment and demonstrating that they were different. LAZ at two years of age was predicted predominantly by maternal and birth anthropometrics. In contrast developmental scores were most prominently predicted by inflammatory biomarkers. These data suggest that interventions aimed to improve growth and neurodevelopment need to be directed at both improvements in maternal and neonatal nutrition and reduction of gut and systemic inflammation.
The finding that perinatal child and maternal anthropometry predicted linear growth reaffirms several studies showing birth anthropometrics are strong predictors of ΔLAZ, suggesting that catch up growth in children born small for gestational age or with intrauterine growth restriction is insufficient [48–51]. Additionally, our findings support previous work showing maternal anthropometry to influence infant growth [21, 50]. Fecal calprotectin and alpha-1 antitrypsin were positively associated with growth. Both markers can be elevated due to intestinal inflammation but have also been shown to be increased in breastfeeding children and thus may be a surrogate marker of improved nutrition in our analysis [52, 53]. However, our data showed that markers of systemic or enteric inflammation were not the strongest predictors of poor growth although studies have repeatedly shown an association [3, 15, 16, 54–59]. As random forests ranks predictors in order of their importance, it may be that the association between inflammation and growth noted in other studies is valid but that inflammation is not as important a driver of growth when compared with maternal or prenatal factors. Our results suggest that future investigation into the complex pathogenesis of growth stunting should include study of the prenatal period.
Our analysis of Bayley-III outcomes demonstrates differences in cognitive, language, motor, and social-emotional development pathways and suggests that different insults may influence separate aspects of neurodevelopment. Cognitive development was strongly affected by perinatal anthropometrics and economic variables although systemic inflammation also played a role. Although there is literature suggesting birth LAZ is predictive of cognitive outcomes [60], several studies have shown associations between LAZ as a static measure at other ages and cognitive function [31, 61–64]. However, these studies did not examine birth anthropometry as a confounder. Our results suggest that birth anthropometry may influence both future LAZ/growth and cognitive performance. Work showing that nutritional supplementation in early childhood had minimal or no effect on cognition support a maternal, prenatal, or non-nutritional (i.e. possibly inflammatory) cause of cognitive deficits [65–67]. However, a recent meta-analysis showed certain nutrients given postnatally including iron can affect cognitive development. Maternal nutritional supplementation in the first trimester was also associated with improved cognition [68]. The presence of ferritin and birth anthropometry as important predictors of cognitive function in our analysis supports these findings. Our analysis is consistent with previous work by our group that suggests systemic inflammation negatively effects cognitive development and work by others showing infectious diseases in early childhood were associated with lower cognitive function [28, 30, 61, 69].
Language scores in our analysis were predicted in part by vaccination against rotavirus, systemic inflammation, mother’s weight, and gender. In this study, the vaccine was shown to have an efficacy of 73.5% against severe rotavirus diarrhea [70]. As only days of diarrhea until 18 weeks was entered into our models, it may be that rotavirus vaccination was a marker of decreased diarrhea over a longer period, which contributed to improved language ability, possibly through a decrease in systemic inflammation. Studies of meningitis in children have repeatedly shown sensorineural hearing loss leading to language deficits to be associated with inflammation in the central nervous system [71]. As we did not measure hearing in our cohort, it is uncertain if the association of systemic inflammation and language deficits has a similar pathogenesis in children from LMICs. Our finding that male gender was associated with decreased language function is consistent with a large body of literature showing females to progress faster in language development [72, 73]. However, Rotavirus vaccination, maternal weight, and markers of systemic inflammation were all stronger predictors than gender. This would suggest that in addition to the direct effects of Rotavirus vaccination on diarrheal disease, downstream effects on development may be an additional benefit of adding the Rotavirus vaccine to national campaigns.
Motor score was associated with markers of systemic immune activation including TNFα, ferritin, CRP, and sCD14. Additionally calprotectin and neopterin were strongly associated with motor function and SCAD revealed a direct relationship. While these markers of enteric inflammation have been associated with poor linear growth in other studies, it may be that their anti-inflammatory effects are significant enough to limit a systemic effect of enteric inflammation and thus are neuroprotective. Anthropometry in older children has been associated with poor motor function but, again, our work would suggest birth anthropometrics to be a confounder in these analyses (45,48).
Social-emotional function was predicted by a diverse set of variables spanning all three groups in our cluster analysis with sCD14, income, and birth anthropometrics being the highest ranking. Mannitol recovery and fecal calprotectin were also negatively associated with social-emotional scores. Inflammation and specifically enteric inflammation has been associated with poor socio-emotional function in other settings including in studies of attention-deficit-hyperactivity-disorder and autism [41, 74–77]. Zinc levels were negatively associated with social-emotional score, which was a surprising and unexplained finding.
Our study reaffirms the findings from the first year analysis of this data that our measured predictors cluster into three distinct groups [6]. While systemic inflammation still clustered tightly, CRP index was more closely correlated with maternal, socioeconomic, and enteric inflammatory variables. This variation is likely due to use of the CRP index in our analyses instead of weeks 6 and 18 CRP values used in the previous work. Additionally, we used enrollment anthropometrics instead of week 18 anthropometrics. While week 18 values clustered with maternal anthropometrics, enrollment values clustered tightly with markers of sanitation [6]. This supports the findings from our random forests and SCAD analyses showing that maternal anthropometry is an important driver of postnatal growth. Birth anthropometrics appear more closely linked to risk factors with potential water, sanitation and hygiene (WASH) interventions. Given the prominence of birth anthropometry in all outcomes of interest in this study, future investigation is warranted to determine the effects of prenatal WASH interventions in expecting mothers, which may have high yield in mitigating the adverse effects of the LMIC environment on childhood growth and development.
Our study has several strengths. First was our relatively large sample size and the ability to collect multiple predictors related to complex biologic processes such as poverty, maternal health, enteric inflammation, and systemic inflammation. Additionally children were followed closely in semi-weekly household visits for two years to obtain neurodevelopmental and anthropometric data. Finally, we were able to utilize two distinct statistical methods, which had significant overlap in findings.
There are several procedural limitations that should be considered when examining this work. First, not all of the original 700 children in the cohort had all of the biomarkers measured. While comparison of enrollment characteristics showed no difference between the children included in the original cohort and those analyzed except for maternal education, the possibility remains of selection bias. Second, while our Bayley-III assessment was culturally adapted, it was not normalized to the Bangladeshi population. This limits our ability to compare the absolute values to an international population and define the extent of the neurodevelopmental delays documented by comparison. Third, information regarding the children’s home environment as it relates to home education and stimulation was not collected nor was information regarding dietary intake. These variables are known to affect scores on neurodevelopmental assessments and may represent unexamined confounders in our analysis [78]. Fourth, several variables collected including ferritin, RBP, and zinc may be difficult to interpret since they are both acute phase reactants and nutritional markers [79]. Finally, for biomarkers of inflammation other than CRP, a limited number of time points were sampled. This limits our ability to assess if we are measuring acute or chronic inflammation, which would improve our understanding of the inflammatory insult on our outcomes.
Previous work has shown that birth anthropometry, maternal education, infection, inflammation, and poverty can impact growth and neurodevelopment [27, 34, 60, 64, 80]. Our analyses suggest that there are several different pathways leading to poor linear growth and neurodevelopment which are likely interrelated. Given the prominence of maternal and prenatal factors in our analyses, future efforts to study linear growth and neurodevelopmental deficits in LMICs should include data collection on these variables. However, to fully assess factors affecting neurodevelopmental outcomes, postnatal effects including those from EED and infection will need to be considered as well.
Supporting information
S1 Fig. Cluster dendrogram of the variables collected in the PROVIDE study.
All predictors entered into both random forests and SCAD analysis were compared using Pearson’s correlation. Three distinct clusters were noted (in Black, Green, and Red).
https://doi.org/10.1371/journal.pntd.0006363.s001
(TIF)
S2 Fig. Dependence plots for the top 15 variables selected by random forests analysis for LAZ at week 104.
Directionality of the relationship between outcome and predictor is depicted.
https://doi.org/10.1371/journal.pntd.0006363.s002
(TIF)
S3 Fig. Dependence plots for the top 15 variables selected by random forests analysis for ΔLAZ from Enrollment to week 104.
Directionality of the relationship between outcome and predictor is depicted.
https://doi.org/10.1371/journal.pntd.0006363.s003
(TIF)
S4 Fig. Dependence plots for the top 15 variables selected by random forests analysis for Bayley-III—Cognitive Score.
Directionality of the relationship between outcome and predictor is depicted.
https://doi.org/10.1371/journal.pntd.0006363.s004
(TIF)
S5 Fig. Dependence plots for the top 15 variables selected by random forests analysis for Bayley-III—Language Score.
Directionality of the relationship between outcome and predictor is depicted.
https://doi.org/10.1371/journal.pntd.0006363.s005
(TIF)
S6 Fig. Dependence plots for the top 15 variables selected by random forests analysis for Bayley-III—Motor Score.
Directionality of the relationship between outcome and predictor is depicted.
https://doi.org/10.1371/journal.pntd.0006363.s006
(TIF)
S7 Fig. Dependence plots for the top 15 variables selected by random forests analysis for Bayley-III—Social-emotional Score.
Directionality of the relationship between outcome and predictor is depicted.
https://doi.org/10.1371/journal.pntd.0006363.s007
(TIF)
S1 Checklist. STROBE checklist: STROBE Checklist (https://www.strobe-statement.org/index.php?id=available-checklists) for cohort studies was completed.
https://doi.org/10.1371/journal.pntd.0006363.s008
(PDF)
S1 Dataset. Dataset used for analyses with Bayley-III scores as the outcomes.
This file includes all predictive and Bayley-III outcome variables. It includes all children for whom we had a complete dataset, including Bayley-III scores, prior to outliers being removed.
https://doi.org/10.1371/journal.pntd.0006363.s009
(CSV)
S2 Dataset. Dataset used for analyses with LAZ or ΔLAZ as the outcome.
This file includes all predictive and anthropometric outcome variables. It includes all children for whom we had a complete dataset, including LAZ and ΔLAZ, prior to outliers being removed.
https://doi.org/10.1371/journal.pntd.0006363.s010
(CSV)
S3 Dataset. Data Dictionary for S1 and S2 Datasets.
This file contains a description of the variable codes used in the S1 and S2 Datasets as well as the units used for each variable.
https://doi.org/10.1371/journal.pntd.0006363.s011
(XLSX)
Acknowledgments
We would like to acknowledge the families participating in the PROVIDE study and the community of Mirpur, Dhaka Bangladesh without whom this endeavor would not have been possible. We also thank Uma Nayak and Joe Mychaleckyj for establishment and quality control of the PROVIDE data repository.
References
- 1.
The Global Nutrition Report, 2016. http://ebrary.ifpri.org/utils/getfile/collection/p15738coll2/id/130354/filename/130565.pdf.
- 2. Olofin I, McDonald CM, Ezzati M, Flaxman S, Black RE, Fawzi WW, et al. Associations of suboptimal growth with all-cause and cause-specific mortality in children under five years: a pooled analysis of ten prospective studies. PloS one. 2013;8(5):e64636. pmid:23734210
- 3. Guerrant RL, DeBoer MD, Moore SR, Scharf RJ, Lima AA. The impoverished gut—a triple burden of diarrhoea, stunting and chronic disease. Nature Reviews Gastroenterology and Hepatology. 2013;10(4):220–9. pmid:23229327
- 4. Victora CG, Adair L, Fall C, Hallal PC, Martorell R, Richter L, et al. Maternal and child undernutrition: consequences for adult health and human capital. The lancet. 2008;371(9609):340–57.
- 5. Prendergast AJ, Rukobo S, Chasekwa B, Mutasa K, Ntozini R, Mbuya M, et al. Stunting is characterized by chronic inflammation in Zimbabwean infants. PloS one. 2014;9(2):e86928. pmid:24558364
- 6. Naylor C, Lu M, Haque R, Mondal D, Buonomo E, Nayak U, et al. Environmental Enteropathy, Oral Vaccine Failure and Growth Faltering in Infants in Bangladesh. EBioMedicine. 2015.
- 7. Wamani H, Åstrøm AN, Peterson S, Tumwine JK, Tylleskär T. Predictors of poor anthropometric status among children under 2 years of age in rural Uganda. Public Health Nutr. 2006;9(3):320–6. pmid:16684383
- 8. Bloss E, Wainaina F, Bailey RC. Prevalence and predictors of underweight, stunting, and wasting among children aged 5 and under in western Kenya. J Trop Pediatr. 2004;50(5):260–70. pmid:15510756
- 9. Dekker LH, Mora-Plazas M, Marín C, Baylin A, Villamor E. Stunting associated with poor socioeconomic and maternal nutrition status and respiratory morbidity in Colombian schoolchildren. Food and nutrition bulletin. 2010;31(2):242–50. pmid:20707230
- 10. Merchant A, Jones C, Kiure A, Kupka R. Water and sanitation associated with improved child growth. Eur J Clin Nutr. 2003;57(12):1562. pmid:14647221
- 11. Rah JH, Cronin AA, Badgaiyan B, Aguayo VM, Coates S, Ahmed S. Household sanitation and personal hygiene practices are associated with child stunting in rural India: a cross-sectional analysis of surveys. BMJ Open. 2015 Feb 12;5(2):e005180,2014–005180. pmid:25678539
- 12. Kosek M, Guerrant RL, Kang G, Bhutta Z, Yori PP, Gratz J, et al. Assessment of environmental enteropathy in the MAL-ED cohort study: theoretical and analytic framework. Clin Infect Dis. 2014 Nov 1;59 Suppl 4:S239–47.
- 13. Kosek M, Haque R, Lima A, Babji S, Shrestha S, Qureshi S, et al. Fecal markers of intestinal inflammation and permeability associated with the subsequent acquisition of linear growth deficits in infants. Am J Trop Med Hyg. 2013 Feb;88(2):390–6. pmid:23185075
- 14. Peterson KM, Buss J, Easley R, Yang Z, Korpe PS, Niu F, et al. REG1B as a predictor of childhood stunting in Bangladesh and Peru. Am J Clin Nutr. 2013 May;97(5):1129–33. pmid:23553156
- 15. Lunn P, Northrop-Clewes C, Downes R. Intestinal permeability, mucosal injury, and growth faltering in Gambian infants. The Lancet. 1991;338(8772):907–10.
- 16. Korpe PS, Petri WA Jr. Environmental enteropathy: critical implications of a poorly understood condition. Trends Mol Med. 2012;18(6):328–36. pmid:22633998
- 17. Taniuchi M, Sobuz SU, Begum S, Platts-Mills JA, Liu J, Yang Z, et al. Etiology of diarrhea in Bangladeshi infants in the first year of life analyzed using molecular methods. J Infect Dis. 2013 Dec 1;208(11):1794–802. pmid:24041797
- 18. Platts-Mills JA, Babji S, Bodhidatta L, Gratz J, Haque R, Havt A, et al. Pathogen-specific burdens of community diarrhoea in developing countries: a multisite birth cohort study (MAL-ED). The Lancet Global Health. 2015;3(9):e564–75. pmid:26202075
- 19. Abuya B, Onsomu E, Kimani J, Moore D. Influence of maternal education on child immunization and stunting in Kenya. Matern Child Health J. 2011;15(8):1389–99. pmid:20848172
- 20. Shah SM, Selwyn BJ, Luby S, Merchant A, Bano R. Prevalence and correlates of stunting among children in rural Pakistan. Pediatrics international. 2003;45(1):49–53. pmid:12654069
- 21. Özaltin E, Hill K, Subramanian S. Association of maternal stature with offspring mortality, underweight, and stunting in low-to middle-income countries. JAMA. 2010;303(15):1507–16. pmid:20407060
- 22. Niehaus MD, Moore SR, Patrick PD, Derr LL, Lorntz B, Lima AA, et al. Early childhood diarrhea is associated with diminished cognitive function 4 to 7 years later in children in a northeast Brazilian shantytown. Am J Trop Med Hyg. 2002;66(5):590–3. pmid:12201596
- 23. Guerrant DI, Moore SR, Lima AA, Patrick PD, Schorling JB, Guerrant RL. Association of early childhood diarrhea and cryptosporidiosis with impaired physical fitness and cognitive function four-seven years later in a poor urban community in northeast Brazil. Am J Trop Med Hyg. 1999;61(5):707–13. pmid:10586898
- 24. Patrick PD, Oriá RB, Madhavan V, Pinkerton RC, Lorntz B, Lima AA, et al. Limitations in verbal fluency following heavy burdens of early childhood diarrhea in Brazilian shantytown children. Child Neuropsychology. 2005;11(3):233–44. pmid:16036449
- 25. Walker CLF, Lamberti L, Adair L, Guerrant RL, Lescano AG, Martorell R, et al. Does childhood diarrhea influence cognition beyond the diarrhea-stunting pathway? PloS one. 2012;7(10):e47908. pmid:23118906
- 26. Ajjampur S, Koshy B, Venkataramani M, Sarkar R, Joseph A, Jacob K, et al. Effect of cryptosporidial and giardial diarrhoea on social maturity, intelligence and physical growth in children in a semi-urban slum in south India. Ann Trop Paediatr. 2011;31(3):205–12. pmid:21781414
- 27. Jiang NM, Tofail F, Moonah SN, Scharf RJ, Taniuchi M, Ma JZ, et al. Febrile illness and pro-inflammatory cytokines are associated with lower neurodevelopmental scores in Bangladeshi infants living in poverty. BMC pediatrics. 2014;14(1):50.
- 28. Jiang NM, Tofail F, Ma JZ, Haque R, Kirkpatrick B, Nelson CA, et al. Early life inflammation and neurodevelopmental outcome in Bangladeshi infants growing up in adversity. The American Journal of Tropical Medicine and Hygiene. 2017;in press.
- 29. Eppig C, Fincher CL, Thornhill R. Parasite prevalence and the worldwide distribution of cognitive ability. Proc Biol Sci. 2010 Dec 22;277(1701):3801–8. pmid:20591860
- 30. Berkman DS, Lescano AG, Gilman RH, Lopez SL, Black MM. Effects of stunting, diarrhoeal disease, and parasitic infection during infancy on cognition in late childhood: a follow-up study. The Lancet. 2002;359(9306):564–71.
- 31. Mendez MA, Adair LS. Severity and timing of stunting in the first two years of life affect performance on cognitive tests in late childhood. J Nutr. 1999 Aug;129(8):1555–62. pmid:10419990
- 32. Pollitt E, Gorman KS, Engle PL, Martorell R, Rivera J, Wachs TD, et al. Early supplementary feeding and cognition: effects over two decades. Monogr Soc Res Child Dev. 1993:i–118.
- 33.
de Onis M, Blössner M. WHO global database on child growth and malnutrition. 1997.
- 34. Walker SP, Wachs TD, Grantham-McGregor S, Black MM, Nelson CA, Huffman SL, et al. Inequality in early childhood: risk and protective factors for early child development. The Lancet. 2011;378(9799):1325–38.
- 35. Tofail F, Persson LA, El Arifeen S, Hamadani JD, Mehrin F, Ridout D, et al. Effects of prenatal food and micronutrient supplementation on infant development: a randomized trial from the Maternal and Infant Nutrition Interventions, Matlab (MINIMat) study. Am J Clin Nutr. 2008 Mar;87(3):704–11. pmid:18326610
- 36. McGrath N, Bellinger D, Robins J, Msamanga GI, Tronick E, Fawzi WW. Effect of maternal multivitamin supplementation on the mental and psychomotor development of children who are born to HIV-1-infected mothers in Tanzania. Pediatrics. 2006 Feb;117(2):e216–25. pmid:16452331
- 37. Kramer MS, Aboud F, Mironova E, Vanilovich I, Platt RW, Matush L, et al. Breastfeeding and child cognitive development: new evidence from a large randomized trial. Arch Gen Psychiatry. 2008;65(5):578–84. pmid:18458209
- 38. Mwaniki MK, Atieno M, Lawn JE, Newton CR. Long-term neurodevelopmental outcomes after intrauterine and neonatal insults: a systematic review. The Lancet. 2012;379(9814):445–52.
- 39. Schlapbach LJ, Aebischer M, Adams M, Natalucci G, Bonhoeffer J, Latzin P, et al. Impact of sepsis on neurodevelopmental outcome in a Swiss National Cohort of extremely premature infants. Pediatrics. 2011 Aug;128(2):e348–57. pmid:21768312
- 40. Harvey L, Boksa P. Prenatal and postnatal animal models of immune activation: relevance to a range of neurodevelopmental disorders. Developmental neurobiology. 2012;72(10):1335–48. pmid:22730147
- 41. de Magistris L, Familiari V, Pascotto A, Sapone A, Frolli A, Iardino P, et al. Alterations of the intestinal barrier in patients with autism spectrum disorders and in their first-degree relatives. J Pediatr Gastroenterol Nutr. 2010 Oct;51(4):418–24. pmid:20683204
- 42. Jensen SK, Berens AE, Nelson CA. Effects of poverty on interacting biological systems underlying child development. The Lancet Child & Adolescent Health. 2017.
- 43. Berens AE, Jensen SK, Nelson CA. Biological embedding of childhood adversity: from physiological mechanisms to clinical implications. BMC medicine. 2017;15(1):135. pmid:28724431
- 44. Kirkpatrick BD, Colgate ER, Mychaleckyj JC, Haque R, Dickson DM, Carmolli MP, et al. The "Performance of Rotavirus and Oral Polio Vaccines in Developing Countries" (PROVIDE) study: description of methods of an interventional study designed to explore complex biologic problems. Am J Trop Med Hyg. 2015 Apr;92(4):744–51. pmid:25711607
- 45. Donowitz JR, Haque R, Kirkpatrick BD, Alam M, Lu M, Kabir M, et al. Small Intestine Bacterial Overgrowth and Environmental Enteropathy in Bangladeshi Children. MBio. 2016 Jan 12;7(1): pmid:26758185
- 46. Taniuchi M, Platts-Mills JA, Begum S, Uddin MJ, Sobuz SU, Liu J, et al. Impact of enterovirus and other enteric pathogens on oral polio and rotavirus vaccine performance in Bangladeshi infants. Vaccine. 2016;34(27):3068–75. pmid:27154394
- 47. Colgate ER, Haque R, Dickson DM, Carmolli MP, Mychaleckyj JC, Nayak U, et al. A Randomized Controlled Trial with Delayed Dosing of Oral Rotavirus Vaccine Demonstrates Decreased Risk of Rotavirus Gastroenteritis Associated with Serum Zinc. Clinical Infectious Diseases. 2016:ciw346.
- 48. Espo M, Kulmala T, Maleta K, Cullinan T, Salin M, Ashorn P. Determinants of linear growth and predictors of severe stunting during infancy in rural Malawi. Acta paediatrica. 2002;91(12):1364–70. pmid:12578296
- 49. Vella V, Tomkins A, Borghesi A, Migliori GB, Oryem VY. Determinants of stunting and recovery from stunting in northwest Uganda. Int J Epidemiol. 1994 Aug;23(4):782–6. pmid:8002193
- 50. Dekker LH, Mora-Plazas M, Marín C, Baylin A, Villamor E. Stunting associated with poor socioeconomic and maternal nutrition status and respiratory morbidity in Colombian schoolchildren. Food and nutrition bulletin. 2010;31(2):242–50. pmid:20707230
- 51. Black RE, Allen LH, Bhutta ZA, Caulfield LE, De Onis M, Ezzati M, et al. Maternal and child undernutrition: global and regional exposures and health consequences. The lancet. 2008;371(9608):243–60.
- 52. Dorosko SM, MacKenzie T, Connor RI. Fecal calprotectin concentrations are higher in exclusively breastfed infants compared to those who are mixed-fed. Breastfeeding Medicine. 2008;3(2):117–9. pmid:18564000
- 53. Davidson L, Lönnerdal B. Fecal Alpha1-Antitrypsin in Breast-Fed Infants Is Derived from Human Milk and Is not Indicative of Enteric Protein Loss. Acta Paediatrica. 1990;79(2):137–41.
- 54. Campbell DI, Elia M, Lunn PG. Growth faltering in rural Gambian infants is associated with impaired small intestinal barrier function, leading to endotoxemia and systemic inflammation. J Nutr. 2003 May;133(5):1332–8. pmid:12730419
- 55. Gilmartin AA, Petri WA, Jr. Exploring the role of environmental enteropathy in malnutrition, infant development and oral vaccine response. Philos Trans R Soc Lond B Biol Sci. 2015 Jun 19;370(1671).
- 56. Goto R, Mascie-Taylor C, Lunn PG. Impact of intestinal permeability, inflammation status and parasitic infections on infant growth faltering in rural Bangladesh. Br J Nutr. 2009;101(10):1509–16. pmid:18947438
- 57. Guerrant RL, Leite AM, Pinkerton R, Medeiros PH, Cavalcante PA, DeBoer M, et al. Biomarkers of environmental enteropathy, inflammation, stunting, and impaired growth in children in Northeast Brazil. PloS one. 2016;11(9):e0158772. pmid:27690129
- 58. Keusch GT, Denno DM, Black RE, Duggan C, Guerrant RL, Lavery JV, et al. Environmental enteric dysfunction: pathogenesis, diagnosis, and clinical consequences. Clin Infect Dis. 2014 Nov 1;59 Suppl 4:S207–12.
- 59. Mondal D, Minak J, Alam M, Liu Y, Dai J, Korpe P, et al. Contribution of enteric infection, altered intestinal barrier function, and maternal malnutrition to infant malnutrition in Bangladesh. Clin Infect Dis. 2012 Jan 15;54(2):185–92. pmid:22109945
- 60. Wang W, Sung Y, Sung F, Lu T, Kuo S, Li C. Low birth weight, prematurity, and paternal social status: impact on the basic competence test in Taiwanese adolescents. J Pediatr. 2008;153(3):333–8. pmid:18534212
- 61. Rose SA. Relation between physical growth and information processing in infants born in India. Child Dev. 1994;65(3):889–902. pmid:8045175
- 62. Oberhelman RA, Guerrero ES, Fernandez ML, Silio M, Mercado D, Comiskey N, et al. Correlations between intestinal parasitosis, physical growth, and psychomotor development among infants and children from rural Nicaragua. Am J Trop Med Hyg. 1998;58(4):470–5. pmid:9574794
- 63. Hall A, Khanh LN, Son TH, Dung NQ, Lansdown RG, Dar DT, et al. An association between chronic undernutrition and educational test scores in Vietnamese children. Eur J Clin Nutr. 2001 Sep;55(9):801–4. pmid:11528497
- 64. Kuklina EV, Ramakrishnan U, Stein AD, Barnhart HH, Martorell R. Early childhood growth and development in rural Guatemala. Early Hum Dev. 2006;82(7):425–33. pmid:16431042
- 65. Walker SP, Grantham-McGregor SM, Powell CA, Chang SM. Effects of growth restriction in early childhood on growth, IQ, and cognition at age 11 to 12 years and the benefits of nutritional supplementation and psychosocial stimulation. J Pediatr. 2000;137(1):36–41. pmid:10891819
- 66. Pollitt E, Watkins WE, Husaini MA. Three-month nutritional supplementation in Indonesian infants and toddlers benefits memory function 8 y later. Am J Clin Nutr. 1997 Dec;66(6):1357–63. pmid:9394687
- 67. Pollitt E, Saco-Pollitt C, Jahari A, Husaini M, Huang J. Effects of an energy and micronutrient supplement on mental development and behavior under natural conditions in undernourished children in Indonesia. Eur J Clin Nutr. 2000;54(S2):S80.
- 68. Ip P, Ho FKW, Rao N, Sun J, Young ME, Chow CB, et al. Impact of nutritional supplements on cognitive development of children in developing countries: A meta-analysis. Scientific reports. 2017;7(1):10611. pmid:28878390
- 69. Jiang NM, Tofail F, Moonah SN, Scharf RJ, Taniuchi M, Ma JZ, et al. Febrile illness and pro-inflammatory cytokines are associated with lower neurodevelopmental scores in Bangladeshi infants living in poverty. BMC pediatrics. 2014;14(1):50.
- 70. Colgate ER, Haque R, Dickson DM, Carmolli MP, Mychaleckyj JC, Nayak U, et al. Delayed Dosing of Oral Rotavirus Vaccine Demonstrates Decreased Risk of Rotavirus Gastroenteritis Associated With Serum Zinc: A Randomized Controlled Trial. Clin Infect Dis. 2016 Sep 1;63(5):634–41. pmid:27217217
- 71. Baraff LJ, Lee SI, Schriger DL. Outcomes of bacterial meningitis in children: a meta-analysis. Pediatr Infect Dis J. 1993;12(5):389–94. pmid:8327300
- 72. Vogel SA. Gender differences in intelligence, language, visual-motor abilities, and academic achievement in students with learning disabilities: A review of the literature. J Learn Disabil. 1990;23(1):44–52. pmid:2404079
- 73. Eriksson M, Marschik PB, Tulviste T, Almgren M, Pérez Pereira M, Wehberg S, et al. Differences between girls and boys in emerging language skills: evidence from 10 language communities. British journal of developmental psychology. 2012;30(2):326–43.
- 74. Depino AM. Peripheral and central inflammation in autism spectrum disorders. Molecular and Cellular Neuroscience. 2013;53:69–76. pmid:23069728
- 75. Dinel A, Joffre C, Trifilieff P, Aubert A, Foury A, Le Ruyet P, et al. Inflammation early in life is a vulnerability factor for emotional behavior at adolescence and for lipopolysaccharide-induced spatial memory and neurogenesis alteration at adulthood. Journal of neuroinflammation. 2014;11(1):155.
- 76. Rossignol DA, Frye RE. A review of research trends in physiological abnormalities in autism spectrum disorders: immune dysregulation, inflammation, oxidative stress, mitochondrial dysfunction and environmental toxicant exposures. Mol Psychiatry. 2012;17(4):389–401. pmid:22143005
- 77. Ceylan MF, Uneri OS, Guney E, Ergin M, Alisik M, Goker Z, et al. Increased levels of serum neopterin in attention deficit/hyperactivity disorder (ADHD). J Neuroimmunol. 2014;273(1):111–4.
- 78. Hamadani JD, Tofail F, Hilaly A, Huda SN, Engle P, Grantham-McGregor SM. Use of family care indicators and their relationship with child development in Bangladesh. J Health Popul Nutr. 2010 Feb;28(1):23–33. pmid:20214083
- 79. Raiten DJ, Sakr Ashour FA, Ross AC, Meydani SN, Dawson HD, Stephensen CB, et al. Inflammation and Nutritional Science for Programs/Policies and Interpretation of Research Evidence (INSPIRE). J Nutr. 2015 May;145(5):1039S–108S. pmid:25833893
- 80. Bhutta ZA, Guerrant RL, Nelson CA. Neurodevelopment, Nutrition, and Inflammation: The Evolving Global Child Health Landscape. Pediatrics. 2017;139(Supplement 1):S12–22.