Skip to main content
  • Research article
  • Open access
  • Published:

Using the ages and stages questionnaire in the general population as a measure for identifying children not at risk of a neurodevelopmental disorder

Abstract

Background

Early detection of neurodevelopmental disorders (NDDs) enables access to early interventions for children. We assess the Ages and Stages Questionnaire (ASQ)’s ability to identify children with a NDD in population data.

Method

Children 4 to 5 years old in the National Longitudinal Survey of Children and Youth (NLSCY) from cycles 5 to 8 were included. The sensitivity, specificity, positive and negative predictive values were calculated for the ASQ at 24, 27, 30, 33, 36 and 42 months. Fixed effects regression analyses assessed longitudinal associations between domain scores and child age.

Results

Specificity for the ASQ was high with 1SD or 2SD cutoffs, indicating good accuracy in detecting children who will not develop a NDD, however the sensitivity varied over time points and cut-offs. Sensitivity for the 1 SD cutoff at 24 months was above the recommended value of 70% for screening. Differences in ASQ domains scores between children with and without NDD increases with age.

Conclusions

The high specificity and negative predictive values of the ASQ support its use in identifying children who are not at the risk of developing a NDD. The capacity of the ASQ to identify children with a NDD in the general population is limited except for the ASQ-24 months with 1SD and can be used to identify children at risk of NDD.

Peer Review reports

Background

Early childhood is a uniquely sensitive period for developing cognitive ability, language, social and motor development. Both developmental delay and neurodevelopmental disorders (NDDs) manifest early in life. While, developmental delays signifies a failure to meet developmental milestones for children under the age of five [1], NDDs are characterized as life-long disabilities associated with poorer long-term health outcomes [2], quality of life implications for children and their families [3,4,5] and higher healthcare and societal costs [6]. The prevalence of NDDs in children is estimated to range from 5 to 9%, depending on the definition and data set used [7,8,9].

Early detection and intervention for children with developmental delays or disorders, is recognised as an essential part of good health care to optimise outcomes for children and families [10, 11]. The successful identification of children with a NDD requires two stages: screening for risk of developmental delays using a valid and reliable screening tool and a comprehensive diagnostic evaluation of children whose development differs from the same age-norms [12]. The Canadian Paediatric Society supports developmental screening of all children at 18 months using a validated screening tool [13], and the American Academy of Pediatrics recommends developmental screening at 9, 18 and 24 or 30 months [12]. While a diagnosis by an experienced health care professional could occur by the age of two, many children do not receive a diagnosis until after the age of four [14,15,16]. In Canada, a study modelling time to diagnosis found that socioeconomic and sociodemographic factors had little impact [17]. This study suggests health system characteristics and differing wait times in regions may be key factors in time to diagnosis. This delay in diagnosis limits access to early intervention, as children with developmental delays may not receive early intervention services until their delays manifest more profoundly to affect functional abilities or when they receive a diagnosis [18]. There is evidence to suggest that protective factors such as social support and community engagement for children at risk could include low cost identification and intervention strategies in the community with parents to decrease the risk for child developmental and behavioural problems [19].

The use of parent-completed screening tools, such as the Ages and Stages Questionnaire (ASQ), has increased in recent years because of being a low-cost screening tool with a short completion time, easily administered by parents in the home setting. The ASQ has been shown to perform well in children with biological risk factors [20,21,22] or some environmental risk factors [23]. As a parent report tool, it provides an important communication opportunity for parents to discuss concerns they have about their child’s development in a structured manner with a healthcare professional [24].

The original ASQ has been proven to be reliable and valid with an overall sensitivity of 75% and specificity of 86% in detecting developmental delays, but it is unclear how many children go on to have a developmental disability [25]. Many of the validation studies to date are in high-risk children in clinical settings [26,27,28]. This study uses population data to look at the validity of the ASQ as a screening tool for identifying children at risk of a developmental delay who are later identified in the data as having a NDD. The objectives of our study were 1) to evaluate the ability of the ASQ questionnaire to identify children with and without a NDD using population-based survey data and 2) to analyse and compare ASQ domain scores for children with and without a NDD different time points.

Methods

Data source

This study used data from the National Longitudinal Survey of Children and Youth (NLSCY), a long-term study of the physical and social development of Canadian children from birth to early adulthood [29]. The survey conducted jointly by Statistics Canada and Human Resources Development Canada began in 1994 and was repeated biennially. Data collection stopped in cycle 8 (2009). The target population of the survey comprised the noninstitutionalized civilian population aged 0 to 11 months at the time of data collection. The person most knowledgeable (PMK), usually mothers, provided information on the selected child. More details about data collection can be found in the Statistics Canada user guide [29].

Ages and stages questionnaire (ASQ)

ASQ is a standardised parent completed questionnaire to screen for developmental delays in children using 19 age-specific developmental questionnaires starting at 4 months and ending at 60 months of age [25]. The ASQ-2 was the version used in NLSCY data collection. There are five domains: Fine Motor, Gross Motor, Communication, Problem-Solving and Personal-Social; each domain contains six questions that can be answered with a yes (10 points), sometimes (5 points) or not yet (0 points), as well as nine open-ended questions. Scores obtained from each domain are compared with established cut-off points at one and two standard deviations that are used to identify children at risk of developmental delay. If the score on any domain falls below the 2SD cut-off, referral for further assessment is advised. If the score on any domain is within the one standard deviation (1SD) and 2SD cut-off point, it is advised to provide learning activities and monitor the child’s development.

Identification of children with neurodevelopmental disorders

Children with NDD were identified using two indicators: (a) a parent reported checklist of chronic conditions diagnosed by a health professional (for children 4 to 5 years old) and (b) health utility index-3(HUI) scores when children were 4 to 5 years old. The checklist included five chronic conditions: Cerebral Palsy, Epilepsy, Mental Handicap, Learning Disability, and Attention Deficit Disorder (and Autism in cycle 8). The HUI is a generic preference-based instrument used to measure overall health status and health-related quality of life (HRQoL) of life of individuals [30]. It includes eight domains-vision, hearing, speech, ambulation, dexterity, emotion and pain. Cut-off values for four domains of the HUI established by Lach et al. [8] for identifying children with NDD were used: > 3 for the speech and mobility domains, > 2 for the dexterity domain, and > 4 for the cognition domain. If one of the indicators identified children, they were classified as children with NDD and were combined to obtain the sample.

Unfortunately, the gross motor portion of the ASQ was not included in cycle 5 and onwards, so we were limited to use only four domains- Fine Motor, Communication, Problem-Solving, and Personal-Social [29].

Sample

The sample was restricted to children aged 4 to 5 years in cycles 5 to 8 because the HUI was only collected for children 4 to 5 years old in the survey. Two cohorts were created to address the research objectives: the short cohort for objective 1 and the long cohort for objective 2 (Additional file 1). The short cohort consisted of children who were 4 to 5 years old in cycles 5, 6, 7, or 8, and was also present in the corresponding previous cycle. Observations from different cycles were aggregated into a single sample. For the short cohort (unweighted n = 12,142), 725 children with a NDD were identified. This sample for the short cohort was used to estimate sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of the ASQ. The long cohort consisted of 350 children with a NDD (5604 total observations) who were 4 to 5 years old in cycles 5, 6, 7, or 8, and was also present in the corresponding two previous cycles. This sample was used to compare the ASQ domain scores longitudinally using fixed effects regression modelling.

Weighted proportions of the sample size for the short cohort and the long cohort can be found in Table 1. Using both the HUI and the checklist of chronic conditions, 6.47% of children aged 4 to 5 years were identified as having NDD for the short cohort (HUI 5.65% and reported 1.88%). The percentage was slightly higher 7.17% for the long cohort (HUI 6.26% and reported 1.91%). The percentage of children reported to have a learning disability was higher, and epilepsy was lower compared to other NDDs in both cohorts.

Table 1 Weighted Proportion of Sample Size for the Short Cohort and the Long Cohort

Data analyses

Descriptive statistics were generated for children with and without NDD at baseline. Two-sample t-tests (age and HUI) and two-sample tests of proportions (income, gender, race, and education) were conducted to examine group differences. The screening accuracy of ASQ was determined by comparing passed/failed status on domains for children with and without a NDD. The passed/failed status was defined by using the established age-specific cut-off scores for each domain i.e. less than 1SD/2SD below the mean in any domain was defined as a failure [25]. Next, sensitivity, specificity, PPV, and NPV were calculated for 1SD and 2SD of ASQ at 24, 27, 30, 33, 36 and 42 months.

Fixed effects regression analyses were conducted to examine longitudinal associations between domain scores and age of children accounting for the effects of other domains. The models were analysed separately for each domain (communication, personal social, fine motor and problem-solving) for children with and without NDD. For example, the fixed effect model for the fine motor domain was:

$$ {\mathrm{Finemotor}}_{it}={\upalpha}_i+{\upbeta}_1{\mathrm{Agemonths}}_{it+}{\upbeta}_2\ {\mathrm{Communication}}_{it+}{\upbeta}_3\ {\mathrm{Problemsolving}}_{it}\kern0.75em +{\upbeta}_4\ {\mathrm{Personalsocial}}_{it+}\ {\upvarepsilon}_{it,} $$

where α i (i = 1…..n) is the individual-level fixed effect. Finemotor it is the dependent variable where i = child, t = time, β is the coefficient for the respective variable and. Agemonths it, Communication it, Problemsolving it and Personalsocial it are independent variables, and ɛ it is the error term.

All analyses were weighted (and bootstrapped for fixed effects models) to account for the complex survey design and to ensure that the sample size was representative of the Canadian population. Statistics Canada provides the survey weights and 1000 bootstrap sample weights for each cycle [29]. Statistical software STATA 14 was used to conduct the analysis.

Results

Screening accuracy of ASQ in identifying children at risk of NDD

Weighted descriptive statistics of the study population in the short cohort are presented in Table 2. The mean age for children in the sample with and without a NDD at baseline was 34.91 months and 34.50 months, respectively. Children with a NDD in the short cohort were more likely to be male, non-white, from a less educated family with lower household income, compared to children without a NDD. Boys (65.75%) were twice as likely to have a NDD compared to girls (34.25%). Approximately 25.12% of children with a NDD were from low-income households compared to 15.37% of children without a NDD. This sociodemographic information is in line with other studies finding children with NDD are more frequently male or from lower income families [9, 31,32,33].

Table 2 Weighted Demographic Characteristics for the Short Cohort and the Long Cohort

Health related quality of life (HRQoL) was significantly different for children with and without a NDD. PMK rated mean HUI scores for children with a reported NDD diagnosis to be 0.68 compared to 0.96 for children without a reported diagnosis. HUI scores can range from 0 to 1, ‘1’ as in perfect health and ‘0’ as in dead. The mean HUI scores for children diagnosed with epilepsy, attention deficit disorder, autism, learning disability, mental handicap and cerebral palsy were 0.75, 0.73, 0.72, 0.70, 0.32 and 0.31, respectively.

The sensitivity, specificity, PPV and NPV of the ASQ at 24, 27, 30,33, 36 and 47 months can be seen in Fig. 1. When 1SD is used as the cut-off point, sensitivity at 24 months was 83.60% and dropped to 45.10% at 42 months. The specificity at 24 months was 69.40% and increased to 82.20% at 42 months. PPV for 1SD started at 21.90% for 24 months and dropped to 16.60% at 42 months. NPV for 1SD was 97.60% for 24 months and fell slightly to 95.00% at 42 months. Using a 2SD cut-off point the sensitivity at 24 months was 32.20% dropping to 24.00% at 42 months. The specificity for 2SD was 90.90% at 24 months increasing to 95.70% at 42 months. The PPV value for 2SD was 26.70% at 24 months and 30.30% at 42 months. NPV for 2SD was 92.90% at 24 months and increased to 94.10% for 42 months.

Fig. 1
figure 1

Sensitivity, Specificity, Positive Predictive and Negative Predictive values of ASQ for 1SD and 2SD at 24, 27, 30, 33, 36 and 42 months

ASQ domain scores over time for children with NDD and without NDD

The mean age for children at baseline who were later identified with and without a NDD in the long cohort was 15.27 months and 14.80 months, respectively (descriptive statistics in Table 2). Similar to the short cohort, children with NDD in the long cohort were more likely to be male, non-white and from a low-income household and less educated family compared to the children without NDD. The PMK rated mean HUI scores were 0.67 for children with a reported diagnosis with NDD and 0.96 for children without a reported diagnosis. The mean HUI scores for children diagnosed with epilepsy, attention deficit disorder, autism, learning disability, mental handicap and cerebral palsy were 0.71, 0.72, 0.75, 0.72, 0.22 and 0.26 respectively.

We present predicted mean scores for each ASQ domain over time in Fig. 2. The communication, personal social and problem-solving domains increased as the age of children increased. The predicted mean scores for fine motor had a negative relationship with the age of children, which is consistent with the relationship between established cut-off values for this domain across ages [34]. Results from these fixed effect models demonstrated a strong correlation between domain scores and age of the children. For children without a NDD, the predicted mean scores for all four domains at baseline were higher compared to children with a NDD and similar trends can be observed over the time. For instance, the mean predicted communication scores for children with NDD at baseline was 40.65 and 46.89 for children without NDD. Mean fine motor scores were 52.65 and 55.43 for children with and without NDD, respectively.

Fig. 2
figure 2

Predicted domains scores for children with NDD and without NDD over time from fixed effects regression. The models were analysed separately for each domain (communication, personal social, fine motor and problem-solving) for children with and without NDD accounting for the effects of other domains

Discussion

The prevalence of children with NDD in our sample was 6% across our two cohorts. This finding supports earlier work using the NLSCY which estimated that 6% children between ages of 4 to 11 years have NDD [8]. While it is not possible to make a direct comparison with other published prevalence estimates owing to differences in data sources, age of children, and operationalization of the NDD definition, this percentage is within the range of other Canadian and international estimates [7,8,9, 31, 35, 36]. For example, a recent study using administrative data suggests 8.3% of 6–10-year-old children in British Columbia, Canada were identified as having a NDD [9].

The results from our study indicate that the ASQ specificity was high with 1SD or 2SD cut-offs, showing good accuracy in detecting children who will not develop a NDD. However, the sensitivity varied over time points and cut-offs. The sensitivity for 1 SD at 24 months (83.60%) was the only time point where the sensitivity was high enough to suggest it is an effective screening tool in the general population [12]. The NPV was high (92.90–97.60%) at all time points and for all cut-offs while the PPV was low (10.10–30.30%), reflecting the low prevalence of NDD in our sample. Thus, in general, ASQ was an accurate measure to identify children not at risk of NDD. The ASQ was not an effective screening tool for identifying children at risk of NDD, except when a 1SD cutoff was used at 24 months. When 1SD was used as a cut-off score, the ASQ had better test characteristics as a screening tool compared to 2SD.

Our study confirms findings from several other studies that reported the ability of the ASQ to exclude children without a NDD despite varying populations, settings and definitions used to identify children with a NDD [27, 37, 38]. Skellern et al. found that in general, the ASQ has a low sensitivity and high negative predictive value in detecting children with neurosensory disabilities [37]. They conducted their study in a clinical setting whereas our study was in a population-based sample and used a 2SD cutoff only. In contrast, using the same definition for classification of neurosensory disability for children in developing countries, Yu et al. found an acceptable adjusted sensitivity (87.4%) and specificity (82.3%) in detecting children with neurosensory disabilities across 12 age groups ranging from 12 months to 60 months [38]. One possible explanation for the variation in results could be due to lack of access to more rigorous clinical assessment tools in developing countries. In a study of the general population, Veldhuizen et al. found poor agreement between the ASQ and the Bayley Scales of Infant Development (BSID-III) with a sensitivity of 41% and specificity of 82%. Given Veldhuizen et al. used a 2SD cutoff for the ASQ, their results would only be comparable to the 2SD findings in this study [39].

Our fixed effects regression analysis revealed that communication, personal social and problem-solving scores correlated positively, and fine motor correlated negatively with age of the children. This finding is consistent with the relationship between established US cut-off values and age [25]. Moreover, the differences in domains scores between children with and without NDD increase with age, except for personal social scores (Fig. 2). This may reflect developmental delays becoming more noticeable when children are older, or the ASQ performing better when temporally closer to the age of diagnosis.

These findings offer important implications for practice and research. Waiting until school age for a child to demonstrate a lack of major milestones may not be as effective as an intervention within the first 3 years of life [40]. Using the ASQ as a valid and reliable [25, 28, 41] screening tool to exclude children who do not develop a NDD can help streamline early identification of children who should go through more intensive diagnosis assessment for NDD. An RCT suggests that early screening improves referral rates and time [42]. Children who were screened with the ASQ under 30 months of age were more likely to be identified with developmental delays, referred to early intervention, and eligible for early intervention services in a timelier fashion.

While the evidence on screening for developmental delay under the age of four is inconclusive [43], our findings from population survey data suggests that the 24 months ASQ with 1SD might be a valuable screening tool for identifying children at an early age who are at the high risk of developing a NDD. Inaccurately identifying a child as having a risk of NDD at a very young age could have adverse effects later in life and increase anxiety in parents [44, 45]. While our study showed that in general, the ASQ could be simple and valid screening tool to exclude children who do not develop NDD, we have to accept the risk of false-negatives. Tools with higher specificity come with greater risk of false negatives, which could have adverse consequences [45,46,47]. For those children who are identified as at risk of developing a NDD, appropriate developmental and comprehensive medical evaluations to determine a particular NDD are needed to prompt initiation of specific and appropriate early childhood therapeutic interventions.

Strengths and limitations

The strength of our study is that we have used a large population-based survey, which improves the generalizability of our findings for the Canadian population. The ability to look at the longitudinal relationship of the ASQ domains scores over early development using fixed effect models which control effects of other domains provides insight into the distribution of domain scores at different time points. The study has three limitations. First, the ASQ-2 has been revised to the ASQ-3, which is now typically used in a clinical setting. There are minor differences in wording of items in the two versions and it is possible that this may have some effect on the study results when considering the ASQ-3, however the ASQ authors found few significant differences between the ASQ2 and ASQ3. A study by Kyerematen et al. [48] combined samples from the ASQ 2 and 3 suggesting comparable samples, however the version should be considered when interpreting these results. Second, only four domains of the ASQ were available in the dataset. To address this, we compared the sensitivity and specificity using four domains and all five domains in the cycle 4 data, which has ASQ scores on five domains and did not find any significant differences. Third, the classification of child health was limited to health conditions and behaviours reported by parents and not a clinical scale of behaviour problems.

Conclusion

The high negative predictive value and specificity of the ASQ supports its potential use in identifying children who will not develop a NDD. While low sensitivity was found at most ages of development, the ASQ at 24 months with 1SD may be a good tool as a first step for early identification of children with NDD for early intervention. Further testing of its reliability and validity in a diverse population with all five domains and a clinical gold standard is needed to confirm our results.

Abbreviations

ASQ:

Ages and Stages Questionnaire

HUI:

Health Utilities Index

NDD(s):

Neurodevelopmental Disorder(s)

NPV:

Negative predictive value

PMK:

A person most knowledgeable about the child

PPV:

Positive predictive value

References

  1. American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM-5®). Washington: American Psychiatric Pub; 2013.

  2. Currie J, Stabile M, Manivong P, Roos LL. Child health and young adult outcomes. J Hum Resour. 2010;45(3):517–48.

    Google Scholar 

  3. Boyle CA, Decoufle P, Yeargin-Allsopp M. Prevalence and health impact of developmental disabilities in US children. Pediatrics. 1994;93(3):399–403.

    CAS  PubMed  Google Scholar 

  4. Reichman NE, Corman H, Noonan K. Impact of child disability on the family. Matern Child Health J. 2008;12(6):679–83.

    Article  PubMed  Google Scholar 

  5. Lamsal R, Zwicker JD. Economic evaluation of interventions for children with neurodevelopmental disorders: opportunities and challenges. Appl Health Econ Health Policy. 2017;15(6):763–72.

  6. Stabile M, Allin S. The economic costs of childhood disability. Futur Child. 2012;22(1):65–96.

    Article  Google Scholar 

  7. Control CfD, Prevention. Disabilities among children aged< or= 17 years--United States, 1991-1992. MMWR Morb Mortal Wkly Rep. 1995;44(33):609.

    Google Scholar 

  8. Lach LM, Kohen DE, Garner RE, Brehaut JC, Miller AR, Klassen AF, Rosenbaum PL. The health and psychosocial functioning of caregivers of children with neurodevelopmental disorders. Disabil Rehabil. 2009;31(9):741–52.

    Article  PubMed  Google Scholar 

  9. Arim RG, Miller AR, Guèvremont A, Lach LM, Brehaut JC, Kohen DE. Children with neurodevelopmental disorders and disabilities: a population-based study of healthcare service utilization using administrative data. Dev Med Child Neurol. 2017;59(12):1284–90.

    Article  PubMed  Google Scholar 

  10. Cioni G, Inguaggiato E, Sgandurra G. Early intervention in neurodevelopmental disorders: underlying neural mechanisms. Dev Med Child Neurol. 2016;58(S4):61–6.

    Article  PubMed  Google Scholar 

  11. Campbell F, Conti G, Heckman JJ, Moon SH, Pinto R, Pungello E, Pan Y. Early childhood investments substantially boost adult health. Science. 2014;343(6178):1478–85.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. American Academy Of Pediatrics. Identifying infants and young children with developmental disorders in the medical home: an algorithm for developmental surveillance and screening. Pediatrics. 2006;118:404–19.

    Article  Google Scholar 

  13. Canadian Task Force on Preventive Health C. Recommendations on screening for developmental delay. CMAJ. 2016;188(8):579–87.

    Article  Google Scholar 

  14. Lord C, Risi S, DiLavore PS, Shulman C, Thurm A, Pickles A. Autism from 2 to 9 years of age. Arch Gen Psychiatry. 2006;63(6):694–701.

    Article  PubMed  Google Scholar 

  15. Wiggins LD, Baio J, Rice C. Examination of the time between first evaluation and first autism spectrum diagnosis in a population-based sample. J Dev Behav Pediatr. 2006;27(2):S79–87.

    Article  PubMed  Google Scholar 

  16. Shattuck PT, Durkin M, Maenner M, Newschaffer C, Mandell DS, Wiggins L, Lee L-C, Rice C, Giarelli E, Kirby R. Timing of identification among children with an autism spectrum disorder: findings from a population-based surveillance study. J Am Acad Child Adolesc Psychiatry. 2009;48(5):474–83.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Coo H, Ouellette-Kuntz H, Lam M, Yu C. Correlates of age at diagnosis of autism spectrum disorders in six Canadian regions. Chronic Dis Injuries Can 2012. 32(2):90–100.

  18. Rosenberg SA, Zhang D, Robinson CC. Prevalence of developmental delays and participation in early intervention services for young children. Pediatrics. 2008;121(6):e1503–9.

    Article  PubMed  Google Scholar 

  19. McDonald S, Kehler H, Bayrampour H, Fraser-Lee N, Tough S. Risk and protective factors in early child development: results from the all our babies (AOB) pregnancy cohort. Res Dev Disabil. 2016;58:20–30.

    Article  PubMed  Google Scholar 

  20. Lindsay NM, Healy GN, Colditz PB, Lingwood BE. Use of the ages and stages questionnaire to predict outcome after hypoxic-ischaemic encephalopathy in the neonate. J Paediatr Child Health. 2008;44(10):590–5.

    Article  PubMed  Google Scholar 

  21. Marks K, Hix-Small H, Clark K, Newman J. Lowering developmental screening thresholds and raising quality improvement for preterm children. Pediatrics. 2009;123(6):1516–23.

    Article  PubMed  Google Scholar 

  22. Plomgaard AM, Hansen BM, Greisen G. Measuring developmental deficit in children born at gestational age less than 26 weeks using a parent-completed developmental questionnaire. Acta Paediatr. 2006;95(11):1488–94.

    Article  PubMed  Google Scholar 

  23. Jee SH, Szilagyi M, Ovenshire C, Norton A, Conn A-M, Blumkin A, Szilagyi PG. Improved detection of developmental delays among young children in foster care. Pediatrics. 2010;125(2):282–9.

    Article  PubMed  Google Scholar 

  24. Sices L, Drotar D, Keilman A, Kirchner HL, Roberts D, Stancin T. Communication about child development during well-child visits: impact of parents’ evaluation of developmental status screener with or without an informational video. Pediatrics. 2008;122(5):e1091–9.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Squires J, Bricker D, Potter L. Revision of a parent-completed development screening tool: ages and stages questionnaires. J Pediatr Psychol. 1997;22(3):313–28.

    Article  CAS  PubMed  Google Scholar 

  26. Agarwal PK, Shi L, Daniel LM, Yang PH, Khoo PC, Quek BH, Zheng Q, Rajadurai VS. Prospective evaluation of the ages and stages questionnaire 3rd edition in very-low-birthweight infants. Dev Med Child Neurol. 2017;59(5):484–9.

    Article  PubMed  Google Scholar 

  27. Kerstjens JM, Bos AF, ten Vergert EMJ, de Meer G, Butcher PR, Reijneveld SA. Support for the global feasibility of the ages and stages questionnaire as developmental screener. Early Hum Dev. 2009;85(7):443–7.

    Article  PubMed  Google Scholar 

  28. Flamant C, Branger B, de La Rochebrochard E, Savagner C, Berlie I, Rozé J-C. Parent-completed developmental screening in premature children: a valid tool for follow-up programs. PLoS One. 2011;6(5):e20004.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Statistics Canada: National Longitudinal Survey of children and youth (NLSCY) 2008-2009. In, vol 2016; 2010.

  30. Horsman J, Furlong W, Feeny D, Torrance G. The health utilities index (HUI®): concepts, measurement properties and applications. Health Qual Life Outcomes. 2003;1(1):54.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Arim RG, Kohen DE, Brehaut JC, Guèvremont A, Garner RE, Miller AR, McGrail K, Brownell M, Lach LM, Rosenbaum PL. Developing a non-categorical measure of child health using administrative data. Health Rep. 2015;26(2):9.

    PubMed  Google Scholar 

  32. Blackburn CM, Spencer NJ, Read JM. Prevalence of childhood disability and the characteristics and circumstances of disabled children in the UK: secondary analysis of the family resources survey. BMC Pediatr. 2010;10(1):21.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Zwicker J, Zaresani A, Emery JH. Describing heterogeneity of unmet needs among adults with a developmental disability: an examination of the 2012 Canadian survey on disability. Res Dev Disabil. 2017;65:1–11.

    Article  PubMed  Google Scholar 

  34. Squires J, Bricker DD, Twombly E. Ages & stages questionnaires. Baltimore: Paul H. Brookes; 2009.

    Google Scholar 

  35. Miller AR, Mâsse LC, Shen J, Schiariti V, Roxborough L. Diagnostic status, functional status and complexity among Canadian children with neurodevelopmental disorders and disabilities: a population-based study. Disabil Rehabil. 2013;35(6):468–78.

    Article  PubMed  Google Scholar 

  36. Arim R, Garner R, Brehaut J, Lach L, MacKenzie M, Rosenbaum P, Kohen D. Contextual influences of parenting behaviors for children with neurodevelopmental disorders: results from a Canadian national survey. Disabil Rehabil. 2012;34(26):2222–33.

    Article  CAS  PubMed  Google Scholar 

  37. Skellern CY, Rogers Y, O'Callaghan M. A parent-completed developmental questionnaire: follow up of ex-premature infants. J Paediatr Child Health. 2001;37(2):125–9.

    Article  CAS  PubMed  Google Scholar 

  38. Yu LM, Hey E, Doyle LW, Farrell B, Spark P, Altman DG, Duley L. Evaluation of the ages and stages questionnaires in identifying children with neurosensory disability in the magpie trial follow-up study. Acta Paediatr. 2007;96(12):1803–8.

    Article  PubMed  Google Scholar 

  39. Veldhuizen S, Clinton J, Rodriguez C, Wade TJ, Cairney J. Concurrent validity of the ages and stages questionnaires and Bayley developmental scales in a general population sample. Acad Pediatr. 2015;15(2):231–7.

    Article  PubMed  Google Scholar 

  40. Ozonoff S. Editorial: early detection of mental health and neurodevelopmental disorders: the ethical challenges of a field in its infancy. J Child Psychol Psychiatry. 2015;56(9):933–5.

    Article  PubMed  Google Scholar 

  41. Limbos MM, Joyce DP. Comparison of the ASQ and PEDS in screening for developmental delay in children presenting for primary care. J Dev Behav Pediatr. 2011;32(7):499–511.

    Article  PubMed  Google Scholar 

  42. Guevara JP, Gerdes M, Localio R, Huang YV, Pinto-Martin J, Minkovitz CS, Hsu D, Kyriakou L, Baglivo S, Kavanagh J. Effectiveness of developmental screening in an urban setting. Pediatrics. 2013;131(1):30–7.

    Article  PubMed  Google Scholar 

  43. Warren R, Kenny M, Bennett T, Fitzpatrick-Lewis D, Ali MU, Sherifali D, Raina P. Screening for developmental delay among children aged 1-4 years: a systematic review. CMAJ Open. 2016;4(1):E20.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Hewlett J, Waisbren SE. A review of the psychosocial effects of false-positive results on parents and current communication practices in newborn screening. J Inherit Metab Dis. 2006;29(5):677–82.

    Article  CAS  PubMed  Google Scholar 

  45. Matson JL, Kozlowski AM, Fitzgerald ME, Sipes M. True versus false positives and negatives on the modified checklist for autism in toddlers. Res Autism Spectrum Disorders. 2013;7(1):17–22.

    Article  Google Scholar 

  46. García-Primo P, Hellendoorn A, Charman T, Roeyers H, Dereu M, Roge B, Baduel S, Muratori F, Narzisi A, Van Daalen E. Screening for autism spectrum disorders: state of the art in Europe. Eur Child Adolesc Psychiatry. 2014;23(11):1005–21.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Hall S, Bobrow M, Marteau TM. Psychological consequences for parents of false negative results on prenatal screening for Down's syndrome: retrospective interview study. BMJ. 2000;320(7232):407–12.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  48. Kyerematen V, Hamb A, Oberhelman RA, Cabrera L, Bernabe-Ortiz A, Berry SJ. Exploratory application of the ages and stages (ASQ) child development screening test in a low-income Peruvian shantytown population. BMJ Open. 2014;4(1):e004132.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgments

The authors would like to thank Dr. Rubab G. Arim & Dr. Dafna E. Kohen of Statistics Canada for providing methodological supports. The authors would also like to acknowledge the contribution of the University of Calgary RDC, a part of the Canadian Research Data Centre Network (CRDN). The CRDN is funded through the Social Sciences and Humanities Research Council (SSHRC), the Canadian Institute for Health Research (CIHR), the Canadian Foundation for Innovation (CFI), and Statistics Canada. The opinions expressed in this article are those of the authors and do not represent the views of Statistics Canada.

Funding

The authors would like to thank the Kids Brain Health Network, a Canadian Network of Center for Excellence for supporting this work. While they provided funding for this project, the design of the study and collection, analysis, and interpretation of data and writing of the manuscript was only the effort of the authors. The authors would also like to acknowledge the support of the CHILD-BRIGHT Network under Canada’s Strategy for Patient-Oriented Research (SPOR) initiative.

Availability of data and materials

The data that support the findings of this study are available from Statistics Canada but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of Statistics Canada.

Declarations

None

Author information

Authors and Affiliations

Authors

Contributions

DD made substantial contributions to conception and design of analysis and interpretation of data; RL and JZ were involved in conception, design, data analysis, drafting the manuscript or revising it critically for important intellectual content. All authors approve the final version.

Corresponding author

Correspondence to Jennifer D. Zwicker.

Ethics declarations

Ethics approval and consent to participate

Conjoint Faculties Research Ethics Board review through the University of Calgary was not required as this research relied exclusively on secondary use of anonymous Information (TCPS Article 2.4).

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

The flow chart for the selection of samples for the short and the long short. First, children with NDD were identified and followed them in the previous cycle(s) for ASQ scores. (DOCX 2 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lamsal, R., Dutton, D.J. & Zwicker, J.D. Using the ages and stages questionnaire in the general population as a measure for identifying children not at risk of a neurodevelopmental disorder. BMC Pediatr 18, 122 (2018). https://doi.org/10.1186/s12887-018-1105-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12887-018-1105-z

Keywords