Trends in COVID-19 vaccine administration across visit types in a safety net pediatric practice during the first year of authorization
Grace W. Ryan1*† 
Melissa Goulding1† 
Angela L. Beeler2 Beverly L. Nazarian2,3 Lori Pbert1 Milagros C. Rosal1 
Stephenie C. Lemon1
- 1Division of Preventive and Behavioral Medicine, Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, Worcester, MA, United States
- 2Department of Pediatrics, UMass Memorial Health, Worcester, MA, United States
- 3Department of Pediatrics, UMass Chan Medical School, Worcester, MA, United States
We explored patterns of COVID-19 vaccination across pediatric visit types using electronic health record data from 7/1/2021 through 7/25/2022 in a pediatric safety-net clinic. We generated frequencies and descriptive statistics for patient demographic and vaccine administration variables. Analyses were stratified into age subgroups of 5-to-11-year-olds and 12- to-17-year-olds. 1,409 children received at least one dose of the COVID-19 vaccine and 2,197 doses were administered in this first year of vaccine delivery. Most vaccines given were first doses in the series (45%), followed by second doses (38%), and then booster doses (17%). First doses tended to be given at well-child (42%) or nurse visits (48%), while second doses were almost entirely given at nurse visits (87%) and booster doses at well-child visits (58%). Efforts to optimize COVID-19 vaccination could leverage clinic workflow systems to provide reminder prompts for vaccination for scheduling future doses and identify strategies to facilitate vaccination at non-well child visits, particularly for booster doses.
1. Introduction
COVID-19 vaccination prevents severe disease and hospitalization in children and adolescents (1). While the COVID-19 vaccines have been available to adolescents (ages 12–15) since Spring 2021, and to 5- to 11-year-olds since Fall 2021 (2), vaccination rates for these populations have stalled and as of December 2022 only 32% of 5- to 11-year-olds and 61% of 12- to 17-year-olds had completed their primary series (3). As COVID-19 reaches endemic levels and additional booster shots may be recommended, it is critical to establish long-term strategies for vaccinating pediatric populations.
Pediatric practices are the most likely delivery site for COVID-19 vaccines among children moving forward. Across multiple studies, parents have reported their pediatricians' offices as the most desirable location to get their children vaccinated (4, 5) and research on other vaccines indicates that pediatricians are trusted messengers and play a critical role in vaccine promotion (6). However, in comparison to other pediatric vaccines, COVID-19 vaccine delivery within pediatric practice presents unique challenges. These include requiring a 15-min post-vaccination waiting period, multiple doses with specific time intervals, and in some cases more rigorous storage requirements than other pediatric vaccines (e.g., the Pfizer-BioNTech vaccine requires storage at negative 130 to negative 76 degrees Fahrenheit). It is important to note that due to these logistical challenges (i.e., constantly changing guidelines; time required to reconstitute vaccines), not all pediatric settings are able to offer these vaccines (7). A national analysis conducted between November 2021 and April 2022 found that only 30% of US counties had a pediatric provider offering COVID-19 vaccines (8).
Despite the clear role of pediatric practices in delivering vaccinations, little is known about COVID-19 administration patterns in this setting. Gaining a better understanding of vaccine delivery in the pediatric practice setting could support future vaccine promotion efforts. With other vaccines, for example, successful strategies for increasing uptake include recommending and offering vaccines at all types of visits (9), not just well-child visits, and offering nurse or immunization-only visits to ease scheduling burden for parents. To begin identifying potential strategies to optimize COVID-19 vaccine delivery, we analyzed vaccine administration data in a safety net pediatric clinic within a system affiliated with a medical center in Central Massachusetts to explore trends in uptake and delivery patterns during the first year of COVID-19 vaccine delivery.
2. Methods
Patient-level vaccine administration data from a pediatric clinic within the UMass Memorial Health system was obtained from electronic health records (EHR) (Epic). The clinic began administering COVID-19 vaccines beginning 7/13/2021, and thus our data ranges from 7/13/2021 through 7/25/2022. The clinic exclusively offers the Pfizer-BioNTech vaccine. On an average day the clinic is staffed by 4 FTE (full time equivalent) of physician time, 2 FTE nurse practitioners, and 3 FTE nursing staff. Overall, the clinic has approximately 18,000 pediatric visits per year. Most of their patient population is covered by Medicaid (60%), 40% identifies as Hispanic/Latino and 10% prefers a language other than English.
EHR data on all patients between ages 5 and 17 who received any COVID-19 vaccination during the time period of interest included: date of vaccine administration, dose in the series (first, second, or booster dose), type of visit at which vaccine administration occurred (i.e., well child; follow-up; nurse-only; or sick visit), patient sex, age, race/ethnicity and language. We generated frequencies and descriptive statistics for all variables of interest. We used χ2 tests to assess differences in demographics across types of visits and to explore differences in types of visits for different doses in the series. All analyses were stratified into age subgroups of 5- to 11-year-olds and 12- to 17-year-olds. Vaccine administration data were aggregated and graphed by month to explore trends over time. Additionally, we used data from the Massachusetts Department of Public Health on monthly COVID-19 case counts to assess trends in vaccine administration during surges of the pandemic. This study received a not human subjects' determination from the University of Massachusetts Chan Medical School Institutional Review Board.
3. Results
Overall, 1,409 children were vaccinated in the clinic from July 13, 2021 to July 25, 2022. A little over half (55%) of those vaccinated were in the 5–11 age group. Child demographic characteristics by the visit type of the first COVID-19 vaccine dose that they received in the clinic are shown in Table 1. We observed significant associations between age category (p < 0.001) and race/ethnicity (p = 0.02) by visit type. In this first year of vaccine administration a total of 2,197 doses were administered to the 1,409 unique patients. In terms of dose in the series, the largest percentage of those administered were first doses (45%), followed by second doses (38%) and booster doses (17%). Of the patients who received a first dose at this clinic, 72% returned for their second dose there (70% in 5- to 11-year-olds and 75% in 12- to 17-year-olds).
Table 1. Patient demographics by type of visit for first dose of COVID-19 vaccine series at a pediatric safety-net clinic, Worcester MA, July 2021 to July 2022 (N = 1,409).
We also explored at which types of visits doses were typically administered, and χ2 test indicated a statistically significant association between dose and visit type. First doses of the series tended to be given at well-child visits (42.4%) or nurse visits (48.8%), while second doses were almost entirely given at nurse visits (87.9%) and booster doses at well-child visits (58.9%) (Table 2). Finally, we graphed monthly uptake of the vaccine to assess the relationship between uptake and local COVID-19 cases. Figure 1 displays doses of the COVID-19 vaccine administered by age group and month. For the 5–11-year-old age group, most doses were administered during the 3 months after Emergency Use Authorization (EUA) approval (November 2021 through January 2022) with most doses being the first in the series. For the 12–17-year-old age group, the most doses were administered in August 2021 and these doses were split between the first and second in the series. Figure 1 also depicts weekly case rates for Worcester County, where most of the clinic's patients reside, and highlights the spike caused by the Omicron variant with cases beginning to rise in November 2021, and ultimately peaking to nearly 2,500 cases per 100,000 residents in January 2022.
Table 2. COVID-19 vaccine doses administration by Age group and type of visit from July 2021 to July 2022 in a pediatric safety-net clinic, Worcester, MA (N = 2,197).
Figure 1. COVID-19 vaccine administration in a pediatric safety-net clinic, Worcester, MA and Worcester County weekly case rates July 2021 to July 2022.
4. Discussion
Examining trends in COVID-19 vaccine administration at a pediatric practice in the first-year post-approval for 12- to 17-year-olds and 5- to 11-year-olds, we gained important insight into when these vaccines are being administered and how that might be influenced by contextual factors. These findings have implications for COVID-19 vaccine delivery going forward, and also more broadly for other seasonal or multi-dose vaccines (e.g., HPV, influenza). With COVID-19 vaccination rates among pediatric populations lagging and the likelihood that further booster doses may be needed (10, 11), it is critical to improve vaccine delivery to ensure the prevention of excess morbidity and mortality from COVID-19 infections.
In exploring at which visit types COVID-19 vaccines were administered, an interesting pattern arose which gives context to who may be initiating vaccination. We found that first doses were often administered at nurse or well child visits, suggesting that this dose may be parent and provider driven as parents would initiate a nurse visit for the purpose of vaccination and providers would recommend vaccination at well visits. Second doses primarily occurred at nurse visits again implying parent and provider initiation as nurse visits for a second dose could be booked independently by the parent if the first dose was received elsewhere or based on provider's request to return for the second dose. In contrast, our data implied booster doses were mainly provider driven. We found that booster doses were most common at well-child visits but also administered more than the other doses at follow-up and sick visits. The administration of vaccines at these visits may indicate that providers in this clinic are trying to take advantage of all opportunities to vaccinate children, rather than waiting for preventive care or parent-initiated visits. This strategy of reducing missed opportunities by taking better advantage of acute care visits (i.e sick visits or follow up visits) has been shown to increase rates for other vaccines (12, 13) and should be promoted for use with COVID-19 vaccination. Given that the primary contraindications for COVID-19 vaccination are allergic reaction or active COVID-19 infection, there are many instances in which children may be in their pediatric practice and eligible for vaccination. Strategies like integrating EHR pop-ups to check vaccine status at all visit types (14–16) may help to further encourage providers to take advantage of all visits either to vaccinate or to schedule a return visit for vaccination. Additionally, offering nurse-only visits which parents can schedule specifically for vaccination and potentially increasing nursing staff capacity to accommodate these appointments may be important strategies in supporting pediatric practices' capacity to vaccinate.
We also were able to discern trends in administration based on contextual factors. For example, we saw increases in COVID-19 vaccine doses administered prior to the beginning of the school year and in the weeks during this county's Omicron surge. August is often a popular time to target vaccine promotion efforts due to the influx of children coming into clinics for well child and sports' physicals, going forward COVID-19 vaccination should also be promoted during this time. Moreover, while ideally continued vaccination will prevent future COVID-19 surges like the one experienced due to Omicron, knowing the patterns of the virus allows us to predict optimal timing for vaccination. Similar to influenza and other respiratory viruses, winter surges seem common with COVID-19, therefore messaging should focus on getting vaccinated prior to these potential surges, rather than during. Additionally, pediatric practices can and should prepare to increase capacity for vaccine administration during these times.
Beyond understanding these patterns, our results further support the need to focus on pediatric practice clinics as the ideal setting for pediatric COVID-19 vaccination. There is extensive research showing that parents would prefer to get their child vaccinated in their own pediatricians' offices (4, 5). In our study, we found that 72% of children who received their first dose at the clinic returned for their second dose, suggesting that parents felt comfortable or appreciated the convenience of getting their child vaccinated at their pediatricians' office, as they do with most other routine vaccines. Furthermore, the percentage of 5- to 11-year-olds who returned for their second dose at this clinic (70%) is considerably higher than the rate for the entire state of Massachusetts (53%) (17). While this difference may be due to differential uptake and vaccine perceptions across the state, one possible explanation is that it could be due to more positive vaccine experiences within pediatric clinics as compared to experiences in alternative vaccine settings (e.g., community-settings, pharmacies) (18, 19). Although there is a push for alternative vaccine settings, it seems clear that for the pediatric population, the focus needs to be on supporting pediatricians in their ability to administer COVID-19 vaccines within their practices.
4.1. Limitations
There are several limitations that should be acknowledged in interpreting our results. First, these results are limited to a single clinic within an academic medical center, and not representative of the experience of all clinics, especially clinics that are community-based, in other geographic areas, or that lack the capacity to offer the COVID-19 vaccines. Moreover, vaccine rollout varied state to state and in Massachusetts, mass vaccination sites were prioritized over individual clinics, which could have affected uptake. Furthermore, we do not have access to these patients' full medical records, therefore it is possible that they received doses outside of this clinic. This would be especially true for patients between ages 12 and 17 as the clinic began offering the vaccine three months after EUA for this age group. Likewise, this makes it impossible in this analysis to estimate prevalence of vaccination receipt within the clinic. Despite these limitations, our results offer insight into challenges of pediatric COVID-19 vaccine delivery and highlight potential strategies for improving vaccination in this age group.
4.2. Conclusions
This analysis allowed the exploration of patterns in COVID-19 vaccination and began to identify opportunities to improve vaccine delivery. Other clinical settings may see different vaccination trends and a similar exercise could help them identify opportunities to improve COVID-19 vaccine delivery. Future work in this area could prioritize optimizing COVID-19 vaccine delivery within pediatric practices by leveraging clinic workflow systems to provide reminder prompts for vaccination for scheduling future doses or identifying strategies to facilitate vaccination at non-well child visits. Ultimately, this analysis shed light on the ways in which clinic-level data can be used to understand these trends and the utility in exploring vaccine administration data in this way.
Data availability statement
The data analyzed in this study is subject to the following licenses/restrictions: We used electronic health record data proprietary to our health system that contains PHI therefore we are unable to share this data. Requests to access these datasets should be directed to grace.ryan1@umassmed.edu.
Ethics statement
The studies involving humans were approved by University of Massachusetts Chan Medical School Institutional Review Board. The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required from the participants or the participants’ legal guardians/next of kin in accordance with the national legislation and institutional requirements.
Author contributions
GR and MG conceptualized this study, analyzed and interpreted results, and drafted the first draft of the manuscript. AB and BN interpreted results and contributed to the first draft of the manuscript. LP, MR, and SL interpreted the results and revised the work critically for important intellectual content. All authors contributed to manuscript revision and read and approved the submitted draft. All authors contributed to the article and approved the submitted version.
Funding
This work was supported by the Centers for Disease Control and Prevention [6 U48DP006381-02-02]. GR is supported by National Cancer Institute Grant [T32 CA172009]. MG is supported by the National Heart Lung and Blood Institute [F31HL164126]. Funders had no involvement in this project.
Acknowledgments
We would like to thank the UMass Memorial System Quality Informatics team for supplying the data for this project.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Klein NP, Stockwell MS, Demarco M, Gaglani M, Kharbanda AB, Irving SA, et al. Effectiveness of COVID-19 pfizer-BioNTech BNT162b2 mRNA vaccination in preventing COVID-19-associated emergency department and urgent care encounters and hospitalizations among nonimmunocompromised children and adolescents aged 5–17 years—vISION network, 10 states, April 2021-January 2022. MMWR Morb Mortal Wkly Rep. (2022) 71(9):352–8. (Published 2022 Mar 4). doi: 10.15585/mmwr.mm7109e3
2. Centers for Disease Control and Prevention. COVID-19. Advisory committee on immunization practices (ACIP) (2022). Available at: https://www.cdc.gov/vaccines/hcp/acip-recs/vacc-specific/covid-19.html (Accessed January 6, 2023).
3. Centers for Disease Control and Prevention. Trends in demographic characteristics of people receiving COVID-19 vaccinations in the United States (2022). Available at: https://covid.cdc.gov/covid-data-tracker/#vaccination-demographics-trends (Accessed January 5, 2023).
4. Scherer AM, Gedlinske AM, Parker AM, Gigengil CA, Askelson NM, Petersen CA, et al. Acceptability of adolescent COVID-19 vaccination among adolescents and parents of adolescents—United States, April 15–23, 2021. MMWR Morb Mortal Wkly Rep. (2021) 70(28):997–1003. (Published 2021 Jul 16). doi: 10.15585/mmwr.mm7028e1
5. Goulding M, Ryan GW, Minkah P, Borg A, Gonzalez M, Medina N, et al. Parental perceptions of the COVID-19 vaccine for 5- to 11-year-old children: focus group findings from Worcester Massachusetts. Hum Vaccin Immunother. (2022) 18(6):2120721 (published online ahead of print, 2022 Sep 9). doi: 10.1080/21645515.2022.2120721
6. Edwards KM, Hackell JM; COMMITTEE ON INFECTIOUS DISEASES, THE COMMITTEE ON PRACTICE AND AMBULATORY MEDICINE. Countering vaccine hesitancy. Pediatrics. (2016) 138(3):e20162146. doi: 10.1542/peds.2016-2146
7. Ryan GW, Goulding M, Borg A, Minkah P, Hermann S, Fisher L, et al. Clinician perspectives on pediatric COVID-19 vaccination: a qualitative study in central and western, Massachusetts. Prev Med Rep. (2022) 29:101966. doi: 10.1016/j.pmedr.2022.101966
8. DeCuir J, Meng L, Pan Y, Vogt T, Chatham-Stevens K, Meadow S, et al. COVID-19 vaccine provider availability and vaccination coverage among children aged 5-11 years—United States, November 1, 2021-April 25, 2022. MMWR Morb Mortal Wkly Rep. (2022) 71(26):847–51. (Published 2022 Jul 1). doi: 10.15585/mmwr.mm7126a3
9. Pruitt SL, Tiro JA, Kepka D, Henry K. Missed vaccination opportunities among U. S. adolescents by area characteristics. Am J Prev Med. (2022) 62(4):538–47. doi: 10.1016/j.amepre.2021.10.014
10. Kelly SL, Le Rutte EA, Richter M, Penny MA, Shattock AJ. COVID-19 vaccine booster strategies in light of emerging viral variants: frequency, timing, and target groups. Infect Dis Ther. (2022) 11(5):2045–61. doi: 10.1007/s40121-022-00683-z
11. Iacobucci G. COVID-19: England is preparing to offer annual booster vaccination, says NHS boss. Br Med J. (2021) 375:n2824. (Published 2021 Nov 17). doi: 10.1136/bmj.n2824
12. Rand CM, Concannon C, Wallace-Brodeur R, Davis W, Albertin CS, Humiston SG, et al. Identifying strategies to reduce missed opportunities for HPV vaccination in primary care: a qualitative study of positive deviants. Clin Pediatr (Phila). (2020) 59(12):1058–68. doi: 10.1177/0009922820930357
13. Kelly MK, Grundmeier RW, Stephens-Shields AJ, Local R, Shone LP, Wright M, et al. Missed opportunities for human papillomavirus vaccination at office visits during which influenza vaccine was administered: an AAP pediatric research in office settings (PROS) national primary care research network study. Vaccine. (2020) 38(33):5105–8. doi: 10.1016/j.vaccine.2020.05.090
14. Au L, Oster A, Yeh GH, Magno J, Paek HM. Utilizing an electronic health record system to improve vaccination coverage in children. Appl Clin Inform. (2010) 1(3):221–31. (Published 2010 Jul 14). doi: 10.4338/ACI-2009-12-CR-0028
15. Fiks AG, Grundmeier RW, Biggs LM, Localio AR, Alessandrini EA. Impact of clinical alerts within an electronic health record on routine childhood immunization in an urban pediatric population. Pediatrics. (2007) 120(4):707–14. doi: 10.1542/peds.2007-0257
16. Szilagyi PG, Serwint JR, Humiston SG, Rand CM, Schaffer S, Vincelli P, et al. Effect of provider prompts on adolescent immunization rates: a randomized trial. Acad Pediatr. (2015) 15(2):149–57. doi: 10.1016/j.acap.2014.10.006
17. Massachusetts Department of Public Health. Weekly COVID-19 vaccination report (2022). Available at: https://www.mass.gov/doc/weekly-covid-19-vaccination-report-november-16-2022/download (Accessed November 22, 2022).
18. Hess K, Bach A, Won K, Seed SM. Community pharmacists roles during the COVID-19 pandemic. J Pharm Pract. (2022) 35(3):469–76. doi: 10.1177/0897190020980626
Keywords: COVID-19 vaccination, electronic health record data, pediatrics, safety-net clinic, vaccine administration
Citation: Ryan GW, Goulding M, Beeler AL, Nazarian BL, Pbert L, Rosal MC and Lemon SC (2023) Trends in COVID-19 vaccine administration across visit types in a safety net pediatric practice during the first year of authorization. Front. Pediatr. 11:1227115. doi: 10.3389/fped.2023.1227115
Received: 22 May 2023; Accepted: 17 October 2023;
Published: 6 November 2023.
Edited by:
Jérémie F. Cohen, Necker-Enfants malades Hospital, FranceReviewed by:
Antonina Argo, University of Palermo, ItalyEllen Kerns, University of Nebraska Medical Center, United States
© 2023 Ryan, Goulding, Beeler, Nazarian, Pbert, Rosal and Lemon. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Grace W. Ryan grace.ryan1@umassmed.edu
†These authors share co-first authorship