Hostname: page-component-848d4c4894-wzw2p Total loading time: 0 Render date: 2024-05-16T16:02:00.141Z Has data issue: false hasContentIssue false
  • English
  • Français

Assessing data accuracy in a large multi-institutional quality improvement registry: an update from the Pediatric Cardiac Critical Care Consortium (PC4)

Published online by Cambridge University Press:  28 December 2021

Jennifer Schuette Open the ORCID record for Jennifer Schuette [Opens in a new window] ,
Hayden Zaccagni ,
Janet Donohue ,
Julie Bushnell ,
Kelly Veneziale ,
Michael Gaies  and
Sarah Tabbutt
Jennifer Schuette*
Affiliation:
Department of Anesthesiology and Critical Care Medicine, Johns Hopkins Children’s Center and Johns Hopkins University School of Medicine, Baltimore, MD, USA
Hayden Zaccagni
Affiliation:
Division of Pediatric Cardiology, Children’s of Alabama and University of Alabama at Birmingham School of Medicine, Birmingham, AL, USA
Janet Donohue
Affiliation:
Division of Pediatric Cardiology, C.S. Mott Children’s Hospital, Ann Arbor, MI, USA
Julie Bushnell
Affiliation:
UCSF Benioff Pediatric Heart Center, UCSF Benioff Children’s Hospital, San Francisco, CA, USA
Kelly Veneziale
Affiliation:
Center for Healthcare Quality and Analytics, Children’s Hospital of Philadelphia, Philadelphia, PA, USA
Michael Gaies
Affiliation:
Division of Pediatric Cardiology, C.S. Mott Children’s Hospital and University of Michigan School of Medicine, Ann Arbor, MI, USA
Sarah Tabbutt
Affiliation:
Department of Pediatrics, Benioff Children’s Hospital, University of California San Francisco School of Medicine, San Francisco, CA, USA
*
Author for correspondence: J. Schuette, MD, MS, Department of Anesthesiology and Critical Care Medicine, Johns Hopkins Children’s Center and Johns Hopkins University School of Medicine, 1800 Orleans Street, Bloomberg 6347, Baltimore, MD 21287, USA. Tel: 410-955-2393. E-mail: schuette@jhmi.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Background:

The Pediatric Cardiac Critical Care Consortium (PC4) is a multi-institutional quality improvement registry focused on the care delivered in the cardiac ICU for patients with CHD and acquired heart disease. To assess data quality, a rigorous procedure of data auditing has been in place since the inception of the consortium.

Materials and methods:

This report describes the data auditing process and quantifies the audit results for the initial 39 audits that took place after the transition from version one to version two of the registry’s database.

Results:

In total, 2219 total encounters were audited for an average of 57 encounters per site. The overall data accuracy rate across all sites was 99.4%, with a major discrepancy rate of 0.52%. A passing score is based on an overall accuracy of >97% (achieved by all sites) and a major discrepancy rate of <1.5% (achieved by 38 of 39 sites, with 35 of 39 sites having a major discrepancy rate of <1%). Fields with the highest discrepancy rates included arrhythmia type, cardiac arrest count, and current surgical status.

Conclusions:

The extensive PC4 auditing process, including initial and routinely scheduled follow-up audits of every participating site, demonstrates an extremely high level of accuracy across a broad array of audited fields and supports the continued use of consortium data to identify best practices in paediatric cardiac critical care.

Keywords

Cardiaccritical caredatabaseauditpaediatric
Type
Original Article
Information
Cardiology in the Young , Volume 32 , Issue 11 , November 2022 , pp. 1742 - 1747
Check for updates
Copyright
© The Author(s), 2021. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Gaies, M, Cooper, DS, Tabbutt, S, et al. Collaborative quality improvement in the cardiac intensive care unit: development of the Paediatric Cardiac Critical Care Consortium (PC4). Cardiol Young 2015; 25: 951–957.CrossRefGoogle ScholarPubMed
Gaies, M, Donohue, JE, Willis, GM, et al. Data integrity of the Pediatric Cardiac Critical Care Consortium (PC4) clinical registry. Cardiol Young 2016; 26: 1090–1096.CrossRefGoogle ScholarPubMed
Lyu, H, Cooper, M, Patel, K, et al. Prevalence and data transparency of national clinical registries in the United States. J Healthc Qual 2016; 38: 223–234.CrossRefGoogle ScholarPubMed
Md Emdadul Hoque, D, Ruseckaite, R, Lorgelly, P, McNeil, JJ, Evans, SM. Cross-sectional study of characteristics of clinical registries in Australia: a resource for clinicians and policy makers. Int J Qual Health Care 2018; 30: 192–199.CrossRefGoogle Scholar
Black, N, Barker, M, Payne, M. Cross sectional survey of multicentre clinical databases in the United Kingdom. BMJ 2004; 328: 1478.CrossRefGoogle ScholarPubMed
Stow, PJ, Hart, GK, Higlett, T, et al. Development and implementation of a high-quality clinical database: the Australian and New Zealand Intensive Care Society Adult Patient Database. J Crit Care 2006; 21: 133–141.CrossRefGoogle ScholarPubMed
Andrianopoulos, N, Dinh, D, Duffy, SJ, et al. Quality control activities associated with registries in interventional cardiology and surgery. Heart Lung Circ 2011; 20: 180–186.CrossRefGoogle ScholarPubMed
Shahian, DM, Jacobs, JP, Edwards, FH, et al. The society of thoracic surgeons national database. Heart 2013; 99: 1494–1501.CrossRefGoogle ScholarPubMed
Magee, MJ. Database audit in thoracic surgery. Thorac Surg Clin 2017; 27: 291–296.CrossRefGoogle ScholarPubMed
Overman, DM, Jacobs, ML, O'Brien, JE, et al. Ten years of data verification: The Society of Thoracic Surgeons Congenital Heart Surgery Database Audits. World J Pediatr Congenit Heart Surg 2019; 10: 454–463.CrossRefGoogle Scholar
Wang, RY, Storey, VC, Firth, CP. A framework for analysis of data quality research. IEEE Trans Knowl Data Eng 1995; 7: 623–640.CrossRefGoogle Scholar
Assareh, H, Waterhouse, MA, Moser, C, et al. Data quality improvement in clinical databases using statistical quality control: review and case study. Ther Innov Regul Sci 2013; 47: 70–81.CrossRefGoogle ScholarPubMed
Arts, DG, De Keizer, NF, Scheffer, GJ. Defining and improving data quality in medical registries: a literature review, case study, and generic framework. J Am Med Inform Assoc 2002; 9: 600–611.CrossRefGoogle ScholarPubMed
Hewson-Conroy, KM, Tierney, LT, Burrell, AR. Assessment and perceptions of intensive care data quality, reporting and use: a survey of ICU directors. Anaesth Intensive Care 2012; 40: 675–682.CrossRefGoogle ScholarPubMed
Gaies, M, Pasquali, SK, Banerjee, M, et al. Improvement in pediatric cardiac surgical outcomes through interhospital collaboration. J Am Coll Cardiol 2019; 74: 2786–2795.CrossRefGoogle ScholarPubMed
Supplementary material: File

Schuette et al. supplementary material

Table S1

Download Schuette et al. supplementary material(File)
File 58.7 KB