Predictors of Low Patient-Reported Outcomes Response Rates in the California Joint Replacement Registry

doi:10.1016/j.arth.2015.06.029

The Journal of Arthroplasty

Volume 30, Issue 12, December 2015, Pages 2071-2075

https://doi.org/10.1016/j.arth.2015.06.029 Get rights and content

Abstract

Total joint arthroplasty registries are increasingly collecting Patient Reported Outcome Measures (PROM) to more directly measure clinical success after surgery. Obtaining these valuable, complete pre- and post-operative surveys is challenging. We sought to identify specific patient or provider characteristics that are associated with low-reporting of PROM surveys in the California Joint Replacement Registry (CJRR). All reported total hip and knee arthroplasties (n = 6861) during 2011–2014 were retrospectively reviewed. PROMs were prospectively collected to determine factors associated with non-participation. The critical factor in predicting ongoing participation post-operatively was the collection of PROM surveys pre-operatively. Specific patient demographics (race, discharge disposition, occurrence of a complication) and surgeon volume were predictive of non-response and are potential targets for increasing reporting rates.

Section snippets

Material and Methods

The population for this prospective, observational study included 6861 patients enrolled in a statewide registry (CJRR) between 2011 and 2014; 7 TJA patients with malignant neoplasms or pathological fracture were excluded from the study population. The CJRR consists of 71 surgeons from 13 different hospitals within California. Preoperative, 3-month and 1-year postoperative PROMs were administered and collected by physician offices as long as the implant remained in place. The PROM protocol

Results

The bi-variable analysis indicated that patient age, race, ASA class, several preoperative comorbidities (i.e. immunocompromised status, obesity, hypertension, history of myocardial infarction and venous thromboembolism, and coronary artery disease), type of surgery (TKA vs. THA), and surgeon’s TJA volume were significantly associated with lower PROM completion rates at preoperative and follow-ups time points (Table 1, P < 0.05). In addition, patient discharge disposition, postoperative

Discussion

Our study has four major findings: (1) The multivariable logistic regression models identified patient and provider factors with strong predictive power for PROM completion preoperatively and at 3-months and 1-year post-operatively. Lower PROM completion rates in CJRR were associated with specific patient demographic and clinical conditions. (2) Preoperative PROM completion was the most important predictive factor for both short-term (3-month) and longer-term (1-year) PROM completion, and the

Acknowledgements

We appreciate the help in manuscript preparation by Kate Chenok.

References (15)

E.M. Schamber et al.
Barriers to completion of patient reported outcome measures
J Arthroplasty
(2013)
V.J. Hansen et al.
Registries collecting level-I through IV data: Institutional and multicenter use
J Bone Joint Surg Am
(2014)
M.E. Greene et al.
Education attainment is associated with patient-reported outcomes: Findings from the Swedish Hip Arthroplasty Register
Clin Orthop Relat Res
(2014)
G. Hawker et al.
Health-related quality of life after knee replacement
J Bone Joint Surg Am
(1998)
E.J. Novak et al.
Advances in orthopaedic outcomes research
J Surg Orthop Adv
(2008)
D.C. Ayers et al.
Joint registry update- Joint replacement registries in the United States: A new paradigm
J Bone Joint Surg Am
(2014)
Patient-Centered Outcomes Research Institute

There are more references available in the full text version of this article.

Cited by (31)

Non-White Race and Concomitant Orthopedic Conditions Are Risk Factors for Failure to Achieve Clinically Relevant Improvement After Total Knee Arthroplasty
2024, Journal of Arthroplasty
Data from the American Joint Replacement Registry demonstrate that 1-year minimal clinically important difference (MCID) achievement rates after total knee arthroplasty (TKA) are substantially lower when using general patient reported outcome measures, such as Patient-Reported Outcomes Measurement Information System Physical Function (PROMIS-PF), than joint specific measures. The purpose of this study was to evaluate patient characteristics and outcomes associated with MCID achievement after TKA using the PROMIS-PF measure.
A retrospective review of 263 patients undergoing TKA with preoperative and 1-year postoperative PROMIS-PF scores from March 12, 2020 to February 8, 2022 was performed. Three multivariate models were built to evaluate predictors of MCID achievement. Preoperative predictors evaluated included demographics, comorbidities, history of spine and knee surgery, and baseline PROMIS-PF. Postoperative clinical outcomes evaluated included lengths of stay, discharge statuses, complications, and utilizations of other orthopaedic services.
There were 109 patients (41%) who achieved an MCID at 1-year postoperatively. Non-white patients had 2.17 times lower odds of achieving MCID. No clinical outcomes assessed were independently predictive of MCID achievement. During the 1-year postoperative period, 63% of patients sought care for another orthopaedic condition. Patients requiring postoperative injections on another joint had a 2.27 times lower odds of achieving MCID. Those seen for spine conditions postoperatively had a 2.44 lower odds of achieving MCID.
Race, postoperative injections, and treatment for spine conditions after TKA were independent predictors of failure to achieve MCID. These results may guide preoperative patient consultation and risk-adjustment in future studies using PROMIS-PF as an endpoint for evaluation of TKA outcomes.
Completion of Patient-Reported Outcome Measures Improved With Use of a Mobile Application in Arthroplasty Patients: Results From a Randomized Controlled Trial
2024, Journal of Arthroplasty
The collection of patient-reported outcome measures (PROMs) has historically been reported as costly and time-consuming, with low compliance rates that may impact reimbursement. Little research has reported the effects of mobile applications to support PROMs collection following arthroplasty.
Secondary analysis of data from a multicenter randomized controlled trial was performed. Patients undergoing knee and hip arthroplasty were randomized to utilize a smartphone-based care management platform (app) for self-directed rehabilitation and completed joint-specific PROMs (Hip Dysfunction and Osteoarthritis Outcome Score, Joint Replacement or Knee Injury and Osteoarthritis Score, Joint Replacement) via the application at prescribed intervals or on paper during clinic visits. Control patients received practice standard of care, and completed PROMs via emailed hyperlink or during clinic visits following lower limb arthroplasty. Overall, 455 patients underwent knee arthroplasty procedures (245 control, 210 app group) and 380 underwent total hip arthroplasty (206 control, 174 app group). Compliance with expected PROMs completion was calculated through one year postoperatively.
Compliance was higher in the app group preoperatively in both knee (98.1 versus 86.9%, P < .0001) and hip cohorts (96.0 versus 88.4%, P = .008), and postoperatively, including at one year (knees, 72.2 versus 53.7%, P < .0001; hips, 71.1 versus 49.2%, P < .0001). On log-binomial regressions, intervention arm was the strongest predictor of completion of all PROMs, where app users undergoing knee (Relative Risk 2.039, 95% confidence interval (CI) 1.595 to 2.607, P < .000) and hip arthroplasty (2.268 95% CI 1.742 to 2.953, P < .0001) were more likely to be compliant at all timepoints. The majority of patients in the app group, including those over 65 years of age, completed PROMs using the application as opposed to paper methods.
A smartphone mobile application that engages patients during recovery after knee and hip joint arthroplasty improved compliance with completion of preoperative and postoperative PROMs compared to other electronic and paper methods.
Analysis of factors associated with patient-reported outcome (PRO) score completion rate one year after shoulder surgeries
2024, JSES International
Patient-reported outcome measurements (PROMs) are important metrics for monitoring improvements following shoulder surgery. Despite the easy accessibility of electronic PROM surveys, completion rates vary, and factors predictive of survey completion for patients enrolled in medical survey follow-up after shoulder surgery remain largely unknown. The purpose of this study is to investigate survey completion rates for common shoulder procedures and identify factors predictive of PROM completion at one-year postoperatively. We hypothesize that the response rate to shoulder PROMs may vary by the shoulder procedure type after surgery.
Patients undergoing total shoulder arthroplasty (TSA), rotator cuff repair (RCR), and instability surgery (Latarjet procedure [LP], and arthroscopic Bankart repair [ABR]) from 2019 to 2021 were prospectively enrolled. Each patient was administered PROM surveys via email preoperatively and at 2-weeks, 6-weeks, 3-months, 6-months, and 12-months following surgery. Demographics and socioeconomic characteristics were collected from our institutional database. The primary outcome studied was survey completion rate by procedure. Multivariable logistic regression was performed to identify factors predictive of completing 12-month follow-up.
A total of 514 (251 TSA, 194 RCR, and 69 instability surgery (35 LP, 34 ABR)) patients with an average age of 58 ± 15 years were included in this study. Overall, the 12-month survey completion rate for all procedures was 57.2%. TSA had the highest completion rate (64.9%), followed by RCR (52.1%), ABR (44.2%), and LP (42.9%). ABR and LP demonstrated more than a 50% drop in survey response at 2 weeks, and the RCR cohort demonstrated an increased attrition in survey response at the 6-month mark. Patients who completed the 12-month follow-up survey were older [61 ± 14 vs. 54 ± 17; P < .001], less frequently self-identified as Hispanic [13% vs. 23%; P = .009], less frequently single [32% vs. 44%; P = .008], and most frequently classified as the American Society of Anesthesiology [ASA] score II [65%, P = .001].
Postoperative PROM survey completion rates vary significantly among commonly performed shoulder procedures during the first year after surgery. Hispanic ethnicity and younger age were all predictive of a lower propensity, and the TSA procedure is predictive of higher odds for PROM survey completion at the 12-month follow-up.
Non-English Speakers and Socioeconomic Minorities are Significantly Less Likely to Complete Patient-Reported Outcome Measures for Total Hip and Knee Arthroplasty: Analysis of 16,119 Cases
2023, Journal of Arthroplasty
The Comprehensive Care for Joint Replacement requires patient-reported outcome measure (PROM) completion for total knee/hip arthroplasty (TKA/THA) patients. A 90% completion rate to avoid penalties was planned for 2023 but has been delayed. Our analysis compares TKA/THA PROM completion and results across demographics. We hypothesized that minority groups would be less likely to complete PROMs.
A retrospective review was performed from 2018 to 2021 of 16,119 patients who underwent primary elective TKA or THA at a single institution. Pairwise chi-squared tests, t-tests, analysis of variance, and multiple logistic regression analyses were used to compare PROM completion rates and scores across demographics and surgery type (TKA/THA).
Comparing patients who had (N = 7,664) and did not have (N = 8,455) documented PROMs, completion rates were significantly lower in patients who were women, Black, Hispanic, less educated, used Medicaid insurance, lived in lower income neighborhoods, spoke non-English languages, required an interpreter, and underwent TKA versus THA. After regression analyses, odds ratios for PROM completion remained significantly lower in non-English speakers, Hispanic and Medicaid patients, lower income groups, and patients undergoing TKA. For the 31.8% of patients who completed both preoperative/postoperative PROMs, women, Black, and non-English speaking patients had significantly lower PROM scores for most measures preoperatively and postoperatively despite similar or better improvements after surgery.
Patients undergoing TKA and non-English speaking, ethnic, and socioeconomic minorities are less likely to complete PROMs. Strategies to create, validate, and collect PROMs for these populations are needed to avoid exacerbation of healthcare disparities.
Factors associated with completion of patient surveys 1 year after bariatric surgery
2021, Surgery for Obesity and Related Diseases
Patient-reported outcomes (PRO) obtained from follow-up survey data are essential to understanding the longitudinal effects of bariatric surgery. However, capturing data among patients who are well beyond the recovery period of surgery remains a challenge, and little is known about what factors may influence follow-up rates for PRO.
To assess the effect of hospital practices and surgical outcomes on patient survey completion rates at 1 year after bariatric surgery.
Prospective, statewide, bariatric-specific clinical registry.
Patients at hospitals participating in the Michigan Bariatric Surgery Collaborative are surveyed annually to obtain information on weight loss, medication use, satisfaction, body image, and quality of life following bariatric surgery. Hospital program coordinators were surveyed in June 2017 about their practices for ensuring survey completion among their patients. Hospitals were ranked based on 1-year patient survey completion rates between 2011 and 2015. Multivariable regression analyses were used to identify associations between hospital practices, as well as 30-day outcomes, on hospital survey completion rankings.
Overall, patient survey completion rates at 1 year improved from 2011 (33.9% ± 14.5%) to 2015 (51.0% ± 13.0%), although there was wide variability between hospitals (21.1% versus 77.3% in 2015). Hospitals in the bottom quartile for survey completion rates had higher adjusted rates of 30-day severe complications (2.6% versus 1.7%, respectively; P = .0481), readmissions (5.0% versus 3.9%, respectively; P = .0157), and reoperations (1.5% versus .7%, respectively; P = .0216) than those in the top quartile. While most hospital practices did not significantly impact survey completion at 1 year, physically handing out surveys during clinic visits was independently associated with higher completion rates (odds ratio, 13.60; 95% confidence interval, 1.99−93.03; P =.0078).
Hospitals vary considerably in completion rates of patient surveys at 1 year after bariatric surgery, and lower rates were associated with hospitals that had higher complication rates. Hospitals with the highest completion rates were more likely to physically hand surveys to patients during clinic visits. Given the value of PRO on longitudinal outcomes of bariatric surgery, improving data collection across multiple hospital systems is imperative.
Preparing for an Era of Episode-Based Care in Total Joint Arthroplasty
2021, Journal of Arthroplasty
With a history of steadily rising healthcare costs, the United States faces an unprecedented set of health and financial challenges. The COVID-19 pandemic will only exacerbate these challenges, and it is of paramount importance to reform and refine health systems to maximize the value of care delivered to the patient. Recent developments related to value improvement in total joint arthroplasty suggest that episode-based payment is likely to become standard practice given the current healthcare environment. Consequently, developing episode-based care models for total joint arthroplasty is in the best interests of surgeons, health systems, and patients. In this article, we review important developments related to value-based care in total joint arthroplasty and present an episode-based framework for delivering high-value, patient-centric care. We examine each phase of a total joint arthroplasty episode—preoperative, acute, post-acute, and follow up—and present several ideas with developing bodies of evidence that can improve the value of care delivered to the patient.

View all citing articles on Scopus

: One or more of the authors of this paper have disclosed potential or pertinent conflicts of interest, which may include receipt of payment, either direct or indirect, institutional support, or association with an entity in the biomedical field which may be perceived to have potential conflict of interest with this work. For full disclosure statements refer to http://dx.doi.org/10.1016/j.arth.2015.06.029.

View full text

Predictors of Low Patient-Reported Outcomes Response Rates in the California Joint Replacement Registry

Abstract

Section snippets

Material and Methods

Results

Discussion

Acknowledgements

J Arthroplasty

Registries collecting level-I through IV data: Institutional and multicenter use

J Bone Joint Surg Am

Education attainment is associated with patient-reported outcomes: Findings from the Swedish Hip Arthroplasty Register

Clin Orthop Relat Res

Health-related quality of life after knee replacement

J Bone Joint Surg Am

Advances in orthopaedic outcomes research

J Surg Orthop Adv

Joint registry update- Joint replacement registries in the United States: A new paradigm

J Bone Joint Surg Am

Patient-Centered Outcomes Research Institute