Abstract
Background
We have been conducting a Japanese trial-ready cohort web study since 2019 as a web-based online registry to enroll individuals with preclinical Alzheimer’s disease to facilitate trials on Alzheimer’s disease prevention. The usability of a website might be an important factor in determining user participation and retention.
Objectives
We conducted a user questionnaire survey to analyze the usability of the Japanese trial-ready cohort website and user characteristics for future website improvement.
Design
This was a cross-sectional prospective observational study.
Setting
Online survey using Google Forms.
Participants
Among the Japanese trial-ready cohort web study participants, we enrolled those who provided consent to participate in the study and had completed one or more Cognitive Function Instrument tests before May 2, 2023. We sent an invitation e-mail, including the questionnaire web address, to eligible participants on July 21 and 22, 2023.
Measurements
We analyzed the questionnaire answers, including the system usability scale score and time of response (in 24 h). We also compared the respondents’ characteristics with that of all the Japanese trial-ready cohort web study participants to identify features associated with an increased/decreased response rate to the questionnaire.
Results
Among the 10,112 Japanese trial-ready cohort web study participants that we sent invitation e-mails, we received 1,574 eligible responses (15.6%) within three weeks of the response acceptance period. The mean system usability scale score was 67.6, and no difference in system usability scale scores was observed in terms of age or sex. Approximately half of the respondents of the Japanese trial-ready cohort web study heard about it online, whereas one-fourth heard about it via newspapers. Contribution to drug development for dementia treatment was the most frequent motivation for participating in the Japanese trial-ready cohort web study (51.5%), followed by participation in the latest research (48.1%), concerns about self-memory (43.4%), and a family history of dementia (34.6%). Female respondents responded approximately 1.5 h later than male respondents. Lastly, those who had participated in the Japanese trial-ready cohort onsite study, were in their 70’s, or had a larger number of Cognitive Function Instrument or Cogstate tests completion history were more likely to respond to the current online survey (relative risk of response > 1).
Conclusions
We conducted an online survey using Google Forms for participants in the Japanese trial-ready cohort web study to determine the usability. The results of this study might help to improve the user experience of the Japanese trial-ready cohort website itself, increase the web study registrants, maintain user retention, facilitate future online surveys, and serve as a reference for other web-based registries of presymptomatic disease status.
Similar content being viewed by others
References
Cummings J, Zhou Y, Lee G, Zhong K, Fonseca J, Cheng F. Alzheimer’s disease drug development pipeline: 2023. Alzheimers Dement (N Y). 2023 May 25;9(2):e12385. doi: https://doi.org/10.1002/trc2.12385.
Hampel H, Cummings J, Blennow K, Gao P, Jack CR Jr, Vergallo A. Developing the ATX(N) classification for use across the Alzheimer disease continuum. Nat Rev Neurol. 2021 Sep;17(9):580–589. doi: https://doi.org/10.1038/s41582-021-00520-w.
Parnetti L, Chipi E, Salvadori N, D’Andrea K, Eusebi P. Prevalence and risk of progression of preclinical Alzheimer’s disease stages: a systematic review and meta-analysis. Alzheimers Res Ther. 2019 Jan 15;11(1):7. doi: https://doi.org/10.1186/s13195-018-0459-7.
Langbaum JB, Zissimopoulos J, Au R, et al. Recommendations to address key recruitment challenges of Alzheimer’s disease clinical trials. Alzheimers Dement. 2023 Feb;19(2):696–707. doi: https://doi.org/10.1002/alz.12737.
Aisen PS, Sperling RA, Cummings J, et al. The Trial-Ready Cohort for Preclinical/Prodromal Alzheimer’s Disease (TRC-PAD) Project: An Overview. J Prev Alzheimers Dis. 2020;7(4):208–212. doi: https://doi.org/10.14283/jpad.2020.45.
Sato K, Ihara R, Suzuki K, et al. Predicting amyloid risk by machine learning algorithms based on the A4 screen data: Application to the Japanese Trial-Ready Cohort study. Alzheimers Dement (N Y). 2021 Mar 24;7(1):e12135. doi: https://doi.org/10.1002/trc2.12135.
Sato K, Niimi Y, Ihara R, et al. Efficacy and Cost-effectiveness of Promotion Methods to Recruit Participants to an Online Screening Registry for Alzheimer Disease Prevention Trials: Observational Study. J Med Internet Res. 2021 Jul 22;23(7):e26284. doi: https://doi.org/10.2196/26284.
Walter S, Clanton TB, Langford OG, et al. Recruitment into the Alzheimer Prevention Trials (APT) Webstudy for a Trial-Ready Cohort for Preclinical and Prodromal Alzheimer’s Disease (TRC-PAD). J Prev Alzheimers Dis. 2020;7(4):219–225. doi: https://doi.org/10.14283/jpad.2020.46.
Li C, Neugroschl J, Luo X, et al. The Utility of the Cognitive Function Instrument (CFI) to Detect Cognitive Decline in Non-Demented Older Adults. J Alzheimers Dis. 2017;60(2):427–437. doi: https://doi.org/10.3233/JAD-161294.
Maruff P, Lim YY, Darby D, et al. Clinical utility of the cogstate brief battery in identifying cognitive impairment in mild cognitive impairment and Alzheimer’s disease. BMC Psychol. 2013 Dec 23;1(1):30. doi: https://doi.org/10.1186/20507283-1-30.
Brooke, J. (1996). Sus: a “quick and dirty’usability. Usability evaluation in industry, 189(3), 189–194.
Hyzy M, Bond R, Mulvenna M, et al. System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis. JMIR Mhealth Uhealth. 2022 Aug 18;10(8):e37290. doi: https://doi.org/10.2196/37290.
Sauro, J., & Lewis, J. R. (2016). Quantifying the user experience: Practical statistics for user research. Morgan Kaufmann.
Berry, Katherine, et al. “Factors associated with inattentive responding in online survey research.” Personality and Individual Differences 149 (2019): 157–159.
Gummer, Tobias, Joss Roßmann, and Henning Silber. “Using instructed response items as attention checks in web surveys: Properties and implementation.” Sociological Methods & Research 50.1 (2021): 238–264.
Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011 Jun 27;2:53–55. doi: https://doi.org/10.5116/ijme.4dfb.8dfd.
Sammut R, Griscti O, Norman IJ. Strategies to improve response rates to web surveys: A literature review. Int J Nurs Stud. 2021 Nov;123:104058. doi: https://doi.org/10.1016/j.ijnurstu.2021.104058.
Robb KA, Gatting L, Wardle J. What impact do questionnaire length and monetary incentives have on mailed health psychology survey response? Br J Health Psychol. 2017 Nov;22(4):671–685. doi: https://doi.org/10.1111/bjhp.12239.
Acknowledgements
Not applicable.
Funding
Funding: This study was supported by AMED (Grant no: JP21dk0207048 (T. I.) and JP21dk0207054 (Y.N)) and JSPS KAKENHI (Grant no: 21K20891 (K.S)). The sponsors had no role in the design and conduct of the study; collection, analysis, and interpretation of data; preparation of the manuscript; or review or approval of the manuscript.
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of Interest Disclosure: The authors declare that they have no conflicts of interest to disclose.
Ethical standards: The J-TRC web study was approved by the University of Tokyo Graduate School of Medicine Institutional Ethics Committee (ID:2019132NI-(3)), and online informed consent was obtained from each participant upon registration. The online survey was also approved by the ethics committee.
Electronic supplementary material
Rights and permissions
About this article
Cite this article
Sato, K., Niimi, Y., Ihara, R. et al. Usability of a Web-Based Registry for Preclinical Alzheimer’s Disease: Implications from a Cross-Sectional Online Survey. J Prev Alzheimers Dis 11, 661–671 (2024). https://doi.org/10.14283/jpad.2024.48
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.14283/jpad.2024.48