Abstract
The collection of real-time, real-world patient experience data that are reliable, valid, and sensitive to drug effects presents many challenges to clinical trial sponsors and investigators. Recent developments in electronic patient experience diary (PED) systems highlight the importance of building a robust, subject-friendly system that can enhance subjects’ protocol compliance and is regulatory compliant. To succeed in a clinical trial, an electronic PED system must simultaneously meet two related standards: clinical integrity and system integrity. Clinical integrity includes the elements of protocol compliance, measurement reliability, data validity, and auditable subject quality. An electronic PED system with clinical integrity produces compliance metadata that can be used to better understand and evaluate the efficacy data. System integrity includes the elements of management control, system reliability, data integrity, and auditable system quality for computerized data handling. An electronic PED system with system integrity collects data that have been authenticated by built-in logic and security checks and can be attributed to the subject. The challenges and promises of such a system are presented.
Similar content being viewed by others
References
Gill TM, Feinstein AR. A critical appraisal of the quality of quality-of-life measurements. JAMA. 1984;272:619–626.
Muldoon MF, Barger SD, Flory JD, Manuck SB. What are quality of life measurements measuring? Br Med J. 1998;316:542–545.
Schipper H, Clinch J, Powell V. Definitions and Conceptual Issues. In Spilker B, ed. Quality of Life Assessments in Clinical Trials. New York, NY: Raven Press; 1990.
Stone AA, Turkkan JS, Bachrach CA, Jobe JB, Kurtman HS, Cain VS. The Science of Self Report: Implications for Research and Practice. Mahwah, NJ: Lawrence Erlbaum Associates; 2000.
Bradburn NM. Temporal Representation and Event Dating. In Stone AA, et al, eds. The Science of Self Report: Implications for Research and Practice. Mahwah, NJ: Lawrence Erlbaum Associates; 2000.
Jobe JB. Cognitive Processes in Self-Report. In Stone AA, et al, eds. The Science of Self Report: Implications for Research and Practice. Mahwah, NJ: Lawrence Erlbaum Associates; 2000.
Shiftman S, Hufford M, Hickcox M, Paty JA, Gnys M, Kassel JD. Remember That? A comparison of real-time versus retrospective recall of smoking lapses. J Consult Clin Psych. 1997;65:292–300.
Verbrugge LM. Health Diaries. Med Care. 1980;18: 73–95.
Houpt JB, McMillan R, Wein C, Paget-Dellio SD. Effect of Glucosamine hydrochloride in the treatment of pain of osteoarthritis of the knee. J Rheumatol. 1999;26:2423–2430.
Norman GR, McFarlane AH, Streiner DL, Neale K. Health diaries: strategies for compliance and relation to other measures. Med Care. 1982;20:623–629.
Urquhart J. Role of patient compliance in clinical pharmacokinetics: A review of recent research. Clin Pharmacokin. 1994;27:202–215.
Urquhart J, De Klerk E. Contending paradigms for the interpretation of data on patient compliance with therapeutic drug regimens. Stat Med. 1998;17:251–267.
Chmelik F, Doughty A. Objective measurements of compliance in asthma treatment. Ann Allergy. 1994;73:527–532.
Jonasson G, Carlsen KH, Sodal A, Jonasson C, Mowinckel P. Patient compliance in a clinical trial with inhaled budesonide in children with mild asthma. European Resp J. 1999;14:150–154.
Mazze RS, Shamoon H, Pasmantier R, Lucidio D, Murphy J, Hartmann K, Kuykendall V, Lopatin W. Reliability of blood glucose monitoring by patients with diabetes mellitus. Am J Med. 1984;77:211–217.
Milgrom H, Bender B, Ackerson L, Bowry P, Smith B, Rand C. Noncompliance and treatment failure in children with asthma. J Allergy Clin Immunol. 1996;98:1051–1057.
Simmons M. Unpredictability of deception in compliance with physician-prescribed bronchodilator inhaler use in a clinical trial. Chest. 2000;118:290–295.
Spector SL, Kinsman R, Mawhinney H, Siegel SC, Rachelefsky GS, Katz RM, Rohr AS. Compliance in patients with asthma with an experimental aerolized medication: Implications for controlled clinical trials. J Allergy Clin Immunol. 1986;77:65–70.
Straka RJ, Fish JT, Benson SR, Suh JT. Patient self-reporting of compliance does not correspond with electronic monitoring: an evaluation using isosorbide dinitrate as a model drug. Pharmacother. 1997;17:126–132.
Verscheiden P, Cartier A, L’Archeveque, Trudeau C, Malo JL. Compliance with and accuracy of daily assessment of peak expiratory flows (PEF) in asthmatic subjects over a three month period. European Resp J. 1996;9:880–885.
Goldsmith CH. The effect of compliance distributions on therapeutic trials. Res Appl Future Res. 1979;297–308.
Drummond HE, Ghosh S, Ferguson A, Brackenridge D, Tiplady B. Electronic quality of life questionnaires: a comparison of pen-based electronic questionnaires with conventional paper in a gastrointestinal study. Quality Life Res. 1995;4:21–26.
Tiplady B, Jamieson AH, Crompton GK. Use of pen-based electronic diaries in an international clinical trial of asthma. Drug Inf J. 2000;34:129–136.
Hyland ME, Kenyon CA, Allen R, Howarth P. Diary keeping in asthma: Comparison of written and electronic methods. Br Med J. 1993;306:487–489.
Johannes CB, Crawford SL, Woods J, Goldstein RB, Tran D, Mehrotra S, Jonhson KB, Santoro N. An electronic menstrual cycle calendar: comparison of data quality with a paper version. Menopause. 2000;7:200–208.
Raskin J. The Humane Interface: New Directions for Designing Interactive Systems. Reading, MA: Addison Wesley Longman, Inc; 2000.
Boudes P. Drug compliance in therapeutic trials: a review. Cont Clin Trials. 1998;19:257–168.
Urquhart J. Patient compliance with crucial drug regimens: implications for prostate cancer. Eur Urol. 1996;29(2):124–131.
Trick LR. Patient compliance—don’t count on it! J Am Optom Assoc. 1993;64:264–270.
Kamarck TW, Shiffman S, Smithline L, Goodie JL, Thompson H, Ituarte P, Jong JY, Pro V, Paty J, Kassel J, Gnys M, Perz W. The diary of ambulatory behavioral states: a new approach to the assessment of psychosocial influences on ambulatory cardiovascular activity. In Krantz D, & Baum A, eds. Perspectives in Behavioral Medicine: Technology and Methodology in Behavioral Medicine. Mahwah, NJ: Lawrence Erlbaum Associates; 1998.
Shiffman S, Paty JA, Gnys M, Kassel JA, Hickcox M. First lapses to smoking: within-subjects analysis of real-time reports. J Consult Clin Psych. 1996;64: 366–379.
Shiffman S, Elash C, Paton S, Gwaltney CJ, Paty J, Clark DB, Liu KS, DiMarino ME. Comparative efficacy of 24-hour and 16-hour transdermal nicotine patches for relief of morning craving. Addiction. 2000;95:1185–1195.
Stone AA, Shiffman S, DeVries MW. Ecological Momentary Assessment. In Kahneman D, ed. Well-being: The Foundations of Hedonic Psychology. New York, NY: Russell Sage Foundation; 1999.
Stokes T. Technology update: Computer systems validation. Part 1: A GCP computer system is a lifetime responsibility. Appl Clin Trials. 2000;Aug:38–43.
Stokes T. Technology update: Computer systems validation. Part 2: GCP validation of platform and infrastructure systems. Appl Clin Trials. 2000;Sept:55–66.
Stokes T. Technology update: Computer systems validation. Part 3: GCP software verification. Appl Clin Trials. 2000;Nov:48–58.
Stokes T. People, Paper, and Practices: How to survive the validation process and thrive on the business potential of strategic systems. Drug Inf J. 1999;33: 49–61.
Stokes T. Technology update: Computer systems validation. Part 6: Audits and inspections—A survive and thrive approach. Appl Clin Trials. 1997; Aug(6).
Author information
Authors and Affiliations
Corresponding author
Additional information
Some of the material in this manuscript was presented at the DIA’s “6th Annual Computer Validation Meeting: Treating Validation from a Systems Perspective,” September 2000, Washington, District of Columbia.
Rights and permissions
About this article
Cite this article
Hufford, M.R., Stokes, T.E. & Paty, J.A. Collecting Reliable and Valid Real-Time Patient Experience Data. Ther Innov Regul Sci 35, 755–765 (2001). https://doi.org/10.1177/009286150103500314
Published:
Issue Date:
DOI: https://doi.org/10.1177/009286150103500314