Skip to main content

Advertisement

Log in

Collecting Reliable and Valid Real-Time Patient Experience Data

  • Published:
Drug information journal : DIJ / Drug Information Association Aims and scope Submit manuscript

Abstract

The collection of real-time, real-world patient experience data that are reliable, valid, and sensitive to drug effects presents many challenges to clinical trial sponsors and investigators. Recent developments in electronic patient experience diary (PED) systems highlight the importance of building a robust, subject-friendly system that can enhance subjects’ protocol compliance and is regulatory compliant. To succeed in a clinical trial, an electronic PED system must simultaneously meet two related standards: clinical integrity and system integrity. Clinical integrity includes the elements of protocol compliance, measurement reliability, data validity, and auditable subject quality. An electronic PED system with clinical integrity produces compliance metadata that can be used to better understand and evaluate the efficacy data. System integrity includes the elements of management control, system reliability, data integrity, and auditable system quality for computerized data handling. An electronic PED system with system integrity collects data that have been authenticated by built-in logic and security checks and can be attributed to the subject. The challenges and promises of such a system are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Gill TM, Feinstein AR. A critical appraisal of the quality of quality-of-life measurements. JAMA. 1984;272:619–626.

    Article  Google Scholar 

  2. Muldoon MF, Barger SD, Flory JD, Manuck SB. What are quality of life measurements measuring? Br Med J. 1998;316:542–545.

    Article  CAS  Google Scholar 

  3. Schipper H, Clinch J, Powell V. Definitions and Conceptual Issues. In Spilker B, ed. Quality of Life Assessments in Clinical Trials. New York, NY: Raven Press; 1990.

    Google Scholar 

  4. Stone AA, Turkkan JS, Bachrach CA, Jobe JB, Kurtman HS, Cain VS. The Science of Self Report: Implications for Research and Practice. Mahwah, NJ: Lawrence Erlbaum Associates; 2000.

    Google Scholar 

  5. Bradburn NM. Temporal Representation and Event Dating. In Stone AA, et al, eds. The Science of Self Report: Implications for Research and Practice. Mahwah, NJ: Lawrence Erlbaum Associates; 2000.

    Google Scholar 

  6. Jobe JB. Cognitive Processes in Self-Report. In Stone AA, et al, eds. The Science of Self Report: Implications for Research and Practice. Mahwah, NJ: Lawrence Erlbaum Associates; 2000.

    Google Scholar 

  7. Shiftman S, Hufford M, Hickcox M, Paty JA, Gnys M, Kassel JD. Remember That? A comparison of real-time versus retrospective recall of smoking lapses. J Consult Clin Psych. 1997;65:292–300.

    Article  Google Scholar 

  8. Verbrugge LM. Health Diaries. Med Care. 1980;18: 73–95.

    Article  CAS  Google Scholar 

  9. Houpt JB, McMillan R, Wein C, Paget-Dellio SD. Effect of Glucosamine hydrochloride in the treatment of pain of osteoarthritis of the knee. J Rheumatol. 1999;26:2423–2430.

    CAS  PubMed  Google Scholar 

  10. Norman GR, McFarlane AH, Streiner DL, Neale K. Health diaries: strategies for compliance and relation to other measures. Med Care. 1982;20:623–629.

    Article  CAS  Google Scholar 

  11. Urquhart J. Role of patient compliance in clinical pharmacokinetics: A review of recent research. Clin Pharmacokin. 1994;27:202–215.

    Article  CAS  Google Scholar 

  12. Urquhart J, De Klerk E. Contending paradigms for the interpretation of data on patient compliance with therapeutic drug regimens. Stat Med. 1998;17:251–267.

    Article  CAS  Google Scholar 

  13. Chmelik F, Doughty A. Objective measurements of compliance in asthma treatment. Ann Allergy. 1994;73:527–532.

    CAS  PubMed  Google Scholar 

  14. Jonasson G, Carlsen KH, Sodal A, Jonasson C, Mowinckel P. Patient compliance in a clinical trial with inhaled budesonide in children with mild asthma. European Resp J. 1999;14:150–154.

    Article  CAS  Google Scholar 

  15. Mazze RS, Shamoon H, Pasmantier R, Lucidio D, Murphy J, Hartmann K, Kuykendall V, Lopatin W. Reliability of blood glucose monitoring by patients with diabetes mellitus. Am J Med. 1984;77:211–217.

    Article  CAS  Google Scholar 

  16. Milgrom H, Bender B, Ackerson L, Bowry P, Smith B, Rand C. Noncompliance and treatment failure in children with asthma. J Allergy Clin Immunol. 1996;98:1051–1057.

    Article  CAS  Google Scholar 

  17. Simmons M. Unpredictability of deception in compliance with physician-prescribed bronchodilator inhaler use in a clinical trial. Chest. 2000;118:290–295.

    Article  CAS  Google Scholar 

  18. Spector SL, Kinsman R, Mawhinney H, Siegel SC, Rachelefsky GS, Katz RM, Rohr AS. Compliance in patients with asthma with an experimental aerolized medication: Implications for controlled clinical trials. J Allergy Clin Immunol. 1986;77:65–70.

    Article  CAS  Google Scholar 

  19. Straka RJ, Fish JT, Benson SR, Suh JT. Patient self-reporting of compliance does not correspond with electronic monitoring: an evaluation using isosorbide dinitrate as a model drug. Pharmacother. 1997;17:126–132.

    CAS  Google Scholar 

  20. Verscheiden P, Cartier A, L’Archeveque, Trudeau C, Malo JL. Compliance with and accuracy of daily assessment of peak expiratory flows (PEF) in asthmatic subjects over a three month period. European Resp J. 1996;9:880–885.

    Article  Google Scholar 

  21. Goldsmith CH. The effect of compliance distributions on therapeutic trials. Res Appl Future Res. 1979;297–308.

    Google Scholar 

  22. Drummond HE, Ghosh S, Ferguson A, Brackenridge D, Tiplady B. Electronic quality of life questionnaires: a comparison of pen-based electronic questionnaires with conventional paper in a gastrointestinal study. Quality Life Res. 1995;4:21–26.

    Article  CAS  Google Scholar 

  23. Tiplady B, Jamieson AH, Crompton GK. Use of pen-based electronic diaries in an international clinical trial of asthma. Drug Inf J. 2000;34:129–136.

    Article  Google Scholar 

  24. Hyland ME, Kenyon CA, Allen R, Howarth P. Diary keeping in asthma: Comparison of written and electronic methods. Br Med J. 1993;306:487–489.

    Article  CAS  Google Scholar 

  25. Johannes CB, Crawford SL, Woods J, Goldstein RB, Tran D, Mehrotra S, Jonhson KB, Santoro N. An electronic menstrual cycle calendar: comparison of data quality with a paper version. Menopause. 2000;7:200–208.

    Article  CAS  Google Scholar 

  26. Raskin J. The Humane Interface: New Directions for Designing Interactive Systems. Reading, MA: Addison Wesley Longman, Inc; 2000.

    Google Scholar 

  27. Boudes P. Drug compliance in therapeutic trials: a review. Cont Clin Trials. 1998;19:257–168.

    Article  CAS  Google Scholar 

  28. Urquhart J. Patient compliance with crucial drug regimens: implications for prostate cancer. Eur Urol. 1996;29(2):124–131.

    Article  Google Scholar 

  29. Trick LR. Patient compliance—don’t count on it! J Am Optom Assoc. 1993;64:264–270.

    CAS  PubMed  Google Scholar 

  30. Kamarck TW, Shiffman S, Smithline L, Goodie JL, Thompson H, Ituarte P, Jong JY, Pro V, Paty J, Kassel J, Gnys M, Perz W. The diary of ambulatory behavioral states: a new approach to the assessment of psychosocial influences on ambulatory cardiovascular activity. In Krantz D, & Baum A, eds. Perspectives in Behavioral Medicine: Technology and Methodology in Behavioral Medicine. Mahwah, NJ: Lawrence Erlbaum Associates; 1998.

    Google Scholar 

  31. Shiffman S, Paty JA, Gnys M, Kassel JA, Hickcox M. First lapses to smoking: within-subjects analysis of real-time reports. J Consult Clin Psych. 1996;64: 366–379.

    Article  CAS  Google Scholar 

  32. Shiffman S, Elash C, Paton S, Gwaltney CJ, Paty J, Clark DB, Liu KS, DiMarino ME. Comparative efficacy of 24-hour and 16-hour transdermal nicotine patches for relief of morning craving. Addiction. 2000;95:1185–1195.

    Article  CAS  Google Scholar 

  33. Stone AA, Shiffman S, DeVries MW. Ecological Momentary Assessment. In Kahneman D, ed. Well-being: The Foundations of Hedonic Psychology. New York, NY: Russell Sage Foundation; 1999.

    Google Scholar 

  34. Stokes T. Technology update: Computer systems validation. Part 1: A GCP computer system is a lifetime responsibility. Appl Clin Trials. 2000;Aug:38–43.

    Google Scholar 

  35. Stokes T. Technology update: Computer systems validation. Part 2: GCP validation of platform and infrastructure systems. Appl Clin Trials. 2000;Sept:55–66.

    Google Scholar 

  36. Stokes T. Technology update: Computer systems validation. Part 3: GCP software verification. Appl Clin Trials. 2000;Nov:48–58.

    Google Scholar 

  37. Stokes T. People, Paper, and Practices: How to survive the validation process and thrive on the business potential of strategic systems. Drug Inf J. 1999;33: 49–61.

    Article  Google Scholar 

  38. Stokes T. Technology update: Computer systems validation. Part 6: Audits and inspections—A survive and thrive approach. Appl Clin Trials. 1997; Aug(6).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael R. Hufford PhD.

Additional information

Some of the material in this manuscript was presented at the DIA’s “6th Annual Computer Validation Meeting: Treating Validation from a Systems Perspective,” September 2000, Washington, District of Columbia.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hufford, M.R., Stokes, T.E. & Paty, J.A. Collecting Reliable and Valid Real-Time Patient Experience Data. Ther Innov Regul Sci 35, 755–765 (2001). https://doi.org/10.1177/009286150103500314

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1177/009286150103500314

Key Words

Navigation