Skip to main content
SpringerLink
Log in

Evaluating Acceptance and User Experience of a Guideline-based Clinical Decision Support System Execution Platform

  • Original Paper
  • Published:
Journal of Medical Systems Aims and scope Submit manuscript

Abstract

This study aims to determine what the initial disposition of physicians towards the use of Clinical Decision Support Systems (CDSS) based on Computerised Clinical Guidelines and Protocols (CCGP) is; and whether their prolonged utilisation has a positive effect on their intention to adopt them in the future. For a period of 3 months, 8 volunteer paediatricians monitored each up to 10 asthmatic patients using two CCGPs deployed in thee-GuidesMed CDSS. A Technology Acceptance Model (TAM) questionnaire was supplied to them before and after using the system. Results from both questionnaires are analysed searching for significant improvements in opinion between them. An additional survey was performed to analyse the usability of the system. It was found that initial disposition of physicians towards e-Guidesmed is good. Improvement between the pre and post iterationsof the TAM questionnaire has been found to be statistically significant. Nonetheless, slightly lower values in the Compatibility and Habit variables show that participants perceive possible difficulties to integrate e-GuidesMed into their daily routine. The variable Facilitators shows the highest correlation with the Intention to Use. Usabilityof the system has also been rated very high and, in this regard, no fundamental flaw has been detected. Initial views towards e-GuidesMed are positive, and become reinforced after continued utilisation of the system. In order to achieve an effective implementation, it becomes essential to facilitate conditions to integrate the system intothe physician’s daily routine.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Field, M., and Lohr, K. (Eds.), Clinical practice guidelines: Directions for a new program. Washington, DC: Institute of Medicine, National Academy Press, 1990.

    Google Scholar 

  2. Rosenfeld, R., and Shiffman, R., Clinical practice guideline development manual: A quality-driven approach for translating evidence into action. Otolaryngol. Head Neck Surg. 140(6 Suppl 1):1–43, 2009.

    Google Scholar 

  3. Isern, D., and Moreno, A., Computer-based execution of clinical guidelines: A review. Int. J. Med. Inform. 77:787–808, 2008.

    Article  Google Scholar 

  4. Tu, S., Campbell, J.R., Glasgow, J., Nyman, M.A., McClure, R., McClay, J., Parker, C., Hrabak, K.M., Berg, D., Weida, T., Mansfield, J.G., Musen, M.A. and Abarbanel, R.M., The sage guideline model: Achievements and overview. J. Am. Med. Inform. Assoc. 14(5):589–598, 2007.

    Article  Google Scholar 

  5. Latoszek-Berendsen, A., Tange, H., van den Herik, H., and Hasman, A., From clinical practice guidelines to computer-interpretable guidelines. Methods Inf. Med. 49:550–570, 2010.

    Article  Google Scholar 

  6. Lugtenberg, M., van Schaick, J.M.Z., Westert, G.P., and Burgers, J.S., Why don’t physicians adhere to guideline recommendations in practice? An analysis of barriers among dutch general practitioners. Implement. Sci. 4:54, 2009.

    Article  Google Scholar 

  7. Bracha, Y., Brottman, G.M., and Carlson, A., Physicians, guidelines and cognitive tasks. Eval. Health Prof. 34:309–335, 2011.

    Article  Google Scholar 

  8. Spallek, H., Song, M., Polk, D.E., Bekhuis, T., Frantsve-Hawley, J., and Aravamudhan, K., Barriers to implementing evidence-based clinical guidelines: A survey of early adopters. J. Evid. Based Dent. Pract. 10:195–206, 2010.

    Article  Google Scholar 

  9. Bouaud, J., Séroussi, B., Falcoff, H., and Venot, A., Design factors for success or failure of guideline-based decision support systems: An hypothesis involving case complexity. In: Proceedings of The AMIA Annual Symposium. pp. 71–75, 2006.

  10. Damiani, G., Pinnarelli, L., Colosimo, S., Almiento, R., Sicuro, L., Galasso, R., Somella, L., and Ricciardi, W., The effectiveness of computerized clinical guidelines in the process of care: A systematic review. BMC Health Serv. Res. 10:2, 2010.

    Article  Google Scholar 

  11. Heselmans, A., de Velde, S.V., Donceel, P., Aertgeerts, B., and Ramaekers, D., Effectiveness of electronic guideline-based implementation systems in ambulatory care settings - a systematic review. Implement. Sci. 4:82, 2009.

    Article  Google Scholar 

  12. Barrena, R., Pikatza, J.M., Iruetaguena, A., Segundo, U., Buenestado, D., Elorz, J., and Aldamiz-Echevarria, L., e-Guidesmed: support for translation of clinical guidelines. In: Moen, A. (Ed.), XXIII International Conference of the European Federation for Medical Informatics, MIE 2011/CD/Demonstrations, 2011.

  13. Pikatza, J.M., Iruetaguena, A., Buenestado, D., Segundo, U., Garcia, J.J., Aldamiz-Echevarria, L., Elorz J., Barrena, R., and Sanjurjo, P., Towards an effective knowledge translation of clinical guidelines and complementary information. In: Advances in Intelligent and Soft-Computing Series of Springer Verlag. Vol. 79, pp. 409–416, 2010.

  14. Davids, F.D., Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 13(3):319–340, 1989.

    Article  Google Scholar 

  15. Yousafzai, S.Y., Foxall, G.R., and Pallister, J.G., Technology acceptance: A meta-analysis of the tam: Part 1. J. Mod. Manag. 2(3):251–280, 2007.

    Google Scholar 

  16. Holden, R.J., and Karsh, B.T., The technology acceptance model: Its past and its future in health care. J. Biomed. Inform. 43(1):159–172, 2010.

    Article  Google Scholar 

  17. Wilkins, M.A., Fact ors influencing acceptance of electronic health records in hospitals. Perspect. Health Inf. Manag. 6(1f), 2009.

  18. Fishbein, M., and Ajzen, I., Belief, attitude, intentions and behaviour: An introduction to theory and research. Reading, MA: Addison-Westley, 1975.

    Google Scholar 

  19. Yan, H., and Yoo, Y., It’s all about attitude: Revisiting the technology acceptance model. Decis. Support. Syst. 38:19–31, 2004.

    Article  Google Scholar 

  20. Venkatesh, V., and Davis, F.D., A theoretical extension of the technology acceptance model: Four longitudinal field studies. Manag. Sci. 46(2):186–204, 2000.

    Article  Google Scholar 

  21. Venkatesh, V., and Bala, H., Technology acceptance model 3 and a research agenda on interventions. Decis. Sci. 39(2):273–315, 2008.

    Article  Google Scholar 

  22. Venkatesh, V., Morris, M.G., Davis, G.B., and Davids, F.D., User acceptance of information technology: Toward a unified view. MIS Q. 27(3):425–478, 2003.

    Google Scholar 

  23. Peleg, M., Shachak, A., Wang, D., and Karnieli, E., Using multi-perspective methodologies to study users interactions with the prototype front end of a guideline-based decision support system for diabetic foot care. Int. J. Med. Inform. 78:482–493, 2009.

    Article  Google Scholar 

  24. Melas, C.D., Zampetakis, L.Z., Dimopoulou, A., and Moustakis, V., Modeling the acceptance of clinical information systems among hospital medical staff: An extended tam model. J. Biomed. Inform. 44:553–564, 2011.

    Article  Google Scholar 

  25. Orruno, E., Gagnon, M.P., Asua, J., and Abdeljelilre, A.B., Evaluation of teledermatology adoption by health-care professionals using a modified technology acceptance model. J. Telemed. Telecare 17(6):303–307, 2011.

    Article  Google Scholar 

  26. Gagnon, M.P., Orruo, E., Asua, J., Abdeljelil, A.B., and Emparanza, J., Using a modified technology acceptance model to evaluate health professionals’ adoption of a new telemonitoring system. Telemed. J. E. Health 18:54–59, 2012.

    Article  Google Scholar 

  27. Trafton, J., Martins, S., Michel, M., Lewis, E., Wang, D., Combs, A., Scates, N., Tu, S., and Goldstein, M.K., Evaluation of the acceptability and usability of a decision support system to encourage safe and effective use of opioid therapy for chronic, noncancer pain by primary care providers. Pain Med. 11:575–585, 2010.

    Article  Google Scholar 

  28. Lomotan, E., Hoeksema, L.J., Edmonds, D.E., Ramı’rez-Garnica, G., Shiffman, R.N., and Horwitz, L.I., Evaluating the use of a computerized clinical decision support system for asthma by pediatric pulmonologist. Int. J. Med. Inform. 81:157–165, 2012.

    Article  Google Scholar 

  29. Osakidetza - Basque Health Service Healthcare Department of the Basque Government, Guia de Practica Clinica sobre Asma. Basque Country, Spain: Donostia-San Sebastian, 2006.

    Google Scholar 

  30. British Thoracic Society, Scottish Intercollegiate Guidelines Network (SIGN). British Intercollegiate Network. British Guideline on the Management of Asthma. Edinburgh, Scotland, UK, 2008 (updated 2012).

  31. Nielsen, J., Estimating the number of subjects needed for a thinking aloud test. Int. J. Hum. Comput. Interact. 41:385–97, 1994.

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank the physicians that took part in our study. The authors also thank J. López-Cuadrado and T.A. Pérez for their comments on the manuscript. This work was supported by funding received from the Department of Education, Universities and Research of the Basque Government (Grant No. BFI-09-270), the UPV/EHU [GIU08/27, INF10/58, GIU11/28 and UFI11/19], Gipuzkoa Regional Council [OF53/2011], the Department of Industry, Commerce and Tourism—Basque Government [S-PE09UN60 and S-PE11UN115], and the Spanish Ministry of Science and Innovation [TIN2009-14 159-C05-03].

Conflict of interest

No author reports a conflict of interest with this study.

Author information

Authors and Affiliations

  1. Department of Computer Languages and Systems, Computer Science Faculty, The University of the Basque Country (UPV/EHU), P. Manuel Lardizabal 1, 20018, Donostia-San Sebastián, Spain

    David Buenestado, Ander Iruetaguena, Unai Segundo, Raúl Barrena & Juan M. Pikatza

  2. Neumology Unit, Paediatrics Service, Basurto UniversityHospital, Osakidetza - Basque Health Service, Av. Montevideo 18, 48013, Bilbao, Spain

    Javier Elorz

  3. Department of Paediatrics, Donostia University Hospital, The University of the Basque Country (UPV/EHU), P. Doctor Begiristain, 20014, Donostia-San Sebastián, Spain

    Eduardo G. Pérez-Yarza

Authors
  1. David Buenestado
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Javier Elorz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Eduardo G. Pérez-Yarza
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ander Iruetaguena
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Unai Segundo
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Raúl Barrena
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Juan M. Pikatza
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to David Buenestado.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Buenestado, D., Elorz, J., Pérez-Yarza, E.G. et al. Evaluating Acceptance and User Experience of a Guideline-based Clinical Decision Support System Execution Platform. J Med Syst 37, 9910 (2013). https://doi.org/10.1007/s10916-012-9910-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10916-012-9910-7

Keywords

Search

Navigation