Abstract
Clinical handover refers to healthcare workers transferring responsibility and accountability for patient care, e.g., between shifts or wards. Safety and quality health standards call for this process to be systematically structured across the organisation and synchronous with its documentation. This paper evaluates information extraction as a way to help comply with these standards. It implements the handover process of first specifying a structured handover form, whose hierarchy of headings guides the handover narrative, followed by the technology filling it out objectively and almost instantly for proofing and sign-off. We trained a conditional random field with 8 feature types on 101 expert-annotated documents to 36-class classify. This resulted in good generalisation to an independent set of 50 validation and 50 test documents that we now release: 77.9 % F1 in filtering out irrelevant information, up to 98.4 % F1 for the 35 classes for relevant information, and 52.9 % F1 after macro-averaging over these 35 classes, whilst these percentages were 86.2, 100.0, and 70.2 for the leave-one-document-out cross-validation across the first set of 101 documents. Also as a result of this study, the validation and test data were released to support further research.
NICTA is funded by the Australian Government through the Department of Communications and the Australian Research Council through the Information and Communications Technology (ICT) Centre of Excellence Program. We thank Maricel Angel, RN at NICTA, for helping HS to create the dataset. LZ conducted all experiments under HS’s supervision.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Pothier, D., Monteiro, P., Mooktiar, M., Shaw, A.: Pilot study to show the loss of important data in nursing handover. Br. J. Nurs. 14(20), 1090–1093 (2005)
Tran, D.T., Johnson, M.: Classifying nursing errors in clinical management within an Australian hospital. Int. Nurs. Rev. 57(4), 454–462 (2010)
Matic, J., Davidson, P., Salamonson, Y.: Review: bringing patient safety to the forefront through structured computerisation during clinical handover. J. Clin. Nurs. 20(1–2), 184–189 (2011)
Finlayson, S.G., LePendu, P., Shah, N.H.: Building the graph of medicine from millions of clinical narratives. Sci. Data 1, 140032 (2014)
Australian Commission on Safety and Quality in Healthcare (ACSQHC): Standard 6: clinical handover. In: National Safety and Quality Health Standards, pp. 44–47. ACSQHC, Sydney (2012)
The World Health Organisation (WHO): Patient safety. Organizational tools. Communication. handover (handoff) tools. http://goo.gl/VjAikK
Johnson, M., Lapkin, S., Long, V., Sanchez, P., Suominen, H., Basilakis, J., Dawson, L.: A systematic review of speech recognition technology in health care. BMC Med. Inform. Decis. Mak. 14, 94 (2014)
Suominen, H., Hanlen, L., Goeuriot, L., Kelly, L., Jones, G.J.F.: Task 1a of the CLEF eHealth evaluation lab 2015: clinical speech recognition. In: Cappellato, L., Ferro, N., Jones, G., San Juan, E. (eds.) CLEF 2015 Labs and Workshops, Notebook Papers. CEUR Workshop Proceedings (CEUR-WS.org) (2015)
Suominen, H., Johnson, M., Zhou, L., Sanchez, P., Sirel, R., Basilakis, J., Hanlen, L., Estival, D., Dawson, L., Kelly, B.: Capturing patient information at nursing shift changes: methodological evaluation of speech recognition and information extraction. J. Am. Med. Inform. Assoc. 22(e1), e48–e66 (2015)
Suominen, H., Zhou, L., Hanlen, L., Ferraro, G.: Benchmarking clinical speech recognition and information extraction: new data, methods, and evaluations. JMIR Med. Inform. 3(2), e19 (2015)
Poissant, L., Pereira, J., Tamblyn, R., Kawasumi, Y.: The impact of electronic health records on time efficiency on physicians and nurses: a systematic review. JAMIA 12(5), 505–516 (2005)
Hakes, B., Whittington, J.: Assessing the impact of an electronic medical record on nurse documentation time. J. Crit. Care 26(4), 234–241 (2008)
Banner, L., Olney, C.: Automated clinical documentation: does it allow nurses more time for patient care? Comput. Inform. Nurs. (CIN) 27(2), 75–81 (2009)
Lafferty, J.D., McCallum, A., Pereira, F.C.N.: Conditional random fields: probabilistic models for segmenting and labelling sequence data. In: Proceedings of the 18th International Conference on Machine Learning, ICML 2001, pp. 282–289. Morgan Kaufmann Williamstown, MA, USA (2001)
Smith, A., Osborne, M.: Regularisation techniques for conditional random fields: parameterised versus parameter-free. In: Dale, R., Wong, K.-F., Su, J., Kwong, O.Y. (eds.) IJCNLP 2005. LNCS (LNAI), vol. 3651, pp. 896–907. Springer, Heidelberg (2005)
Meystre, S.M., Savova, G.K., Kipper-Schuler, K.C., Hurdle, J.F.: Extracting information from textual documents in the electronic health record: a review of recent research. Yearb. Med. Inform. 35, 128–144 (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Zhou, L., Suominen, H. (2015). Information Extraction to Improve Standard Compliance. In: Pfahringer, B., Renz, J. (eds) AI 2015: Advances in Artificial Intelligence. AI 2015. Lecture Notes in Computer Science(), vol 9457. Springer, Cham. https://doi.org/10.1007/978-3-319-26350-2_57
Download citation
DOI: https://doi.org/10.1007/978-3-319-26350-2_57
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-26349-6
Online ISBN: 978-3-319-26350-2
eBook Packages: Computer ScienceComputer Science (R0)