Skip to main content

Understanding health management and safety decisions using signal processing and machine learning

Abstract

Background

Small group research in healthcare is important because it deals with interaction and decision-making processes that can help to identify and improve safer patient treatment and care. However, the number of studies is limited due to time- and resource-intensive data processing. The aim of this study was to examine the feasibility of using signal processing and machine learning techniques to understand teamwork and behaviour related to healthcare management and patient safety, and to contribute to literature and research of teamwork in healthcare.

Methods

Clinical and non-clinical healthcare professionals organised into 28 teams took part in a video- and audio-recorded role-play exercise that represented a fictional healthcare system, and included the opportunity to discuss and improve healthcare management and patient safety. Group interactions were analysed using the recurrence quantification analysis (RQA; Knight et al., 2016), a signal processing method that examines stability, determinism, and complexity of group interactions. Data were benchmarked against self-reported quality of team participation and social support. Transcripts of group conversations were explored using the topic modelling approach (Blei et al., 2003), a machine learning method that helps to identify emerging themes within large corpora of qualitative data.

Results

Groups exhibited stable group interactions that were positively correlated with perceived social support, and negatively correlated with predictive behaviour. Data processing of the qualitative data revealed conversations focused on: (1) the management of patient incidents; (2) the responsibilities among team members; (3) the importance of a good internal team environment; and (4) the hospital culture.

Conclusions

This study has shed new light on small group research using signal processing and machine learning methods. Future studies are encouraged to use these methods in the healthcare context, and to conduct further research on how the nature of group interaction and communication processes contribute to the quality of team and task decision-making.

Peer Review reports

Background

Today’s healthcare service is increasingly dependent on interdisciplinary teamwork in order to provide holistic and patient-centred care [1]. Effective teamwork entails independent yet collaborative work commitment toward a shared goal, where each member values and relies on each other’s expertise, roles and responsibilities [2]. Such collaboration increases the quality of decision-making and the effectiveness of performance outcomes because each member contributes through their unique expertise and specialism [3]. To achieve team cohesion and consensus in decision-making, members engage in discrete stages of knowledge processing, coordination, and integration, which are manifested in non-linear and dynamic group interactions, and observed in behaviour such as information exchange, evaluation and systematization [4,5,6,7].

Small group research, which is embedded in the wider context of social psychology [8], focuses on such group dynamics. In this setting, the term “groups” refers to social, collective entities that have a shared and common purpose. This sense of shared purpose is expressed through coordinated task activities and within environments in which participants work together to accomplish a goal while experiencing a feeling of togetherness. Based on this concept, studies of small groups typically explore aspects of group related to formation and development, group structures, group communication and group decision-making [9, 10].

Group interactions are usually addressed through the systematic coding of occurrence of behaviour on a predetermined scale either in situ, from video, or both [8]. Alternatively, interactions can also be examined through retrospective qualitative analysis [8]. The results, such as the frequency and duration of specific behaviours and emerging themes from the team members’ discourses, are generally presented and discussed descriptively [11, 12], or analysed using more advanced statistical methods such as general linear models, a predictive technique suitable for both multiple qualitative and quantitative variables [13, 14].

Observational and qualitative data provide valuable insights into the contextual and temporal features of human interactions that can be found in team meetings. However, when it comes to large corpora of data, each method has limitations [15]. For instance, while observational data of team behaviour provides useful information about social interactional processes, the analytical process is costly in terms of time and resources [16]. Qualitative research, while rich in information, may be influenced by personal biases (i.e. researcher’s opinion and viewpoint in the topic analyzed) [17], is extremely time-consuming and, as such, is usually only feasible for small-scale studies.

One way to extract meaningful and unbiased information, and to overcome the challenges and limitations associated with resource-intensive analyses, is the application of signal processing and statistical machine learning (ML) techniques [18, 19]. The former allows for processing continuous, non-linear information from physical observation [20], including the examination of physiological signals such as breathing or heart rate variability. The latter approach, ML techniques, identifies optimal parameters to capture patterns and regularities in a given system, such as are needed in risk assessment and document classification [21]. In small group research, both have been proposed as novel techniques to address relationship management in group conversations in order to understand group characteristics, make predictions, or both [22] (for a detailed review, see Gatica-Perez [23]).

Context

This study examined group interactions and communication processes related to healthcare management and patient safety using a role-play exercise. The results were considered in relation to self-reported quality of teamwork participation and social support [3]. This was done by utilising two methods drawn from engineering. First, we applied recurrence quantification analysis, a signal processing method that examines stability, determinism, and complexity of group interactions; and the topic modelling approach, a machine learning method that helps to identify emerging themes within large corpora of qualitative data (cf. Figure 1). Stability refers to the recurrence of interaction between members, while determinism reflects a predictive constellation of group interactions over time. Lastly, complexity is the degree to which the interactions are “chaotic” and follow a disorderly pattern. Thus, we examined the relationship between self-reported quality of participation and social support and the RQA in response to the role-play exercise.

Fig. 1
figure 1

Flowchart of processing techniques applied for both quantitative and qualitative data sets

Second, we used the topic modelling approach to understand whether it is a feasible approach to analysis small group conversations. We also examined whether the role-play exercise provides an environment that allows for a naturalistic group processes related to content addressing healthcare management and patient safety. As illustrated in Fig. 1, the RQA was applied to data extracted and coded from video recordings, while the topic modelling approach was used to explore the audio-recorded transcripts of group discussions.

Recurrence quantification analysis

Originally designed as a graphical technique, the RQA assesses system dynamics found in discrete time series (e.g. physical signals such as heart rate variability) by providing a visual representation and an index of the recurrence, predictability, and complexity of states at different points in time [24]. This is achieved by creating a matrix of a given length of a time series x, where the recurrence plot, if the value of x at time point (i) is sufficiently close (within a given threshold) to the value of x at time point (j), displays a dot plotted at x(i,j) [25]. In the example illustrated in Fig. 2, time series data for groups are ordered to a vector of sequences of group interactions over time, before being transformed into a recurrence plot. Each recurrent point is represented by a black dot in the recurrence plot, with a main diagonal that consists of coded data who’s row number and column number are equal (xj,j).

Fig. 2
figure 2

Example of a recurrence plot. The black dots represent recurrent states within a given time series

The matrix of pairwise combinations x(i,j) can then be assessed in terms of its structural complexity of diagonal lines by extracting three complexity measures from the RQA: (1) the recurrence rate, (2) the percentage of determinism; and (3) the entropy [26, 27].

The recurrence rate is a density measure that indicates the stability of a system by assessing how often the system revisits a past state in relation to the total number of possible recurrences. As illustrated in the recurrence plot (Fig. 2), the proportion of black dots represents the points of recurrent states. For instance, a recurrence rate of 30 indicates that a specific state was revisited a third of the time series. Recurrence rate can range from 0 to 100, the former indication no recurrence at all and the latter a continuous repetition of the same state [28, 29].

The percentage of determinism informs about the predictability of the system based on a pre-defied minimum length of recurrent points [30]. As can be observed in Fig. 2, upward-running lines represent periods when a system exhibits identical states over time. A plot that has only few diagonal lines suggests a random dynamic process. Levels of predictability can range from 0%, classified as random system, to 100%, referring to as highly deterministic system.

Entropy is a complexity measure that describes the complexity of the distribution probability of diagonal lines of the same length [31, 32]. In other words, the entropy provides information on the degree of perplexity or uncertainty of sequences of group interactions over time. Groups that exhibit disordered or chaotic interactions between team members should exhibit a higher degree of entropy than groups that do not. Theoretically, the entropy should be zero for matrixes with diagonals of the exact lengths, positive for matrixes with diagonals of many different lengths, and infinite for matrixes with diagonals of random lengths [30].

In social science, applications of these tools are still in their infancy. For instance, the majority of RQA studies in small group research has investigated reoccurring coupling effects in physiological (e.g. cardiac inter-beat intervals) and behavioural (e.g. postural sway) signals during mentally challenging tasks [33], or investigated the degree of synchrony in behaviour (e.g. head movements) between participants during positive versus negative conversations, and with and without informative visual stimuli [34]. Similar to our study, two studies have investigated changes related to stability, determinism, and complexity of sequences of group interactions [28, 35]. Findings suggest that group members collaborating over multiple sessions develop a greater level of determinism of group interactions than groups that change membership each time, and that an increased level of predictability is associated with less flexibility in coordination and communication processes. However, none of these studies examined results in relation to objective or self-reported measures of teamwork behaviour and quality, respectively. Thus, further work is needed to understand the value of the RQA as a quality index in the context of teamwork in general, and there are specific applications to team processes that relate to healthcare management and patient safety.

Topic modelling

Topic modelling is an optimisation process that allows for identifying co-occurring words and clusters of reoccurring patterns that appear together in the transcript [36, 37]. Similar to a factor analysis, words of high probability within an identified cluster represent semantically related content (e.g. leader, member, team, group). A commonly used and well-established topic modelling approach is the Latent Dirichlet Allocation (LDA), an unsupervised method (i.e. using unlabelled data), appropriate for the analysis of qualitative data analysis carried out in an exploratory fashion. For the LDA results to be meaningful, pre-processing steps have to be undertaken [38] such as, erasing punctuations, converting the text data to lowercase, tokenisation (i.e. sequences of characters are grouped together to allow for useful semantic units for processing) [39], removing a list of stop words such as “of”, “a”, “and”, removing words with two or fewer characters, and words with 15 or greater characters, and normalising words using the Porter [40] stemmer. The Porter stemmer removes various suffixes –ed, −ing, −ion, or –ions and leave the single term to be processed. For instance, talks, talking, talked will be reduced to the word stem “talk”. This is done to reduce the overall size of the vocabulary and computational burden, as well as to enhance the interpretability of results [38].

Next, LDA tests for a range of suitable numbers of topics per group, and cross-validates each model (i.e. number of topic) on a sub-set of documents (i.e. this is called training data, which was 10% of randomly selected partition within the data set, also called test data) [41]. The number of topics with the lowest degree of perplexity (i.e. the least complex model for the best prediction of the data) is then selected on the remaining data. The perplexity measure is similar to a confirmatory factor analysis, which uses a scree plot and the degree of Eigenvalue to assess and make a cut-off between relevant and non-relevant factors [42]. For defining the number of topics that best represent the data, the lowest degree of perplexity is determined by comparing the fit of LDA models of various numbers of topics on held-out documents (i.e. test data), and by visually inspecting the perplexity plot for each model. For instance, a perplexity plot could be generated for LDA models of 20, 40, 80, etc. numbers per topics. Here, the choice of number topics will depend the size and set up of data (e.g. abstracts versus twitter data versus full conversations). A greater model power is represented in a lower perplexity, indicating that there is less uncertainty about the documents [43]. Final results allow for the identification of (1) the number of topics for the whole set of data; and (2) the words within documents to specific topics.

We carried out the LDA using MATLAB, a mathematical computing software for engineers and scientists. Developed and published by Steyver’s and Griffith [44], the authors provide a Topic Modeling Toolbox that allows conducting an LDA – including the aforementioned pre-processing steps – in order to extract meaningful information. For this, no advanced or programming skills or complex and time-intensive manual pre-processing work is required.Footnote 1

Previous studies have demonstrated that topic modelling is suitable for examining information from blogs, journal entries or open-ended responses in electronic health records for the purpose of e.g. opinion analysis [38, 45, 46]. However, no documentation exists whether the ML technique is sufficient in exploring and understanding small group conversations related to patient safety and healthcare management. Group conversations are rich in terms of complexity of content and language used. Thus, exploring whether findings from this study align with previous qualitative studies related to healthcare management and patient safety would support the application of the ML technique to this context.

Methods

Sample

Participant recruitment took place through the offices of a UK hospital and a UK university that offers executive education to healthcare professionals between November 2016 and December 2017. Potential participants were informed about the schedule of events and the time commitment required. The sample comprised 103 participants (28 groups of 3–5 participants; mean age = 33.01, SD = 8.53; female = 55) clinical and non-clinical managerial students (e.g. medicine students as well as executive students who have already obtained a professional qualification; n = 28) and healthcare professionals (nurses, surgical registrars, public health managers; n = 75) from a number of organisations that participants represented.

Setting

The role-play exercise was built on a fictional healthcare system that contained recognisable issues, problems and opportunities to improve patient safety. Participants were asked to read through a portfolio of information that consisted of a description of the fictional healthcare trusts (e.g. in-patient and out-patient activity), reports on recent patient safety events, including a wrong lens implant, a forgotten swab after surgery and a medication error, and a booklet on effective practices related to teamwork, shared leadership and joint decision-making. The room for the role-play exercise included a table, up to 6 chairs and two video cameras positioned in the corner opposite to each other. The exercise lasted approximately 2 h. Activities were audio (Olympus WS-853) and video (2 GoPro4Black; setting 1080p wide at 60 frames per second) recorded, and observed by a member of the research team. Data collection took place at the offices of the research team.

The exercise was divided into three 30-min activities including an individual task, in which participants familiarised themselves with the material, a group task, where participants discussed how to improve patient safety and healthcare management, and a debrief in which a member of the research team provided participants with feedback on their teamwork skills. This study focuses on the data gathered during the group task.

Group task

During the 30-min group task, participants were assigned a role that represented a Healthcare Management Committee, consisting of the Lead Medical Director, the Deputy Medical Director, the Chief Nurse, the Human Resource Manager, and the Finance Director. These roles were chosen because they are typically represented board level meeting related to healthcare management and patient safety. The overall task was to discuss and develop a list of recommendations to improve healthcare management and patient safety.

Questionnaires

Before the group activity, participants completed a background questionnaire including sex, age and number of years of supervisory experience. After the group activity, participants rated their perceived team member’s ability to participate and provide input, and whether team members supported everyone actively participating. This was assessed by two sub-scales – quality of participation (i.e. voice) and social support – that were adapted from Carson et al.’s [2] internal team environment scale, a tool that examines the degree of team members’ perceived ability to encourage participation and support. Sample items are: “My team supports everyone actively participating in decision-making” and “Everyone on this team has a chance to participate and provide input.” Rated on a 7-point Likert scale (1 = “Strongly disagree” to 7 = “Strongly agree”), higher scores indicate a greater degree of perceived quality of participation. The Cronbach’s Alpha for the quality of participation was .85 and the value for social support was .81 [47].

Data collection and processing

In order to be able to appropriately investigate the characteristics of group processes and communication in the context of healthcare management and patient safety decisions, and in alignment with previous measures in small group research, three types of data were collected [8, 48]: First, we extracted and coded sequences of group interactions between members from the video recording (cf. Figure 3 of the layout of the room and the coded data). For this, time series data for each group were ordered to a vector of sequences of group interactions over time, before being transformed into a recurrence plot. The sequences were defined by the interaction between team members. Specifically, each member was assigned a number (1,2,3, etc.), with interactions being reflected in the number of dyadic combinations (e.g. 1–2, 2–3, 3–1, etc.). We also acknowledged the interaction between a team member and other team members; e.g. a member asking the other team members whether they approve of a suggestion and the remaining team members responding simultaneously, e.g. by agreeing. In these cases, an additional number was assigned to account for member-team interactions.

Fig. 3
figure 3

Layout of the room where the role-play exercise took place, as well as coding strategy for each team members and the team, respectively

The interactions were categorised according to Bales’ Interaction Process Analysis (IPA) model. The IPA is a robust method for categorising systems of interaction in small face-to-face groups [49]. Behaviours were examined based on a predetermined a set of 12 behaviours that represent two categories: “social-emotional” and “task” (for more details, see Bales [50]). We coded videos using the MANGOLD INTERACT software [51], a video analysis tool that allows synchronised viewing, content coding, and event logging analysis of video recordings for observational research. Each video was analysed by two independent researchers. If behaviour was not visibly seen in one of the video recordings, the second video was used for clarification purposes. The consistency of the inter-rater agreement of frequency in behaviour and, thus, interactions was assessed by intra-class correlation coefficient 2-way random-effects model. The results showed a high degree of reliability between the two raters (ICC = .94). Following the coding of these interactions, we assessed the extent to which the stability, determinism, and complexity of sequences of group interactions. To establish the degree of determinism, and in alignment with Knight et al. (2016) [28] who also evaluated group interactions in simulated settings, the minimal length to account for deterministic interactions were set to two recurrent data points of sequences of group interactions over time.

Second, we audio-recorded group discussions that were transcribed by an external company for an agreed fee. For the transcription, a verbal intelligent style was applied. ‘Intelligent verbatim’ transcripts omit ‘ums’ and ‘ers’ and other fillers [52] to produce an accurate transcript which is also readable. Each team member’s input was transcribed line by line. This led to a total final word count of 53,485 words for all transcripts. Next, the transcripts were imported into MATLAB and pre-processing of the data was executed.

Third, self-reports on the team’s perceived quality of participation and social support. Self-reports were based on Carson et al.’s [2] internal team environment scales.

In summary, both observational data and transcripts were imported into MATLAB 2017b and processed using the recurrence quantification analysis (for guidelines and further information see Knight et al. [28] and Marwan et al. [53]) and the topic modelling toolbox based on Steyver’s and Griffith, respectively [44]. Self-reports, collected after the group activity, were used to assess the degree to which characteristics of group interactions explain the quality of participation and social support. The script for the RQA analysis as well as exemplar data are provided in the Additional files 1 and 2. The MATLAB scripts for the LDA analysis can be found online.Footnote 2

Data analysis

Observational data and self-reports

We applied the Generalised Estimating Equations (GEES) approach in order to examine the relationship between group level RQA outcome measures and participants’ perceived quality of participation and social support (SPSS 24; IBM). GEEs are an extension of general linear model for analysing outcomes that violate the assumptions that are typically required e.g. non-normally distributed outcomes. Furthermore, the GEEs method has been recommended for use with clustered data and with datasets that are small in size and thus low in power [54, 55]. Because our data were not normally distributed and relatively small in size, the GEE is deemed as an ideal tool to test our theoretical assumption. Variables were tested for multicollinearity and the results were found to be below the advised degree for linear dependencies [56, 57]. Two GEEs were modelled: one examined the relationship between the RQA (stability, determinism, and complexity) and perceived quality of participation (i.e. outcome variable); the other examined the relationship between the RQA (stability, determinism, and complexity) and perceived social support.

Qualitative data

Emerging groups of semantically related words were clustered into topics, for which the narrative structure was developed by two independent researchers who met throughout the data processing to identify, discuss, and resolve any inconsistencies in theme interpretation.

Results

Observational data and self-reports

The recurrence quantification analysis was carried out on a sequence of 157 (SD = 67) dyadic team interactions per 30-min group discussions. On average, groups revealed low levels of recurrence (mean =11.52; SD = 4.48), low to medium levels of predictability (mean = 35.73; SD = 10.42) and medium to high levels of complexity of sequences of group interactions (mean = 67.11; SD = 0.19). For the self-reports, groups had a mean level of perceived quality of participation and social support of 5.68 (SD = 0.61) and 4.78 (SD = 0.61), respectively. As illustrated in Table 1, there was no significant association between the quality of participation and the RQA. However, there was a significant positive association between group-level stability and perceived social support, as well as a significant negative association between perceived social support and the level of predictability in sequences of group interactions.

Table 1 Findings based on the Generalised Estimating Equations

Qualitative data

Results from the topic modelling method suggested that the data were best represented by fifteen topics. Figure 4 provides an illustration of the first ten topics for the first ten documents. Figure 5 shows the word cloud as visual illustration produced alongside the analysis. The first four topics are illustrated in the table below (cf. Table 2). Conversations addressed themes such as (1) areas and concerns related to the management of patient incidents; (2) the responsibilities among team members, including nurses and doctors; (3) the importance of a good internal team environment; and (4) the hospital culture. Although words within topics are low in probability, they remain within a reasonable range compared to other small group research studies [58].

Fig. 4
figure 4

Topic probability for the first 10 documents

Fig. 5
figure 5

Word cloud created using the LDA approach

Table 2 Word distributions of the first four topics with the highest probability (p) distribution

Discussion

This study examined group interactions and communication processes related to healthcare management and patient safety, with the aim to understand the nature of group interactions related to perceived quality of participation and social support, as well as to examine conversations around healthcare management and patient safety decisions using signal processing and machine learning technologies. Audio and video recordings of teams discussing healthcare management and patient safety were analysed using the RQA and the topic modelling approach.

Our findings revealed that group interactions were characterised by low stability, medium levels of predictability and medium to high complexity. The structural stability of interactions was positively related to perceived social support, while the predictability of sequences of interactions was negatively related to perceived social support. The quality of participation and perceived social support were illustrated by behavioural exemplars such as the encouragement of expression of views and opinions, showing respect for individual differences, and discouraging personal insults [2]. Concurrently, team members showed stable sequences of knowledge integration, with some degree of determinism of interaction that was represented by giving and receiving social support to other team members. While the interactions between members in a systematic and repetitive fashion allowed for an increased perception of participation and social support, the perception became negative when interactions occurred in a predictable manner. One reason for the latter could be that social support should be provided repeatedly but in consideration of the situational awareness necessary to provide support to the right person at the right time. However, if interactions become predictable, it might not lead to the same perception of support but to a common response pattern (e.g. person A always interacts with person B irrespective of content).

A practical example taken from these findings includes the scenario of optimising patient safety in operating theatres. During the simulations, various stakeholders provided input of their expertise to relevant factors in the simulation case, such as addressing systems organisation, factor analysis, employment practices and root causes. There was high variability in the suggestions and proposed solutions. Whilst the input was appropriate for each case, the variability was associated with the degree of encouragement needed to recognise team members’ contribution. For example, team members expressed different views about the priority to assign to practical tasks within the scenario, e.g. hiring the most appropriate surgeon versus general safety training for operating theatre staff. These conversations were reflected in a mix of stable patterns of group interactions, which, in previous research, have been associated with enhanced communication processes [28, 35]. Data from the current study add to these findings by demonstrating that the results of the RQA were associated with participants’ perceived social support. This is a novel finding which shows that the RQA indices have predictive power related to perceived quality indices of teamwork.

Spoken language data revealed points of discussions in real-life settings including the management of patient safety events; the responsibilities of team members, such as nurses and doctors; and an emphasis on a good internal team environment as well as the hospital culture. Similar to previous studies [59, 60], our data showed that that efficient healthcare management and patient safety is believed to consist of teamwork and effort that is reflected in clear roles and responsibilities, and that a culture of engagement and trust is essential for health systems to succeed in an era of accountable care.

Furthermore, findings are novel in that they highlight the role-play exercise as an appropriate environment to hold discussions about patient safety decisions and healthcare management. Topics identified as part of our set up, and in our findings, closely resemble the material used for this simulation. That is, the scenario of two serious incidents presented led to discussions around incident management, while the guideline on effective teamwork practices created discussions around team environment. As such, results are encouraging in that they could be used as a baseline for training and assessing patient safety decisions and healthcare management, and the simulation material as a tool of theory building around healthcare management and patient safety policy development, as well as for building practical applications that address sensitive and high-risk contexts such as serious incident management.

Methodological consideration and implications for further research

Future studies could provide further guidelines on how to efficiently implement signal processing in this, and other, contexts. For instance, studies could address the degree to which the groups’ stability, predictability, and complexity are related to task accomplishment and objectively rated performance quality [61]. Thus, using standardised measures [50] alongside objective indices of teamwork and quality to examine patterns of cooperative inquiry and joint decision-making would facilitate a better understanding of the relationships and predictive tendencies between group interactions, perceived teamwork, observable behaviour, and team-level outcomes.

Related to ML techniques, the LDA, since being first developed by Blei et al. [62], has been subjected to extensions, such as the “topics over time” topic modelling approach [63], which uses time-stamps in texts to identify and cluster topics, or the “author-topic” modelling method [64] that links and clusters the words of each person to generate content in a group discussion. This approach would help to further understanding of the degree and content of each member’s contributions. While these methods were not of immediate relevance to our study since we examined the general feasibility of LDA as one of the fundamental ML methods to explore team-level conversations on patient safety and healthcare management, future studies could apply alternative approaches to address how discussion and decision-making change over time, and the degree to which each member’s input plays a role in the decision-making process.

Limitations

Some limitations should be noted. We used self-reported data to understand the perceived quality of participation and social support rather than more objective ratings of quality of teamwork and performance outcomes (e.g. quality of problem solving through expert evaluation). To better assess the conditions for effective group interactions, future studies could obtain expert opinions in order to confirm the usefulness of the RQA as an attribute of teamwork and quality.

We used a simulated scenario to explore group interaction and conversations about patient safety and healthcare management. This method, while high in internal validity allowing for a scientifically robust establishment of the relationship between interactions and perceived quality of teamwork, has limited external validity, since everyday settings (e.g. board meetings) addressing patient safety incidents vary in duration, expertise, and content addressed. We also acknowledge that the role-play activity may have influenced the process and sequences of group interactions itself. While it was emphasised that participants should not feel limited by the role they were assigned to, and that they were welcome to bring in their own experience into the group discussion, future studies are encouraged to replicate this form of discussion in a real healthcare team environment in order to test the RQA application in real-life settings.

Lastly, while the results based on the LDA are in alignment with related studies in healthcare and management, results could be compared with e.g. positive and negative health-related practices, and with focus on potential policy recommendations and their implementations. For instance, by comparing the type of content addressed around serious incidents and by assessing the impact of final agreements on the quality of patient safety would be, although outside the scope if this research, a valuable further avenue of research. Thus, future studies are encouraged to carry out a robust validation, where themes from the ML technique are benchmarked against a range of health management practices established in real healthcare settings.

Conclusion

Improving the quality of patient care requires the expression and coordination of specialist knowledge between team members, team members to support each other during the process of decision-making. The primary purpose of this study was to explore effective healthcare management and patient safety through the lens of group interaction and communication processes, and by using signal processing and ML techniques to analyse the data. Key findings show that stable yet complex team interactions are related to higher perceived social support. Moreover, conversations about patient safety and healthcare management addressed the reporting and handling of patient safety events, clear roles and responsibilities between team members, the importance of a good internal team environment, and the overall need to change the hospital culture towards commitment and trust. The research on appropriate management of serious incidents is still in its infancy and establishing further insights into how patient safety could be increased is an important aspect of healthcare. Future studies are, therefore, encouraged to apply both methods to determine further actions needed to improve healthcare service and delivery. Overall, findings contribute to examining and understanding the feasibility and effectiveness of both signal processing and ML techniques to analyse healthcare management practices, and offer a new avenue to theoretical developments that build on the enhanced use of data.

Availability of data and materials

The data that support the findings of this study are not publicly available. Because of the nature of the informed consent and ethical restrictions, data distribution is not permitted. However, we have provided MATLAB scripts and sample data sets of coded group interactions in the Additional files 1 and 2.

Notes

  1. The scripts can be downloaded here: http://psiexp.ss.uci.edu/research/programs_data/toolbox.htm and https://uk.mathworks.com/help/textanalytics/index.html?s_tid=CRUX_lftnav

  2. http://psiexp.ss.uci.edu/research/programs_data/toolbox.htm and https://uk.mathworks.com/help/textanalytics/index.html?s_tid=CRUX_lftnav

Abbreviations

%DET:

Percentage of determinism

ENTR:

Entropy

LDA:

Latent Dirichlet Allocation

ML:

Machine learning

P:

Probability

R:

Correlation coefficient

RQA:

Recurrence quantification analysis

RR:

Recurrence rate

References

  1. Bland JM, Altman DG. Statistics notes: bootstrap resampling methods. BMJ. 2015;350:h2622.

    Article  PubMed  Google Scholar 

  2. Carson JB, Telsuk PE, Marrone JA. Shared leadership in teams: an investigation of antecedent conditions and performance. Acad Manag J. 2007;50(5):1217–34.

    Google Scholar 

  3. Lewis K. Measuring transactive memory systems in the field: scale development and validation. J Appl Psychol. 2003;88(4):587–604.

    Article  PubMed  Google Scholar 

  4. Lemieux-Charles L, McGuire WL. What do we know about health care team effectiveness? A review of the literature. Med Care Res Rev. 2006;63(3):263–300.

    Article  PubMed  Google Scholar 

  5. Kvarnstrom S. Difficulties in collaboration: a critical incident study of interprofessional healthcare teamwork. J Interprof Care. 2008;22(2):191–203.

    Article  PubMed  Google Scholar 

  6. Tuckman BW. Developmental sequence in small groups. Psychol Bull. 1965;63(6):384–99.

    Article  CAS  PubMed  Google Scholar 

  7. Gersick CJG. Time and transition in work teams. In: Hirokawa R, Cathcart R, Samovar L, Henman L, editors. Small group communication, theory and practice (an anthology), 8th edition. Los Angeles: Roxbury publishing company; 2003. p. 59–75.

    Google Scholar 

  8. Kerr NL, Scott T. Methods of small group research. In: Reis HT, Judd CM, editors. Handbook of research methods in social and personality psychology. New York, NY: Cambridge University Press; 2014. p. 188–219.

    Google Scholar 

  9. Kauffeld S, Lehmann-Willenbrock N. Meetings matter: effects of team meatings on team and organizational success. Small Group Res. 2012;43(2):130–58.

    Article  Google Scholar 

  10. Tschan F, Semmer NK, Gurtner A, et al. Explicit reasoning, confirmation bias, and illusory transactive memory: a simulation study of group medical decision making. Small Group Res. 2009;40:271–300.

    Article  Google Scholar 

  11. Anderson C. Presenting and evaluating qualitative data. Am J Pharm Educ. 2010;74(8):141.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Pett MA. Non-parametric statistics for health care research. London: SAGE Publications; 2015.

    Google Scholar 

  13. Bakeman R. Behavioral observation and coding. In: Reis HT, Judd CM, editors. Handbook of research methods in social and personality psychology. New York: Cabridge: University Press; 2000. p. 138–60.

  14. Kenny DA, Mannetti L, Pierro A, et al. The statistical analysis of data from small groups. J Pers Soc Psychol. 2002;83(1):126–37.

    Article  PubMed  Google Scholar 

  15. Kavoura A, Bitsani E. Methodological considerations for qualitative communication research. Procedia - Social and Behavioral Sciences. 2014;147:544–9.

    Article  Google Scholar 

  16. Baumeister BF, Vohs KD, Funder DC. Psychology as the science of self-reports and finger movements. Perspect Psychol Sci. 2007;2(4):296–403.

    Article  Google Scholar 

  17. Atieno OP. An analysis of the strengths and limitations of qualitative and quantitative research paradigms. Problems of Education in the 21st. Century. 2009;13:13–8.

    Google Scholar 

  18. Burgoon JK, Dunbar NE, Giles H. Interaction coordinaton and adaption. In: Burgoon JK, Magnenat-Thalmann N, Pantie M, Vinciarelli A, editors. Social Signal Processing. Cambridge, UK: Cambridge University Press; 2017. p. 78–97.

    Chapter  Google Scholar 

  19. Georgiou PG, Black MP, Lammert A, et al. "That’s aggravating, very aggravating": Is it possible to classify behaviors in couple interactions using automatically derived lexical features? Proc Affective Comput Intell Interaction. Memhis, TM. 2011:87–96.

  20. Vinciarelli A, Pantic M, Bourlard H. Social signal processing: survey of an emerging domain. Image Vis Comput. 2009;27(12):1743–59.

    Article  Google Scholar 

  21. Alpaydin E. Introduction to machine learning (adaptive computation and machine learning series) London, England: The MIT Press, 2014.

  22. Black MP, Katsamanis A, Baucom BR, et al. Toward automating a human behavioral coding system for married couples’ interactions using speech acoustic features. Speech Comm. 2013;55(1):1–21.

    Article  Google Scholar 

  23. Gatica-Perez D, Aran O, Jayapogi D. Analysis of small groups. In: Burgoon JK, Magnenat-Thalmann N, Pantic M, Vinciarelli A, editors. Social Signal Processing. Cambridge, UK: Cambridge University Press; 2017. p. 349–68.

    Chapter  Google Scholar 

  24. Marwan N. A historical review of recurrence plots. The European Physical Journal Special Topics. 2008;164(1):3–12.

    Article  Google Scholar 

  25. Eckmann JP, Kamphorst SO, Ruelle D. Recurrence plots of dynamical systems. EPL (Europhysics Letters). 1987;4(9):973–7.

    Article  Google Scholar 

  26. Webber CL Jr, Zbilut JP. Recurrence quantification analysis of nonlinear dynamical systems. In: Tutorials in contemporary nonlinear methods for the behavioral sciences; 2005. p. 26–94.

    Google Scholar 

  27. Zbilut JP, Thomasson N, Webber CL. Recurrence quantification analysis as a tool for nonlinear exploration of nonstationary cardiac signals. Med Eng Phys. 2002;24:53–60.

    Article  PubMed  Google Scholar 

  28. Knight AP, Kennedy DM, McComb SA. Using recurrence analysis to examine group dynamics. Group Dyn Theory Res Pract. 2016;20(3):223–41.

    Article  Google Scholar 

  29. Mocenni C, Facchini A, Vicino A. Comparison of recurrence quantification methods for the analysis of temporal and spatial chaos. Math Comput Model. 2011;53(7–8):1535–45.

    Article  Google Scholar 

  30. Proulx R, Côté P, Parrott L. Use of recurrence analysis to measure the dynamical stability of a multi-species community model. The European Physical Journal Special Topics. 2008;164(1):117–26.

    Article  Google Scholar 

  31. Shannon CE. A mathematical theory of communication. Bell System Technical Journal. 1948;27:379–423.

    Article  Google Scholar 

  32. Shuiabi E, Thomson V, Bhuiyan N. Entropy as a measure of operational flexibility. Eur J Oper Res. 2005;165(3):696–707.

    Article  Google Scholar 

  33. Strang AJ, Funke GJ, Russell SM, et al. Physio-behavioral coupling in a cooperative team task: contributors and relations. J Exp Psychol Hum Percept Perform. 2014;40(1):145–58.

    Article  PubMed  Google Scholar 

  34. Paxton A, Dale R. Interpersonal movement synchrony responds to high- and low-level conversational constraints. Front Psychol. 2017;8:1135.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Gorman JC, Cooke NJ, Amazeen PG, et al. Measuring patterns in team interaction sequences using a discrete recurrence approach. Hum Factors. 2012;54(4):503–17.

    Article  PubMed  Google Scholar 

  36. Wallach HM, Murray I, Salakhutdinov R, et al. Evaluation methods for topic models. In: Danyluk AP, Bottou L, Littman ML, editors. Proceedings of the 26th annual international conference on machine learning. New York: ACM; 2009. p. 1105–12.

    Google Scholar 

  37. Hu Y, Boyd-Graber J, Satinoff B, et al. Interactive topic modeling. Mach Learn. 2013;95(3):423–69.

    Article  Google Scholar 

  38. Atkins DC, Rubin TN, Steyvers M, et al. Topic models: a novel method for modeling couple and family text data. J Fam Psychol. 2012;26(5):816–27.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Ali N, Ibrahim N. Porter stemming algorithm for semantic checking. ICCIT. 2012:253–8.

  40. Porter MF. An algorithm for suffix stripping. Program. 1980;14(3):130–7.

    Article  Google Scholar 

  41. Asuncion A, W M, Smyth P, et al. On smoothing and inference for topic models. In: Bilmes J, Ng A-Y, editors. Proceedings of the twenty-fifth conference on uncertainty in artificial intelligence. Arlington, VA: AUAI press; 2009. p. 27–34.

    Google Scholar 

  42. Cattell RB. The scree test for the number of factors. Multivar Behav Res. 1966;1:629–37.

    Google Scholar 

  43. Blei DM. Probabilistic topic models. Commun ACM. 2012;55(4):77.

    Article  Google Scholar 

  44. Steyvers M, Griffiths T. Probabilistic topic models. In: Landauer T, McNamara D, Dennis S, Kintsch W, editors. Latent semantic analysis: A road to meaning: Laurence Erlbaum; 2007.

  45. Chang J, Boyd-Graber J, Gerrish S, et al. Reading tea leaves: how humans interpret topic models. In: Advances in neural information processing systems 21 (NIPS); 2009.

    Google Scholar 

  46. Blei DM, Lafferty JD. A correlated topic model of science. Ann Appl Stat. 2007;1(1):17–35.

    Article  Google Scholar 

  47. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297–334.

    Article  Google Scholar 

  48. Salas E, DiazGranados D, Weaver SJ, et al. Does team training work? Principles for health care. Acad Emerg Med. 2008;15(11):1002–9.

    Article  PubMed  Google Scholar 

  49. Bales RF. Interaction process analysis: a method for the study of small groups. Reading, MA: Addison-Wesley; 1950.

    Google Scholar 

  50. Bales RF. A set of categories for the analysis of small group interaction. Am Sociol Rev. 1950;15(2):257–63.

    Article  Google Scholar 

  51. Mangold. INTERACT User Guide. In GmbH MI, ed. http://www.mangold-international.com, 2017.

  52. McLellan E, MacQueen KM, Neidig JL. Beyond the qualitative interview: data preparation and transcription. Field Methods. 2016;15(1):63–84.

    Article  Google Scholar 

  53. Marwan N, Carmenromano M, Thiel M, et al. Recurrence plots for the analysis of complex systems. Phys Rep. 2007;438(5–6):237–329.

    Article  Google Scholar 

  54. Muth C, Bales KL, Hinde K, et al. Alternative models for small samples in psychological research: applying linear mixed effects models and generalized estimating equations to repeated measures data. Educ Psychol Meas. 2015;76:64–87.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Vagenas D, Totsika V. Modelling correlated data: multilevel models and generalized estimating equations and their use with data from research in developmental disabilities. Res Dev Disabil. 2018;81:1–11.

    Article  PubMed  Google Scholar 

  56. Hair JFJ, Anderson RE, Tatham RL, et al. Multivariate data analysis. New York: Macmillan; 1995.

    Google Scholar 

  57. Yoo W, Mayberry R, Sejong B. A study of effects of multicollinearity in the mulltivariate analysis. International Journal of Applied Science Technology. 2014;4(5):9–19.

    PubMed  Google Scholar 

  58. Jayapogi D, Gatica-Perez D. Mining group nonverbal conversational patterns using probabilistic topic model. IEEE Transactions on Multimedia. 2010;12(8):790–802.

    Article  Google Scholar 

  59. Waterson P. A critical review of the systems approach within patient safety research. Ergonomics. 2009;52(10):1185–95.

    Article  PubMed  Google Scholar 

  60. Sujan MA, Huang H, Braithwaite J. Learning from incidents in health care: critique from a safety-II perspective. Saf Sci. 2017;99(Part A:115–21.

    Article  Google Scholar 

  61. Salas E, Shuffler ML, Thayer AL, et al. Understanding and improving teamwork in organizations: a scientifically based practical guide. Hum Resour Manag. 2015;54(4):599–622.

    Article  Google Scholar 

  62. Blei DM, Jordan M, Griffin KL, et al. Hierarchical topic models and the nested chinese restaurant process. Adv Neural Inf Proces Syst. 2003;40(5):621–36.

    Google Scholar 

  63. Wang X, McCallum A. Topics over time: A non-Markov continuous-time model of topical trends. KDD '06 proceedings of the 12th ACM SIGKDD international conference on knowledge discovery and data mining. Philadelphia, PA: USA; 2006. p. 424–33.

    Google Scholar 

  64. Rosen-Zvi M, Griffiths T, Steyvers M, et al. The author-topic model for authors and documents. UAI '04 proceedings of the 20th conference on uncertainty in artificial intelligence. Canada: Banff; 2004. p. 487–94.

    Google Scholar 

Download references

Acknowledgements

We thank the National Institute for Health Research (NIHR) Imperial Patient Safety Translation Research Centre (PSTRC) and the NIHR Imperial Biomedical Research Centre (BRC) for its support of this research. We also thank all participants for their contribution to and participation in this study. We also thank Dr Hamdi Joudeh for his input on the RQA analysis.

Funding

The work was supported by the National Institute for Health Research (NIHR) Imperial Patient Safety Translation Research Centre (PSTRC) and the NIHR Imperial Biomedical Research Centre (BRC). The funder had no role in the design of this study, collection and analysis of data, or decision to submit results.

Author information

Authors and Affiliations

Authors

Contributions

LA, CB, and ES conceptualised this research. LA collected and analysed the data. The manuscript was written by LA with contributions from LA, CB, ES, HA, and AD. All authors have read and approved the manuscript.

Corresponding author

Correspondence to Lisa Aufegger.

Ethics declarations

Ethics approval and consent to participate

The research was granted ethical approval by the Health Research Authority (HRA; IRAS number: 212233), UK, and was conducted according to ethical guidelines of the British Psychological Society. Written informed consent was obtained from all participants, and no payment was given in exchange for participation.

Consent for publication

Not applicable.

Competing interests

We declare no conflict(s) of interest associated with this research.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1:

 RQA Matlab script. (M 1 kb)

Additional file 2:

RQA exemplar data. (MAT 236 bytes)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Aufegger, L., Bicknell, C., Soane, E. et al. Understanding health management and safety decisions using signal processing and machine learning. BMC Med Res Methodol 19, 121 (2019). https://doi.org/10.1186/s12874-019-0756-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12874-019-0756-2