Next Article in Journal
Routing Protocols for Underwater Wireless Sensor Networks: Taxonomy, Research Challenges, Routing Strategies and Future Directions
Next Article in Special Issue
Wide-Band Color Imagery Restoration for RGB-NIR Single Sensor Images
Previous Article in Journal
Application of a Novel S3 Nanowire Gas Sensor Device in Parallel with GC-MS for the Identification of Rind Percentage of Grated Parmigiano Reggiano
Previous Article in Special Issue
Multi-Touch Tabletop System Using Infrared Image Recognition for User Position Identification
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Estimating Respiratory Rate in Post-Anesthesia Care Unit Patients Using Infrared Thermography: An Observational Study

by
Nadine Hochhausen
1,*,
Carina Barbosa Pereira
2,
Steffen Leonhardt
2,
Rolf Rossaint
1 and
Michael Czaplik
1
1
Department of Anesthesiology, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany
2
Philips Chair for Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, 52074 Aachen, Germany
*
Author to whom correspondence should be addressed.
Sensors 2018, 18(5), 1618; https://doi.org/10.3390/s18051618
Submission received: 29 March 2018 / Revised: 4 May 2018 / Accepted: 14 May 2018 / Published: 18 May 2018
(This article belongs to the Special Issue Advances in Infrared Imaging: Sensing, Exploitation and Applications)

Abstract

:
The post-anesthesia care unit (PACU) is the central hub for recovery after surgery, especially when the surgery is performed under general anesthesia. Aside from clinical aspects, respiratory impairment is one of the major causes of morbidity and affected recovery in the PACU and should therefore be monitored. In previous studies, infrared thermography was applied to assess the breathing rate (BR) of healthy volunteers. Here, the transferability of published methods for postoperative patients in the PACU was examined. Video recordings of 28 patients were acquired using a long-wave infrared camera, and analyzed offline. For validation purposes, BRs derived from body surface electrocardiography were measured simultaneously. In general, a close agreement between the two techniques (r = 0.607, p = 0.002 upon arrival, and r = 0.849, p < 0.001 upon discharge from the PACU) was obtained. In conclusion, the algorithm was demonstrated to be feasible and reliable under these challenging conditions.

1. Introduction

The post-anesthesia care unit (PACU) is the central hub for recovery after surgery, especially when the surgery is performed under general anesthesia [1]. During stays in the PACU, patients have to be monitored (clinically, and by assessing vital parameters) and stabilized in terms of potential volume deficits, pain, and body temperature, if necessary, before being transferred to a normal unit [2]. Respiratory complications are a major cause of morbidity and impaired recovery in the PACU, as respiratory function is already affected by general anesthesia. Thus, impaired oxygenation and a reduction of up to 50% in functional residual capacity when compared with pre-anesthesia values were reported. In addition, various critical respiratory events (CREs) can occur during stays in the PACU, including hypoxemia, where one’s oxygen saturation (SpO2) lies below 90%; hypoventilation, where one’s breathing rate (BR) rests below 8 breaths per minute (bpm), or one’s partial pressure of carbon dioxide in arterial blood (pCO2) rises above 50 mmHg; and upper airway obstruction. The factors contributing to these respiratory complications can be patient-, surgical-, or anesthesia-related. Therefore, early detection of these CREs is very important for a prompt and appropriate medical intervention, such as a physical treatment (e.g., insertion of an oral or nasal supraglottic airway device, oxygen insufflation, or even tracheal reintubation) or pharmacological therapy (e.g., opioid antagonism or muscle relaxant reversal) [3,4]. In addition, the monitoring of breathing function is essential because altered breathing patterns such as tachypnea (high BR), bradypnea (low BR), apnea (suspension of breathing), or irregular breathing (e.g., Cheyne–Stokes respiration or Kussmaul breathing) may indicate impaired recovery [4,5,6,7]. For these reasons, BR and other vital parameters, such as heart rate and temperature, should be assessed continuously in PACUs.
Although BR is a solid indicator, and one of the earliest indicators of physiological distress, studies have reported that it is also commonly neglected due to the shortcomings of current clinical monitoring techniques [8]. The current methods used to monitor vital signs require the attachment of sensors to the patient’s body, which frequently leads to discomfort and stress [9]. Therefore, the demand for contactless monitoring techniques in clinical settings is increasing, not only for vital parameter detection, but also for diagnostic tools [10,11,12,13,14,15]. Several research groups have demonstrated that infrared thermography (IRT) may be a promising technology for the monitoring of BR [16], heart rate [17], temperature [18], and perfusion [19]. It combines various advantages, such as passive, contactless, and radiation-free measurement procedures, as well as independence from a light source [19].
In 2015, a robust and effective algorithm for BR detection in thermal videos was introduced by Pereira et al. It ensured automatic detection and tracking of the nose, which was the region of interest (ROI). Furthermore, successful extraction and processing of breathing waveforms was demonstrated in an experimental study involving healthy volunteers [20]. We strongly believe that PACU patients may benefit from contactless BR estimation. Therefore, in this paper, the performance of the approach developed by Pereira et al. was evaluated in terms of reliability and feasibility on postoperative patients in the PACU. To the best of our knowledge, this is the first study in which IRT was used to monitor BR in a real clinical scenario involving adult patients.

2. Materials and Methods

2.1. Study Design

All subjects gave their informed consent for inclusion before participating in the study. The study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Ethics Committee of the RWTH Aachen Faculty of Medicine, Germany (EK 041/14). The observational study was performed in the PACU from January 2016 to April 2016 at the University Hospital Aachen.
Twenty-eight patients receiving general anesthesia for non-emergency surgeries were enrolled in this observational study. Inclusion criteria were age over 18 years, the ability to give written consent, and a postoperative stay planned in the PACU. Exclusion criteria resulted from the inclusion criteria: underage patients, the inability to give written consent, and a postoperative stay planned in the intensive care unit or intermediate care unit.

2.2. Monitoring and Data Assessment

After admission to the PACU, all patients were connected to a Philips IntelliVue MP30 monitor (Philips Electronics N.V., Amsterdam, The Netherlands) for continuous assessment of vital data (electrocardiography (ECG), noninvasive blood pressure, BR, and oxygen saturation).
According to clinical standards, vital signs were collected and documented every 15 min. Additionally, a 2-minute IRT video (after calibration) was acquired in 15-minute phases, focusing on the patient’s face. Vital signs were recorded simultaneously. However, in this study, only two thermal videos were analyzed per patient. These corresponded to the first (upon admission to the PACU) and last measurements (upon discharge from the PACU).
IRT sequences were recorded with an uncooled, long-wave infrared camera, VarioCAM® HD head 820 S/30 mm (Infratec GmbH, Dresden, Germany), using the software IRBIS 3 plus. Its spatial resolution covers 1024 × 768 pixels, the spectral range is between 7.5 μm and 14 μm, and the thermal sensitivity is 50 mK at 30 °C. In addition, sequences were acquired at a rate of 30 frames per second.
The experimental setup, assuring quality of data acquisition, was placed in the PACU, which was air-conditioned. The infrared camera was mounted on a tripod head, which was fixed on a rolling rack. The rolling rack was positioned at the foot of the bed. All patients laid in the bed with an elevated upper body, wearing patient hospital clothing and no jewelry. All patients were sober after their surgical procedures (Figure 1).

2.3. IRT Image Analysis

The approach used to assess BR relies on the temperature variation around the nose during the respiratory cycle. During inspiration, cold air from the environment is inhaled, and during expiration, warm air from the lungs is exhaled. As demonstrated in several pilot studies [16,20,21,22], thermal imaging is capable of accurately detecting this temperature modulation. Figure 2 shows the main steps used to assess BR from thermal videos. These are explained in the following section in more detail. As described by Pereira et al. [20], the algorithm was implemented in MATLAB (MATLAB 2014a, The MathWorks Inc., Natick, MA, USA). The collected data were analyzed offline, using a standardized protocol.

2.3.1. Region Selection and Tracking

The first step of this approach consisted of manually selecting the ROI (i.e., the nose of the patient). Afterward, a rough tracking of the nose was carried out using the algorithm proposed by Mei et al. [23]. It is a particle filter-based object tracker that integrates sparse representation. The tracking algorithm considers two models: a state transition model, p ( x t | x t 1 ) , and an observation model, p ( y t | x t ) . The former, p ( x t | x t 1 ) , uses conditional density to compute the temporal correlation of a state transition between two consecutive frames. Here, x t is calculated using the affine transformation parameters ( α 1 , α 2 , α 3 , α 4 , t 1 , t 2 ) , and velocities ( v 1 , v 2 ) , where ( α 1 , α 2 , α 3 , α 4 ) are the deformation parameters, and ( t 1 , t 2 ) stand for the translation parameters, which describe displacement along the two axes, x and y. Finally, ( v 1 , v 2 ) correspond to the velocities of both translation parameters. The latter, p ( y t | x t ) , compares the similarity between the target model and target candidate at each time, t. The maximum observation likelihood is given by Equation (1):
p ( y t | x t ) = j = 1 , , d N ( y ˜ t ( j ) ; 0 , σ 2 ) .
Here, y t is the observation, N ( · ) stands for the Gaussian distribution, and σ 2 represents its variance. Additionally, j denotes the j th pixel, d is the number of pixels in the appearance model, and y ˜ t stands for the approximation residual of the observation, y t by the target model.
To improve the signal-to-noise ratio, a second ROI, labeled the region of measurement (ROM), was defined and tracked.

2.3.2. Extraction of the Respiratory Waveform and Signal Processing

After the tracking procedure, the mean temperature value, s ¯ ( t ) , of the ROM was calculated for each frame of the video according to Equation (2):
s ¯ ( t ) = 1 m · n   i = 0 m 1 j = 0 n 1 s ( i , j , t ) .
In this equation, m and n stand for the width and length of the ROM, and s ( i , j , t ) corresponds to the temperature at pixel ( i , j ) of frame t . The variable s ¯ ( t ) represents the temperature waveform around the nostrils. The next step was its preprocessing, by applying a second-order Butterworth bandpass filter.
To estimate the instantaneous respiratory frequencies, the approach presented by Brüser et al. was used [24]. Firstly, a short adaptive analysis window, w i [ v ] , centered at n i , was slid across the respiratory signal, s [ n ] . Secondly, for each window position, the local breath-to-breath interval, T i , was computed using three estimators: E A C [ m ] , E A M D F [ m ] , and E M A P [ m ] . The adaptive window autocorrelation estimator, E A C [ m ] , calculates, for all interval lengths, the correlation between m samples to the right, w [ v ] , and to the left, w [ v m ] , of the window center, w [ 0 ] , and was defined as shown in Equation (3):
E A C [ m ] = 1 m   v = 0 m w [ v ] · w [ v m ] .
The adaptive window average magnitude difference function, E A M D F [ m ] , computes, in turn, the absolute difference between samples for all interval lengths as defined by Equation (4):
E A M D F [ m ] = ( 1 m   v = 0 m | w [ v ] · w [ v m ] | ) 1 .
The third and last estimator, the adaptive maximum amplitude pairs, E M A P [ m ] , is an indirect peak detector because it calculates the maximum amplitude of any two samples for each lag, [ m ] , as shown in Equation (5):
E M A P [ m ] = max v { 0 , , m } ( w [ v ] · w [ v m ] ) .
After computing the three estimators, Bayesian fusion was applied. Given E A C [ m ] , E A M D F [ m ] , and E M A P [ m ] , the conditional probability of m being the correct breath-to-breath interval is governed by Equation (6):
p ( m | E A C , E A M D F , E M A P ) p ( m | E A C ) p ( m | E A M D F ) p ( m | E M A P ) .
Note that the estimators E A C [ m ] , E A M D F [ m ] , and E M A P [ m ] can be regarded as probability density functions: p ( m | E A C ) , p ( m | E A M D F ) , and p ( m | E M A P ) .

2.4. Statistical Analysis

No power analysis was performed due to the observational nature of this study.
All data were analyzed with SPSS Statistics 23 for Windows (SPSS Inc., IBM Business Analytics Software, Armonk, NY, USA). The statistical significance level was set at p < 0.05. The Kolmogorov–Smirnov test confirmed the non-normal distribution of the data. Therefore, Spearman’s rho correlation coefficients were presented for the time points “arrival at the PACU” and “discharge from the PACU” separately, in order to consider intra-individual dependencies within one dataset.
The Bland–Altman plot (Figure 3) compares the BR obtained with IRT, and the ground truth (GT, which is the BR derived from body surface ECG). For subgroup analysis, patients were assigned to category A (BR < 12 bpm), category B (BR: 12–15 bpm), or category C (BR > 15 bpm). Since the number of resulting datasets was relatively low, correlation analysis was performed over both time points.

3. Results

In total, 28 patients were included in the study. Thus, in this work, 56 datasets (two datasets per patient) were analyzed. No patient declined measurements after participation in the study. Forty-seven datasets were included in the data analysis. Nine datasets were unable to be analyzed and were therefore excluded, either because the ROI (nose) was not visible, or because of the patient’s constant movement. The study population had an age of 70 years (interquartile range (IQR) 51–77), and consisted of 24 female and 4 male patients.
The Bland–Altman plot (Figure 3) shows the comparison between the two measurement techniques. It compares the BR obtained with IRT (BR IRT) with the BR of the GT (BR GT). The plot shows a bias of 1.75 bpm, and limits of agreement ranged from −2.74 bpm to 6.23 bpm.
Table 1 shows the performance of the algorithm in terms of correlation coefficients and p-values, for the three BR categories (A to C). On average, Spearman’s rho correlation coefficient (r) between the BR estimated using IRT, and using the GT was r = 0.607 (p = 0.002) upon arrival and r = 0.849 (p < 0.001) upon discharge from the PACU. The highest correlation was obtained for category A (BR < 12 bpm, r = 0.845, and p = 0.034), and the lowest performance was obtained for higher BRs (BR > 15 bpm, category C, r = 0.458, and p = 0.024).
Figure 4 shows the correlation between BRs obtained with IRT and the GT, depending on the breathing categories, A to C.
Table 2 compares the correlation between IRT and the GT for both cases: oxygen insufflation and no insufflation. The algorithm’s performance was only slightly lower when the patient needed insufflation with a nasal cannula. Additionally, the correlation between BRs obtained with the GT and with IRT is presented in the scatter plot (Figure 5).
Assessing each patient individually, it was clear that the algorithm performed better for regular, deep breathing patterns than for shallow breathing (Table 3).

4. Discussion

In this paper, the reliability and feasibility of a new algorithm for BR estimation from thermal videos of postoperative patients in the PACU was examined. The key result was that this IRT-based approach, which was previously validated in a study involving healthy volunteers, was capable of accurately assessing BR in a realistic clinical scenario, typically found in the PACU.
In our study, thermal videos from postoperative patients staying in the PACU were acquired. The estimated BR was compared with the BR derived from body surface ECG (ground truth). A high degree of agreement between both measurement techniques was observed, even though the nostril region (ROI) represented a relatively small portion of the image (smaller than 1%). In category A (BR < 12 bpm) and category B (BR 12–15 bpm) in particular, the strength of the relationship was high. A lower correlation coefficient was observed for higher breathing frequencies (category C, BR > 15 bpm), surely influenced by outliers (Figure 4). One possible explanation may be the shallow breathing accompanying tachypnea.
In some cases, the reference method may have failed to detect episodes of shallow breathing and bradypnea, contributing to higher errors. Because the assessment of BR was only conducted at one defined time point, and several measures were obtained from IRT sequence analysis, correlation was impaired for irregular breathing (Table 3). Broens et al. claimed that ECG-derived BR monitoring is error-prone and might lead to underdetection of respiratory events [6]. In addition, it is very prone to motion artefacts, poor electrode placement, and physiologic events that induce thoracic movements unrelated to respiration (e.g., coughing) [25]. Fortunately, no disruptive influence factors were present in the analyzed IRT sequences of this study. In total, IRT-based BR detection may be superior to ECG-derived BR monitoring in particular situations. Extreme perspiration also complicates ECG electrode attachment. Additionally, postoperative patients with reduced awareness of their situation, confused patients, or patients with senile dementia tend to remove sensors. In all these situations, remote monitoring techniques may be advantageous.
At this time, we know that the algorithm used, based on IRT, worked accurately in healthy volunteers in a laboratory setting, even under challenging conditions. Here, the healthy participants were asked to move, as well as to simulate various types of breathing disorders (e.g., Kussmaul breathing, Cheyne–Stokes respiration, tachypnea, etc.). The results of the study demonstrated that this approach was able to compensate for the patient’s movement, and to accurately estimate BR. A good agreement between IRT and piezoplethysmography (reference measurement) was reported. Additionally, the approach seemed to be robust against motion as well as various breathing patterns [20]. Overall, localization of selected features, analysis of thermal images, and image segmentation of the face are always challenging [26,27,28]. However, other approaches in the literature show promising results using IRT for BR estimation. Specifically, Lewis et al. published an IRT-based approach for the estimation of BR and relative tidal volume in participants. In this case, a variety of breathing protocols were performed and then analyzed. Similar close correlations between thermal and mechanical BRs were obtained [16]. Additionally, Fei et al. introduced a thermal imaging approach using wavelet analysis for filtering out breathing information. Here, a high correlation between the IRT approach and the reference method was also demonstrated [21]. In 2010, Al-Khalidi proposed an algorithm that also used skin temperature changes around the nose during a respiration cycle for respiration monitoring. In contrast to our approach, it computed the position of the nose (region of interest) for every single frame [29]. This method is probably computationally costly, but is less sensitive to sudden and unpredictable strong movements of the object. In 2017, Alkali presented an improved version of this approach [30].
In this paper, we used a more sophisticated tracking algorithm which employs a motion model describing how the target may change for various possible motions of the object. Here, the tracking always relies on prior information to estimate the new position of the object. Furthermore, Chauvin et al. demonstrated that real-time measurements during exercising are possible using a thermal camera [31]. In 2018, a case report was published showing an acceptable performance of thermal cameras for BR estimation during nighttime measurements [32]. Another study demonstrated accurate robustness, despite different amounts of thermal changes and motion [33].
Despite the high correlation between the IRT-based approach and the GT, all introduced studies worked with voluntary participants under laboratory conditions. Even if participants were instructed to perform various movements and breathing patterns during data acquisition, an experimental setting does not reflect a clinical scenario. In our study, we analyzed, for the very first time, the capability of IRT to estimate the BR of adult patients in a postoperative clinical setting. Here, the patients arrived for treatment in the PACU after a variety of surgical procedures. Postoperative pain and state of consciousness varied. Additionally, some patients needed an oxygen supply via a nasal cannula. The data recording was performed without instructions or restrictions for the patients. Nevertheless, close correlations between the IRT-based approach and the GT were obtained, despite the challenging conditions that characterize the typical clinical environment.
As referred to in Section 2.3.1, the ROI (nose) was manually selected. Thus, our next goal is to improve the current approach to work automatically. Some pathologies, such as Raynaud’s phenomenon, must be considered since they can negatively affect the segmentation of the ROI (patients suffering from this syndrome may have a lower temperature in the nose due to extreme vasoconstriction). In the future, such phenomena must be focused on to ensure robust ROI segmentation.
However, our study had some limitations. Because of the fixed camera position at the foot of the bed, nostril regions were not tracked when patients moved to a lateral sleeping position, or when patients were agitated with strong urges to move. Additionally, with changing breathing patterns, such as extreme tachypnea or shallow breathing, the approach had difficulties distinguishing between inspiration and expiration.
In total, the IRT-based algorithm performed in a robust and reliable manner in a postoperative clinical setting, without disturbing postoperative care. In particular, the advantages of IRT, such as independence from a light source and the ability to handle motion artefacts, make it interesting for prospective daily use. Additionally, the reproducibility of IRT measurements is high when quality assurance (e.g., including data protocols) is given [34,35,36,37].

5. Conclusions

According to the current state of relevant studies as well as our experience, IRT may be a promising technique for contactless BR estimation. Our results showed that a feasible and reliable use of the presented approach was possible, even under challenging conditions in a postoperative clinical setting in the PACU. Furthermore, a close correlation between the IRT-based approach and the GT were obtained, especially for low and normal breathing frequencies. Further analysis should focus on the inferior performance of the algorithm for higher breathing rates. It is possible that a modification or development of the algorithm may improve the correlation between the IRT-based approach and the GT under this condition. Additionally, the recognition of shallow breathing or apnea must be examined in further studies. A fusion of newly-developed parameters (e.g., open-mouth respiration or shoulder and thorax movement) may improve the algorithm for further clinical studies.

Author Contributions

M.C., R.R., and S.L. conceived and designed the experiments; N.H. and C.B.P. performed the experiments; N.H., M.C., and C.B.P. analyzed and interpreted the data; N.H. and C.B.P. wrote the paper. M.C., R.R., and S.L. substantively revised the paper. All authors have approved the submitted version.

Funding

The project was funded by the Federal Ministry for Economic Affairs and Energy (Bundesministerium für Wirtschaft und Energie), abbreviated BMWi.

Acknowledgments

C.B.P. wishes to acknowledge the FCT (Foundation for Science and Technology in Portugal) for her PhD grant SFRH/BD/84357/2012. Additionally, we would like to express our appreciation of the efforts of our PACU team.

Conflicts of Interest

The authors declare no conflict of interest. The founding sponsors had no role in the design of the study, in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Feldman, L.S.; Lee, L.; Fiore, J. What outcomes are important in the assessment of Enhanced Recovery after Surgery (ERAS) pathways? Can. J. Anaesth. 2015, 62, 120–130. [Google Scholar] [CrossRef] [PubMed]
  2. Lalani, S.B.; Ali, F.; Kanji, Z. Prolonged-stay patients in the PACU: A review of the literature. J. Perianesthesia Nurs. 2013, 28, 151–155. [Google Scholar] [CrossRef] [PubMed]
  3. Rose, D.K.; Cohen, M.M.; Wigglesworth, D.F.; DeBoer, D.P. Critical respiratory events in the postanesthesia care unit. Patient, surgical, and anesthetic factors. Anesthesiology 1994, 81, 410–418. [Google Scholar] [CrossRef] [PubMed]
  4. Karcz, M.; Papadakos, P.J. Respiratory complications in the postanesthesia care unit: A review of pathophysiological mechanisms. Can. J. Respir. Ther. 2013, 49, 21–29. [Google Scholar] [PubMed]
  5. Cavalcante, A.N.; Martin, Y.N.; Sprung, J.; Imsirovic, J.; Weingarten, T.N. Low minute ventilation episodes during anesthesia recovery following intraperitoneal surgery as detected by a non-invasive respiratory volume monitor. J. Clin. Monit. Comput. 2017. [Google Scholar] [CrossRef] [PubMed]
  6. Broens, S.J.; He, X.; Evley, R.; Olofsen, E.; Niesters, M.; Mahajan, R.P.; Dahan, A.; van Velzen, M. Frequent respiratory events in postoperative patients aged 60 years and above. Ther. Clin. Risk Manag. 2017, 13, 1091–1098. [Google Scholar] [CrossRef] [PubMed]
  7. Sun, Z.; Sessler, D.I.; Dalton, J.E.; Devereaux, P.J.; Shahinyan, A.; Naylor, A.J.; Hutcherson, M.T.; Finnegan, P.S.; Tandon, V.; Darvish-Kazem, S.; et al. Postoperative Hypoxemia Is Common and Persistent: A Prospective Blinded Observational Study. Anesth. Analg. 2015, 121, 709–715. [Google Scholar] [CrossRef] [PubMed]
  8. Cretikos, M.A.; Bellomo, R.; Hillman, K.; Chen, J.; Finfer, S.; Flabouris, A. Respiratory rate: The neglected vital sign. Med. J. Aust. 2008, 188, 657–659. [Google Scholar] [PubMed]
  9. Al-Khalidi, F.Q.; Saatchi, R.; Burke, D.; Elphick, H.; Tan, S. Respiration rate monitoring methods: A review. Pediatr. Pulmonol. 2011, 46, 523–529. [Google Scholar] [CrossRef] [PubMed]
  10. Droitcour, A.D.; Seto, T.B.; Park, B.-K.; Yamada, S.; Vergara, A.; El Hourani, C.; Shing, T.; Yuen, A.; Lubecke, V.M.; Boric-Lubecke, O. Non-contact respiratory rate measurement validation for hospitalized patients. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2009), Minneapolis, MN, USA, 3–6 September 2009; pp. 4812–4815. [Google Scholar] [CrossRef]
  11. Tattersall, G.J. Infrared thermography: A non-invasive window into thermal physiology. Comp. Biochem. Physiol. A. Mol. Integr. Physiol. 2016, 202, 78–98. [Google Scholar] [CrossRef] [PubMed]
  12. Ko, L.N.; Raff, A.B.; Garza-Mayers, A.C.; Dobry, A.S.; Ortega-Martinez, A.; Anderson, R.R.; Kroshinsky, D. Skin Surface Temperatures Measured by Thermal Imaging Aid in the Diagnosis of Cellulitis. J. Investig. Dermatol. 2018, 138, 520–526. [Google Scholar] [CrossRef] [PubMed]
  13. Drucker, A.M.; Piguet, V. Hot Stuff: Thermal Imaging Aids in Cellulitis Diagnosis. J. Investig. Dermatol. 2018, 138, 482–484. [Google Scholar] [CrossRef] [PubMed]
  14. Koprowski, R. Automatic analysis of the trunk thermal images from healthy subjects and patients with faulty posture. Comput. Biol. Med. 2015, 62, 110–118. [Google Scholar] [CrossRef] [PubMed]
  15. Snekhalatha, U.; Rajalakshmi, T.; Gopikrishnan, M.; Gupta, N. Computer-based automated analysis of X-ray and thermal imaging of knee region in evaluation of rheumatoid arthritis. Proc. Inst. Mech. Eng. Part H J. Eng. Med. 2017, 231, 1178–1187. [Google Scholar] [CrossRef] [PubMed]
  16. Lewis, G.F.; Gatto, R.G.; Porges, S.W. A novel method for extracting respiration rate and relative tidal volume from infrared thermography. Psychophysiology 2011, 48, 877–887. [Google Scholar] [CrossRef] [PubMed]
  17. Garbey, M.; Sun, N.; Merla, A.; Pavlidis, I. Contact-free measurement of cardiac pulse based on the analysis of thermal imagery. IEEE Trans. Biomed. Eng. 2007, 54, 1418–1426. [Google Scholar] [CrossRef] [PubMed]
  18. Knobel, R.B.; Guenther, B.D.; Rice, H.E. Thermoregulation and thermography in neonatal physiology and disease. Biol. Res. Nurs. 2011, 13, 274–282. [Google Scholar] [CrossRef] [PubMed]
  19. Pereira, C.B.; Czaplik, M.; Blanik, N.; Rossaint, R.; Blazek, V.; Leonhardt, S. Contact-free monitoring of circulation and perfusion dynamics based on the analysis of thermal imagery. Biomed. Opt. Express 2014, 5, 1075–1089. [Google Scholar] [CrossRef] [PubMed]
  20. Pereira, C.B.; Yu, X.; Czaplik, M.; Rossaint, R.; Blazek, V.; Leonhardt, S. Remote monitoring of breathing dynamics using infrared thermography. Biomed. Opt. Express 2015, 6, 4378–4394. [Google Scholar] [CrossRef] [PubMed]
  21. Fei, J.; Pavlidis, I. Thermistor at a distance: Unobtrusive measurement of breathing. IEEE Trans. Biomed. Eng. 2010, 57, 988–998. [Google Scholar] [CrossRef] [PubMed]
  22. Pereira, C.B.; Yu, X.; Blazek, V.; Leonhardt, S. Robust remote monitoring of breathing function by using infrared thermography. In Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy, 25–29 August 2015; pp. 4250–4253. [Google Scholar] [CrossRef]
  23. Mei, X.; Ling, H. Robust visual tracking and vehicle classification via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 2011, 33, 2259–2272. [Google Scholar] [CrossRef] [PubMed]
  24. Brüser, C.; Winter, S.; Leonhardt, S. Robust inter-beat interval estimation in cardiac vibration signals. Physiol. Meas. 2013, 34, 123–138. [Google Scholar] [CrossRef] [PubMed]
  25. Gaucher, A.; Frasca, D.; Mimoz, O.; Debaene, B. Accuracy of respiratory rate monitoring by capnometry using the Capnomask(R) in extubated patients receiving supplemental oxygen after surgery. Br. J. Anaesth. 2012, 108, 316–320. [Google Scholar] [CrossRef] [PubMed]
  26. Marzec, M.; Koprowski, R.; Wróbel, Z. Methods of face localization in thermograms. Biocybern. Biomed. Eng. 2015, 35, 138–146. [Google Scholar] [CrossRef]
  27. Koprowski, R. Some selected quantitative methods of thermal image analysis in Matlab. J. Biophotonics 2016, 9, 510–520. [Google Scholar] [CrossRef] [PubMed]
  28. Arunachalam, H. Motwani Image Segmentation for the Extraction of Face Using Haar Like Feature. Int. Arab J. Inf. Technol 2016, 13, 951–958. [Google Scholar]
  29. AL-Khalidi, F.Q.; Saatchi, R.; Burke, D.; Elphick, H. Tracking human face features in thermal images for respiration monitoring. In Proceedings of the 2010 IEEE/ACS International Conference on Computer Systems and Applications (AICCSA), Hammamet, Tunisia, 16–19 May 2010; pp. 1–6. [Google Scholar]
  30. Alkali, A.H.; Saatchi, R.; Elphick, H.; Burke, D. Thermal image processing for real-time non-contact respiration rate monitoring. IET Circuits Devices Syst. 2017, 11, 142–148. [Google Scholar] [CrossRef]
  31. Chauvin, R.; Hamel, M.; Brière, S.; Ferland, F.; Grondin, F.; Létourneau, D.; Tousignant, M.; Michaud, F. Contact-Free Respiration Rate Monitoring Using a Pan-Tilt Thermal Camera for Stationary Bike Telerehabilitation Sessions. IEEE Syst. J. 2016, 10, 1046–1055. [Google Scholar] [CrossRef]
  32. Hu, M.; Zhai, G.; Li, D.; Fan, Y.; Duan, H.; Zhu, W.; Yang, X. Combination of near-infrared and thermal imaging techniques for the remote and simultaneous measurements of breathing and heart rates under sleep situation. PLoS ONE 2018, 13, e0190466. [Google Scholar] [CrossRef] [PubMed]
  33. Cho, Y.; Julier, S.J.; Marquardt, N.; Bianchi-Berthouze, N. Robust tracking of respiratory rate in high-dynamic range scenes using mobile thermal imaging. Biomed. Opt. Express 2017, 8, 4480–4503. [Google Scholar] [CrossRef] [PubMed]
  34. Zaproudina, N.; Varmavuo, V.; Airaksinen, O.; Närhi, M. Reproducibility of infrared thermography measurements in healthy individuals. Physiol. Meas. 2008, 29, 515–524. [Google Scholar] [CrossRef] [PubMed]
  35. Ring, E.F.J.; Ammer, K.; Wiecek, B.; Plassmann, P.; Jones, C.; Jung, A.; Murawski, P. Quality assurance for thermal imaging systems in medicine. Thermol. Int. 2007, 17, 103–106. [Google Scholar]
  36. Ring, E.F.J.; Ammer, K. The Technique of Infrared Imaging in Medicine. Thermol. Int. 2000, 10, 7–14. [Google Scholar] [CrossRef]
  37. Fernández-Cuevas, I.; Bouzas Marins, J.C.; Arnáiz Lastras, J.; Gómez Carmona, P.M.; Piñonosa Cano, S.; García-Concepción, M.Á.; Sillero-Quintana, M. Classification of factors influencing the use of infrared thermography in humans: A review. Infrared Phys. Technol. 2015, 71, 28–55. [Google Scholar] [CrossRef]
Figure 1. The experimental setup in the post-anesthesia care unit (PACU). (1) Long-wave infrared camera, VarioCAM® HD head 820 S/30 mm (Infratec GmbH, Dresden, Germany). (2) Laptop. (3) Philips IntelliVue MP30 monitor (Philips Electronics N.V., Amsterdam, the Netherlands). (4) Patient bed. (5) Rolling rack.
Figure 1. The experimental setup in the post-anesthesia care unit (PACU). (1) Long-wave infrared camera, VarioCAM® HD head 820 S/30 mm (Infratec GmbH, Dresden, Germany). (2) Laptop. (3) Philips IntelliVue MP30 monitor (Philips Electronics N.V., Amsterdam, the Netherlands). (4) Patient bed. (5) Rolling rack.
Sensors 18 01618 g001
Figure 2. Representation of the five major steps used to extract breathing rate (BR) from thermal videos. (1) Video acquisition. (2) Manual selection and tracking of the nose, which is the region of interest (ROI). (3) Manual selection and tracking of the region of measurement (ROM), which encloses the nostrils. (4) Extraction of the breathing waveform. (5) Breathing rate estimation.
Figure 2. Representation of the five major steps used to extract breathing rate (BR) from thermal videos. (1) Video acquisition. (2) Manual selection and tracking of the nose, which is the region of interest (ROI). (3) Manual selection and tracking of the region of measurement (ROM), which encloses the nostrils. (4) Extraction of the breathing waveform. (5) Breathing rate estimation.
Sensors 18 01618 g002
Figure 3. Difference against mean for breathing rate (BR). The figure compares the breathing rate (BR) obtained with infrared thermography (BR IRT) with the corresponding BR measured with the ground truth (BR GT). The plot shows a bias of 1.75 bpm, and limits of agreement range from −2.74 bpm to 6.23 bpm.
Figure 3. Difference against mean for breathing rate (BR). The figure compares the breathing rate (BR) obtained with infrared thermography (BR IRT) with the corresponding BR measured with the ground truth (BR GT). The plot shows a bias of 1.75 bpm, and limits of agreement range from −2.74 bpm to 6.23 bpm.
Sensors 18 01618 g003
Figure 4. Correlation between breathing rates (BRs) obtained with the ground truth (BR GT) and IRT (BR IRT). The scatter plot shows the relationship between BRs obtained with the GT and IRT for three BR categories (A: BR < 12 bpm, black dots; B: BR 12–15 bpm, green dots; C: BR > 15 bpm, red dots).
Figure 4. Correlation between breathing rates (BRs) obtained with the ground truth (BR GT) and IRT (BR IRT). The scatter plot shows the relationship between BRs obtained with the GT and IRT for three BR categories (A: BR < 12 bpm, black dots; B: BR 12–15 bpm, green dots; C: BR > 15 bpm, red dots).
Sensors 18 01618 g004
Figure 5. Correlation between breathing rates (BRs) obtained with the ground truth (BR GT) and IRT (BR IRT). The scatter plot shows the relationship between BRs obtained with the GT and IRT for insufflation with nasal cannula (green dots), and no insufflation (black dots).
Figure 5. Correlation between breathing rates (BRs) obtained with the ground truth (BR GT) and IRT (BR IRT). The scatter plot shows the relationship between BRs obtained with the GT and IRT for insufflation with nasal cannula (green dots), and no insufflation (black dots).
Sensors 18 01618 g005
Table 1. Algorithm performance for different breathing rate (BR) categories.
Table 1. Algorithm performance for different breathing rate (BR) categories.
CategoryBR RangeNumber of DatasetsSpearman’s Rho Correlationp Value
A<12 bpm60.8450.034
B12–15 bpm170.6510.005
C>15 bpm240.4580.024
Table 2. Algorithm performance for insufflation with nasal cannula and with no insufflation.
Table 2. Algorithm performance for insufflation with nasal cannula and with no insufflation.
CategoryNumber of DatasetsSpearman’s Rho Correlationp Value
No Insufflation200.774<0.001
Insufflation270.690<0.001
Table 3. Performance of the algorithm for each patient (n.a.; not applicable).
Table 3. Performance of the algorithm for each patient (n.a.; not applicable).
PatientTime PointBR (bpm)Relative ErrorInsufflationRegion of Interest (ROI)—Fraction of Image (%)Breathing Pattern/Patient Movement
Ground Truth (GT)Infrared Thermography (IRT)
1116.0011.540.28no0.03shallow
214.0013.680.02no0.06normal
2124.00n.a.n.a.non.a.shallow
216.0016.030.00no0.07normal
3116.0012.540.22no0.09normal
218.00n.a.n.a.non.a.movement
4120.00n.a.n.a.non.a.movement
212.00n.a.n.a.non.a.movement
5114.0013.480.04no0.20normal
214.0012.350.12no0.20normal
6118.0017.110.05yes0.13normal
220.0018.640.07yes0.14normal
7116.0012.600.21no0.16shallow/movement
216.00n.a.n.a.non.a.movement
8120.0015.940.20yes0.25irregular
220.0016.490.18yes0.21irregular
9115.0015.680.05no0.12normal
218.0017.500.03no0.10normal
10115.0014.720.02yes0.12normal
214.0013.100.06yes0.13normal
11117.0016.000.06yes0.08normal
211.0011.170.02yes0.07normal
12112.0011.010.08no0.18normal
212.0010.490.13no0.14normal
13117.0017.370.02no0.12normal
210.0010.010.00no0.20normal
14118.0015.450.14no0.10normal
216.0015.850.01no0.19normal
15116.0015.510.03yes0.14normal
216.0015.040.06yes0.06normal
16120.00n.a.n.a.yesn.a.no signal
218.0015.720.13yes0.08normal
17110.00n.a.n.a.non.a.movement
212.0013.800.15no0.24normal
18120.0014.900.26no0.05irregular
218.0016.880.06no0.07normal
19110.009.020.10yes0.06normal
212.0011.480.04yes0.05normal
20116.0012.680.21yes0.04irregular
212.0012.090.01yes0.05normal
21116.0011.350.29yes0.13apnea
216.0010.080.37yes0.07apnea
22112.0011.260.06yes0.06normal
216.0015.050.06yes0.04normal
23120.007.930.60yes0.10apnea
210.009.430.06yes0.07normal
24110.0010.380.04yes0.16normal
213.009.790.25yes0.13apnea
251n.a.n.a.n.a.non.a.lateral position
2n.a.n.a.n.a.non.a.lateral position
26120.0016.340.18yes0.09movement
212.0011.310.06yes0.07normal
27112.009.330.22no0.06movement
28.007.630.05no0.11normal
28114.0011.350.19yes0.08normal
212.0010.830.10yes0.09normal

Share and Cite

MDPI and ACS Style

Hochhausen, N.; Barbosa Pereira, C.; Leonhardt, S.; Rossaint, R.; Czaplik, M. Estimating Respiratory Rate in Post-Anesthesia Care Unit Patients Using Infrared Thermography: An Observational Study. Sensors 2018, 18, 1618. https://doi.org/10.3390/s18051618

AMA Style

Hochhausen N, Barbosa Pereira C, Leonhardt S, Rossaint R, Czaplik M. Estimating Respiratory Rate in Post-Anesthesia Care Unit Patients Using Infrared Thermography: An Observational Study. Sensors. 2018; 18(5):1618. https://doi.org/10.3390/s18051618

Chicago/Turabian Style

Hochhausen, Nadine, Carina Barbosa Pereira, Steffen Leonhardt, Rolf Rossaint, and Michael Czaplik. 2018. "Estimating Respiratory Rate in Post-Anesthesia Care Unit Patients Using Infrared Thermography: An Observational Study" Sensors 18, no. 5: 1618. https://doi.org/10.3390/s18051618

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop