Next Article in Journal
Fault Diagnosis of Rotating Machinery Based on Improved Self-Supervised Learning Method and Very Few Labeled Samples
Next Article in Special Issue
Performance Analysis of Deep-Neural-Network-Based Automatic Diagnosis of Diabetic Retinopathy
Previous Article in Journal
A Layered Middleware for OT/IT Convergence to Empower Industry 5.0 Applications
Previous Article in Special Issue
Experimental Study on Wound Area Measurement with Mobile Devices
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Advances in Thermal Image Analysis for the Detection of Pregnancy in Horses Using Infrared Thermography

1
Department of Large Animal Diseases and Clinic, Institute of Veterinary Medicine, Warsaw University of Life Sciences, 02-787 Warsaw, Poland
2
Institute of Biomedical Engineering, Faculty of Mechanical Engineering, Białystok University of Technology, 15-351 Bialystok, Poland
3
Menzies Health Institute Queensland, Griffith University School of Medicine, Southport, QLD 4222, Australia
4
Department of Animal Breeding, Institute of Animal Science, Warsaw University of Life Sciences, 02-787 Warsaw, Poland
*
Authors to whom correspondence should be addressed.
Sensors 2022, 22(1), 191; https://doi.org/10.3390/s22010191
Submission received: 20 November 2021 / Revised: 22 December 2021 / Accepted: 24 December 2021 / Published: 28 December 2021
(This article belongs to the Special Issue Biomedical Image and Signals for Treatment Monitoring)

Abstract

:
Infrared thermography (IRT) was applied as a potentially useful tool in the detection of pregnancy in equids, especially native or wildlife. IRT measures heat emission from the body surface, which increases with the progression of pregnancy as blood flow and metabolic activity in the uterine and fetal tissues increase. Conventional IRT imaging is promising; however, with specific limitations considered, this study aimed to develop novel digital processing methods for thermal images of pregnant mares to detect pregnancy earlier with higher accuracy. In the current study, 40 mares were divided into non-pregnant and pregnant groups and imaged using IRT. Thermal images were transformed into four color models (RGB, YUV, YIQ, HSB) and 10 color components were separated. From each color component, features of image texture were obtained using Histogram Statistics and Grey-Level Run-Length Matrix algorithms. The most informative color/feature combinations were selected for further investigation, and the accuracy of pregnancy detection was calculated. The image texture features in the RGB and YIQ color models reflecting increased heterogeneity of image texture seem to be applicable as potential indicators of pregnancy. Their application in IRT-based pregnancy detection in mares allows for earlier recognition of pregnant mares with higher accuracy than the conventional IRT imaging technique.

1. Introduction

Pregnancy detection is an important aspect of herd management, both in domestic and wild animals. In domestic animals, the most common methods of pregnancy detection are ultrasonography and hormone level measurements. However, both require direct contact with animals [1,2]. Such examinations may be stressful for an animal, or in the case of wild animals nearly impossible [3]. Thus, there is a need for the development of accurate, noninvasive, and contactless methods for pregnancy detection. Infrared thermography (IRT) is considered a valuable diagnostic method, which has previously been adapted to evaluate pregnancy in females of different species, such as zebras, rhinoceros, giraffes [4], pandas [5], cattle [6], and horses [7,8,9]. IRT measures the infrared spectrum of electromagnetic radiation emitted from the body surface [10]. This radiation represents the energy which is dissipated as heat [11], and is affected by a variety of factors, including internal factors such as local tissue metabolism and regional blood flow [12]. During pregnancy, intrauterine tissue proliferates, and uterine blood flow is increases. These physiological changes result in body surface temperature changes near the womb that are detectable by IRT [7].
IRT is considered an accurate imaging method, allowing for detection of even subtle changes in the body surface temperature before they can be detected by palpation [13]. However, some limitations should be considered when using IRT imaging in the detection of pregnancy. The surface body temperature gradients imaged in the abdominal area can be influenced by ambient temperature fluctuations [14,15], other weather conditions [10,16], and individual properties of horses’ body surface [17,18,19]. A high level of repeatability can be achieved and maintained in thermal images using standardized conditions of image acquisition [20,21]; however, the length of time it takes to detect pregnancy related surface temperature changes [7,8] and the accuracy of pregnancy detection [9] limit the application of IRT to the late stage of pregnancy. Therefore, this work focused on developing a methodology for the detection of pregnancy in mares by building a multifactorial approach for digital thermal image processing. This involved combining conventional IRT image acquisition and segmentation with advanced transformation of color models and extraction of image texture. Conventional IRT imaging is a promising modality, and with specific limitations considered, we aim to develop a novel method in the field of digital image processing (DIP).
DIP has been applied in the fields of material mechanics [22,23,24] and human medicine [25,26,27,28,29,30], and provides quantified, objective data considered to be more informative than conventional temperature measures. In materials science, DIP increased the efficiency of non-destructive materials testing, in the detection of damage to composite materials [22], aerospace structures [23], and building elements [24]. Moreover, in medical science, DIP increased the sensitivity and specificity of non-invasive diagnostic imaging, in the diagnosis of diabetes [25], skin cancer [26], and breast tumors [27]. However, the application of DIP to thermal images in equine medicine is only in the early stages of development [18,31]. In this study, two aspects of DIP, transformation to color models and image texture extraction, have been applied using IRT to enable earlier and more accurate detection of pregnancy in mares.
Thermal images are colorful, where the emitted infrared radiation is presented as the color gradient corresponding to the distribution of surface temperatures [15]. Conversely, image texture approaches require grayscale images as input [32,33,34,35,36]. Therefore, conversion of the IRT images to selected color components is required to transform the input to grayscale [36,37,38]. Certain mathematical functions are used to convert the color coordinates of light into three color components in three-dimensional space. Based on the position of the light color coordinates in space, the color models are determined [39,40]. In this research, Red/Green/Blue (RGB) color cube [39,41], Brightness/U-component/V-component (YUV) color spaces [39], Brightness/I-component/Q-component (YIQ) color spaces [39], and Hue/Saturation/Brightness (HSB) color coin [40] were the color models considered. Individual components of each color model may be used as an input for image texture analysis using the first order histogram [33] or the second order histogram [32] of the image intensity distribution to determine the pixel relations in Histogram Statistics (HS) and Gray Level Co-occurrence Matrix (GLCM) approaches, respectively. GLCM and Grey-Level Run-Length Matrix (GRLM), are both detailed approaches of Gray-Level Matrices (GLM). The GLM has been recently applied in equine medicine to detect the influence of a rider’s body weight on the thermography of the thoracolumbar region [31]. Moreover, GLM has successfully been used in human medicine to improve the extraction of texture features of ultrasound images [30], radiographic images [42], magnetic resonance images [29,43], and thermal images [27,44,45,46,47,48]. GLM describes a group of texture operators that map image function, image complexity, and statistics of pixel distribution [28] and has been reported to provide complex descriptions of image texture [28,29,43,44].
DIP applications have returned numerous component combinations of color models and features of image texture that have potential to be used in the detection of equine pregnancy; however, they must be evaluated in more detail prior to being used in the field. Therefore, this study aimed to transform thermal images obtained from non-pregnant and pregnant mares into four color models, separate ten color components, and extract features of image texture for each component. The applicability of color/feature combinations obtained were evaluated using specific criteria to select the most informative combinations. Finally, for the selected combinations, the accuracy of pregnancy detection was calculated for consecutive months.

2. Materials and Methods

2.1. Mares

The research was conducted in the Polish state stud farm Dobrzyniewo engaged in conservative breeding of horses of the Polish Konik breed. Out of a herd of 90 Konik Polski horses, 40 Konik Polski mares were selected to carry out IRT imaging. All studied mares were housed under the same conditions in all-day open stables. They were fed twice daily with an individualized portion of hay to maintain a healthy condition and had over 12 h of daily access to a large grassy pasture.
Mares were divided based on the ultrasonographic examination of the reproductive tract into one of two distinct groups of mares: non-pregnant and pregnant. The non-pregnant group was composed of 14 non-lactating mares (n = 14; age 5.47 ± 3.90 years; height 143.10 ± 2.09 cm), whereas the pregnant group was composed of 26 non-lactating mares (n = 26; age 6.28 ± 4.04 years; height 142.40 ± 2.12 cm). The pregnant group’s inclusion criteria were mares that had naturally mated in February and/or March and had a confirmed ultrasonographical pregnancy screened at 14 and 35-days post-ovulation, according to McCue’s protocol [2]. The non-pregnant group’s inclusion criteria were lack of mating during the current reproductive season and two negative results of ultrasonographical pregnancy examination. Ultrasonographic examination of the reproductive tract was conducted using an ultrasound scanner (MyLabOne, ESAOTE, Florence, Italy) and a linear 5 MHz transducer (ESAOTE, Florence, Italy). The experimental protocol was approved by the II Local Ethical Committee on Animal Testing in Warsaw on behalf of the National Ethical Committees on Animal Testing (No WAW2/007/2020, day 15 January 2020).

2.2. Data Collection

For all studied mares, the left lateral surface of the abdomen was imaged using a non-contact thermal camera (FLIR Therma CAM E60, FLIR Systems Brazil, Sorocaba, Brazil) with 0.99 emissivity and a temperature range from 10.0 to 40.0 °C. The impact of external conditions [14,15] was minimized by imaging mares in a closed space, devoid of wind and sun radiation. Thermal images were taken four times every two months, such that 26 mares enrolled in the study were divided into two subgroups basing on the age of pregnancy, where each subgroup concerned 13 mares. The first subgroup (n = 13) was imaged in the 4th, 6th, 8th, and 10th month of pregnancy, whereas the second (n = 13) in the 5th, 7th, 9th, and 11th month of pregnancy. Data collection began in April and was conducted until the last foaling took place in January, with the ambient temperature and humidity ranging from 1.0 °C and 50% to 24 °C and 90%, respectively. Each of a total of 160 thermal images were taken by the same researcher after a standardized preparation of the imaging area including brushing off dirt and mud 15 min before imaging [15]. The thermal camera was always set at the same distance (2.0 m from the imaged area) and positioned consistently (half of the vertical line through the tuber coxae). Thermal images obtained were then conventionally processed. The thermal image processing steps for conventional analysis of IRT measures included (i) image acquisition, (ii) segmentation of regions of interests (ROIs), and (iii) extraction of thermal features (the maximal temperature, the average temperature, the minimal temperature, and the area of the maximal temperature). Results from conventionally processed thermal images were previously documented [8,9].

2.3. Data Processing

The thermal image processing steps for image texture analysis included (i) image acquisition, (ii) segmentation of ROIs, (iii) transformation to color models, and (iv) extraction of image texture features using three analytical approaches: Histogram Statistics (HS), symmetric Gray Level Co-occurrence Matrix (GLCM), and asymmetric Gray Level Co-occurrence Matrix (GLCH). The first two steps were the same for the conventional analysis and the texture analysis of thermal images. All ROIs were manually annotated in the flank area. Each ROI was limited by the vertical line behind the tuber coxae, the dorsal edge of the abdomen, the caudal edge of the last rib, and the lower 2/3 of the abdomen height (Figure 1B,B’). The third and fourth steps were those of digital image processing.

2.3.1. Transformation to Color Models

Grayscale images are required as input for the extraction of image texture features using QMazda Software. Therefore, the third step, transformation to color models, was conducted by QMazda Software as a way of image transformation to grayscale by conversion to selected color components [36,37,38]. IRT is based on the physical phenomenon, that all objects, including the equine body, with a temperature above absolute zero (−273 K) emit infrared (IR) radiation from their surface [49]. The radiated power is proportional to the fourth power of the object’s absolute temperature. The thermal camera detected by the radiated power in the IR spectrum focused IR radiation onto a two-dimensional array and used it to calculate the temperature of the object [10]. The output of the thermal camera is expressed as a thermogram or thermal images which is an image color coded for temperature [50]. In the presented approach, color analysis included the image transformation from the basic RGB color model to YUV, YIQ, and HSB color models which reflected the two-dimensional temperature assignation of the lateral aspect of the mares’ abdomens (Figure 1C–N’).
From the RGB color model, three components, the Red (R), Green (G) and Blue (B) components were separated without any conversion [36,37,38]. In other color spaces, the chrominance components were separated by transforming RGB spaces following the formulas below.
From the YUV color model, three components (a) Brightness component (Y), (b) U-component (U), and (c) V-component (V) were converted as follows [37]:
(a)  299 R + 587 G + 114 B / 1000
(b)  886 B 587 G 299 R + 886 Θ / 1772
(c)  114 B 587 G + 701 R + 701 Θ / 1402
From the YIQ color model, the Brightness component (Y) remained the same as in the YUV color model, and two other components, (a) I-component (I) and (b) Q-component (Q), were converted as follows [36]:
(a)    3213 B 2744 G + 5957 R + 5958 Θ / 11916
(b)  3111 B 5226 G + 2115 R + 5226 Θ / 10452
For the HSB color model, the Brightness component (B) remained the same as Y in the YUV and YIQ color models, and two other components, (a) Hue (H) and (b) Saturation (S) components, were converted as follows [37]:
(a)  Θ 2 π a r g 886 B 587 G 299 R 886 + j 114 B 587 G 701 R 701
(b)  0.937 886 B 587 G 299 R 886 2 + 114 B 587 G 701 R 701 2

2.3.2. Extraction of Image Texture Features

The fourth step, extraction of image texture features, was conducted using three approaches in annotated ROIs using QMazda Software [34,35]. Texture features of thermal images were calculated independently for individual R, G, B, Y, U, V, I, Q, H, and S components. The following three approaches were applied:
(i)
Histogram Statistics (HS) is a usual method of image intensity analysis, based on the first order histogram. HS does not consider the special dependence on the intensity distribution. Moreover, the first order histogram features describe the overall number of pixels having certain intensity but independent of their location in the image [33]. For image I with the dimensions N × M and range of intensity K 0 2 n 1 ( n is the number of bits per pixel), the normalized histogram H is defined as:
H k = n u m b e r   o f   p i x e l s   w i t h   v a l u e   k 0 255 t o t a l   n u m b e r   o f   p i x e l s   N x M
The 13 features from normalized H are defined as [33]:
M e a n = i = 1 N j = 1 M I i , j N M V a r i a n c e = i = 1 N j = 1 M I i , j M e a n 2 N M S k e w n e s s = i = 1 N j = 1 M I i , j M e a n 3 V a r i a n c e 3 N M K u r t o s i s = i = 1 N j = 1 M I i , j M e a n 4 V a r i a n c e 4 3 N M P e r c 01 = min K : k = 0 K H k 0.01 P e r c 10 = min K : k = 0 K H k 0.10 P e r c 50 = min K : k = 0 K H k 0.50 P e r c 90 = min K : k = 0 K H k 0.90 P e r c 99 = min K : k = 0 K H k 0.99 D o m n 01 = k : m a x k = 0 K H k D o m n 10 = k : m a x k = 0 K r H k + r H k M a x m 01 = 1 N M m a x k = 0 K H k M a x m 10 = 1 N M m a x k = 0 K r H k + r H k
(ii)
Gray Level Co-occurrence Matrix (GLCM, GLCH) is a current method of image intensity analysis, based on the second order histogram. GLCM considers the mutual spatial relationship between pairs of image pixels with specific intensity levels. The GLCM method uses the second-order histogram of the image intensity distribution and can be calculated in different directions (horizontal in this study, vertical, 45°, 135°) and at different distances of pixel pairs ( d 1 , , 9 ,   d = 1   i n   t h i s   s t u d y ) [32]. For image I with the dimensions N × M and range of intensity k , l 0 255 , the co-occurrence matrix is defined as:
C o M k , l = i = 1 N j = 1 M 1 : i f   I i , j = k I i + i , j + j = l 0 :   o t h e r w i s e
where i , j is the offset between the pixel of interest and its neighbor. The C o M k , l can be symmetric (GLCM) or asymmetric (GLCH). The normalized co-occurrence matrix (probability of co-occurrence) is defined as:
p k , l = C o M k , l k = 1 K l = 1 K C o M k , l
The 11 Haralick features from normalized C o M matrix are defined as [32]:
AngScMom = k = 1 K l = 1 K p k , l 2 Contrast = m = 0 K 1 m 2 k = 1 K l = 1 K p k , l k l = m Correlat = k = 1 K l = 1 K k l   p k , l μ k μ l σ k σ l SumOfSqs = k = 1 K l = 1 K k μ k 2 p k , l InvDefMom = k = 1 K l = 1 K 1 1 + k l 2 p k , l SumAverg = m = 2 2 K m k = 1 K l = 1 K p k , l k + l = m SumVarnc = m = 2 2 K m S u m A v e r g 2 k = 1 K l = 1 K p k , l k + l = m SumEntrp = m = 2 2 K k = 1 K l = 1 K p k , l k + l = m log k = 1 K l = 1 K p k , l k + l = m Entropy = k = 1 K l = 1 K p k , l log p k , l DifVarnc = m = 0 K 1 m o = 0 K 1 o k = 1 K l = 1 K p k , l k l = o 2 k = 1 K l = 1 K p k , l k l = m DifEntrp = m = 0 K 1 k = 1 K l = 1 K p k , l k l = m log k = 1 K l = 1 K p k , l k l = m
where
μ k = k = 0 K l = 0 K k p k , l μ l = k = 0 K l = 0 K l p k , l σ k = k = 0 K l = 0 K k μ k 2 p k , l σ l = k = 0 K l = 0 K l μ l 2 p k , l .

2.4. Statistical Analysis

Statistical analysis was performed using GraphPad Prism6 software (GraphPad Software Inc., San Diego, CA, USA). Data from 35 image texture features (13 HS features, 11 GLCM features, and 11 GLCH features) were presented as data series for each color component independently, where each horse represented one realization. The numerical data in Supplementary Tables S1–S3 (Supplementary Materials) were presented as mean ± standard deviation (SD), whereas the numerical data on Supplementary Figures S1–S10 were presented as mean + SD. Data series were tested independently for univariate distributions using a Shapiro–Wilk normality test. Data analysis was performed in the following three steps: (i) Testing the differences between data series obtained in consecutive months for the non-pregnant group; (ii) testing the differences between the pooled non-pregnant group and data series obtained in consecutive months for the pregnant group; (iii) calculating the accuracy of pregnancy detection for consecutive months of pregnancy.
The comparisons between (i) data series for the non-pregnant group were assessed using the Ordinary one-way ANOVA followed by Tukey’s multiple comparisons test for Gaussian data and the Kruskal–Wallis test followed by the Dunn’s multiple comparisons test for non-Gaussian data. The alpha value was established as α = 0.05. When features do not differ significantly between consecutive months, the mean ± SD value was calculated as given in Supplementary Tables S1–S3. When features differed significantly, only the p-value was given. Only those features that did not differ between non-pregnant data series were summarized in Figure 2 and selected for further analysis.
The comparisons between (ii) data series for the non-pregnant and pregnant groups were assessed using the Ordinary one-way ANOVA followed by Tukey’s multiple comparisons test for Gaussian data and the Kruskal–Wallis test followed by the Dunn’s multiple comparisons test for non-Gaussian data. The alpha value was established as α = 0.05. When features differed significantly between the non-pregnant and pregnant groups between consecutive months, the month number was noted and presented in Supplementary Tables S4–S6. When the groups differed from a given month to the end of pregnancy, the feature was selected for visualization on a plot and summarized in Figure 3. On the plots in Supplementary Figures S1–S10 a comparison between non-pregnant and pregnant groups was visualized. Only those features that gradually increased or decreased within the pregnancy were summarized in Figure 4 and selected for further calculations.
The accuracy of (iii) pregnancy detection for consecutive months was calculated using three thresholds for gradually increasing features (mean, mean + SD, mean + 2SD) and for gradually decreasing features (mean, mean-SD, mean-2SD), respectively. The mare was annotated as pregnant (1) when the individual feature value was above threshold and annotated as non-pregnant (0) when below it. The same annotation was done in pregnant and non-pregnant groups. The sensitivity (Se), specificity (Sp), positive predictive value (PPV), and negative predictive value (NPV) of pregnancy detection were estimated. The values of Se, Sp, PPV, and NPV were calculated across the range of pregnancy proportions from 0.1 to 1.0 using standard formulae [51].

3. Results

Among 350 returned combinations of color components (n = 10) and image texture features (n = 35; HS n = 13, GLCM n = 11, GLCH n = 11), 127 combinations of HS, 110 combinations of GLCM, and 110 combinations of GLCH did not differ significantly between consecutive months of examination in the non-pregnant group. These combinations were summarized in Figure 2 and considered for further analysis after the first step of determining potential IRT indicators of pregnancy. For features which did not differ significantly between consecutive months, the mean ± SD value was calculated and presented as a pooled value of the non-pregnant group in Supplementary Tables S1–S3 available online. The pooled data series of 347 selected combinations were used for further comparisons with the pregnant groups.
Among 347 selected combinations of color components and image texture features, 77 combinations of HS, 76 combinations of GLCM, and 76 combinations of GLCH differed significantly between the non-pregnant and pregnant groups from a given month to the end of pregnancy. For the Red component in the RGB color model, 12 features of HS, nine features of GLCM, and nine features of GLCH were selected. For the Green component in the RGB color model, six features of HS, four features of GLCM, and four features of GLCH were selected. For the Blue component in the RGB color model, seven features of HS, six features of GLCM, and six features of GLCH were selected. For the Brightness component in the YUV/YIQ/HSB color models, one feature of HS, five features of GLCM, and five features of GLCH were selected. For the U-component in the YUV color model, two features of HS, seven features of GLCM, and seven features of GLCH were selected. For the V-component in the YUV color model, nine features of HS, 10 features of GLCM, and 10 features of GLCH were selected. For the I-component in the YIQ color model, 11 features of HS, nine features of GLCM, and nine features of GLCH were selected. For the Q-component in the YIQ color model, 11 features of HS, five features of GLCM, and five features of GLCH were selected. For the Hue component in the HSB color model, 11 features of HS, 11 features of GLCM, and 11 features of GLCH were selected. For the Saturation component in the HSB color model, seven features of HS, 10 features of GLCM, and 10 features of GLCH were selected. These combinations were summarized in Figure 3 and considered for further analysis after the second step of determining potential IRT indicators of pregnancy. Comparisons of image texture features were summarized in Supplementary Tables S4–S6 available online. No differences were found between the data tested for symmetric (GLCM) and asymmetric (GLCH) Gray Level Co-occurrence Matrices and therefore only the selection of features for GLCM was considered further. Among 229 selected combinations of color components and image texture features, GLCM feature reduction was found to be as equally useful as GLCH features, and therefore 153 combinations were further considered.
Among 153 selected combinations of color components and image texture features, five combinations of HS and eight combinations of GLCM increased or decreased significantly within consecutive months of pregnancy. With respect to the Red component in the RGB color model, no HS features were selected; however, three features of GLCM were selected (Figure S1 available online). The three features of GLCM were SumEntrp, Entropy, and DifEntrp which increased with progressing months of pregnancy. For the Green component in the RGB color model, one feature of HS was selected whereas no GLCM features were selected (Figure S2 available online). The GLCM feature selected was Perc10 which increased with progressing months of pregnancy. For the Blue component in the RGB color model, no HS features were selected and only one feature of GLCM was selected (Figure S3 available online). The GLCM featured selected was InvDefMom which decreased with progressing months of pregnancy. For the Brightness component in the YUV/YIQ/HSB color models, no features of either HS or GLCM were selected (Figure S4 available online). For both the U-component and the V-component in the YUV color model, no HS features were selected and one feature of GLCM was selected (Figures S5 and S6 available online). For the I-component in the YIQ color model, no HS features were selected; however, two GLCM features were selected (Figure S7 available online). The two selected GLCM features of the I-component were SumEntrp and Entropy which increased with progressing months of pregnancy. For the Q-component in the YIQ color model, three HS features and two GLCM features were selected (Figure S8 available online). These features were Mean, Variance, Perc50, SumAverg, and SumVarnc which all decreased with progressing months of pregnancy. For the Hue component in the HSB color model, no HS or GLCM features were selected (Figure S9 available online). For the Saturation component in the HSB color model, one HS feature was selected; however, no GLCM features were selected (Figure S10 available online). The one HS feature was Variance which increased with progressing months of pregnancy. These combinations are summarized in Figure 4 and were considered for further analysis after the third step of determining potential IRT indicators of pregnancy.
For all 13 selected combinations of color components and image texture features, the accuracy of pregnancy detection was summarized for the RGB color model (Table 1), YIQ color model (Table 2), and HSB color model (Table 3). The accuracy of pregnancy detection for the YUV color model was not calculated, due to a lack of selected combinations in this color model. In all three-color models, a salient observation is that the Se increased with higher threshold values (2SD > SD > mean) as well as with progressing months of pregnancy. For the first threshold (mean), Se ranged from 0.14 in the 4th and 5th months (SumEntrp of the Red component) to 1.00 in the 10th and 11th months (Perc10 of the Green component). For the second threshold (mean ± SD), Se ranged from 0.57 in the 4th month (Entropy of the Red component, SumEntrp of the I-component, Variance of the Q-component, and SumVarnc of the Q-component) to 1.00 in the 8th and 9th months (Mean of the Q-component) and then repetitively in 10th and 11th months (DifEntrp of the Red component, Perc10 of the Green component, Mean of the Q-component, Variance of the Q-component, SumVarnc of the Q-component, and SumVarnc of the Q-component). For the third threshold (mean ± 2SD), Se ranged from 0.86 in the 4th and 5th months (Perc10 of the Green component and Variance of the Q-component) and the 6th and 7th months (Perc10 of the Green component, to 1.00 in numerous months including the 4th month (SumEntrp of the Red component, InvDfMom of the Blue component, SumEntrp of the I-component, Entropy of the I-component, and Perc50 of the Q-component). For all considered thresholds, Sp varied within different months and features, therefore the applicability of potential IRT pregnancy indicators was considered and then discussed individually, during the fourth step of analysis.

4. Discussion

The first criterion, and thus the first step of determining potential IRT indicators of pregnancy was to determine which color/feature combinations were significantly different over time for mares in the non-pregnant group. It should be highlighted that homogeneity of data sets obtained from thermal images from the control group, in this research the non-pregnant group, is crucial for accurate group distinction [12,21,52,53]. Information obtained from thermal images of normal horses [18,20,54] provide a baseline of the expected values in the imaged area when comparing to the physiological [7,8,55] and pathological [13,56,57] changes observed in experimental groups. In the case of the abdominal area in mares, the maximal, average, and minimal temperatures on normal thermal images were recently reported [7,8,9] both for non-pregnant and pregnant mares. In previous research, the Gaussian distribution test was the only test used to explore the homogeneity of data. Uniform values would allow for easier diagnosis of pregnancy by increasing positive predictive value and decreasing negative predictive value [2,58,59]; the 350 combinations that passed this criterion were considered for further evaluation.
The second criterion, and thus the second step of determining potential IRT indicators of pregnancy was to determine which color/feature combinations differed significantly between the non-pregnant and pregnant groups from the first indicated month of pregnancy to the end of pregnancy. Bowers et al. [7] showed that IRT imaging can detect pregnancy in horses during late gestation, from the 9th month of pregnancy. Ultrasound allows the diagnosis of pregnancy on the 14th–16th day after ovulation [2]. One concern is that IRT may not be able to detect pregnancy as early as ultrasound and efforts were made therefore to determine how early pregnancy could be detected [8,9]. Using minimal temperature allowed the detection of pregnancy from the 8th month of gestation [8], whereas the maximal temperature, average temperature, and Area of Tmax from the 6th month [8,9]. The differences in thermal images were observed specifically in the smaller flank area of the lateral surface of the abdomen as opposed to the whole area of the lateral surface of the abdomen [8,9], probably due to the decreased amount of hair coat growth in the flank area [60] and thus lower local thermal insulation [19]. The flank area, therefore, was considered in this research. Of the cited features of thermal images, only the maximal temperature and the average temperature in the flank area [9] and the Area of Tmax [8] differed between examined groups from any given month to the end of pregnancy. Moreover, only the Area of Tmax increased as pregnancy progressed, and unlike measured maximal and average temperatures [9], it did not decrease as ambient temperature decreased [8]. It should be highlighted that body surface temperature is highly influenced by ambient temperature fluctuations [14,15], thus of the cited thermal features only one feature, the Area of Tmax, could pass the second criterion adopted in this study. We demonstrated as many as 153 combinations that met this criterion and thus were further evaluated as features that have an advantage over the conventional thermal features examined so far.
The third criterion, and thus the third step in determining potential IRT indicators of pregnancy, was to determine which feature/color combinations increase or decrease within the study period. The gradual increase or decrease of an indicator variable may allow the prediction of the time to parturition and evaluate the development of a free-living herd. In the case of wild horses, the ability to identify a pregnancy based on thermal imaging is limited by the lack of knowledge about mating [61], which can be improved by selecting continuously increasing features from the first indicated month until parturition. Such features would prove to be of high applicability using the proposed method, especially in wildlife research [3,61]. Of the cited features of thermal images, the Area of Tmax did not differ in the pregnant mares from the 6th month of pregnancy to delivery [8] and thus it could not pass the third criterion adopted in this study. Of the 13 combinations examined here which passed this criterion, noteworthy combinations were selected GLCM features in the RGB color model and features selected from HS and GLCM in the YIQ color model.
In different color models, the light color coordinates are mathematically converted into color components in three-dimensional space [40] representing the digitalized contained colors [39], therefore it was hypothesized that different color models will convey differing features of image texture. In the current study, the most combinations were selected in the RGB color model (three features in the Red component, and one feature each in each of the Green and Blue components) and the YIQ color model (two features in the I-component and five features in the Q-component). It is worth noting that in both color models, the same GLCM features were selected. SumEntrp and Entropy increased with the progression of pregnancy in both the Red and I-components. Recent research using the novel approach of thermal image analysis of the equine thoracolumbar region showed that both Entropy and DifEntrp were informative variables in differentiating between two physiological conditions: working under a heavy or a light rider [31]. The change in physiological condition was suggested to increase the degree of thermal energy dissipation detectable as an increased entropy measure. The high values of Entropy and SumEntrp indicate a high heterogeneity of texture [62] and may be a detectible feature in the progression of pregnancy. This result is in line with the successive increase of blood flow in the abdominal area, overall metabolic activity, and the proliferation of uterine and foetal tissues that require the pregnant mare to expend a large amount of energy [1,7,63]. This additional metabolic energy usage in pregnant mares leads to increases in heat emission from the body surface changing the conventional thermal pattern [7,8,9] but also the thermal image texture, as reported here.
While the selection of three features in the Red component is no surprise, the selection of five features in the Q-component may shed new light on the digital image processing of thermal images. In thermal images, high temperature is red-annotated and low temperature is blue-annotated [8,10,18]. Therefore, increased heterogeneity of texture in the Red component and decreased homogeneity indicated by the inverse different moment in the Blue component are consistent with conventional thermal results [7,8,9]. It was shown that the count of red-annotated pixels on thermal images, indicated by Area of Tmax, increased with the progression of pregnancy [8]. On the other hand, the Q-component corresponds to magenta-green axis [39] in the YIQ color model, which is sensitive to changes in luminance rather than hue or saturation changes [41]. With conventional thermal images, the medium-high temperature is magenta-annotated and the medium-low temperature is green-annotated [8,10,18] thus a decrease in the medium range of energy may also be a distinguishing feature of the progression of pregnancy. One might observe the described change in the Q-component when comparing Figure 1K,K’, representing non-pregnant and pregnant mares, respectively. In summary, we suspect that the increase in the count and mutual relations between extreme high red-annotated pixels as well as the decrease in the count and mutual relations between medium-high magenta-annotated pixels and extreme low blue-annotated pixels on the thermal images of the flank area may be potential IRT indicators of pregnancy.
Finally, the accuracy of pregnancy detection for consecutive months of pregnancy and selected color/feature combinations were then evaluated. In a recent study, the highest sensitivity and specificity of pregnancy detection using IRT was noted using the minimal temperature indicator in the 8th month of pregnancy [9]. Earlier pregnancy detection was reported with lower sensitivity and specificity using the average temperature indicator or with the lowest specificity using the maximal temperature indicator [9]. In the current study, with respect to the third threshold, comparable accuracy values were noted partially in the 4th and more clearly in the 5th month of pregnancy. In 6th month and certainly in 8th month of pregnancy the sensitivity and specificity of pregnancy detection in mares were much higher based on the texture features than conventional thermal measures. One may conclude, the application of DIP proposed here allows for earlier and more accurate detection of pregnancy as compared to conventional IRT imaging.

5. Conclusions

Thermal images obtained from non-pregnant and pregnant mares may be successfully transformed into four color models and their individual color components may be separated. Image texture features may then be successfully calculated from color components creating numerous color/feature combinations. Out of these combinations, the IRT image texture features representing the increase in extreme high red-annotated pixels, the decrease in medium-high magenta-annotated pixels, and extreme low blue-annotated pixels seem to be useful indicators of pregnancy. Application of these methods in IRT-based pregnancy detection allows for earlier recognition of pregnancy in mares with higher accuracy than conventional IRT imaging techniques.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/s22010191/s1, Figure S1: Twenty-one selected features (mean + SD) of the Histogram Statistics and Gray Level Co-occurrence Matrix for the Red component in the RGB color model compared between the non-pregnant group and pregnant group over consecutive months of pregnancy, Figure S2: Ten selected features (mean + SD) of the Histogram Statistics and Gray Level Co-occurrence Matrix for the Green component in the RGB color model compared between the non-pregnant group and pregnant group over consecutive months of pregnancy, Figure S3: Thirteen selected features (mean + SD) of the Histogram Statistics and Gray Level Co-occurrence Matrix for the Blue component in the RGB color model compared between the non-pregnant group and pregnant group over consecutive months of pregnancy, Figure S4: Six selected features (mean + SD) of the Histogram Statistics and Gray Level Co-occurrence Matrix for the Brightness component in the YUV/YIQ/HSB color models compared between the non-pregnant group and consecutive pregnant group over consecutive months of pregnancy, Figure S5: Nine selected features (mean + SD) of the Histogram Statistics and Gray Level Co-occurrence Matrix for the U-component in the YUV color model compared between the non-pregnant group and consecutive pregnant group over consecutive months of pregnancy, Figure S6: Nineteen selected features (mean + SD) of the Histogram Statistics and Gray Level Co-occurrence Matrix for the V-component in the YUV color model compared between the non-pregnant group and consecutive pregnant group over consecutive months of pregnancy, Figure S7: Twenty selected features (mean + SD) of the Histogram Statistics and Gray Level Co-occurrence Matrix for the I-component in the YIQ color model compared between the non-pregnant group and consecutive pregnant group over consecutive months of pregnancy, Figure S8: Sixteen selected features (mean + SD) of the Histogram Statistics and Gray Level Co-occurrence Matrix for the Q-component in the YIQ color model compared between the non-pregnant group and consecutive pregnant group over consecutive months of pregnancy, Figure S9: Twenty two selected features (mean + SD) of the Histogram Statistics and Gray Level Co-occurrence Matrix for the Hue component in the HSB color model compared between the non-pregnant group and consecutive pregnant group over consecutive months of pregnancy, Figure S10: Seventeen selected features (mean + SD) of the Histogram Statistics and Gray Level Co-occurrence Matrix for the Saturation component in the HSB color model compared between the non-pregnant group and consecutive pregnant group over consecutive months of pregnancy, Table S1: Features of Histogram Statistics (HS) for each examined color component in the non-pregnant group. When features did not differ significantly (p > 0.05) between consecutive months, the mean ±SD value was calculated as shown in the table, Table S2: Features of the symmetric Gray Level Co-occurrence Matrix (GLCM) for each examined color component in the non-pregnant group, Table S3: Features of the asymmetric Gray Level Co-occurrence Matrix (GLCH) for each examined color component in the non-pregnant group, Table S4: Comparison of Histogram Statistics (HS) features for each examined color component between the non-pregnant and pregnant groups, Table S5: Comparison of the symmetric Gray Level Co-occurrence Matrix (GLCM) features for each examined color component between the non-pregnant and pregnant groups, Table S6: Comparison of the asymmetric Gray Level Co-occurrence Matrix (GLCH) features for each examined color component between the non-pregnant and pregnant groups.

Author Contributions

Conceptualization, M.D. and M.M.; methodology, M.D., M.B. and M.M.; software, M.B.; validation, T.J. and G.S.; formal analysis, M.D., M.B., N.K. and T.J.; investigation, M.D., Ł.Z., T.J. and M.M.; resources, M.B. and M.M.; data curation, M.D.; writing---original draft preparation, M.D., M.B., N.K. and T.J.; writing---review and editing, Ł.Z., G.S. and M.M; visualization, M.D. and T.J.; supervision, G.S.; project administration, M.D. and M.M.; funding acquisition, M.B. and M.M. All authors have read and agreed to the published version of the manuscript.

Funding

The study was performed as part of the projects WI/WM-IIB/2/2021 and was partially financed with funds from the Polish Ministry of Science and Higher Education. The study was also partially financed by the National Science Centre in Poland, ‘Miniatura 3’ Project, No. 2019/03/X/NZ9/01759.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the II Local Ethical Committee on Animal Testing in Warsaw on behalf of the National Ethical Committees on Animal Testing (protocol code WAW2/007/2020 approved at 15 January 2020).

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

The authors are sincerely grateful to the stud in Dobrzyniewo, especially to Felicjan Pikulik, the President of the Management Board and Dobrochna Olesińska, the Chief Animal Technician. We are grateful for their permission to examine horses, their help on site, kindness and their collaboration during the research project.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Bucca, S.; Fogarty, U.; Collins, A.; Small, V. Assessment of feto-placental well-being in the mare from mid-gestation to term: Transrectal and transabdominal ultrasonographic features. Theriogenology 2005, 64, 542–557. [Google Scholar] [CrossRef] [PubMed]
  2. McCue, P.M. Ultrasound Examination of the Pregnant Mare. In Equine Reproductive Procedures; John Wiley & Sons, Inc.: Hoboken, NJ, USA, 2014. [Google Scholar]
  3. Kirkpatrick, J.F.; Lasley, B.L.; Shideler, S.E.; Roser, J.F.; Turner, J.W., Jr. Non-instrumented immunoassay field tests for pregnancy detection in free-roaming feral horses. J. Wildl. Manag. 1993, 57, 168–173. [Google Scholar] [CrossRef]
  4. Hilsberg, S.; Goltenboth, R.; Eulenberger, K. Infrared thermography of zoo animals, first experience in its use for pregnancy diagnosis. Erkrankungen der Zootiere 1997, 38, 187–190. [Google Scholar]
  5. Durrant, B.S.; Ravida, N.; Spady, T.; Cheng, A. New technologies for the study of carnivore reproduction. Theriogenology 2006, 66, 1729–1736. [Google Scholar] [CrossRef]
  6. Jones, M.; Denson, A.; Williams, E.; Graves, K.; Dos Santos, A.; Kouba, A.; Willard, S. Assessing pregnancy status using digital infrared thermal imaging in Holstein dairy heifers. J. Anim. Sci. 2005, 83, 40. [Google Scholar]
  7. Bowers, S.; Gandy, S.; Anderson, B.; Ryan, P.; Willard, S. Assessment of pregnancy in the late-gestation mare using digital infrared thermography. Theriogenology 2009, 72, 372–377. [Google Scholar] [CrossRef]
  8. Maśko, M.; Zdrojkowski, Ł.; Wierzbicka, M.; Domino, M. Association between the Area of the Highest Flank Temperature and Concentrations of Reproductive Hormones during Pregnancy in Polish Konik Horses—A Preliminary Study. Animals 2021, 11, 1517. [Google Scholar] [CrossRef] [PubMed]
  9. Maśko, M.; Witkowska-Piłaszewicz, O.; Jasiński, T.; Domino, M. Thermal features, ambient temperature and hair coat lengths: Limitations of infrared imaging in pregnant primitive breed mares within a year. Reprod. Domest. Anim. 2021, 56, 1315–1328. [Google Scholar] [CrossRef]
  10. Soroko, M.; Howell, K. Infrared thermography: Current applications in equine medicine. J. Equine Vet. Sci. 2018, 60, 90–96. [Google Scholar] [CrossRef]
  11. Simon, E.; Gaughan, E.; Epp, T.; Spire, M. Influence of exercise on thermographically determined surface temperatures of thoracic and pelvic limbs in horses. J. Am. Vet. Med. Assoc. 2006, 229, 1940–1944. [Google Scholar] [CrossRef]
  12. Kastberger, G.; Stachl, R. Infrared imaging technology and biological applications. Behav. Res. Methods Instrum. Comput. 2003, 35, 429–439. [Google Scholar] [CrossRef] [Green Version]
  13. Eddy, A.; Van Hoogmoed, L.; Snyder, J. The role of thermography in the management of equine lameness. Vet. J. 2001, 162, 172–181. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Kastelic, J.P.; Cook, R.B.; Coulter, G.H.; Wallins, G.L.; Entz, T. Environmental factors affecting measurement of bovine scrotal surface temperature with infrared thermography. Anim. Reprod. Sci. 1996, 41, 153–159. [Google Scholar] [CrossRef]
  15. Soroko, M.; Howell, K.; Dudek, K. The effect of ambient temperature on infrared thermographic images of joints in the distal forelimbs of healthy racehorses. J. Therm. Biol. 2017, 66, 63–67. [Google Scholar] [CrossRef]
  16. Schutz, K.E.; Rogers, A.R.; Cox, N.R.; Webster, J.R.; Tucker, C.B. Dairy cattle prefer shade over sprinklers: Effects on behavior and physiology. J. Dairy Sci. 2011, 94, 273–283. [Google Scholar] [CrossRef]
  17. Montanholi, Y.R.; Lim, M.; Macdonald, A.; Smith, B.A.; Goldhawk, C.; Schwartzkopf-Genswein, K.; Miller, S.P. Technological, environmental and biological factors: Referent variance values for infrared imaging of the bovine. J. Anim. Sci. Biotechnol. 2015, 6, 27. [Google Scholar] [CrossRef]
  18. Domino, M.; Romaszewski, M.; Jasiński, T.; Maśko, M. Comparison of the surface thermal patterns of horses and donkeys in infrared thermography images. Animals 2020, 10, 2201. [Google Scholar] [CrossRef]
  19. Jørgensen, G.H.M.; Mejdell, C.M.; Bøe, K.E. Effects of hair coat characteristics on radiant surface temperature in horses. J. Therm. Biol. 2020, 87, 102474. [Google Scholar] [CrossRef]
  20. Tunley, B.V.; Henson, F.M.D. Reliability and repeatability of thermographic examination and the normal thermographic image of the thoracolumbar region in the horse. Equine Vet. J. 2004, 36, 306–312. [Google Scholar] [CrossRef]
  21. Howell, K.; Dudek, K.; Soroko, M. Thermal camera performance and image analysis repeatability in equine thermography. Infrared Phys. Technol. 2020, 110, 103447. [Google Scholar] [CrossRef]
  22. Chrysafi, A.; Athanasopoulos, N.; Siakavellas, N. Damage detection on composite materials with active thermography and digital image processing. Int. J. Therm. Sci. 2017, 116, 242–253. [Google Scholar] [CrossRef]
  23. Deane, S.; Avdelidis, N.P.; Ibarra-Castanedo, C.; Zhang, H.; Nezhad, H.Y.; Williamson, A.A.; Tsourdos, A. Application of NDT thermographic imaging of aerospace structures. Infrared Phys. Technol. 2019, 97, 456–466. [Google Scholar] [CrossRef] [Green Version]
  24. Tejedor, B.; Barreira, E.; Almeida, R.M.; Casals, M. Automated data-processing technique: 2D map for identifying the distribution of the u-value in building elements by quantitative internal thermography. Autom. Constr. 2021, 122, 103478. [Google Scholar] [CrossRef]
  25. Mancilla, R.B.; Daul, C.; Martínez, J.G.; Hernández, A.V.; Wolf, D.; Salas, L.L. Detection of Sore-Risk Regions on the Foot Sole with Digital Image Processing and Passive Thermography in Diabetic Patients. In Proceedings of the 2020 17th International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE 2020), Mexico City, Mexico, 11–13 November 2020; pp. 1–6. [Google Scholar]
  26. Benjumea, E.; Morales, Y.; Torres, C.; Vilardy, J. Characterization of thermographic images of skin cancer lesions using digital image processing. J. Phys. 2019, 1221, 012076. [Google Scholar] [CrossRef]
  27. Silva, T.A.E.; Silva, L.F.; Muchaluat-Saade, D.C.; Conci, A. A computational method to assist the diagnosis of breast disease using dynamic thermography. Sensors 2020, 20, 3866. [Google Scholar] [CrossRef]
  28. Depeursinge, A.; Al-Kadi, O.S.; Mitchell, J.R. Biomedical Texture Analysis: Fundamentals, Tools and Challenges; Academic Press: Cambridge, MA, USA, 2017. [Google Scholar]
  29. Bębas, E.; Borowska, M.; Derlatka, M.; Oczeretko, E.; Hładuński, M.; Szumowski, P.; Mojsak, M. Machine-learning-based classification of the histological subtype of non-small-cell lung cancer using MRI texture analysis. Biomed. Signal. Process. Control. 2021, 66, 102446. [Google Scholar] [CrossRef]
  30. Sohail, A.S.M.; Bhattacharya, P.; Mudur, S.P.; Krishnamurthy, S. Local relative GLRLM-based texture feature extraction for classifying ultrasound medical images. In Proceedings of the 2011 24th Canadian Conference on Electrical and Computer Engineering (CCECE, IEEE), Niagara Falls, ON, Canada, 8–11 May 2011; pp. 001092–001095. [Google Scholar]
  31. Masko, M.; Borowska, M.; Domino, M.; Jasinski, T.; Zdrojkowski, L.; Gajewski, Z. A novel approach to thermographic images analysis of equine thoracolumbar region: The effect of effort and rider’s body weight on structural image complexity. BMC Vet. Res. 2021, 17, 99. [Google Scholar] [CrossRef]
  32. Haralick, R.M. Statistical and structural approaches to texture. Proc. IEEE 1979, 67, 786–804. [Google Scholar] [CrossRef]
  33. Materka, A.; Strzelecki, M. Texture Analysis Methods–A Review—COST B11 Report; Technical University of Lodz, Institute of Electronics: Brussels, Belgium, 1998. [Google Scholar]
  34. Szczypinski, P.M.; Klepaczko, A. Mazda—A framework for biomedical image texture analysis and data exploration. In Biomedical Texture Analysis; Elsevier: Amsterdam, The Netherlands, 2017; pp. 315–347. [Google Scholar]
  35. Szczypinski, P.M.; Klepaczko, A.; Kociołek, M. Qmazda—Software tools for image analysis and pattern recognition. In Proceedings of the 2017 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA), Poznan, Poland, 20–22 September 2017; pp. 217–221. [Google Scholar]
  36. Szczypiński, P.; Klepaczko, A.; Pazurek, M.; Daniel, P. Texture and color based image segmentation and pathology detection in capsule endoscopy videos. Comput. Methods Programs Biomed. 2014, 113, 396–411. [Google Scholar] [CrossRef]
  37. Umapathy, S.; Vasu, S.; Gupta, N. Computer aided diagnosis based hand thermal image analysis: A potential tool for the evaluation of rheumatoid arthritis. J. Med. Biol. Eng. 2018, 38, 666–677. [Google Scholar] [CrossRef]
  38. Wu, T.; Yang, Z. Animal tumor medical image analysis based on image processing techniques and embedded system. Microprocess. Microsyst. 2021, 81, 103671. [Google Scholar] [CrossRef]
  39. Ibraheem, N.A.; Hasan, M.M.; Khan, R.Z.; Mishra, P.K. Understanding color models: A review. ARPN J. Sci. Technol. 2012, 2, 265–275. [Google Scholar]
  40. Wen, C.-Y.; Chou, C.-M. Color image models and its applications to document examination. Forensic Sci. J. 2004, 3, 23–32. [Google Scholar]
  41. Plataniotis, K.N.; Venetsanopoulos, A.N. Color Image Processing and Applications; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
  42. Girejko, G.; Borowska, M.; Szarmach, J. Statistical analysis of radiographic textures illustrating healing process after the guided bone regeneration surgery. In Proceedings of the International Conference on Information Technologies in Biomedicine, Springer (ITIB’2018), Kamień Śląski, Poland, 18–20 June 2018; pp. 217–226. [Google Scholar]
  43. Zhang, H.; Hung, C.L.; Min, G.; Guo, J.P.; Liu, M.; Hu, X. GPU-accelerated GLRLM algorithm for feature extraction of MRI. Sci. Rep. 2019, 9, 10883. [Google Scholar] [CrossRef]
  44. Resmini, R.; Silva, L.; Araujo, A.S.; Medeiros, P.; Muchaluat-Saade, D.; Conci, A. Combining Genetic Algorithms and SVM for Breast Cancer Diagnosis Using Infrared Thermography. Sensors 2021, 21, 4802. [Google Scholar] [CrossRef]
  45. Lashkari, A.; Pak, F.; Firouzmand, M. Full intelligent cancer classification of thermal breast images to assist physician in clinical diagnostic applications. JMSS 2016, 6, 12. [Google Scholar] [CrossRef] [PubMed]
  46. Pramanik, S.; Bhattacharjee, D.; Nasipuri, M. Texture analysis of breast thermogram for differentiation of malignant and benign breast. In Proceedings of the 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Jaipur, India, 21–24 September 2016. [Google Scholar]
  47. Abdel-Nasser, M.; Moreno, A.; Puig, D. Breast cancer detection in thermal infrared images using representation learning and texture analysis methods. Electronics 2019, 8, 100. [Google Scholar] [CrossRef] [Green Version]
  48. Sánchez-Ruiz, D.; Olmos-Pineda, I.; Olvera-López, J.A. Automatic region of interest segmentation for breast thermogram image classification. Pattern Recognit. Lett. 2020, 135, 72–81. [Google Scholar] [CrossRef]
  49. Faust, O.; Acharya, U.R.; Ng, E.Y.K.; Hong, T.J.; Yu, W. Application of infrared thermography in computer aided diagnosis. Infrared Phys. Technol. 2014, 66, 160–175. [Google Scholar] [CrossRef]
  50. McCafferty, D.J. The value of infrared thermography for research on mammals: Previous applications and future directions. Mammal Rev. 2007, 37, 207–223. [Google Scholar] [CrossRef]
  51. Dohoo, I.; Martin, W.; Stryhn, H. Veterinary Epidemiologic Research, 2nd ed.; VER Inc.: Charlottetown, Canada, 2009. [Google Scholar]
  52. Turner, T. Diagnostic thermography. Vet. Clin. N. Am. Equine Pract. 2001, 17, 95–114. [Google Scholar] [CrossRef]
  53. Kim, S.M.; Cho, G.J. Evaluation of Heat Distribution for the Diagnosis of the Hoof with Abscess by Infrared Thermography in Horses. Open Agric. J. 2021, 15, 48–53. [Google Scholar] [CrossRef]
  54. Pavelski, M.; Basten, M.; Busato, E.; Dornbusch, P. Infrared thermography evaluation from the back region of healthy horses in controlled temperature room. Ciência Rural. 2015, 45, 1274–1279. [Google Scholar] [CrossRef] [Green Version]
  55. Witkowska-Piłaszewicz, O.; Maśko, M.; Domino, M.; Winnicka, A. Infrared thermography correlates with lactate concentration in blood during race training in horses. Animals 2020, 11, 2072. [Google Scholar] [CrossRef] [PubMed]
  56. Ciutacu, O.; Tanase, A.; Miclaus, I. Digital infrared thermography in assessing soft tissues injuries on sport equines. Bull. Univ. Agric. Sci. Vet. Med. Cluj Napoca Vet. Med. 2006, 63, 228–233. [Google Scholar]
  57. Roberto, J.V.B.; De Souza, B.B. Use of infrared thermography in veterinary medicine and animal production. J. Anim. Behav. Biometeorol. 2020, 2, 73–84. [Google Scholar] [CrossRef]
  58. Drobatz, K.J. Measures of accuracy and performance of diagnostic tests. J. Vet. Cardiol. 2009, 11, S33–S40. [Google Scholar] [CrossRef] [PubMed]
  59. Shikichi, M.; Iwata, K.; Ito, K.; Miyakoshi, D.; Murase, H.; Sato, F.; Nambo, Y. Abnormal pregnancies associated with deviation in progestin and estrogen profiles in late pregnant mares: A diagnostic aid. Theriogenology 2017, 98, 75–81. [Google Scholar] [CrossRef]
  60. Górecka, A.; Słoniewski, K.; Golonka, M.; Jaworski, Z.; Jezierski, T. Heritability of hair whorl position on the forehead in Konik horses. J. Anim. Breed. Genet. 2006, 123, 396–398. [Google Scholar] [CrossRef] [PubMed]
  61. Kirkpatrick, J.F.; Kasman, L.H.; Lasley, B.L.; Turner, J.W., Jr. Pregnancy determination in uncaptured feral horses. J. Wildl. Manag. 1988, 35, 305–308. [Google Scholar] [CrossRef]
  62. Borowska, M. Entropy-based algorithms in the analysis of biomedical signals. Stud. Log. Gramm. Rhetor. 2015, 43, 21–32. [Google Scholar] [CrossRef] [Green Version]
  63. Fowden, A.L.; Giussani, D.A.; Forhead, A.J. Physiological development of the equine fetus during late gestation. Equine Vet. J. 2020, 52, 165–173. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Thermal image processing for the analysis of image texture. Image acquisition, white light (A,A’) and thermal image (B,B’); segmentation of the region of interest (ROI) (B,B’); transformation to color models (CN’): RGB color model (CE’), YUV color model (FH’), YIQ color model (IK’), and HSB color model (LN’). Subfigures (AN) and (A’N’) represent non-pregnant and pregnant mares, respectively.
Figure 1. Thermal image processing for the analysis of image texture. Image acquisition, white light (A,A’) and thermal image (B,B’); segmentation of the region of interest (ROI) (B,B’); transformation to color models (CN’): RGB color model (CE’), YUV color model (FH’), YIQ color model (IK’), and HSB color model (LN’). Subfigures (AN) and (A’N’) represent non-pregnant and pregnant mares, respectively.
Sensors 22 00191 g001
Figure 2. Features of (A) Histogram Statistics and (B) Gray Level Co-occurrence Matrix for each examined color component found not to be significantly different between months in the non-pregnant group. R—Red component in the RGB color model; G—Green component in the RGB color model; B—Blue component in the RGB color model; Y—Brightness component in the YUV/YIQ/HSB color models; U—U-component in the YUV color model; V—V-component in the YUV color model; I—I-component in the YIQ color model; Q—Q-component in the YIQ color model; H—Hue component in the HSB color model; S—Saturation component in the HSB color model. Skewness—skewness coefficient; Perc01, Perc10, Perc50, Perc90, Perc99—percentiles; Domn01, Domn10—dominants; Maxm01, Maxm10—maximum of moments; AngScMom—angular second moment/energy; Correlat—correlation; SumOfSqs—sum of squares; InvDefMom—inverse different moment/homogeneity; SumAverg—summation mean; SumVarnc—summation variance; SumEntrp—summation entropy; DifVarnc—differential variance; DifEntrp—differential entropy.
Figure 2. Features of (A) Histogram Statistics and (B) Gray Level Co-occurrence Matrix for each examined color component found not to be significantly different between months in the non-pregnant group. R—Red component in the RGB color model; G—Green component in the RGB color model; B—Blue component in the RGB color model; Y—Brightness component in the YUV/YIQ/HSB color models; U—U-component in the YUV color model; V—V-component in the YUV color model; I—I-component in the YIQ color model; Q—Q-component in the YIQ color model; H—Hue component in the HSB color model; S—Saturation component in the HSB color model. Skewness—skewness coefficient; Perc01, Perc10, Perc50, Perc90, Perc99—percentiles; Domn01, Domn10—dominants; Maxm01, Maxm10—maximum of moments; AngScMom—angular second moment/energy; Correlat—correlation; SumOfSqs—sum of squares; InvDefMom—inverse different moment/homogeneity; SumAverg—summation mean; SumVarnc—summation variance; SumEntrp—summation entropy; DifVarnc—differential variance; DifEntrp—differential entropy.
Sensors 22 00191 g002
Figure 3. Features of (A) Histogram Statistics and (B) Gray Level Co-occurrence Matrix for each examined color component found to be significantly different between non-pregnant and pregnant groups from a given (numbered) month as compared to the end of pregnancy. R—Red component in the RGB color model; G—Green component in the RGB color model; B—Blue component in the RGB color model; Y—Brightness component in the YUV/YIQ/HSB color models; U—U-component in the YUV color model; V—V-component in the YUV color model; I—I-component in the YIQ color model; Q—Q-component in the YIQ color model; H—Hue component in the HSB color model; S—Saturation component in the HSB color model. Skewness—skewness coefficient; Perc01, Perc10, Perc50, Perc90, Perc99—percentiles; Domn01, Domn10—dominants; Maxm01, Maxm10—maximum of moments; AngScMom—angular second moment/energy; Correlat—correlation; SumOfSqs—sum of squares; InvDefMom—inverse different moment/homogeneity; SumAverg—summation mean; SumVarnc—summation variance; SumEntrp—summation entropy; DifVarnc—differential variance; DifEntrp—differential entropy.
Figure 3. Features of (A) Histogram Statistics and (B) Gray Level Co-occurrence Matrix for each examined color component found to be significantly different between non-pregnant and pregnant groups from a given (numbered) month as compared to the end of pregnancy. R—Red component in the RGB color model; G—Green component in the RGB color model; B—Blue component in the RGB color model; Y—Brightness component in the YUV/YIQ/HSB color models; U—U-component in the YUV color model; V—V-component in the YUV color model; I—I-component in the YIQ color model; Q—Q-component in the YIQ color model; H—Hue component in the HSB color model; S—Saturation component in the HSB color model. Skewness—skewness coefficient; Perc01, Perc10, Perc50, Perc90, Perc99—percentiles; Domn01, Domn10—dominants; Maxm01, Maxm10—maximum of moments; AngScMom—angular second moment/energy; Correlat—correlation; SumOfSqs—sum of squares; InvDefMom—inverse different moment/homogeneity; SumAverg—summation mean; SumVarnc—summation variance; SumEntrp—summation entropy; DifVarnc—differential variance; DifEntrp—differential entropy.
Sensors 22 00191 g003
Figure 4. Features of (A) Histogram Statistics and (B) Gray Level Co-occurrence Matrix for each examined color component found to be significantly increasing (In) or decreasing (De) with the progression of pregnancy. R—Red component in the RGB color model; G—Green component in the RGB color model; B—Blue component in the RGB color model; Y—Brightness component in the YUV/YIQ/HSB color models; U—U-component in the YUV color model; V—V-component in the YUV color model; I—I-component in the YIQ color model; Q—Q-component in the YIQ color model; H—Hue component in the HSB color model; S—Saturation component in the HSB color model. Skewness—skewness coefficient; Perc01, Perc10, Perc50, Perc90, Perc99—percentiles; Domn01, Domn10—dominants; Maxm01, Maxm10—maximum of moments; AngScMom—angular second moment/energy; Correlat—correlation; SumOfSqs—sum of squares; InvDefMom—inverse different moment/homogeneity; SumAverg—summation mean; SumVarnc—summation variance; SumEntrp—summation entropy; DifVarnc—differential variance; DifEntrp—differential entropy.
Figure 4. Features of (A) Histogram Statistics and (B) Gray Level Co-occurrence Matrix for each examined color component found to be significantly increasing (In) or decreasing (De) with the progression of pregnancy. R—Red component in the RGB color model; G—Green component in the RGB color model; B—Blue component in the RGB color model; Y—Brightness component in the YUV/YIQ/HSB color models; U—U-component in the YUV color model; V—V-component in the YUV color model; I—I-component in the YIQ color model; Q—Q-component in the YIQ color model; H—Hue component in the HSB color model; S—Saturation component in the HSB color model. Skewness—skewness coefficient; Perc01, Perc10, Perc50, Perc90, Perc99—percentiles; Domn01, Domn10—dominants; Maxm01, Maxm10—maximum of moments; AngScMom—angular second moment/energy; Correlat—correlation; SumOfSqs—sum of squares; InvDefMom—inverse different moment/homogeneity; SumAverg—summation mean; SumVarnc—summation variance; SumEntrp—summation entropy; DifVarnc—differential variance; DifEntrp—differential entropy.
Sensors 22 00191 g004
Table 1. Three thresholds (mean; mean ±SD (m ± SD); mean ±2SD (m ± 2SD)) used to estimate the sensitivity (Se), specificity (Sp), positive predictive value (PPV), and negative predictive value (NPV) of pregnancy detection using the selected features of Histogram Statistics and Gray Level Co-occurrence Matrix in the RGB color model.
Table 1. Three thresholds (mean; mean ±SD (m ± SD); mean ±2SD (m ± 2SD)) used to estimate the sensitivity (Se), specificity (Sp), positive predictive value (PPV), and negative predictive value (NPV) of pregnancy detection using the selected features of Histogram Statistics and Gray Level Co-occurrence Matrix in the RGB color model.
Month4th5th6th7th8th9th10th11th
ThresholdMeanm ± SDm ± 2SDMeanm ± SDm ± 2SDMeanm ± SDm ± 2SDMeanm ± SDm ± 2SDMeanm ± SDm ± 2SDMeanm ± SDm ± 2SDMeanm ± SDm ± 2SDMeanm ± SDm ± 2SD
SumEntrp of the Red component
Se0.140.641.000.140.641.000.430.711.000.500.711.000.500.861.000.500.861.000.790.931.000.860.931.00
Sp1.001.000.541.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.00
PPV1.001.000.701.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.00
NPV0.520.721.000.520.721.000.620.761.000.650.761.000.650.871.000.650.871.000.810.931.000.870.931.00
Entropy of the Red component
Se0.290.570.930.290.570.930.500.711.000.500.711.000.500.861.000.500.861.000.860.931.000.860.931.00
Sp1.001.000.311.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.00
PPV1.001.000.591.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.00
NPV0.570.680.800.570.680.930.650.761.000.650.761.000.650.871.000.650.871.000.870.931.000.870.931.00
DifEntrp of the Red component
Se0.360.710.930.360.710.930.430.790.930.500.790.930.500.861.000.500.861.000.711.001.000.791.001.00
Sp1.000.770.231.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.00
PPV1.000.770.571.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.00
NPV0.590.710.750.590.760.930.620.810.930.650.810.930.650.871.000.650.871.000.761.001.000.811.001.00
Perc10 of the Green component
Se0.640.790.860.640.790.860.640.860.860.640.860.860.790.931.000.790.931.001.001.001.001.001.001.00
Sp0.690.460.311.000.460.230.920.770.541.000.920.921.000.920.851.000.920.851.001.001.001.001.001.00
PPV0.690.610.571.000.610.550.900.800.671.000.920.921.000.930.881.000.930.881.001.001.001.001.001.00
NPV0.640.670.670.720.670.600.710.830.780.720.860.860.810.921.000.810.921.001.001.001.001.001.001.00
InvDfMom of the Blue component
Se0.500.791.000.500.791.000.430.710.930.430.710.930.570.861.000.570.861.000.500.931.000.500.931.00
Sp0.150.000.000.540.460.310.850.690.690.770.690.540.920.920.541.001.001.001.000.850.850.850.850.69
PPV0.390.460.520.540.610.610.750.710.760.670.710.680.890.920.701.001.001.001.000.870.880.780.870.78
NPV0.220.001.000.500.671.000.580.690.900.560.690.880.670.861.000.680.871.000.650.921.000.610.921.00
SumEntrp—summation entropy; DifEntrp—differential entropy; Perc10—percentile 10; InvDefMom—inverse different moment/homogeneity.
Table 2. Three thresholds (mean; mean ±SD (m ± SD); mean ± 2SD (m ± 2SD)) used to estimate the sensitivity (Se), specificity (Sp), positive predictive value (PPV), and negative predictive value (NPV) of pregnancy detection using the selected features of Histogram Statistics and Gray Level Co-occurrence Matrix in the YIQ color model.
Table 2. Three thresholds (mean; mean ±SD (m ± SD); mean ± 2SD (m ± 2SD)) used to estimate the sensitivity (Se), specificity (Sp), positive predictive value (PPV), and negative predictive value (NPV) of pregnancy detection using the selected features of Histogram Statistics and Gray Level Co-occurrence Matrix in the YIQ color model.
Month4th5th6th7th8th9th10th11th
ThresholdMeanm ± SDm ± 2SDMeanm ± SDm ± 2SDMeanm ± SDm ± 2SDMeanm ± SDm ± 2SDMeanm ± SDm ± 2SDMeanm ± SDm ± 2SDMeanm ± SDm ± 2SDMeanm ± SDm ± 2SD
SumEntrp of the I-component
Se0.430.571.000.500.571.000.500.711.000.570.711.000.430.861.000.430.861.000.790.931.000.860.931.00
Sp1.000.920.231.001.000.921.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.00
PPV1.000.890.571.001.000.931.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.00
NPV0.620.671.000.650.681.000.650.761.000.680.761.000.620.871.000.620.871.000.810.931.000.870.931.00
Entropy of the I-component
Se0.290.641.000.290.641.000.500.641.000.500.711.000.570.791.000.570.861.000.790.931.000.790.931.00
Sp1.000.850.231.001.000.851.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.00
PPV1.000.820.581.001.000.881.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.00
NPV0.570.691.000.570.721.000.650.721.000.650.761.000.680.811.000.680.871.000.810.931.000.810.931.00
Mean of the Q-component
Se0.430.930.930.430.930.930.500.930.930.500.930.930.501.001.000.501.001.000.711.001.000.711.001.00
Sp0.850.310.311.000.230.231.000.620.621.000.850.851.000.920.921.000.850.851.001.001.001.001.001.00
PPV0.750.590.591.000.570.571.000.720.721.000.870.871.000.930.931.000.880.881.001.001.001.001.001.00
NPV0.580.800.800.620.750.750.650.890.890.650.920.920.651.001.000.651.001.000.761.001.000.761.001.00
Variance of the Q-component
Se0.360.570.860.360.570.860.360.790.930.360.790.930.640.931.000.640.931.000.791.001.000.791.001.00
Sp0.460.230.150.540.230.080.850.540.000.920.850.380.920.850.150.850.850.231.000.920.541.001.000.69
PPV0.420.440.520.450.440.500.710.650.500.830.850.620.900.870.560.820.870.581.000.930.701.001.000.78
NPV0.400.330.500.440.330.330.550.701.000.570.790.830.710.921.000.690.921.000.811.001.000.811.001.00
Perc50 of the Q-component
Se0.290.641.000.290.641.000.430.791.000.430.791.000.500.861.000.500.861.000.710.861.000.710.861.00
Sp0.770.690.001.001.000.081.001.000.231.001.000.381.001.000.541.001.000.541.001.000.771.001.000.92
PPV0.570.690.521.001.000.541.001.000.581.001.000.641.001.000.701.001.000.701.001.000.821.001.000.93
NPV0.500.641.000.570.721.000.620.811.000.620.811.000.650.871.000.650.871.000.760.871.000.760.871.00
SumAverg of the Q-component
Se0.43 0.640.930.430.640.930.430.710.930.500.790.930.500.861.000.500.861.000.710.861.000.710.861.00
Sp0.850.690.311.001.000.231.001.000.621.001.000.851.001.000.921.001.000.851.001.001.001.001.001.00
PPV0.750.690.591.001.000.571.001.000.721.001.000.871.001.000.931.001.000.881.001.001.001.001.001.00
NPV0.580.640.800.620.720.750.620.760.890.650.810.920.650.871.000.650.871.000.760.871.000.760.871.00
SumVarnc of the Q-component
Se0.360.570.920.360.570.920.790.790.920.790.790.920.640.860.920.640.931.000.361.001.000.361.001.00
Sp0.460.230.150.540.230.080.850.540.000.920.920.380.920.850.150.920.850.231.000.920.541.001.000.69
PPV0.420.440.520.450.440.500.850.650.480.920.920.600.900.860.520.900.870.571.000.930.681.001.000.76
NPV0.400.330.670.440.330.500.790.700.000.800.800.830.710.850.670.710.921.000.591.001.000.591.001.00
SumEntrp—summation entropy; DifEntrp—differential entropy; Perc50—percentile 50; SumAverg—summation mean; SumVarnc—summation variance.
Table 3. Three thresholds (mean; mean ± SD (m ± SD); mean ±2SD (m ± 2SD)) used to estimate the sensitivity (Se), specificity (Sp), positive predictive value (PPV), and negative predictive value (NPV) of advanced pregnancy detection using the selected features of Histogram Statistics and Gray Level Co-occurrence Matrix in the HSB color model.
Table 3. Three thresholds (mean; mean ± SD (m ± SD); mean ±2SD (m ± 2SD)) used to estimate the sensitivity (Se), specificity (Sp), positive predictive value (PPV), and negative predictive value (NPV) of advanced pregnancy detection using the selected features of Histogram Statistics and Gray Level Co-occurrence Matrix in the HSB color model.
Month4th5th6th7th8th9th10th11th
ThresholdMeanm +SDm +2SDMeanm +SDm +2SDMeanm +SDm +2SDMeanm +SDm +2SDMeanm +SDm +2SDMeanm +SDm +2SDMeanm +SDm +2SDMeanm +SDm +2SD
Variance of the Saturation component
Se0.710.860.930.710.860.930.570.860.930.570.860.930.710.930.930.710.930.930.861.001.000.861.001.00
Sp0.380.380.310.850.770.621.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.00
PPV0.560.600.590.830.800.721.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.001.00
NPV0.560.710.800.730.830.890.680.870.930.680.870.930.760.930.930.760.930.930.871.001.000.871.001.00
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Domino, M.; Borowska, M.; Kozłowska, N.; Zdrojkowski, Ł.; Jasiński, T.; Smyth, G.; Maśko, M. Advances in Thermal Image Analysis for the Detection of Pregnancy in Horses Using Infrared Thermography. Sensors 2022, 22, 191. https://doi.org/10.3390/s22010191

AMA Style

Domino M, Borowska M, Kozłowska N, Zdrojkowski Ł, Jasiński T, Smyth G, Maśko M. Advances in Thermal Image Analysis for the Detection of Pregnancy in Horses Using Infrared Thermography. Sensors. 2022; 22(1):191. https://doi.org/10.3390/s22010191

Chicago/Turabian Style

Domino, Małgorzata, Marta Borowska, Natalia Kozłowska, Łukasz Zdrojkowski, Tomasz Jasiński, Graham Smyth, and Małgorzata Maśko. 2022. "Advances in Thermal Image Analysis for the Detection of Pregnancy in Horses Using Infrared Thermography" Sensors 22, no. 1: 191. https://doi.org/10.3390/s22010191

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop