An iterative possibilistic knowledge diffusion approach for blind medical image segmentation
Graphical abstract
Introduction
In the field of image analysis and interpretation, various kinds of information imperfections are present in all image-processing phases (i.e. preprocessing, feature extraction, image analysis and scene interpretation). Epistemic, due to system constructs, and random or aleatory, inherent to physical observation processes, are generally the terms used to categorize information-based uncertainties. A recent pertinent discussion about uncertainty and its typology (ambiguity, imprecision, vagueness, incompleteness, …, etc.) is presented in chapter 3 of [1]. That discussion is important since a better understanding of information imperfections at each level of a system allows better modelling and consequently better system design to cope with the consequences of those imperfections on systems that support image exploitation and interpretation.
This paper considers a new approach for image segmentation based on possibilistic concepts. The aim of a segmentation process is to distinguish homogeneous regions within an image that belong to different objects. For instance, the segmentation process can be based on finding the maximum homogeneity in grey levels within the identified regions, i.e. the basic information delivered at the output of an imaging sensor. Regions resulting from a segmentation process have to display a uniform behaviour with regard to a considered set of features. That is challenging. First, when can we consider that a behaviour is uniform with respect to a feature or a set of features? Second, given that objects have uniform boundaries, then we are faced with the boundary location problem. In fact, for marking the region boundaries and for locating uniform ones, the uniformity degree of neighbouring pixels shall be considered.
Moreover, several challenges related to image segmentation require attention. One important challenge is related to the selection of the suitable approach to isolate different objects from their background. Another important challenge involves measuring the performance of a segmentation approach and assessing its impact on the global image and scene interpretation.
Image segmentation issues have been approached from a wide variety of perspectives, and different techniques have been developed are to perform that task. These techniques are generally grouped into four major categories: a) clustering-based and histogram thresholding approaches; b) edge-based approaches; c) region-growing based approaches, and finally; d) hybrid approaches combining both region-growing and edge-based techniques. The four image segmentation approaches (a,b,c,d) implement different “understandings” of the human-based image segmentation process. Nevertheless, in all cases, the major encountered difficulty is related to the fact that all image segmentation approaches mainly depend on the “nature” of the spatial knowledge to be used and its spatial diffusion as well as the set of similarity criteria which are strongly based on the physical parameters measured by the imaging sensor in action: consequently, other sources of knowledge are not being integrated.
The focus of the present paper is to offer a region-growing image segmentation approach (category c above) based upon the use of possibility theory concepts that imitates the reasoning scheme of a human when analysing an observed image in terms of its constituting homogeneous regions. Based on the observed features of grey level intensity, colour, texture, patterns, shapes, etc., a human understand image by first, segmenting the whole image into regions/objects. This initial segmentation task is realized by “visually” locating sub-regions, called “reference seed”. Reference seeds are homogenous small regions having semantic visual significance or satisfying some simple similarity criteria: feature-based homogeneity, membership to a known structure or a thematic class. Then, a second “iterative” step follows. It consists on spreading the semantic homogeneous seeds into their spatial context using a set of similarity criteria. Additional sources of knowledge are then used to enlarge the initial homogenous regions. This process leads to a global segmented image over which other interpretation tasks may be conducted.
In this paper, an iterative region growing image segmentation approach based on the use of possibility theory is proposed and evaluated. The main reason behind the use of possibility theory is that this theory allows adequate semantic knowledge modeling without huge constraints. Possibilistic concepts offer simple means for modelling human reasoning related to spatial similarity and to contextual knowledge diffusion. The proposed possibilistic region growing image segmentation approach consists on the possibilistic modeling of different semantic classes present in the observed scene. The observed image is then projected into the classes’ possibilistic representation space forming, thus, possibilistic class maps. Finally, the region-growing process is conducted at the possibility map level.
The paper is organized as follows. Section 2 is devoted to review basic concepts of knowledge diffusion for region- based approaches in image segmentation. A brief introduction to possibility theory is presented in Section 3. The proposed possibilistic knowledge approach is then detailed in Section 4. Section 5 presents empirical results to assess the impact of possibilistic spatial knowledge diffusion allowing the evaluation of the proposed approach. Section 6 is the conclusion.
Section snippets
Related work for knowledge diffusion and region based approaches in image segmentation
An image represents a partial view of an observed scene obtained by interpreting physical measures from sensors. Region-growing based image segmentation methods aim at the identification of the “constituting elements” contained within the image by grouping image pixels into homogeneous regions formed by linked pixels. Each region is assumed to meet an homogeneity criterion according to a common property: its constituting pixels belong to a same semantic entity or a same thematic class. The
A very brief introduction to possibility theory
A very brief introduction to possibility theory is given here since a sufficient description, pertinent to the discussion here, has already been presented in [2], [3], [7]. If the available knowledge is ambiguous and encoded by a membership function, i.e. a fuzzy set, defined over the decisions set,, the possibility theory transforms the membership function into a possibility distribution π. Then the realization of each event A is bounded by a possibilistic interval defined by a
The proposed IPKD approach
This paper proposes an image segmentation approach that exploits to a larger extent the spatial information contained within an image. Section V presents empirical results in order to qualify and quantify that extent. The proposed approach, inspired from region-growing methods, consists, first, in representing available diverse knowledge sources in the possibility theory formalism. The second step is to apply a possibilistic knowledge diffusion process based on contextual information in a
Empirical results
This section presents a quantitative and qualitative evaluation of the possibilistic knowledge diffusion approach using two sources of data: a synthetic image and a set of mammographic medical images from MIAS data base “Mammographic Image Analysis Society” [51].
The synthetic test image (illustrated in Fig. 3) is composed of a basic miniature image containing four circular disks (class C1) and the image background (class C2). The use of several sizes constitutes a first indicator allowing to
Conclusions
In this paper, an iterative possibilistic knowledge diffusion (IPKD) approach for image segmentation has been proposed. A priori expert knowledge used by the proposed approach is limited to the set of thematic classes assumed to be present in the analysed image as well as a seed representative zone for each considered class. The Nagao-based possibilistic knowledge diffusion is retained as the method producing the best segmentation results. In addition, this method has the important property of
Acknowledgments
Authors acknowledge the technical assistance of Dr. Héla Fourati Mseddi, working in Medical Imagery Service of CHU Hédi Chaker Sfax, (Tunisia), for providing ground truth of mammographic images used in the present work.
Imene Khanfir Kallel, Ph.D., Electrical engineering and Ph.D. (ENIS-Tunisa, 2002 and 2010). Actually associate-professor in ISBS, member of CEM-Lab (Sfax-Tunisia) and associate-researcher in iTi-Dept (IMT-Atlantique, Bretagne-France). She's editorial board member of i-manager's (JDP) since 2015. She works on knowledge processing, analysis and interpretation and has published more than 30 papers in reputed journals and conferences.
References (59)
- et al.
A method of spatial unmixing based on possibilistic similarity in soft pattern classification
Fuzzy Inf. Eng.
(2016) - et al.
Seeded region growing: an extensive and comparative study
Pattern Recognit. Lett.
(2005) - et al.
MasmoudiB. Solaiman Feature selection in possibilistic modeling
Pattern Recognit.
(2015) - et al.
A fast iterative scheme for multilevel thresholding methods
Signal Process.
(1997) - et al.
Simultaneous segmentation and bias field estimation using local fitted images
Pattern Recognit.
(2018) - et al.
Fuzzy Markovian segmentation in application of magnetic resonance images
Comput. Vision Image Understand.
(2002) - et al.
A framework of fuzzy information fusion for the segmentation of brain tumor tissues on MR images
Image Vis. Comput.
(2007) - et al.
Automatic image segmentation system through iterative edge–region co-operation
Image Vision Comput.
(2002) - et al.
Edge preserving smoothing
Comput. Graph. Image Process.
(1979) Fuzzy Sets as the Basis for a Theory of Possibility
Fuzzy Sets Syst.
(1978)
Efficient image labeling based on Markov random field and error backpropagation network
Pattern Recognit.
An approach for modelling interdependent infrastructures in the context of vulnerability analysis
Reliability Engineering & System Safety
Approaches for automated detection and classification of masses in mammograms
Pattern Recognit.
Fusion of Information and Analytics for Big Data and IoT
Iterative refinement of possibility distributions by learning for pixel-based classification
IEEE Trans. Image Process.
Breast mass segmentation in mammographic images by an effective region growing algorithm
Adv. Concepts Intel. Vis. Syst.
Semi-supervised classification method for dynamic applications
Fuzzy Sets Syst.
Digital Image Processing
Determination of breast cancer area from mammography images using thresholding method
Int. J. Innov. Res. Adv. Eng.
Statistical segmentation of regions of interest on a mammographic image
EURASIP J. Adv. Signal Process.
An adaptive framework for spectral-spatial classification based on a combination of pixel-based and object-based scenarios
Earth Sci. Inform.
Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images
IEEE Trans. Pattern Anal. Mach. Intell.
Caractérisation de textures à l'aide d'un codage directionnel local
Afrique Science: Revue Internationale des Sciences et Technologie
Classification of urban areas from GeoEye-1 imagery through texture features based on Histograms of Equivalent Patterns
Eur. J. Remote Sens.
Melanoma-Pattern Extraction using Histogram-thresholding Approach
Off. J. Egypt. Soc. Med. Educ. Sci. Med. J. Sci. Med J.(ESCME)
Image segmentation by histogram thresholding using fuzzy sets
IEEE Trans. Image Process.
Active contours without edges
IEEE Trans. Image Process.
Segmentation d'images par contours actifs: application à la détection du ventricule gauche dans les images de scintigraphie cardiaque
SETIT
Active contour model based on local and global Gaussian fitting energy for medical image segmentation
Optik - Int. J. Light Electron Opt.
Cited by (19)
2D Image head pose estimation via latent space regression under occlusion settings
2023, Pattern RecognitionCitation Excerpt :In this section, we introduce a procedure capable of generating synthetic occlusions in images, and describe the datasets used for the head pose estimation. The generation of synthetic data for training in deep learning frameworks has become ever more common and has been proven to be essential in the enlargement of training sets and in improving the generalization and accuracy of learning models e.g., medical segmentation [41], autonomous driving [42] and pose estimation [20,43]. We use existing 2D image head pose datasets that contain thousands of images and respective ground truth pose annotations.
Fighting against terrorism: A real-time CCTV autonomous weapons detection based on improved YOLO v4
2022, Digital Signal Processing: A Review JournalCitation Excerpt :Expanding a model's training data with synthetic datasets is a reliable data augmentation strategy that can effectively enhance model performance. In the field of computer vision, such as license plate recognition [22] and medical image segmentation and detection [23], the scheme has been widely employed for deep network training. Hattori H et al. [24] proposed that synthetic data can compensate for the absence of real training data.
An intelligent quality-based approach to fusing multi-source possibilistic information
2020, Information FusionCitation Excerpt :The recognition rates, illustrated in Table 16 for the impoverished datasets, show the advantage of the possibility theory in data modeling compared to the probability theory and the SVM classifier in poor data environments (information incompleteness). Same kind of advantages have been confirmed from results that have been obtained for different kind of applications namely in pattern recognition and image segmentation in the processing of poor-quality images [32,34-37]. It is worth mentioning that the size of databases in Table 16 does not exceed 800 samples.
A deep Coarse-to-Fine network for head pose estimation from synthetic data
2019, Pattern RecognitionCitation Excerpt :In the past decades, researchers have made impressive progress on 3D object modeling and synthesis. Synthesized data has been applied for deep network training in many computer graphics and vision tasks, e.g., autonomous driving [27], license plate recognition [28], 3D reconstruction [29], scene understanding [30], human detection and pose estimation [31], and medical image segmentation [32] and detection [33], which have proved that synthetic data can help to achieve good performance. In the follow-up phase of the study, we find that the head pose datasets (e.g,.
A local mean and variance active contour model for biomedical image segmentation
2019, Journal of Computational ScienceCitation Excerpt :Lei et al presented a local hybrid image fitting (LHIF) model by constructing a local hybrid image fitting energy based on two different local fitted images [47]. Some similar methods were recently proposed in [48,49] which can deal with intensity inhomogeneity as the LBF model and the LHIF model. However, to some extent these models are still sensitive to initial contour, which limits their practical applications.
Automated pulmonary nodule detection in CT images using deep convolutional neural networks
2019, Pattern RecognitionCitation Excerpt :It is also a challenging task because there are many pulmonary nodules with various sizes, shapes, locations and types which are shown in Fig. 1. Recently, the revolution of deep learning has attracted many researchers to pay their attention to the applications of deep learning in CAD with the extraordinary learning power [6–9]. Current automated pulmonary nodule detection systems mainly consist of two stages: (1) nodule candidate detection; (2) false positive reduction [10–15].
Imene Khanfir Kallel, Ph.D., Electrical engineering and Ph.D. (ENIS-Tunisa, 2002 and 2010). Actually associate-professor in ISBS, member of CEM-Lab (Sfax-Tunisia) and associate-researcher in iTi-Dept (IMT-Atlantique, Bretagne-France). She's editorial board member of i-manager's (JDP) since 2015. She works on knowledge processing, analysis and interpretation and has published more than 30 papers in reputed journals and conferences.
Basel Solaiman, Ph.D., Telecommunication engineering (ENST, 83), Ph.D. and HDR (Université de Rennes-I, 88 and 97). Actually, he is professor and head of iTi-department in IMT Atlantique, Bretagne. He has published several academic books, book chapters and over 200 journal papers. Application domains of his research activities: medical, remote sensing, underwater imaging and knowledge mining.
Éloi Bossé, Ph.D., (M’11), received the B.A.Sc. (79), M.Sc. (81) and Ph.D (90) degrees from Université Laval, QC, in Electrical Engineering. He worked on signal processing, high resolution spectral analysis, information fusion and decision support at Communications Research Centre, Defence Research Establishments at Ottawa and Quebec. He has published over 200 papers in journals, book chapters, conference proceedings and technical reports. Dr. Bossé is actually a researcher and adjunct professor at McMaster University, Hamilton Canada as well as an associate researcher at IMT-Atlantique, Brest, France.