Abstract
Adaptive self-learning is a promising technique in medical image analysis that enables deep learning models to adapt to changes in image distribution over time. As medical image data can vary due to factors like imaging equipment and patient demographics, adaptive self-learning becomes valuable for maintaining the accuracy and robustness of deep learning frameworks. Initially trained on a large dataset, the framework can adapt to new modalities using transfer learning, adaptive learning, and incremental learning, incorporating both manual and auto (CNN-based) features. Adaptive self-learning offers various benefits, including improved model accuracy and efficiency, reducing the need for manual retraining. However, challenges such as the risk of overfitting, acquiring relevant manual features, and careful monitoring need to be addressed. Combining manual features and pretrained CNN models can enhance performance in medical image analysis tasks such as tumor classification, lesion detection, and cancer segmentation. Manual features capture specific image characteristics, while pretrained CNN models automatically learn abstract features from extensive datasets. Combining these approaches provides additional information that neither approach alone can capture. In this study, we present a unique framework for adaptive self-learning in medical image analysis and classification. The proposed framework analyzes image modality, applies preprocessing techniques, and acquires both manual and CNN-based pertinent features. However, careful tuning and experimentation are essential to determine the optimal combination of manual features with the appropriate CNN model architecture. The recommended adaptive self-learning framework achieves a high averaged F1-score \(97.35\pm 0.39\) and precision of \(97.19 \pm 0.51\), as well as its fantabulous abstraction and accuracy of \(97.81 \pm 0.35\), implying that it might be used to build a pathologist’s aid tool.
Similar content being viewed by others
Data availability
The data that support the findings of this study are available from the corresponding author upon reasonable request.
References
Karimi D, Dou H, Warfield SK, Gholipour A (2020) Deep learning with noisy labels: exploring techniques and remedies in medical image analysis. Med Image Anal 65:101759
Tajbakhsh N, Jeyaseelan L, Li Q, Chiang JN, Wu Z, Ding X (2020) Embracing imperfect datasets: a review of deep learning solutions for medical image segmentation. Med Image Anal 63:101693
Liu L, Zhang Z, Li S, Ma K, Zheng Y (2021) S-cuda: self-cleansing unsupervised domain adaptation for medical image segmentation. Med Image Anal 74:102214
Fu S, Lu Y, Wang Y, Zhou Y, Shen W, Fishman W, Yuille A (2020) Domain adaptive relational reasoning for 3d multi-organ segmentation. In: Medical image computing and computer assisted intervention—MICCAI 2020: 23rd international conference, Lima, Peru, October 4–8, 2020, proceedings, Part I, vol 23. Springer, pp 656–666
Zemmal N, Azizi N, Dey N, Sellami M (2016) Adaptive semi supervised support vector machine semi supervised learning with features cooperation for breast cancer classification. J Med Imaging Health Inform 6(1):53–62
Ali O, Abdelbaki W, Shrestha A, Elbasi E, Alryalat MAA, Dwivedi YK (2023) A systematic literature review of artificial intelligence in the healthcare sector: benefits, challenges, methodologies, and functionalities. J Innov Knowl 8(1):100333
Zhang Y, Shen L (2023) Automatic learning rate adaption for memristive deep learning systems. IEEE Trans Neural Netw Learn Syst
Srinivasu PN, Krishna TB, Ahmed S, Almusallam N, Alarfaj FK, Allheeib N et al (2023) Variational autoencoders-basedself-learning model for tumor identification and impact analysis from 2-d mri images. J Healthc Eng 8:2023
Nguyen P, Rathod A, Chapman D, Prathapan S, Menon S, Morris M, Yesha Y (2023) Active semi-supervised learning via bayesian experimental design for lung cancer classification using low dose computed tomography scans. Appl Sci 13(6):3752
Khozeimeh F, Alizadehsani R, Shirani M, Tartibi M, Shoeibi A, Alinejad-Rokny H, Harlapur C, Sultanzadeh SJ, Khosravi A, Nahavandi S et al (2023) Alec: Active learning with ensemble of classifiers for clinical diagnosis of coronary artery disease. Comput Biol Med 8:106841
Shenaj D, Fanì B, Toldo M, Caldarola D, Tavera A, Michieli U, Ciccone M, Zanuttigh P, Caputo B (2023) Learning across domains and devices: style-driven source-free domain adaptation in clustered federated learning. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp 444–454
Saravanan S, Surendheran K, Krishnakumar K (2023) Data analytics on medical images with deep learning approach. In: Biomedical signal and image processing with artificial intelligence. Springer, pp 153–166
Anzai Y, Chang C-P, Rowe K, Snyder J, Deshmukh V, Newman M, Fraser A, Smith K, Date A, Galvao C et al (2023) Surveillance imaging with pet/ct and ct and/or mri for head and neck cancer and mortality: a population-based study. Radiology 8:212915
Rajalingam B, Priya R, Bhavani R, Santhoshkumar R (2023) Image fusion techniques for different multimodality medical images based on various conventional and hybrid algorithms for disease analysis. In: Research anthology on improving medical imaging techniques for analysis and intervention. IGI Global, pp 268–299
Xu W, Fu YL, Xu H, Wong KKL (2023) Medical image fusion using enhanced cross-visual cortex model based on artificial selection and impulse-coupled neural network. Comput Methods Programs Biomed 229:107304
Chen L, Wang X, Zhu Y, Nie R (2023) Multi-level difference information replenishment for medical image fusion. Appl Intell 53(4):4579–4591
Wang L, Zhang L, Shu X, Yi Z (2023) Intra-class consistency and inter-class discrimination feature learning for automatic skin lesion classification. Med Image Anal 16:102746
Zhan X, Liu J, Long H, Zhu J, Tang H, Gou F, Jia W (2023) An intelligent auxiliary framework for bone malignant tumor lesion segmentation in medical image analysis. Diagnostics 13(2):223
Jiang H, Diao Z, Shi T, Zhou Y, Wang F, Hu W, Yao YD (2023) A review of deep learning-based multiple-lesion recognition from medical images: classification, detection and segmentation. Comput Biol Med 16:106726
Singh M, Singh M, De D, Handa S, Mahajan R, Chatterjee D (2023) toward diagnosis of autoimmune blistering skin diseases using deep neural network. Arch Comput Methods Eng 8:1–29
Wenqian ZHAO, Chong YY, Chien WT (2023) Effectiveness of cognitive-based interventions for improving body image of breast cancer patients: a systematic review and meta-analysis. Asia-Pacific J Oncol Nurs 8(100213):2023
Afriyie Y, Weyori BA, Opoku AA (2023) A scaling up approach: a research agenda for medical imaging analysis with applications in deep learning. J Exp Theor Artif Intell 8:1–55
Baji FS, Abdullah SB, Abdulsattar FS (2023) K-mean clustering and local binary pattern techniques for automatic brain tumor detection. Bull Electric Eng Inf 12(3):1586–1594
Wu J, Wei G, Wang Y, Cai J (2023) Multifeature fusion classification method for adaptive endoscopic ultrasonography tumor image. Ultrasound Med Biol 49(4):937–945
Virmani J, Agarwal R (2023) Lbp-based cad system designs for breast tumor characterization. In: Biomedical signal and image processing with artificial intelligence. Springer, pp 231–257
Cheng J, Huang W, Shuangliang Cao R, Yang WY, Yun Z, Wang Z, Feng Q (2015) Enhanced performance of brain tumor classification via tumor region augmentation and partition. PLoS ONE 10(10):e0140381
Sharif M, Amin J, Raza M, Anjum MA, Afzal H, Shad SA (2020a) An integrated design of particle swarm optimization (PSO) with fusion of features for detection of brain tumor. Pattern Recognit Lett 129:150–157
Sharif M, Amin J, Raza M, Anjum MA, Afzal H, Shad SA (2020b) Brain tumor detection based on extreme learning. Neural Comput Appl 32:15975–15987
Ibrahim KSMH, Huang YF, Ahmed AN, Koo CH, El-Shafie A (2022) A review of the hybrid artificial intelligence and optimization modeling of hydrological streamflow forecasting. Alex Eng J 61(1):279–303
Kagolanu VSA, Thimmareddy L, Kanala KL, Sirisha B (2022) Multi-class medical image classification based on feature ensembling using deepnets. In: 2022 9th International conference on computing for sustainable global development (INDIACom). IEEE, pp 540–544
Jiang P, Liu J, Wang L, Ynag Z, Dong H, Feng J (2022) Deeply supervised layer selective attention network: toward label-efficient learning for medical image classification. arXiv preprint arXiv:2209.13844
Al-Masni MA, Al-Antari MA, Park JM, Gi G, Kim TY, Rivera P, Valarezo E, Han SM, Kim TS (2017) Detection and classification of the breast abnormalities in digital mammograms via regional convolutional neural network. In: 2017 39th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 1230–1233
Akselrod-Ballin A, Karlinsky L, Alpert S, Hasoul S, Ben-Ari R, Barkan E (2016) A region based convolutional network for tumor detection and classification in breast mammography. In: Deep learning and data labeling for medical applications: first international workshop, LABELS 2016, and second international workshop, DLMIA 2016, held in conjunction with MICCAI 2016, Athens, Greece, October 21, 2016, proceedings, vol 2. Springer, pp 197–205
Marino MA, Pinker K, Leithner D, Sung J, Avendano D, Morris EA, Jochelson M (2020) Contrast-enhanced mammography and radiomics analysis for noninvasive breast cancer characterization: initial results. Mol Imaging Biol 22:780–787
La Forgia D, Fanizzi A, Campobasso F, Bellotti R, Didonna V, Lorusso V, Moschetta M, Massafra R, Tamborra P, Tangaro S et al (2020) Radiomic analysis in contrast-enhanced spectral mammography for predicting breast cancer histological outcome. Diagnostics 10(9):708
Hassanien MA, Singh VK, Puig D, Abdel-Nasser M (2022) Predicting breast tumor malignancy using deep convnext radiomics and quality-based score pooling in ultrasound sequences. Diagnostics 12(5):1053
Mansoori B, Erhard KK, Sunshine JL (2012) Picture archiving and communication system (PACS) implementation, integration & benefits in an integrated health system. Acad Radiol 19(2):229–235
Gutman D, Codella NCF, Celebi E, Helba B, Marchetti M, Mishra N, Halpern A (2016) Skin lesion analysis toward melanoma detection: a challenge at the international symposium on biomedical imaging (isbi) 2016, hosted by the international skin imaging collaboration (ISIC). arXiv preprint arXiv:1605.01397
Spanhol FA, Oliveira LS, Petitjean C, Heutte L (2015) A dataset for breast cancer histopathological image classification. IEEE Trans Biomed Eng 63(7):1455–1462
Iqbal S, Qureshi AN, Mustafa G (2022a) Hybridization of CNN with LBP for classification of melanoma images. Comput Materials Continua 71(3):4915–4939
Iqbal S, Qureshi AN. Deep-hist: breast cancer diagnosis through histopathological images using convolution neural network. J Intell Fuzzy Syst 1–18 (Preprint)
Iqbal S, Qureshi AN (2022) A heteromorphous deep CNN framework for medical image segmentation using local binary pattern. IEEE Access
Kumar I, Rawat J, Bhadauria HS (2014) A conventional study of edge detection technique in digital image processing. Int J Comput Sci Mob Comput 3(4):328–334
Ritter F, Boskamp T, Homeyer A, Laue H, Schwier M, Link F, Peitgen HO (2011) Medical image analysis. IEEE Pulse 2(6):60–70
Kim Y-T (1997) Contrast enhancement using brightness preserving bi-histogram equalization. IEEE Trans Consum Electron 43(1):1–8
Zuiderveld K (1994) Contrast limited adaptive histogram equalization. Graph Gems 8:474–485
Agarwal M, Mahajan R (2018) Medical image contrast enhancement using range limited weighted histogram equalization. Proc Comput Sci 125:149–156
Macenko M, Niethammer M, Marron JS, Borland D, Woosley JT, Guan X, Schmitt C, Thomas NE (2009) A method for normalizing histology slides for quantitative analysis. In: 2009 IEEE international symposium on biomedical imaging: from nano to macro. IEEE, pp 1107–1110
Benoit-Cattin H (2006) Texture analysis for magnetic resonance imaging. Text Anal Magn Reson
Zwanenburg A, Vallières M, Abdalah MA, Aerts HJWL, Andrearczyk V, Apte A, Ashrafinia S, Bakas S, Beukinga RJ, Boellaard R et al (2020) The image biomarker standardization initiative: standardized quantitative radiomics for high-throughput image-based phenotyping. Radiology 295(2):328
Haralick RM, Shanmugam K, Dinstein IH (1973) Textural features for image classification. IEEE Trans Syst Man Cybern 6:610–621
Galloway MM (1975) Texture analysis using gray level run lengths. Comput Graph Image Process 4(2):172–179
Thibault G, Angulo J, Meyer F (2013) Advanced statistical matrices for texture characterization: application to cell classification. IEEE Trans Biomed Eng 61(3):630–637
Iqbal S, Qureshi AN, Ullah A, Li J, Mahmood T (2022) Improving the robustness and quality of biomedical CNN models through adaptive hyperparameter tuning. Appl Sci 12(22):11870
Mold RF (1989) Introduction to medical statistics, 2nd edn (Bristol: Hilger)
Altman DG, Bland JM (1994) Diagnostic tests 1: sensitivity and specificity. Br Med J 308(6943):1552
Lalkhen AG, McCluskey A (2008) Clinical tests: sensitivity and specificity. Contin Educ Anaesth Crit Care Pain 8(6):221–223
D’Agostino RB, Sullivan LM, Massaro J (2008) Wiley encyclopedia of clinical trials. Wiley, Hoboken
Gore SM, Jones IG, Rytter EC (1977) Misuse of statistical methods: critical assessment of articles in BMJ from January to March 1976. Br Med J 1(6053):85–87
Skaik Y (2015) The bread and butter of statistical analysis “t-test’’: uses and misuses. Pak J Med Sci 31(6):1558–1559
Acknowledgements
The authors extend their appreciation to the Deputyship for Research and Innovation, Ministry of Education in Saudi Arabia for funding this research work through the project no. (IFKSUOR3–596–3).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
No potential conflict of interest was reported by the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Iqbal, S., Qureshi, A.N., Aurangzeb, K. et al. AMIAC: adaptive medical image analyzes and classification, a robust self-learning framework. Neural Comput & Applic (2023). https://doi.org/10.1007/s00521-023-09209-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00521-023-09209-1