Skip to main content
Log in

AMIAC: adaptive medical image analyzes and classification, a robust self-learning framework

  • S.I.: Intelligent Systems in Biomedical and Healthcare Informatics
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Adaptive self-learning is a promising technique in medical image analysis that enables deep learning models to adapt to changes in image distribution over time. As medical image data can vary due to factors like imaging equipment and patient demographics, adaptive self-learning becomes valuable for maintaining the accuracy and robustness of deep learning frameworks. Initially trained on a large dataset, the framework can adapt to new modalities using transfer learning, adaptive learning, and incremental learning, incorporating both manual and auto (CNN-based) features. Adaptive self-learning offers various benefits, including improved model accuracy and efficiency, reducing the need for manual retraining. However, challenges such as the risk of overfitting, acquiring relevant manual features, and careful monitoring need to be addressed. Combining manual features and pretrained CNN models can enhance performance in medical image analysis tasks such as tumor classification, lesion detection, and cancer segmentation. Manual features capture specific image characteristics, while pretrained CNN models automatically learn abstract features from extensive datasets. Combining these approaches provides additional information that neither approach alone can capture. In this study, we present a unique framework for adaptive self-learning in medical image analysis and classification. The proposed framework analyzes image modality, applies preprocessing techniques, and acquires both manual and CNN-based pertinent features. However, careful tuning and experimentation are essential to determine the optimal combination of manual features with the appropriate CNN model architecture. The recommended adaptive self-learning framework achieves a high averaged F1-score \(97.35\pm 0.39\) and precision of \(97.19 \pm 0.51\), as well as its fantabulous abstraction and accuracy of \(97.81 \pm 0.35\), implying that it might be used to build a pathologist’s aid tool.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

Data availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

References

  1. Karimi D, Dou H, Warfield SK, Gholipour A (2020) Deep learning with noisy labels: exploring techniques and remedies in medical image analysis. Med Image Anal 65:101759

    Article  Google Scholar 

  2. Tajbakhsh N, Jeyaseelan L, Li Q, Chiang JN, Wu Z, Ding X (2020) Embracing imperfect datasets: a review of deep learning solutions for medical image segmentation. Med Image Anal 63:101693

    Article  Google Scholar 

  3. Liu L, Zhang Z, Li S, Ma K, Zheng Y (2021) S-cuda: self-cleansing unsupervised domain adaptation for medical image segmentation. Med Image Anal 74:102214

    Article  Google Scholar 

  4. Fu S, Lu Y, Wang Y, Zhou Y, Shen W, Fishman W, Yuille A (2020) Domain adaptive relational reasoning for 3d multi-organ segmentation. In: Medical image computing and computer assisted intervention—MICCAI 2020: 23rd international conference, Lima, Peru, October 4–8, 2020, proceedings, Part I, vol 23. Springer, pp 656–666

  5. Zemmal N, Azizi N, Dey N, Sellami M (2016) Adaptive semi supervised support vector machine semi supervised learning with features cooperation for breast cancer classification. J Med Imaging Health Inform 6(1):53–62

    Article  Google Scholar 

  6. Ali O, Abdelbaki W, Shrestha A, Elbasi E, Alryalat MAA, Dwivedi YK (2023) A systematic literature review of artificial intelligence in the healthcare sector: benefits, challenges, methodologies, and functionalities. J Innov Knowl 8(1):100333

    Article  Google Scholar 

  7. Zhang Y, Shen L (2023) Automatic learning rate adaption for memristive deep learning systems. IEEE Trans Neural Netw Learn Syst

  8. Srinivasu PN, Krishna TB, Ahmed S, Almusallam N, Alarfaj FK, Allheeib N et al (2023) Variational autoencoders-basedself-learning model for tumor identification and impact analysis from 2-d mri images. J Healthc Eng 8:2023

    Google Scholar 

  9. Nguyen P, Rathod A, Chapman D, Prathapan S, Menon S, Morris M, Yesha Y (2023) Active semi-supervised learning via bayesian experimental design for lung cancer classification using low dose computed tomography scans. Appl Sci 13(6):3752

    Article  Google Scholar 

  10. Khozeimeh F, Alizadehsani R, Shirani M, Tartibi M, Shoeibi A, Alinejad-Rokny H, Harlapur C, Sultanzadeh SJ, Khosravi A, Nahavandi S et al (2023) Alec: Active learning with ensemble of classifiers for clinical diagnosis of coronary artery disease. Comput Biol Med 8:106841

    Article  Google Scholar 

  11. Shenaj D, Fanì B, Toldo M, Caldarola D, Tavera A, Michieli U, Ciccone M, Zanuttigh P, Caputo B (2023) Learning across domains and devices: style-driven source-free domain adaptation in clustered federated learning. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp 444–454

  12. Saravanan S, Surendheran K, Krishnakumar K (2023) Data analytics on medical images with deep learning approach. In: Biomedical signal and image processing with artificial intelligence. Springer, pp 153–166

  13. Anzai Y, Chang C-P, Rowe K, Snyder J, Deshmukh V, Newman M, Fraser A, Smith K, Date A, Galvao C et al (2023) Surveillance imaging with pet/ct and ct and/or mri for head and neck cancer and mortality: a population-based study. Radiology 8:212915

    Article  Google Scholar 

  14. Rajalingam B, Priya R, Bhavani R, Santhoshkumar R (2023) Image fusion techniques for different multimodality medical images based on various conventional and hybrid algorithms for disease analysis. In: Research anthology on improving medical imaging techniques for analysis and intervention. IGI Global, pp 268–299

  15. Xu W, Fu YL, Xu H, Wong KKL (2023) Medical image fusion using enhanced cross-visual cortex model based on artificial selection and impulse-coupled neural network. Comput Methods Programs Biomed 229:107304

    Article  Google Scholar 

  16. Chen L, Wang X, Zhu Y, Nie R (2023) Multi-level difference information replenishment for medical image fusion. Appl Intell 53(4):4579–4591

    Article  Google Scholar 

  17. Wang L, Zhang L, Shu X, Yi Z (2023) Intra-class consistency and inter-class discrimination feature learning for automatic skin lesion classification. Med Image Anal 16:102746

    Article  Google Scholar 

  18. Zhan X, Liu J, Long H, Zhu J, Tang H, Gou F, Jia W (2023) An intelligent auxiliary framework for bone malignant tumor lesion segmentation in medical image analysis. Diagnostics 13(2):223

    Article  Google Scholar 

  19. Jiang H, Diao Z, Shi T, Zhou Y, Wang F, Hu W, Yao YD (2023) A review of deep learning-based multiple-lesion recognition from medical images: classification, detection and segmentation. Comput Biol Med 16:106726

    Article  Google Scholar 

  20. Singh M, Singh M, De D, Handa S, Mahajan R, Chatterjee D (2023) toward diagnosis of autoimmune blistering skin diseases using deep neural network. Arch Comput Methods Eng 8:1–29

    Google Scholar 

  21. Wenqian ZHAO, Chong YY, Chien WT (2023) Effectiveness of cognitive-based interventions for improving body image of breast cancer patients: a systematic review and meta-analysis. Asia-Pacific J Oncol Nurs 8(100213):2023

    Google Scholar 

  22. Afriyie Y, Weyori BA, Opoku AA (2023) A scaling up approach: a research agenda for medical imaging analysis with applications in deep learning. J Exp Theor Artif Intell 8:1–55

    Article  Google Scholar 

  23. Baji FS, Abdullah SB, Abdulsattar FS (2023) K-mean clustering and local binary pattern techniques for automatic brain tumor detection. Bull Electric Eng Inf 12(3):1586–1594

    Google Scholar 

  24. Wu J, Wei G, Wang Y, Cai J (2023) Multifeature fusion classification method for adaptive endoscopic ultrasonography tumor image. Ultrasound Med Biol 49(4):937–945

    Article  Google Scholar 

  25. Virmani J, Agarwal R (2023) Lbp-based cad system designs for breast tumor characterization. In: Biomedical signal and image processing with artificial intelligence. Springer, pp 231–257

  26. Cheng J, Huang W, Shuangliang Cao R, Yang WY, Yun Z, Wang Z, Feng Q (2015) Enhanced performance of brain tumor classification via tumor region augmentation and partition. PLoS ONE 10(10):e0140381

    Article  Google Scholar 

  27. Sharif M, Amin J, Raza M, Anjum MA, Afzal H, Shad SA (2020a) An integrated design of particle swarm optimization (PSO) with fusion of features for detection of brain tumor. Pattern Recognit Lett 129:150–157

  28. Sharif M, Amin J, Raza M, Anjum MA, Afzal H, Shad SA (2020b) Brain tumor detection based on extreme learning. Neural Comput Appl 32:15975–15987

  29. Ibrahim KSMH, Huang YF, Ahmed AN, Koo CH, El-Shafie A (2022) A review of the hybrid artificial intelligence and optimization modeling of hydrological streamflow forecasting. Alex Eng J 61(1):279–303

    Article  Google Scholar 

  30. Kagolanu VSA, Thimmareddy L, Kanala KL, Sirisha B (2022) Multi-class medical image classification based on feature ensembling using deepnets. In: 2022 9th International conference on computing for sustainable global development (INDIACom). IEEE, pp 540–544

  31. Jiang P, Liu J, Wang L, Ynag Z, Dong H, Feng J (2022) Deeply supervised layer selective attention network: toward label-efficient learning for medical image classification. arXiv preprint arXiv:2209.13844

  32. Al-Masni MA, Al-Antari MA, Park JM, Gi G, Kim TY, Rivera P, Valarezo E, Han SM, Kim TS (2017) Detection and classification of the breast abnormalities in digital mammograms via regional convolutional neural network. In: 2017 39th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 1230–1233

  33. Akselrod-Ballin A, Karlinsky L, Alpert S, Hasoul S, Ben-Ari R, Barkan E (2016) A region based convolutional network for tumor detection and classification in breast mammography. In: Deep learning and data labeling for medical applications: first international workshop, LABELS 2016, and second international workshop, DLMIA 2016, held in conjunction with MICCAI 2016, Athens, Greece, October 21, 2016, proceedings, vol 2. Springer, pp 197–205

  34. Marino MA, Pinker K, Leithner D, Sung J, Avendano D, Morris EA, Jochelson M (2020) Contrast-enhanced mammography and radiomics analysis for noninvasive breast cancer characterization: initial results. Mol Imaging Biol 22:780–787

    Article  Google Scholar 

  35. La Forgia D, Fanizzi A, Campobasso F, Bellotti R, Didonna V, Lorusso V, Moschetta M, Massafra R, Tamborra P, Tangaro S et al (2020) Radiomic analysis in contrast-enhanced spectral mammography for predicting breast cancer histological outcome. Diagnostics 10(9):708

    Article  Google Scholar 

  36. Hassanien MA, Singh VK, Puig D, Abdel-Nasser M (2022) Predicting breast tumor malignancy using deep convnext radiomics and quality-based score pooling in ultrasound sequences. Diagnostics 12(5):1053

    Article  Google Scholar 

  37. Mansoori B, Erhard KK, Sunshine JL (2012) Picture archiving and communication system (PACS) implementation, integration & benefits in an integrated health system. Acad Radiol 19(2):229–235

    Article  Google Scholar 

  38. Gutman D, Codella NCF, Celebi E, Helba B, Marchetti M, Mishra N, Halpern A (2016) Skin lesion analysis toward melanoma detection: a challenge at the international symposium on biomedical imaging (isbi) 2016, hosted by the international skin imaging collaboration (ISIC). arXiv preprint arXiv:1605.01397

  39. Spanhol FA, Oliveira LS, Petitjean C, Heutte L (2015) A dataset for breast cancer histopathological image classification. IEEE Trans Biomed Eng 63(7):1455–1462

    Article  Google Scholar 

  40. Iqbal S, Qureshi AN, Mustafa G (2022a) Hybridization of CNN with LBP for classification of melanoma images. Comput Materials Continua 71(3):4915–4939

  41. Iqbal S, Qureshi AN. Deep-hist: breast cancer diagnosis through histopathological images using convolution neural network. J Intell Fuzzy Syst 1–18 (Preprint)

  42. Iqbal S, Qureshi AN (2022) A heteromorphous deep CNN framework for medical image segmentation using local binary pattern. IEEE Access

  43. Kumar I, Rawat J, Bhadauria HS (2014) A conventional study of edge detection technique in digital image processing. Int J Comput Sci Mob Comput 3(4):328–334

    Google Scholar 

  44. Ritter F, Boskamp T, Homeyer A, Laue H, Schwier M, Link F, Peitgen HO (2011) Medical image analysis. IEEE Pulse 2(6):60–70

    Article  Google Scholar 

  45. Kim Y-T (1997) Contrast enhancement using brightness preserving bi-histogram equalization. IEEE Trans Consum Electron 43(1):1–8

    Article  Google Scholar 

  46. Zuiderveld K (1994) Contrast limited adaptive histogram equalization. Graph Gems 8:474–485

    Article  Google Scholar 

  47. Agarwal M, Mahajan R (2018) Medical image contrast enhancement using range limited weighted histogram equalization. Proc Comput Sci 125:149–156

    Article  Google Scholar 

  48. Macenko M, Niethammer M, Marron JS, Borland D, Woosley JT, Guan X, Schmitt C, Thomas NE (2009) A method for normalizing histology slides for quantitative analysis. In: 2009 IEEE international symposium on biomedical imaging: from nano to macro. IEEE, pp 1107–1110

  49. Benoit-Cattin H (2006) Texture analysis for magnetic resonance imaging. Text Anal Magn Reson

  50. Zwanenburg A, Vallières M, Abdalah MA, Aerts HJWL, Andrearczyk V, Apte A, Ashrafinia S, Bakas S, Beukinga RJ, Boellaard R et al (2020) The image biomarker standardization initiative: standardized quantitative radiomics for high-throughput image-based phenotyping. Radiology 295(2):328

    Article  Google Scholar 

  51. Haralick RM, Shanmugam K, Dinstein IH (1973) Textural features for image classification. IEEE Trans Syst Man Cybern 6:610–621

    Article  Google Scholar 

  52. Galloway MM (1975) Texture analysis using gray level run lengths. Comput Graph Image Process 4(2):172–179

    Article  Google Scholar 

  53. Thibault G, Angulo J, Meyer F (2013) Advanced statistical matrices for texture characterization: application to cell classification. IEEE Trans Biomed Eng 61(3):630–637

    Article  Google Scholar 

  54. Iqbal S, Qureshi AN, Ullah A, Li J, Mahmood T (2022) Improving the robustness and quality of biomedical CNN models through adaptive hyperparameter tuning. Appl Sci 12(22):11870

    Article  Google Scholar 

  55. Mold RF (1989) Introduction to medical statistics, 2nd edn (Bristol: Hilger)

  56. Altman DG, Bland JM (1994) Diagnostic tests 1: sensitivity and specificity. Br Med J 308(6943):1552

    Article  Google Scholar 

  57. Lalkhen AG, McCluskey A (2008) Clinical tests: sensitivity and specificity. Contin Educ Anaesth Crit Care Pain 8(6):221–223

    Article  Google Scholar 

  58. D’Agostino RB, Sullivan LM, Massaro J (2008) Wiley encyclopedia of clinical trials. Wiley, Hoboken

    Google Scholar 

  59. Gore SM, Jones IG, Rytter EC (1977) Misuse of statistical methods: critical assessment of articles in BMJ from January to March 1976. Br Med J 1(6053):85–87

    Article  Google Scholar 

  60. Skaik Y (2015) The bread and butter of statistical analysis “t-test’’: uses and misuses. Pak J Med Sci 31(6):1558–1559

    Google Scholar 

Download references

Acknowledgements

The authors extend their appreciation to the Deputyship for Research and Innovation, Ministry of Education in Saudi Arabia for funding this research work through the project no. (IFKSUOR3–596–3).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Saeed Iqbal.

Ethics declarations

Conflict of interest

No potential conflict of interest was reported by the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Iqbal, S., Qureshi, A.N., Aurangzeb, K. et al. AMIAC: adaptive medical image analyzes and classification, a robust self-learning framework. Neural Comput & Applic (2023). https://doi.org/10.1007/s00521-023-09209-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00521-023-09209-1

Keywords

Navigation