Skip to main content

Advertisement

SpringerLink
Log in

HBMD-Net: Feature Fusion Based Breast Cancer Classification with Class Imbalance Resolution

  • Published:
Journal of Imaging Informatics in Medicine Aims and scope Submit manuscript

Abstract

Breast cancer, a widespread global disease, represents a significant threat to women’s health and lives, ranking as one of the most vulnerable malignant tumors they face. Many researchers have proposed their computer-aided diagnosis systems for classifying breast cancer. The majority of these approaches primarily utilize deep learning (DL) methods, which are not entirely reliable. These approaches overlook the crucial necessity of incorporating both local and global information for precise tumor detection, despite the fact that the subtle nuances are crucial for precise breast cancer classification. In addition, there are a limited number of publicly available breast cancer datasets, and the ones that are available tend to be imbalanced in nature. Therefore, this paper presents the hybrid breast mass detection-network (HBMD-Net) to address two critical challenges: class imbalance and the need to recognize that relying solely on either global or local features falls short in achieving precise tumor classification. To overcome the problem of class imbalance, HBMD-Net incorporates the borderline synthetic minority over-sampling technique (BSMOTE). Simultaneously, it employs a feature fusion approach, combining features by utilizing ResNet50 to extract deep features that provide global information, while handcrafted features are derived using histogram orientation gradient (HOG), that provide local information. In addition, an ROI segmentation has been implemented to avoid misclassifications. This integrated strategy substantially enhances breast cancer classification performance. Moreover, the proposed method integrates the block matching and 3D (BM3D) denoising filter to effectively eliminate multiplicative noise that has enhanced the performance of the system. The evaluation of the proposed HBMD-Net encompasses two breast ultrasound (BUS) datasets, namely BUSI and UDIAT. The proposed model has demonstrated a satisfactory performance, achieving accuracies of 99.14% and 94.49% respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Algorithm 1
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Data Availability

https://scholar.cu.edu.eg/?q=afahmy/pages/dataset. http://www2.docm.mmu.ac.uk/STAFF/m.yap/dataset.php.

References

  1. Barsha Abhisheka, Saroj Kumar Biswas, and Biswajit Purkayastha. A comprehensive review on breast cancer detection, classification and segmentation using deep learning. Archives of Computational Methods in Engineering, pages 1–30, 2023.

  2. American cancer society. https://www.cancer.org/cancer/types/breast-cancer/understanding-a-breast-cancer-diagnosis/breast-cancer-survival-rates.html. (American Cancer Society)

  3. World health organization. https://www.who.int/news-room/fact-sheets/detail/breast-cancer, 2021.

  4. Ali Bou Nassif, Manar Abu Talib, Qassim Nasir, Yaman Afadar, and Omar Elgendy. Breast cancer detection using artificial intelligence techniques: A systematic literature review. Artificial Intelligence in Medicine, 127:102276, 2022.

  5. Barsha Abhisheka, Saroj Kumar Biswas, Biswajit Purkayastha, Dolly Das, and Alexandre Escargueil. Recent trend in medical imaging modalities and their applications in disease diagnosis: a review. Multimedia Tools and Applications, pages 1–36, 2023.

  6. Meghavi Rana and Megha Bhushan. Machine learning and deep learning approach for medical image analysis: diagnosis to detection. Multimedia Tools and Applications, 82(17):26731–26769, 2023.

    Article  Google Scholar 

  7. Ramin Ranjbarzadeh, Shadi Dorosti, Saeid Jafarzadeh Ghoushchi, Annalina Caputo, Erfan Babaee Tirkolaee, Sadia Samar Ali, Zahra Arshadi, and Malika Bendechache. Breast tumor localization and segmentation using machine learning techniques: Overview of datasets, findings, and methods. Computers in Biology and Medicine, page 106443, 2022.

  8. Arthur AM Teodoro, Douglas H Silva, Muhammad Saadi, Ogobuchi D Okey, Renata L Rosa, Sattam Al Otaibi, and Demóstenes Z Rodríguez. An analysis of image features extracted by cnns to design classification models for covid-19 and non-covid-19. Journal of signal processing systems, pages 1–13, 2021.

  9. Rikiya Yamashita, Mizuho Nishio, Richard Kinh Gian Do, and Kaori Togashi. Convolutional neural networks: an overview and application in radiology. Insights into imaging, 9:611–629, 2018.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Tanzila Saba, Ibrahim Abunadi, Tariq Sadad, Amjad Rehman Khan, and Saeed Ali Bahaj. Optimizing the transfer-learning with pretrained deep convolutional neural networks for first stage breast tumor diagnosis using breast ultrasound visual images. Microscopy Research and Technique, 85(4):1444–1453, 2022.

  11. Wessam M Salama, Azza M Elbagoury, and Moustafa H Aly. Novel breast cancer classification framework based on deep learning. IET Image Processing, 14(13):3254–3259, 2020.

  12. Prabira Kumar Sethy and Santi Kumari Behera. Automatic classification with concatenation of deep and handcrafted features of histological images for breast carcinoma diagnosis. Multimedia Tools and Applications, 81(7):9631–9643, 2022.

    Article  Google Scholar 

  13. Kushangi Atrey, Bikesh Kumar Singh, and Narendra Kuber Bodhey. Multimodal classification of breast cancer using feature level fusion of mammogram and ultrasound images in machine learning paradigm. Multimedia Tools and Applications, pages 1–22, 2023.

  14. Qinghua Huang, Dan Wang, Zhenkun Lu, Shichong Zhou, Jiawei Li, Longzhong Liu, and Cai Chang. A novel image-to-knowledge inference approach for automatically diagnosing tumors. Expert Systems with Applications, 229:120450, 2023.

    Article  Google Scholar 

  15. Yangyang Liu, Li Ren, Xuehong Cao, and Ying Tong. Breast tumors recognition based on edge feature extraction using support vector machine. Biomedical Signal Processing and Control, 58:101825, 2020.

    Article  Google Scholar 

  16. Shallu Sharma and Rajesh Mehra. Conventional machine learning and deep learning approach for multi-classification of breast cancer histopathology images-a comparative insight. Journal of digital imaging, 33:632–654, 2020.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Furkan Atban, Ekin Ekinci, and Zeynep Garip. Traditional machine learning algorithms for breast cancer image classification with optimized deep features. Biomedical Signal Processing and Control, 81:104534, 2023.

    Article  Google Scholar 

  18. Rahman Shafique, Furqan Rustam, Gyu Sang Choi, Isabel de la Torre Díez, Arif Mahmood, Vivian Lipari, Carmen Lili Rodríguez Velasco, and Imran Ashraf. Breast cancer prediction using fine needle aspiration features and upsampling with supervised machine learning. Cancers, 15(3):681, 2023.

  19. Fei Gao, Teresa Wu, Jing Li, Bin Zheng, Lingxiang Ruan, Desheng Shang, and Bhavika Patel. Sd-cnn: A shallow-deep cnn for improved breast cancer diagnosis. Computerized Medical Imaging and Graphics, 70:53–62, 2018.

    Article  PubMed  Google Scholar 

  20. Nini Qian, Wei Jiang, Yu Guo, Jian Zhu, Jianfeng Qiu, Hui Yu, and Xian Huang. Breast cancer diagnosis from contrast-enhanced mammography using multi-feature fusion neural network. European Radiology, pages 1–11, 2023.

  21. Noor Fadzilah Razali, Iza Sazanita Isa, Siti Noraini Sulaiman, Noor Khairiah A Karim, and Muhammad Khusairi Osman. Cnn-wavelet scattering textural feature fusion for classifying breast tissue in mammograms. Biomedical Signal Processing and Control, 83:104683, 2023.

  22. Yaozhong Luo, Zhenkun Lu, Longzhong Liu, and Qinghua Huang. Deep fusion of human-machine knowledge with attention mechanism for breast cancer diagnosis. Biomedical Signal Processing and Control, 84:104784, 2023.

    Article  Google Scholar 

  23. Md Mahbubur Rahman, Md Saikat Islam Khan, and Hafiz Md Hasan Babu. Breastmultinet: A multi-scale feature fusion method using deep neural network to detect breast cancer. Array, 16:100256, 2022.

  24. Saikat Islam Khan, Ashef Shahrior, Razaul Karim, Mahmodul Hasan, and Anichur Rahman. Multinet: A deep neural network approach for detecting breast cancer through multi-scale feature fusion. Journal of King Saud University-Computer and Information Sciences, 34(8):6217–6228, 2022.

  25. Hua Chen, Minglun Ma, Gang Liu, Ying Wang, Zhihao Jin, and Chong Liu. Breast tumor classification in ultrasound images by fusion of deep convolutional neural network and shallow lbp feature. Journal of Digital Imaging, pages 1–15, 2023.

  26. Leren Qian, Jiexin Bai, Yiqian Huang, Diyar Qader Zeebaree, Abbas Saffari, and Dilovan Asaad Zebari. Breast cancer diagnosis using evolving deep convolutional neural network based on hybrid extreme learning machine technique and improved chimp optimization algorithm. Biomedical Signal Processing and Control, 87:105492, 2024.

  27. Qirui Huang, Huan Ding, and Mehdi Effatparvar. Breast cancer diagnosis based on hybrid squeezenet and improved chef-based optimizer. Expert Systems with Applications, 237:121470, 2024.

    Article  Google Scholar 

  28. G Robinson Paul and J Preethi. A novel breast cancer detection system using sdm-who-rnn classifier with ls-ced segmentation. Expert Systems with Applications, 238:121781, 2024.

  29. Evgin Goceri. Evaluation of denoising techniques to remove speckle and gaussian noise from dermoscopy images. Computers in Biology and Medicine, page 106474, 2022.

  30. Changkun Jiang, Weipeng Lv, and Jianqiang Li. Protein-protein interaction sites prediction using batch normalization based cnns and oversampling method borderline-smote. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 2023.

  31. Rakesh Chandra Joshi, Divyanshu Singh, Vaibhav Tiwari, and Malay Kishore Dutta. An efficient deep neural network based abnormality detection and multi-class breast tumor classification. Multimedia Tools and Applications, 81(10):13691–13711, 2022.

  32. Walid Al-Dhabyani, Mohammed Gomaa, Hussien Khaled, and Aly Fahmy. Dataset of breast ultrasound images. Data in brief, 28:104863, 2020.

    Article  PubMed  Google Scholar 

  33. Victor Pomponiu, Harishwaran Hariharan, Bin Zheng, and David Gur. Improving breast mass detection using histogram of oriented gradients. In Medical Imaging 2014: Computer-Aided Diagnosis, volume 9035, pages 465–470. SPIE, 2014.

  34. Mengwan Wei, Yongzhao Du, Xiuming Wu, Qichen Su, Jianqing Zhu, Lixin Zheng, Guorong Lv, and Jiafu Zhuang. A benign and malignant breast tumor classification method via efficiently combining texture and morphological features on ultrasound images. Computational and Mathematical Methods in Medicine, 2020, 2020.

  35. Wenju Cui, Yunsong Peng, Gang Yuan, Weiwei Cao, Yuzhu Cao, Zhengda Lu, Xinye Ni, Zhuangzhi Yan, and Jian Zheng. Fmrnet: A fused network of multiple tumoral regions for breast tumor classification with ultrasound images. Medical Physics, 49(1):144–157, 2022.

    Article  ADS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science and Engineering, NIT Silchar, Silchar, 788010, Assam, India

    Barsha Abhisheka, Saroj Kr. Biswas & Biswajit Purkayastha

Authors
  1. Barsha Abhisheka
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Saroj Kr. Biswas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Biswajit Purkayastha
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Writing—original draft: B.A.; writing—review and editing: B.A. and S.B.; conceptualization and methodology: S.B. and B.P.; software and validation: B.A.; supervision: S.B. and B.P.

Corresponding author

Correspondence to Barsha Abhisheka.

Ethics declarations

Competing Interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abhisheka, B., Biswas, S.K. & Purkayastha, B. HBMD-Net: Feature Fusion Based Breast Cancer Classification with Class Imbalance Resolution. J Digit Imaging. Inform. med. (2024). https://doi.org/10.1007/s10278-024-01046-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10278-024-01046-5

Keywords

Search

Navigation