Abstract
One of the most dangerous malignancies in global diseases is skin cancer. The best way to survive skin cancer is to detect it in its early stages. Its diagnosis is made by medical imaging with dermoscopy, which provides High-Resolution (HR) lesion images to simplify the detection process. Dermoscopy is not available to everyone, and other available imaging technologies, such as mobile devices, deteriorate the image quality required for diagnosis. This research presents a proposed novel Enhanced Deep Super-Resolution Generative Adversarial Network (EDSR-GAN) model to generate HR skin disease images from Low-Resolution (LR) ones. Particularly, a new design of the loss function is adopted for more details and for creating HR images. Experimental results reveal that the proposed model provides a higher performance on the HAM10000 dataset compared with other models applied on the same dataset. Additionally, for evaluating the proposed model, a variety of metrics are employed, including the Peak Signal-to-Noise Ratio (PSNR), Mean Square Error (MSE), Structural Similarity Index (SSIM), Multi-scale Structural Similarity Index (MS-SSIM), and histogram characteristics, to conduct thorough and impartial comparisons and identify the best models according to performance training time, and storage space. By obtaining an accuracy of 98.9958%, the results show that the proposed model outperforms traditional and previous models for color and texture reconstruction and recognition.
Similar content being viewed by others
Data availability
All data are available upon request from the corresponding author.
References
Abdelwahab, K.M., El-atty, A., Saied, M., El-Shafai, W., El-Rabaie, S., El-Samie, A.: Efficient SVD-based audio watermarking technique in FRT domain. Multimedia Tools Appl. 79(9), 5617–5648 (2020)
Afza, F., Sharif, M., Mittal, M., Khan, M.A., Hemanth, D. J.: A hierarchical three-step superpixels and deep learning framework for skin lesion classification. Methods (2021)
Afza, F., Sharif, M., Khan, M.A., Tariq, U., Yong, H.S., Cha, J.: Multiclass skin lesion classification using hybrid deep features selection and extreme learning machine. Sensors 22(3), 799 (2022)
Agrahari, P., Agrawal, A., & Subhashini, N. (2022). Skin cancer detection using deep learning. In: Futuristic Communication and Network Technologies. Springer, Singapore, pp. 179–190.
Al-Afandy, K.A., El-Shafai, W., El-Rabaie, E.S.M., El-Samie, A., Fathi, E., Faragallah, O.S., El-Mhalaway, A., Shehata, A.M., El-Banby, G.M., El-Halawany, M.M.: Robust hybrid watermarking techniques for different color imaging systems. Multimedia Tools Appl. 77(19), 25709–25759 (2018)
Alarifi, A., Sankar, S., Altameem, T., Jithin, K.C., Amoon, M., El-Shafai, W.: A novel hybrid cryptosystem for secure streaming of high efficiency H. 265 compressed videos in IoT multimedia applications. IEEE Access 8, 128548–128573 (2020a)
Alarifi, A., Amoon, M., Aly, M.H., El-Shafai, W.: Optical PTFT asymmetric cryptosystem-based secure and efficient cancelable biometric recognition system. IEEE Access 8, 221246–221268 (2020b)
Algarni, A.D., El Banby, G., Ismail, S., El-Shafai, W., El-Samie, F.E.A., Soliman, N.F.: Discrete transforms and matrix rotation based cancelable face and fingerprint recognition for biometric security applications. Entropy 22(12), 1361 (2020)
Arroyo, J.L.G., Zapirain, B.G.: Automated detection of melanoma in dermoscopic images. In: Computer Vision Techniques for the Diagnosis of Skin Cancer. Springer (2014)
Arshad, M., Khan, M. A., Tariq, U., Armghan, A., Alenezi, F., Younus Javed, M., Aslam, S.M., Kadry, S.: A computer-aided diagnosis system using deep learning for multiclass skin lesion classification. Comput. Intell. Neurosci. (2021)
Attique Khan, M., Sharif, M., Akram, T., Kadry, S., Hsu, C.H.: A two‐stream deep neural network‐based intelligent system for complex skin cancer types classification. Int. J. Intell. Syst (2021).
Bashir, S.M.A., Wang, Y., Khan, M., Niu, Y.: A comprehensive review of deep learning-based single image super-resolution. PeerJ Comput. Sci. 7, e621 (2021)
Baur, C., Albarqouni, S., Navab, N.: MelanoGANs: high resolution skin lesion synthesis with GANs. 2018. arXiv preprint arXiv:1804.04338.
Benbrahim, H., Hachimi, H., Amine, A.: Deep convolutional neural network with TensorFlow and Keras to classify skin cancer images. Scalable Comput. Pract. Exp. 21(3), 379–390 (2020)
Bibi, A., Khan, M. A., Javed, M. Y., Tariq, U., Kang, B. G., Nam, Y., Mostafa, R.R., Sakr, R. H.: Skin lesion segmentation and classification using conventional and deep learning based framework (2022a)
Bibi, A., Khan, M.A., Javed, M.Y., Tariq, U., Kang, B.G., Nam, Y., Mostafa, R.R., Sakr, R.H.: Skin lesion segmentation and classification using conventional and deep learning based framework. CMC-Comput. Mater. Continua 71(2), 2477–2495 (2022b)
Bing, X., et al.: Medical image super resolution using improved generative adversarial networks. IEEE Access 7, 145030–145038 (2019)
Çelik, G., Talu, M.F.: Resizing and cleaning of histopathological images using generative adversarial networks. Phys. Stat. Mech. Appl. 554, 122652 (2020)
Chaturvedi, S.S., Tembhurne, J.V., Diwan, T.: A multi-class skin Cancer classification using deep convolutional neural networks. Multimedia Tools Appl. 79(39), 28477–28498 (2020)
Chen, Y, et al.: Efficient and accurate MRI super-resolution using a generative adversarial network and 3D multi-level densely connected network. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer (2018).
Eklund, A., et al.: Medical image processing on the GPU–Past, present and future. Med. Image Anal. 17(8), 1073–1094 (2013)
Elashry, I.F., El-Shafai, W., Hasan, E.S., El-Rabaie, S., Abbas, A.M., El-Samie, A., El-Sayed, H.S., Faragallah, O.S.: Efficient chaotic-based image cryptosystem with different modes of operation. Multimedia Tools Appl. 79(29), 20665–20687 (2020)
El-Hag, N.A., Sedik, A., El-Shafai, W., El-Hoseny, H.M., Khalaf, A.A., El-Fishawy, A.S., Al-Nuaimy, W., Abd El-Samie, F.E., El-Banby, G.M.: Classification of retinal images based on convolutional neural network. Microsc. Res. Tech. 84(3), 394–414 (2021)
El-Shafai, W.: Pixel-level matching based multi-hypothesis error concealment modes for wireless 3D H. 264/MVC communication. 3D Res. 6(3), 1–11 (2015a)
El-Shafai, W.: Joint adaptive pre-processing resilience and post-processing concealment schemes for 3D video transmission. 3D Res. 6(1), 1–13 (2015b)
El Shafai, W., Hrušovský, B., El-Khamy, M., El-Sharkawy, M.: Joint space-time-view error concealment algorithms for 3D multi-view video. In: 2011 18th IEEE International Conference on Image Processing, pp. 2201–2204. IEEE (2011)
El-Shafai, W., Abd El-Samie, F.: Extensive COVID-19 X-ray and CT chest images dataset. Mendeley Data 3(10) (2020)
El-Shafai, W., El-Rabaie, S., El-Halawany, M., El-Samie, A.: Enhancement of wireless 3d video communication using color-plus-depth error restoration algorithms and Bayesian Kalman filtering. Wirel. Pers. Commun. 97(1), 245–268 (2017)
El-Shafai, W., El-Rabaie, S., El-Halawany, M.M., El-Samie, A., Fathi, E.: Encoder-independent decoder-dependent depth-assisted error concealment algorithm for wireless 3D video communication. Multimedia Tools Appl. 77(11), 13145–13172 (2018a)
El-Shafai, W., El-Rabaie, E.S.M., El-Halawany, M., El-Samie, F.E.A.: Efficient multi-level security for robust 3D color-plus-depth HEVC. Multimedia Tools Appl. 77(23), 30911–30937 (2018b)
El-Shafai, W., El-Rabaie, S., El-Halawany, M.M., Abd El-Samie, F.E.: Efficient hybrid watermarking schemes for robust and secure 3D-MVC communication. Int. J. Commun Syst 31(4), e3478 (2018c)
El-Shafai, W., El-Rabaie, S., El-Halawany, M.M., Abd El-Samie, F.E.: Security of 3D-HEVC transmission based on fusion and watermarking techniques. Multimedia Tools Appl. 78(19), 27211–27244 (2019)
El-Shafai, W., Khallaf, F., El-Rabaie, E.S.M., El-Samie, F.E.A.: Robust medical image encryption based on DNA-chaos cryptosystem for secure telemedicine and healthcare applications. J. Ambient. Intell. Humaniz. Comput. 12(10), 9007–9035 (2021a)
El-Shafai, W., Almomani, I.M., Alkhayer, A.: Optical bit-plane-based 3D-JST cryptography algorithm with cascaded 2D-FrFT encryption for efficient and secure HEVC communication. IEEE Access 9, 35004–35026 (2021b)
Faragallah, O.S., Alzain, M.A., El-Sayed, H.S., Al-Amri, J.F., El-Shafai, W., Afifi, A., Naeem, E.A., Soh, B.: Block-based optical color image encryption based on double random phase encoding. IEEE Access 7, 4184–4194 (2018)
Faragallah, O.S., Afifi, A., El-Shafai, W., El-Sayed, H.S., Naeem, E.A., Alzain, M.A., Al-Amri, J.F., Soh, B., Abd El-Samie, F.E.: Investigation of chaotic image encryption in spatial and FrFT domains for cybersecurity applications. IEEE Access 8, 42491–42503 (2020a)
Faragallah, O.S., El-Hoseny, H., El-Shafai, W., Abd El-Rahman, W., El-Sayed, H.S., El-Rabaie, E.S.M., Abd El-Samie, F.E., Geweid, G.G.: A comprehensive survey analysis for present solutions of medical image fusion and future directions. IEEE Access 9, 11358–11371 (2020b)
Faragallah, O.S., AlZain, M.A., El-Sayed, H.S., Al-Amri, J.F., El-Shafai, W., Afifi, A., Naeem, E.A., Soh, B.: Secure color image cryptosystem based on chaotic logistic in the FrFT domain. Multimedia Tools and Applications 79(3), 2495–2519 (2020c)
Faragallah, O.S., Afifi, A., El-Shafai, W., El-Sayed, H.S., Alzain, M.A., Al-Amri, J.F., Abd El-Samie, F.E.: Efficiently encrypting color images with few details based on RC6 and different operation modes for cybersecurity applications. IEEE Access 8, 103200–103218 (2020d)
Faragallah, O.S., Afifi, A., El-Sayed, H.S., Alzain, M.A., Al-Amri, J.F., Abd El-Samie, F.E., El-Shafai, W.: Efficient HEVC integrity verification scheme for multimedia cybersecurity applications. IEEE Access 8, 167069–167089 (2020e)
Faragallah, O.S., El-sayed, H.S., Afifi, A., El-Shafai, W.: Efficient and secure opto-cryptosystem for color images using 2D logistic-based fractional Fourier transform. Opt. Lasers Eng. 137, 106333 (2021)
Faragallah, O.S., El-Shafai, W., Sallam, A.I., Elashry, I., EL-Rabaie, E.S.M., Afifi, A., AlZain, M.A., Al-Amri, J., Abd El-Samie, F.E., El-sayed, H.S.: Cybersecurity framework of hybrid watermarking and selective encryption for secure HEVC communication. J. Ambient Intell. Human. Comput. 13(2), 1215–1239 (2022)
Goodfellow, I.: NIPS 2016 tutorial: Generative adversarial networks. arXiv:1701.00160, 2017, [online] Available: http://arxiv.org/abs/1701.00160.
Howard, A.G., et al.: MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications (2017).
Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 4700–4708 (2017)
Ibrahim, S., Egila, M.G., Shawky, H., Elsaid, M.K., El-Shafai, W., El-Samie, A., Fathi, E.: Cancelable face and fingerprint recognition based on the 3D jigsaw transform and optical encryption. Multimedia Tools Appl. 79(19), 14053–14078 (2020)
Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. In: European Conference on Computer Vision. Springer, Berlin (2016)
Khan, M.A., Javed, M.Y., Sharif, M., Saba, T., Rehman, A.: Multi-model deep neural network based features extraction and optimal selection approach for skin lesion classification. In: Proceedingd of ICCIS, Sakaka, Saudi Arabia, pp. 1–7 (2019)
Khan, M.A., Sharif, M., Akram, T., Damaševičius, R., Maskeliūnas, R.: Skin lesion segmentation and multiclass classification using deep learning features and improved moth flame optimization. Diagnostics 11(5), 811 (2021a)
Khan, M.A., Muhammad, K., Sharif, M., Akram, T., de Albuquerque, V.H.C.: Multi-class skin lesion detection and classification via teledermatology. IEEE J. Biomed. Health Inform. 25(12), 4267–4275 (2021b)
Khan, M.A., Akram, T., Zhang, Y.D., Sharif, M.: Attributes based skin lesion detection and recognition: A mask RCNN and transfer learning-based deep learning framework. Pattern Recogn. Lett. 143, 58–66 (2021c)
Khan, M.A., Muhammad, K., Sharif, M., Akram, T., Kadry, S.: Intelligent fusion-assisted skin lesion localization and classification for smart healthcare. Neural Comput. Appl. 1–16 (2021d)
Khan, M. A., Akram, T., Sharif, M., Kadry, S., Nam, Y.: Computer decision support system for skin cancer localization and classification (2021e)
Khan, M.A., Sharif, M.I., Raza, M., Anjum, A., Saba, T., Shad, S.A.: Skin lesion segmentation and classification: A unified framework of deep neural network features fusion and selection. Expert. Syst. 39(7), e12497 (2022a)
Khan, M.D., Uddin, A.H., Nahid, A.A., Bairagi, A.K.: Skin cancer detection from low-resolution images using transfer learning. In: Intelligent Sustainable Systems (pp. 317–334). Springer, Singapore (2022b)
Ledig, C., Theis, L., Huszár, F., Caballero, J., Cunningham, A., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, pp. 105–114 (2017)
Ledig, C., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
Li, Z., Wang, Y., Yu, J.: Reconstruction of thin-slice medical images using generative adversarial network. In: International Workshop on Machine Learning in Medical Imaging. Springer (2017)
Lim, B., Son, S., Kim, H., Nah, S., Mu Lee, K.: Enhanced deep residual networks for single image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 136–144 (2017)
Lin, W., Jay Kuo, C.C.: Perceptual visual quality metrics: a survey. J. vis. Commun. Image Represent. 22(4), 297–312 (2011)
Mahapatra, D., Bozorgtabar, B., Garnavi, R.: Image super-resolution using progressive generative adversarial networks for medical image analysis. Comput. Med. Imag Graph. 71, 30–39 (2019)
Mahapatra, D., Bozorgtabar, B.: Progressive generative adversarial networks for medical image super resolution (2019). arXiv preprint arXiv:1902.02144.
Mohamed, E.H., Behaidy, W.H.: Enhanced skin lesions classification using deep convolutional networks. In: Proceedings of ICICIS, Cairo, Egypt, pp. 180–188 (2019)
Shahin, A. H., Kamal, A., Elattar, M.A.: Deep ensemble learning for skin lesion classification from dermoscopic images. In: Proceedings of CIBEC, Cairo, Egypt, pp. 150–153 (2018)
Shahidi, F., Daud, S.M., Abas, H., Ahmad, N.A., Maarop, N.: Breast cancer classification using deep learning approaches and histopathology image: a comparison study. IEEE Access 8, 187531–187552 (2020)
Shi, W., Caballero, J., Huszár, F., Totz, J., Aitken, A. P., Bishop, R., Rueckert, D., Wang, Z.: Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1874–1883 (2016)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition (2014). arXiv preprint arXiv:1409.1556.
Soliman, N.F., Khalil, M.I., Algarni, A.D., Ismail, S., Marzouk, R., El-Shafai, W.: Efficient HEVC steganography approach based on audio compression and encryption in QFFT domain for secure multimedia communication. Multimedia Tools Appl. 80(3), 4789–4823 (2021)
Sood, R., Rusu, M.: Anisotropic super resolution in prostate mri using super resolution generative adversarial networks. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019). IEEE (2019).
Spanhol, F.A., Oliveira, L.S., Petitjean, C., Heutte, L.: A dataset for breast cancer histopathological image classification. IEEE Trans. Biomed. Eng. 63(7), 1455–1462 (2016)
Thurnhofer, K., Dominguez, E.: A convolutional neural network framework for accurate skin cancer detection. Neural Process. Lett. 1(1), 1–21 (2020)
Thuy, M.B.H., Hoang, V.T.: Fusing of deep learning, transfer learning and gan for breast cancer histopathological image classification. In: International Conference on Computer Science, Applied Mathematics and Applications, pp. 255–266. Springer, Cham (2019).
Villa-Pulgarin, J.P., Ruales-Torres, A.A., Arias-Garzon, D., Bravo-Ortiz, M.A., Arteaga-Arteaga, H.B., Mora-Rubio, A., Grisales, J.A.A., Mercado-Ruiz, E., Hassaballah, M., Arias, S.O., Cardona-Morales, O., Tabares-Soto, R.: Optimized convolutional neural network models for skin lesion classification. CMC-Comput. Mater. Continua 70(2), 2131–2148 (2022)
Wang, Z., Simoncelli, E.P., Bovik, A.C.: Multiscale structural similarity for image quality assessment. In: The Thrity-Seventh Asilomar Conference on Signals, Systems Computers, vol. 2, pp. 1398–1402 (2003). https://doi.org/10.1109/ACSSC.2003.1292216.
Wang, Z., Bovik, A., Sheikh, H., Simoncelli, E.: Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)
Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., Change Loy, C.: Esrgan: Enhanced super-resolution generative adversarial networks. In: Proceedings of the European Conference on Computer Vision (ECCV) Workshops (2018a)
Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Loy, C.C., Qiao, Y., Change Loy, C.: Esrgan: Enhanced super-resolution generative adversarial networks. In: Proceedings of the European Conference on Computer Vision (ECCV) workshops (2018b).
Wang, Z., Chen, J., Hoi, S. C.: Deep learning for image super-resolution: a survey. IEEE Trans. Pattern Anal. Mach. Intell. (2020)
Wang, P., Wang, J., Li, Y., Li, P., Li, L., Jiang, M.: Automatic classification of breast cancer histopathological images based on deep feature fusion and enhanced routing. Biomed. Signal Process. Control 65, 102341 (2021)
Xie, S., Girshick, R., Dollár, P., Tu, Z., He, K.: Aggregated residual transformations for deep neural networks. In: Proceedings of 30th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1492–1500 (2017). Available: https://arxiv.org/abs/1611.05431v2.
Xu, L., et al.: Low-dose chest X-ray image super-resolution using generative adversarial nets with spectral normalization. Biomed. Signal Process. Contr 55, 101600 (2020)
Yu X, Porikli F. Face hallucination with tiny unaligned images by transformative discriminative neural networks. In: Thirty-First AAAI Conference on Artificial Intelligence (2017)
Yu, J., Fan, Y., Yang, J., Xu, N., Wang, Z., Wang, X., Huang, T.: Wide activation for efficient and accurate image super-resolution. arXiv preprint arXiv:1808.08718 (2018)
Zhao, M., et al.: Super-resolution of cardiac magnetic resonance images using Laplacian Pyramid based on Generative Adversarial Networks. Comput Med Imag Graph 80, 101698 (2020)
Funding
The authors did not receive support from any organization for the submitted work.
Author information
Authors and Affiliations
Contributions
All authors are equally contributed.
Corresponding author
Ethics declarations
Competing interests
The authors have no relevant financial or non-financial interests to disclose.
Ethics approval
All authors are contributing and accepting to submit the current work.
Consent to participate
All authors are contributing and accepting to submit the current work.
Consent for publication
All authors are accepting to submit and publish the submitted work.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Abd El-Fattah, I., Ali, A.M., El-Shafai, W. et al. Deep-learning-based super-resolution and classification framework for skin disease detection applications. Opt Quant Electron 55, 427 (2023). https://doi.org/10.1007/s11082-022-04432-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11082-022-04432-x