Skip to main content
Log in

Deep-learning-based super-resolution and classification framework for skin disease detection applications

  • Published:
Optical and Quantum Electronics Aims and scope Submit manuscript

Abstract

One of the most dangerous malignancies in global diseases is skin cancer. The best way to survive skin cancer is to detect it in its early stages. Its diagnosis is made by medical imaging with dermoscopy, which provides High-Resolution (HR) lesion images to simplify the detection process. Dermoscopy is not available to everyone, and other available imaging technologies, such as mobile devices, deteriorate the image quality required for diagnosis. This research presents a proposed novel Enhanced Deep Super-Resolution Generative Adversarial Network (EDSR-GAN) model to generate HR skin disease images from Low-Resolution (LR) ones. Particularly, a new design of the loss function is adopted for more details and for creating HR images. Experimental results reveal that the proposed model provides a higher performance on the HAM10000 dataset compared with other models applied on the same dataset. Additionally, for evaluating the proposed model, a variety of metrics are employed, including the Peak Signal-to-Noise Ratio (PSNR), Mean Square Error (MSE), Structural Similarity Index (SSIM), Multi-scale Structural Similarity Index (MS-SSIM), and histogram characteristics, to conduct thorough and impartial comparisons and identify the best models according to performance training time, and storage space. By obtaining an accuracy of 98.9958%, the results show that the proposed model outperforms traditional and previous models for color and texture reconstruction and recognition.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1 
Fig. 2 
Fig. 3 
Fig. 4 
Fig. 5 
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

All data are available upon request from the corresponding author.

References

  • Abdelwahab, K.M., El-atty, A., Saied, M., El-Shafai, W., El-Rabaie, S., El-Samie, A.: Efficient SVD-based audio watermarking technique in FRT domain. Multimedia Tools Appl. 79(9), 5617–5648 (2020)

    Google Scholar 

  • Afza, F., Sharif, M., Mittal, M., Khan, M.A., Hemanth, D. J.: A hierarchical three-step superpixels and deep learning framework for skin lesion classification. Methods (2021)

  • Afza, F., Sharif, M., Khan, M.A., Tariq, U., Yong, H.S., Cha, J.: Multiclass skin lesion classification using hybrid deep features selection and extreme learning machine. Sensors 22(3), 799 (2022)

    ADS  Google Scholar 

  • Agrahari, P., Agrawal, A., & Subhashini, N. (2022). Skin cancer detection using deep learning. In: Futuristic Communication and Network Technologies. Springer, Singapore, pp. 179–190.

  • Al-Afandy, K.A., El-Shafai, W., El-Rabaie, E.S.M., El-Samie, A., Fathi, E., Faragallah, O.S., El-Mhalaway, A., Shehata, A.M., El-Banby, G.M., El-Halawany, M.M.: Robust hybrid watermarking techniques for different color imaging systems. Multimedia Tools Appl. 77(19), 25709–25759 (2018)

    Google Scholar 

  • Alarifi, A., Sankar, S., Altameem, T., Jithin, K.C., Amoon, M., El-Shafai, W.: A novel hybrid cryptosystem for secure streaming of high efficiency H. 265 compressed videos in IoT multimedia applications. IEEE Access 8, 128548–128573 (2020a)

    Google Scholar 

  • Alarifi, A., Amoon, M., Aly, M.H., El-Shafai, W.: Optical PTFT asymmetric cryptosystem-based secure and efficient cancelable biometric recognition system. IEEE Access 8, 221246–221268 (2020b)

    Google Scholar 

  • Algarni, A.D., El Banby, G., Ismail, S., El-Shafai, W., El-Samie, F.E.A., Soliman, N.F.: Discrete transforms and matrix rotation based cancelable face and fingerprint recognition for biometric security applications. Entropy 22(12), 1361 (2020)

    ADS  MathSciNet  Google Scholar 

  • Arroyo, J.L.G., Zapirain, B.G.: Automated detection of melanoma in dermoscopic images. In: Computer Vision Techniques for the Diagnosis of Skin Cancer. Springer (2014)

  • Arshad, M., Khan, M. A., Tariq, U., Armghan, A., Alenezi, F., Younus Javed, M., Aslam, S.M., Kadry, S.: A computer-aided diagnosis system using deep learning for multiclass skin lesion classification. Comput. Intell. Neurosci. (2021)

  • Attique Khan, M., Sharif, M., Akram, T., Kadry, S., Hsu, C.H.: A two‐stream deep neural network‐based intelligent system for complex skin cancer types classification. Int. J. Intell. Syst (2021).

  • Bashir, S.M.A., Wang, Y., Khan, M., Niu, Y.: A comprehensive review of deep learning-based single image super-resolution. PeerJ Comput. Sci. 7, e621 (2021)

    Google Scholar 

  • Baur, C., Albarqouni, S., Navab, N.: MelanoGANs: high resolution skin lesion synthesis with GANs. 2018. arXiv preprint arXiv:1804.04338.

  • Benbrahim, H., Hachimi, H., Amine, A.: Deep convolutional neural network with TensorFlow and Keras to classify skin cancer images. Scalable Comput. Pract. Exp. 21(3), 379–390 (2020)

    Google Scholar 

  • Bibi, A., Khan, M. A., Javed, M. Y., Tariq, U., Kang, B. G., Nam, Y., Mostafa, R.R., Sakr, R. H.: Skin lesion segmentation and classification using conventional and deep learning based framework (2022a)

  • Bibi, A., Khan, M.A., Javed, M.Y., Tariq, U., Kang, B.G., Nam, Y., Mostafa, R.R., Sakr, R.H.: Skin lesion segmentation and classification using conventional and deep learning based framework. CMC-Comput. Mater. Continua 71(2), 2477–2495 (2022b)

    Google Scholar 

  • Bing, X., et al.: Medical image super resolution using improved generative adversarial networks. IEEE Access 7, 145030–145038 (2019)

    Google Scholar 

  • Çelik, G., Talu, M.F.: Resizing and cleaning of histopathological images using generative adversarial networks. Phys. Stat. Mech. Appl. 554, 122652 (2020)

    MATH  Google Scholar 

  • Chaturvedi, S.S., Tembhurne, J.V., Diwan, T.: A multi-class skin Cancer classification using deep convolutional neural networks. Multimedia Tools Appl. 79(39), 28477–28498 (2020)

    Google Scholar 

  • Chen, Y, et al.: Efficient and accurate MRI super-resolution using a generative adversarial network and 3D multi-level densely connected network. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer (2018).

  • Eklund, A., et al.: Medical image processing on the GPU–Past, present and future. Med. Image Anal. 17(8), 1073–1094 (2013)

    Google Scholar 

  • Elashry, I.F., El-Shafai, W., Hasan, E.S., El-Rabaie, S., Abbas, A.M., El-Samie, A., El-Sayed, H.S., Faragallah, O.S.: Efficient chaotic-based image cryptosystem with different modes of operation. Multimedia Tools Appl. 79(29), 20665–20687 (2020)

    Google Scholar 

  • El-Hag, N.A., Sedik, A., El-Shafai, W., El-Hoseny, H.M., Khalaf, A.A., El-Fishawy, A.S., Al-Nuaimy, W., Abd El-Samie, F.E., El-Banby, G.M.: Classification of retinal images based on convolutional neural network. Microsc. Res. Tech. 84(3), 394–414 (2021)

    Google Scholar 

  • El-Shafai, W.: Pixel-level matching based multi-hypothesis error concealment modes for wireless 3D H. 264/MVC communication. 3D Res. 6(3), 1–11 (2015a)

    Google Scholar 

  • El-Shafai, W.: Joint adaptive pre-processing resilience and post-processing concealment schemes for 3D video transmission. 3D Res. 6(1), 1–13 (2015b)

    Google Scholar 

  • El Shafai, W., Hrušovský, B., El-Khamy, M., El-Sharkawy, M.: Joint space-time-view error concealment algorithms for 3D multi-view video. In: 2011 18th IEEE International Conference on Image Processing, pp. 2201–2204. IEEE (2011)

  • El-Shafai, W., Abd El-Samie, F.: Extensive COVID-19 X-ray and CT chest images dataset. Mendeley Data 3(10) (2020)

  • El-Shafai, W., El-Rabaie, S., El-Halawany, M., El-Samie, A.: Enhancement of wireless 3d video communication using color-plus-depth error restoration algorithms and Bayesian Kalman filtering. Wirel. Pers. Commun. 97(1), 245–268 (2017)

    Google Scholar 

  • El-Shafai, W., El-Rabaie, S., El-Halawany, M.M., El-Samie, A., Fathi, E.: Encoder-independent decoder-dependent depth-assisted error concealment algorithm for wireless 3D video communication. Multimedia Tools Appl. 77(11), 13145–13172 (2018a)

    Google Scholar 

  • El-Shafai, W., El-Rabaie, E.S.M., El-Halawany, M., El-Samie, F.E.A.: Efficient multi-level security for robust 3D color-plus-depth HEVC. Multimedia Tools Appl. 77(23), 30911–30937 (2018b)

    Google Scholar 

  • El-Shafai, W., El-Rabaie, S., El-Halawany, M.M., Abd El-Samie, F.E.: Efficient hybrid watermarking schemes for robust and secure 3D-MVC communication. Int. J. Commun Syst 31(4), e3478 (2018c)

    Google Scholar 

  • El-Shafai, W., El-Rabaie, S., El-Halawany, M.M., Abd El-Samie, F.E.: Security of 3D-HEVC transmission based on fusion and watermarking techniques. Multimedia Tools Appl. 78(19), 27211–27244 (2019)

    Google Scholar 

  • El-Shafai, W., Khallaf, F., El-Rabaie, E.S.M., El-Samie, F.E.A.: Robust medical image encryption based on DNA-chaos cryptosystem for secure telemedicine and healthcare applications. J. Ambient. Intell. Humaniz. Comput. 12(10), 9007–9035 (2021a)

    Google Scholar 

  • El-Shafai, W., Almomani, I.M., Alkhayer, A.: Optical bit-plane-based 3D-JST cryptography algorithm with cascaded 2D-FrFT encryption for efficient and secure HEVC communication. IEEE Access 9, 35004–35026 (2021b)

    Google Scholar 

  • Faragallah, O.S., Alzain, M.A., El-Sayed, H.S., Al-Amri, J.F., El-Shafai, W., Afifi, A., Naeem, E.A., Soh, B.: Block-based optical color image encryption based on double random phase encoding. IEEE Access 7, 4184–4194 (2018)

    Google Scholar 

  • Faragallah, O.S., Afifi, A., El-Shafai, W., El-Sayed, H.S., Naeem, E.A., Alzain, M.A., Al-Amri, J.F., Soh, B., Abd El-Samie, F.E.: Investigation of chaotic image encryption in spatial and FrFT domains for cybersecurity applications. IEEE Access 8, 42491–42503 (2020a)

    Google Scholar 

  • Faragallah, O.S., El-Hoseny, H., El-Shafai, W., Abd El-Rahman, W., El-Sayed, H.S., El-Rabaie, E.S.M., Abd El-Samie, F.E., Geweid, G.G.: A comprehensive survey analysis for present solutions of medical image fusion and future directions. IEEE Access 9, 11358–11371 (2020b)

    Google Scholar 

  • Faragallah, O.S., AlZain, M.A., El-Sayed, H.S., Al-Amri, J.F., El-Shafai, W., Afifi, A., Naeem, E.A., Soh, B.: Secure color image cryptosystem based on chaotic logistic in the FrFT domain. Multimedia Tools and Applications 79(3), 2495–2519 (2020c)

    Google Scholar 

  • Faragallah, O.S., Afifi, A., El-Shafai, W., El-Sayed, H.S., Alzain, M.A., Al-Amri, J.F., Abd El-Samie, F.E.: Efficiently encrypting color images with few details based on RC6 and different operation modes for cybersecurity applications. IEEE Access 8, 103200–103218 (2020d)

    Google Scholar 

  • Faragallah, O.S., Afifi, A., El-Sayed, H.S., Alzain, M.A., Al-Amri, J.F., Abd El-Samie, F.E., El-Shafai, W.: Efficient HEVC integrity verification scheme for multimedia cybersecurity applications. IEEE Access 8, 167069–167089 (2020e)

    Google Scholar 

  • Faragallah, O.S., El-sayed, H.S., Afifi, A., El-Shafai, W.: Efficient and secure opto-cryptosystem for color images using 2D logistic-based fractional Fourier transform. Opt. Lasers Eng. 137, 106333 (2021)

    Google Scholar 

  • Faragallah, O.S., El-Shafai, W., Sallam, A.I., Elashry, I., EL-Rabaie, E.S.M., Afifi, A., AlZain, M.A., Al-Amri, J., Abd El-Samie, F.E., El-sayed, H.S.: Cybersecurity framework of hybrid watermarking and selective encryption for secure HEVC communication. J. Ambient Intell. Human. Comput. 13(2), 1215–1239 (2022)

    Google Scholar 

  • Goodfellow, I.: NIPS 2016 tutorial: Generative adversarial networks. arXiv:1701.00160, 2017, [online] Available: http://arxiv.org/abs/1701.00160.

  • Howard, A.G., et al.: MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications (2017).

  • Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 4700–4708 (2017)‏

  • Ibrahim, S., Egila, M.G., Shawky, H., Elsaid, M.K., El-Shafai, W., El-Samie, A., Fathi, E.: Cancelable face and fingerprint recognition based on the 3D jigsaw transform and optical encryption. Multimedia Tools Appl. 79(19), 14053–14078 (2020)

    Google Scholar 

  • Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. In: European Conference on Computer Vision. Springer, Berlin (2016)

  • Khan, M.A., Javed, M.Y., Sharif, M., Saba, T., Rehman, A.: Multi-model deep neural network based features extraction and optimal selection approach for skin lesion classification. In: Proceedingd of ICCIS, Sakaka, Saudi Arabia, pp. 1–7 (2019)

  • Khan, M.A., Sharif, M., Akram, T., Damaševičius, R., Maskeliūnas, R.: Skin lesion segmentation and multiclass classification using deep learning features and improved moth flame optimization. Diagnostics 11(5), 811 (2021a)

    Google Scholar 

  • Khan, M.A., Muhammad, K., Sharif, M., Akram, T., de Albuquerque, V.H.C.: Multi-class skin lesion detection and classification via teledermatology. IEEE J. Biomed. Health Inform. 25(12), 4267–4275 (2021b)

    Google Scholar 

  • Khan, M.A., Akram, T., Zhang, Y.D., Sharif, M.: Attributes based skin lesion detection and recognition: A mask RCNN and transfer learning-based deep learning framework. Pattern Recogn. Lett. 143, 58–66 (2021c)

    ADS  Google Scholar 

  • Khan, M.A., Muhammad, K., Sharif, M., Akram, T., Kadry, S.: Intelligent fusion-assisted skin lesion localization and classification for smart healthcare. Neural Comput. Appl. 1–16 (2021d)

  • Khan, M. A., Akram, T., Sharif, M., Kadry, S., Nam, Y.: Computer decision support system for skin cancer localization and classification (2021e)

  • Khan, M.A., Sharif, M.I., Raza, M., Anjum, A., Saba, T., Shad, S.A.: Skin lesion segmentation and classification: A unified framework of deep neural network features fusion and selection. Expert. Syst. 39(7), e12497 (2022a)

    Google Scholar 

  • Khan, M.D., Uddin, A.H., Nahid, A.A., Bairagi, A.K.: Skin cancer detection from low-resolution images using transfer learning. In: Intelligent Sustainable Systems (pp. 317–334). Springer, Singapore (2022b)

  • Ledig, C., Theis, L., Huszár, F., Caballero, J., Cunningham, A., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, pp. 105–114 (2017)

  • Ledig, C., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)

  • Li, Z., Wang, Y., Yu, J.: Reconstruction of thin-slice medical images using generative adversarial network. In: International Workshop on Machine Learning in Medical Imaging. Springer (2017)

  • Lim, B., Son, S., Kim, H., Nah, S., Mu Lee, K.: Enhanced deep residual networks for single image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 136–144 (2017)‏

  • Lin, W., Jay Kuo, C.C.: Perceptual visual quality metrics: a survey. J. vis. Commun. Image Represent. 22(4), 297–312 (2011)

    Google Scholar 

  • Mahapatra, D., Bozorgtabar, B., Garnavi, R.: Image super-resolution using progressive generative adversarial networks for medical image analysis. Comput. Med. Imag Graph. 71, 30–39 (2019)

    Google Scholar 

  • Mahapatra, D., Bozorgtabar, B.: Progressive generative adversarial networks for medical image super resolution (2019). arXiv preprint arXiv:1902.02144.

  • Mohamed, E.H., Behaidy, W.H.: Enhanced skin lesions classification using deep convolutional networks. In: Proceedings of ICICIS, Cairo, Egypt, pp. 180–188 (2019)

  • Shahin, A. H., Kamal, A., Elattar, M.A.: Deep ensemble learning for skin lesion classification from dermoscopic images. In: Proceedings of CIBEC, Cairo, Egypt, pp. 150–153 (2018)

  • Shahidi, F., Daud, S.M., Abas, H., Ahmad, N.A., Maarop, N.: Breast cancer classification using deep learning approaches and histopathology image: a comparison study. IEEE Access 8, 187531–187552 (2020)

    Google Scholar 

  • Shi, W., Caballero, J., Huszár, F., Totz, J., Aitken, A. P., Bishop, R., Rueckert, D., Wang, Z.: Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1874–1883‏ (2016)

  • Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition (2014). arXiv preprint arXiv:1409.1556.

  • Soliman, N.F., Khalil, M.I., Algarni, A.D., Ismail, S., Marzouk, R., El-Shafai, W.: Efficient HEVC steganography approach based on audio compression and encryption in QFFT domain for secure multimedia communication. Multimedia Tools Appl. 80(3), 4789–4823 (2021)

    Google Scholar 

  • Sood, R., Rusu, M.: Anisotropic super resolution in prostate mri using super resolution generative adversarial networks. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019). IEEE (2019).

  • Spanhol, F.A., Oliveira, L.S., Petitjean, C., Heutte, L.: A dataset for breast cancer histopathological image classification. IEEE Trans. Biomed. Eng. 63(7), 1455–1462 (2016)

    Google Scholar 

  • Thurnhofer, K., Dominguez, E.: A convolutional neural network framework for accurate skin cancer detection. Neural Process. Lett. 1(1), 1–21 (2020)

    Google Scholar 

  • Thuy, M.B.H., Hoang, V.T.: Fusing of deep learning, transfer learning and gan for breast cancer histopathological image classification. In: International Conference on Computer Science, Applied Mathematics and Applications, pp. 255–266. Springer, Cham (2019).‏

  • Villa-Pulgarin, J.P., Ruales-Torres, A.A., Arias-Garzon, D., Bravo-Ortiz, M.A., Arteaga-Arteaga, H.B., Mora-Rubio, A., Grisales, J.A.A., Mercado-Ruiz, E., Hassaballah, M., Arias, S.O., Cardona-Morales, O., Tabares-Soto, R.: Optimized convolutional neural network models for skin lesion classification. CMC-Comput. Mater. Continua 70(2), 2131–2148 (2022)

    Google Scholar 

  • Wang, Z., Simoncelli, E.P., Bovik, A.C.: Multiscale structural similarity for image quality assessment. In: The Thrity-Seventh Asilomar Conference on Signals, Systems Computers, vol. 2, pp. 1398–1402 (2003). https://doi.org/10.1109/ACSSC.2003.1292216.

  • Wang, Z., Bovik, A., Sheikh, H., Simoncelli, E.: Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    ADS  Google Scholar 

  • Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., Change Loy, C.: Esrgan: Enhanced super-resolution generative adversarial networks. In: Proceedings of the European Conference on Computer Vision (ECCV) Workshops (2018a)

  • Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Loy, C.C., Qiao, Y., Change Loy, C.: Esrgan: Enhanced super-resolution generative adversarial networks. In: Proceedings of the European Conference on Computer Vision (ECCV) workshops (2018b).‏

  • Wang, Z., Chen, J., Hoi, S. C.: Deep learning for image super-resolution: a survey. IEEE Trans. Pattern Anal. Mach. Intell.‏ (2020)

  • Wang, P., Wang, J., Li, Y., Li, P., Li, L., Jiang, M.: Automatic classification of breast cancer histopathological images based on deep feature fusion and enhanced routing. Biomed. Signal Process. Control 65, 102341 (2021)

    Google Scholar 

  • Xie, S., Girshick, R., Dollár, P., Tu, Z., He, K.: Aggregated residual transformations for deep neural networks. In: Proceedings of 30th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1492–1500 (2017). Available: https://arxiv.org/abs/1611.05431v2.

  • Xu, L., et al.: Low-dose chest X-ray image super-resolution using generative adversarial nets with spectral normalization. Biomed. Signal Process. Contr 55, 101600 (2020)

    Google Scholar 

  • Yu X, Porikli F. Face hallucination with tiny unaligned images by transformative discriminative neural networks. In: Thirty-First AAAI Conference on Artificial Intelligence (2017)

  • Yu, J., Fan, Y., Yang, J., Xu, N., Wang, Z., Wang, X., Huang, T.: Wide activation for efficient and accurate image super-resolution. arXiv preprint arXiv:1808.08718‏ (2018)

  • Zhao, M., et al.: Super-resolution of cardiac magnetic resonance images using Laplacian Pyramid based on Generative Adversarial Networks. Comput Med Imag Graph 80, 101698 (2020)

    Google Scholar 

Download references

Funding

The authors did not receive support from any organization for the submitted work.

Author information

Authors and Affiliations

Authors

Contributions

All authors are equally contributed.

Corresponding author

Correspondence to Walid El-Shafai.

Ethics declarations

Competing interests

The authors have no relevant financial or non-financial interests to disclose.

Ethics approval

All authors are contributing and accepting to submit the current work.

Consent to participate

All authors are contributing and accepting to submit the current work.

Consent for publication

All authors are accepting to submit and publish the submitted work.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abd El-Fattah, I., Ali, A.M., El-Shafai, W. et al. Deep-learning-based super-resolution and classification framework for skin disease detection applications. Opt Quant Electron 55, 427 (2023). https://doi.org/10.1007/s11082-022-04432-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11082-022-04432-x

Keywords

Navigation