skip to main content
10.1145/3529190.3529214acmotherconferencesArticle/Chapter ViewAbstractPublication PagespetraConference Proceedingsconference-collections
research-article

Diabetic foot ulcers monitoring by employing super resolution and noise reduction deep learning techniques

Published:11 July 2022Publication History

ABSTRACT

Diabetic foot ulcers (DFUs) constitute a serious complication for people with diabetes. The care of DFU patients can be substantially improved through self-management, in order to achieve early-diagnosis, ulcer prevention, and complications management in existing ulcers. In this paper, we investigate two categories of image-to-image translation techniques (ItITT), which will support decision making and monitoring of diabetic foot ulcers: noise reduction and super-resolution. In the former case, we investigated the capabilities on noise removal, for convolutional neural network stacked-autoencoders (CNN-SAE). CNN-SAE was tested on RGB images, induced with Gaussian noise. The latter scenario involves the deployment of four deep learning super-resolution models. The performance of all models, for both scenarios, was evaluated in terms of execution time and perceived quality. Results indicate that applied techniques consist a viable and easy to implement alternative that should be used by any system designed for DFU monitoring.

References

  1. David G Armstrong, Andrew JM Boulton, and Sicco A Bus. 2017. Diabetic foot ulcers and their recurrence. New England Journal of Medicine 376, 24 (2017), 2367–2375.Google ScholarGoogle ScholarCross RefCross Ref
  2. Dominic Asamoah, Emmanuel Ofori, Stephen Opoku, and Juliana Danso. 2018. Measuring the performance of image contrast enhancement technique. International Journal of Computer Applications 181, 22(2018), 6–13.Google ScholarGoogle ScholarCross RefCross Ref
  3. Marco Bevilacqua, Aline Roumy, Christine Guillemot, and Marie Line Alberi-Morel. 2012. Low-complexity single-image super-resolution based on nonnegative neighbor embedding. (2012).Google ScholarGoogle Scholar
  4. Harold C Burger, Christian J Schuler, and Stefan Harmeling. 2012. Image denoising: Can plain neural networks compete with BM3D?. In 2012 IEEE conference on computer vision and pattern recognition. IEEE, 2392–2399.Google ScholarGoogle ScholarCross RefCross Ref
  5. Bill Cassidy, Neil D Reeves, Joseph M Pappachan, David Gillespie, Claire O’Shea, Satyan Rajbhandari, Arun G Maiya, Eibe Frank, Andrew JM Boulton, David G Armstrong, 2021. The DFUC 2020 dataset: Analysis towards diabetic foot ulcer detection. touchREVIEWS in Endocrinology 17, 1 (2021), 5.Google ScholarGoogle Scholar
  6. Richard Dosselmann and Xue Dong Yang. 2011. A comprehensive assessment of the structural similarity index. Signal, Image and Video Processing 5, 1 (2011), 81–91.Google ScholarGoogle ScholarCross RefCross Ref
  7. Anastasios Doulamis, Nikolaos Doulamis, Aikaterini Angeli, Andreas Lazaris, Siri Luthman, Murali Jayapala, Günther Silbernagel, Adriane Napp, Ioannis Lazarou, Alexandros Karalis, 2021. A Non-Invasive Photonics-Based Device for Monitoring of Diabetic Foot Ulcers: Architectural/Sensorial Components & Technical Specifications. Inventions 6, 2 (2021), 27.Google ScholarGoogle ScholarCross RefCross Ref
  8. Francesco Cardinale et al.2018. ISR. https://github.com/idealo/image-super-resolution.Google ScholarGoogle Scholar
  9. Swarup Kr Ghosh, Biswajit Biswas, and Anupam Ghosh. 2019. SDCA: a novel stack deep convolutional autoencoder–an application on retinal image denoising. IET Image Processing 13, 14 (2019), 2778–2789.Google ScholarGoogle ScholarCross RefCross Ref
  10. Lovedeep Gondara. 2016. Medical image denoising using convolutional denoising autoencoders. In 2016 IEEE 16th international conference on data mining workshops (ICDMW). IEEE, 241–246.Google ScholarGoogle ScholarCross RefCross Ref
  11. Manu Goyal, Neil D Reeves, Adrian K Davison, Satyan Rajbhandari, Jennifer Spragg, and Moi Hoon Yap. 2018. Dfunet: Convolutional neural networks for diabetic foot ulcer classification. IEEE Transactions on Emerging Topics in Computational Intelligence 4, 5(2018), 728–739.Google ScholarGoogle ScholarCross RefCross Ref
  12. Manu Goyal, Neil D Reeves, Satyan Rajbhandari, Naseer Ahmad, Chuan Wang, and Moi Hoon Yap. 2020. Recognition of ischaemia and infection in diabetic foot ulcers: Dataset and techniques. Computers in biology and medicine 117 (2020), 103616.Google ScholarGoogle Scholar
  13. Manu Goyal, Neil D Reeves, Satyan Rajbhandari, and Moi Hoon Yap. 2018. Robust methods for real-time diabetic foot ulcer detection and localization on mobile devices. IEEE journal of biomedical and health informatics 23, 4(2018), 1730–1741.Google ScholarGoogle Scholar
  14. Manu Goyal, Moi Hoon Yap, Neil D Reeves, Satyan Rajbhandari, and Jennifer Spragg. 2017. Fully convolutional networks for diabetic foot ulcer segmentation. In 2017 IEEE international conference on systems, man, and cybernetics (SMC). IEEE, 618–623.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770–778.Google ScholarGoogle ScholarCross RefCross Ref
  16. Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International conference on machine learning. PMLR, 448–456.Google ScholarGoogle Scholar
  17. Justin Johnson, Alexandre Alahi, and Li Fei-Fei. 2016. Perceptual losses for real-time style transfer and super-resolution. In European conference on computer vision. Springer, 694–711.Google ScholarGoogle ScholarCross RefCross Ref
  18. Alexia Jolicoeur-Martineau. 2018. The relativistic discriminator: a key element missing from standard GAN. arXiv preprint arXiv:1807.00734(2018).Google ScholarGoogle Scholar
  19. Shizuo Kaji and Satoshi Kida. 2019. Overview of image-to-image translation by use of deep neural networks: denoising, super-resolution, modality conversion, and reconstruction in medical imaging. Radiological physics and technology 12, 3 (2019), 235–248.Google ScholarGoogle Scholar
  20. Christian Ledig, Lucas Theis, Ferenc Huszár, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew Aitken, Alykhan Tejani, Johannes Totz, Zehan Wang, 2017. Photo-realistic single image super-resolution using a generative adversarial network. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4681–4690.Google ScholarGoogle ScholarCross RefCross Ref
  21. Chuan Li and Michael Wand. 2016. Combining markov random fields and convolutional neural networks for image synthesis. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2479–2486.Google ScholarGoogle ScholarCross RefCross Ref
  22. Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and Kyoung Mu Lee. 2017. Enhanced deep residual networks for single image super-resolution. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops. 136–144.Google ScholarGoogle ScholarCross RefCross Ref
  23. Yan Liu and Yi Zhang. 2018. Low-dose CT restoration via stacked sparse denoising autoencoders. Neurocomputing 284(2018), 80–89.Google ScholarGoogle ScholarCross RefCross Ref
  24. Hind Oulhaj, Aouatif Amine, Mohammed Rziza, and Driss Aboutajdine. 2012. Noise Reduction in Medical Images - comparison of noise removal algorithms -. In 2012 International Conference on Multimedia Computing and Systems. 344–349. https://doi.org/10.1109/ICMCS.2012.6320218Google ScholarGoogle ScholarCross RefCross Ref
  25. Irina Sánchez and Verónica Vilaplana. 2018. Brain MRI super-resolution using 3D generative adversarial networks. arXiv preprint arXiv:1812.11440(2018).Google ScholarGoogle Scholar
  26. Umme Sara, Morium Akter, and Mohammad Shorif Uddin. 2019. Image quality assessment through FSIM, SSIM, MSE and PSNR—a comparative study. Journal of Computer and Communications 7, 3 (2019), 8–18.Google ScholarGoogle ScholarCross RefCross Ref
  27. Radu Timofte, Vincent De Smet, and Luc Van Gool. 2013. Anchored neighborhood regression for fast example-based super-resolution. In Proceedings of the IEEE international conference on computer vision. 1920–1927.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Jack Tulloch, Reza Zamani, and Mohammad Akrami. 2020. Machine learning in the prevention, diagnosis and management of diabetic foot ulcers: a systematic review. IEEE Access 8(2020), 198977–199000.Google ScholarGoogle ScholarCross RefCross Ref
  29. Kensuke Umehara, Junko Ota, and Takayuki Ishida. 2017. Super-resolution imaging of mammograms based on the super-resolution convolutional neural network. Open Journal of Medical Imaging 7, 4 (2017), 180–195.Google ScholarGoogle ScholarCross RefCross Ref
  30. Kensuke Umehara, Junko Ota, and Takayuki Ishida. 2018. Application of super-resolution convolutional neural network for enhancing image resolution in chest CT. Journal of digital imaging 31, 4 (2018), 441–450.Google ScholarGoogle ScholarCross RefCross Ref
  31. Pascal Vincent, Hugo Larochelle, Yoshua Bengio, and Pierre-Antoine Manzagol. 2008. Extracting and composing robust features with denoising autoencoders. In Proceedings of the 25th international conference on Machine learning. 1096–1103.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Athanasios Voulodimos, Nikolaos Doulamis, Anastasios Doulamis, and Eftychios Protopapadakis. 2018. Deep learning for computer vision: A brief review. Computational intelligence and neuroscience 2018 (2018).Google ScholarGoogle Scholar
  33. Xintao Wang, Ke Yu, Shixiang Wu, Jinjin Gu, Yihao Liu, Chao Dong, Yu Qiao, and Chen Change Loy. 2018. Esrgan: Enhanced super-resolution generative adversarial networks. In Proceedings of the European conference on computer vision (ECCV) workshops. 0–0.Google ScholarGoogle Scholar
  34. Junyuan Xie, Linli Xu, and Enhong Chen. 2012. Image denoising and inpainting with deep neural networks. In Advances in neural information processing systems. 341–349.Google ScholarGoogle Scholar
  35. Moi Hoon Yap, Bill Cassidy, Joseph M Pappachan, Claire O’Shea, David Gillespie, and Neil D Reeves. 2021. Analysis towards classification of infection and ischaemia of diabetic foot ulcers. In 2021 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI). IEEE, 1–4.Google ScholarGoogle ScholarCross RefCross Ref
  36. Moi Hoon Yap, Ryo Hachiuma, Azadeh Alavi, Raphael Brüngel, Bill Cassidy, Manu Goyal, Hongtao Zhu, Johannes Rückert, Moshe Olshansky, Xiao Huang, 2021. Deep learning in diabetic foot ulcers detection: a comprehensive evaluation. Computers in Biology and Medicine(2021), 104596.Google ScholarGoogle Scholar
  37. Moi Hoon Yap, Neil Reeves, Andrew Boulton, Satyan Rajbhandari, David Armstrong, Arun G. Maiya, Bijan Najafi, Eibe Frank, and Justina Wu. 2020. Diabetic Foot Ulcers Grand Challenge 2020. https://doi.org/10.5281/zenodo.3731068Google ScholarGoogle Scholar
  38. Yulun Zhang, Yapeng Tian, Yu Kong, Bineng Zhong, and Yun Fu. 2018. Residual dense network for image super-resolution. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2472–2481.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Diabetic foot ulcers monitoring by employing super resolution and noise reduction deep learning techniques
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          PETRA '22: Proceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments
          June 2022
          704 pages
          ISBN:9781450396318
          DOI:10.1145/3529190

          Copyright © 2022 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 11 July 2022

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed limited

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format