ABSTRACT
Diabetic foot ulcers (DFUs) constitute a serious complication for people with diabetes. The care of DFU patients can be substantially improved through self-management, in order to achieve early-diagnosis, ulcer prevention, and complications management in existing ulcers. In this paper, we investigate two categories of image-to-image translation techniques (ItITT), which will support decision making and monitoring of diabetic foot ulcers: noise reduction and super-resolution. In the former case, we investigated the capabilities on noise removal, for convolutional neural network stacked-autoencoders (CNN-SAE). CNN-SAE was tested on RGB images, induced with Gaussian noise. The latter scenario involves the deployment of four deep learning super-resolution models. The performance of all models, for both scenarios, was evaluated in terms of execution time and perceived quality. Results indicate that applied techniques consist a viable and easy to implement alternative that should be used by any system designed for DFU monitoring.
- David G Armstrong, Andrew JM Boulton, and Sicco A Bus. 2017. Diabetic foot ulcers and their recurrence. New England Journal of Medicine 376, 24 (2017), 2367–2375.Google ScholarCross Ref
- Dominic Asamoah, Emmanuel Ofori, Stephen Opoku, and Juliana Danso. 2018. Measuring the performance of image contrast enhancement technique. International Journal of Computer Applications 181, 22(2018), 6–13.Google ScholarCross Ref
- Marco Bevilacqua, Aline Roumy, Christine Guillemot, and Marie Line Alberi-Morel. 2012. Low-complexity single-image super-resolution based on nonnegative neighbor embedding. (2012).Google Scholar
- Harold C Burger, Christian J Schuler, and Stefan Harmeling. 2012. Image denoising: Can plain neural networks compete with BM3D?. In 2012 IEEE conference on computer vision and pattern recognition. IEEE, 2392–2399.Google ScholarCross Ref
- Bill Cassidy, Neil D Reeves, Joseph M Pappachan, David Gillespie, Claire O’Shea, Satyan Rajbhandari, Arun G Maiya, Eibe Frank, Andrew JM Boulton, David G Armstrong, 2021. The DFUC 2020 dataset: Analysis towards diabetic foot ulcer detection. touchREVIEWS in Endocrinology 17, 1 (2021), 5.Google Scholar
- Richard Dosselmann and Xue Dong Yang. 2011. A comprehensive assessment of the structural similarity index. Signal, Image and Video Processing 5, 1 (2011), 81–91.Google ScholarCross Ref
- Anastasios Doulamis, Nikolaos Doulamis, Aikaterini Angeli, Andreas Lazaris, Siri Luthman, Murali Jayapala, Günther Silbernagel, Adriane Napp, Ioannis Lazarou, Alexandros Karalis, 2021. A Non-Invasive Photonics-Based Device for Monitoring of Diabetic Foot Ulcers: Architectural/Sensorial Components & Technical Specifications. Inventions 6, 2 (2021), 27.Google ScholarCross Ref
- Francesco Cardinale et al.2018. ISR. https://github.com/idealo/image-super-resolution.Google Scholar
- Swarup Kr Ghosh, Biswajit Biswas, and Anupam Ghosh. 2019. SDCA: a novel stack deep convolutional autoencoder–an application on retinal image denoising. IET Image Processing 13, 14 (2019), 2778–2789.Google ScholarCross Ref
- Lovedeep Gondara. 2016. Medical image denoising using convolutional denoising autoencoders. In 2016 IEEE 16th international conference on data mining workshops (ICDMW). IEEE, 241–246.Google ScholarCross Ref
- Manu Goyal, Neil D Reeves, Adrian K Davison, Satyan Rajbhandari, Jennifer Spragg, and Moi Hoon Yap. 2018. Dfunet: Convolutional neural networks for diabetic foot ulcer classification. IEEE Transactions on Emerging Topics in Computational Intelligence 4, 5(2018), 728–739.Google ScholarCross Ref
- Manu Goyal, Neil D Reeves, Satyan Rajbhandari, Naseer Ahmad, Chuan Wang, and Moi Hoon Yap. 2020. Recognition of ischaemia and infection in diabetic foot ulcers: Dataset and techniques. Computers in biology and medicine 117 (2020), 103616.Google Scholar
- Manu Goyal, Neil D Reeves, Satyan Rajbhandari, and Moi Hoon Yap. 2018. Robust methods for real-time diabetic foot ulcer detection and localization on mobile devices. IEEE journal of biomedical and health informatics 23, 4(2018), 1730–1741.Google Scholar
- Manu Goyal, Moi Hoon Yap, Neil D Reeves, Satyan Rajbhandari, and Jennifer Spragg. 2017. Fully convolutional networks for diabetic foot ulcer segmentation. In 2017 IEEE international conference on systems, man, and cybernetics (SMC). IEEE, 618–623.Google ScholarDigital Library
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770–778.Google ScholarCross Ref
- Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International conference on machine learning. PMLR, 448–456.Google Scholar
- Justin Johnson, Alexandre Alahi, and Li Fei-Fei. 2016. Perceptual losses for real-time style transfer and super-resolution. In European conference on computer vision. Springer, 694–711.Google ScholarCross Ref
- Alexia Jolicoeur-Martineau. 2018. The relativistic discriminator: a key element missing from standard GAN. arXiv preprint arXiv:1807.00734(2018).Google Scholar
- Shizuo Kaji and Satoshi Kida. 2019. Overview of image-to-image translation by use of deep neural networks: denoising, super-resolution, modality conversion, and reconstruction in medical imaging. Radiological physics and technology 12, 3 (2019), 235–248.Google Scholar
- Christian Ledig, Lucas Theis, Ferenc Huszár, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew Aitken, Alykhan Tejani, Johannes Totz, Zehan Wang, 2017. Photo-realistic single image super-resolution using a generative adversarial network. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4681–4690.Google ScholarCross Ref
- Chuan Li and Michael Wand. 2016. Combining markov random fields and convolutional neural networks for image synthesis. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2479–2486.Google ScholarCross Ref
- Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and Kyoung Mu Lee. 2017. Enhanced deep residual networks for single image super-resolution. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops. 136–144.Google ScholarCross Ref
- Yan Liu and Yi Zhang. 2018. Low-dose CT restoration via stacked sparse denoising autoencoders. Neurocomputing 284(2018), 80–89.Google ScholarCross Ref
- Hind Oulhaj, Aouatif Amine, Mohammed Rziza, and Driss Aboutajdine. 2012. Noise Reduction in Medical Images - comparison of noise removal algorithms -. In 2012 International Conference on Multimedia Computing and Systems. 344–349. https://doi.org/10.1109/ICMCS.2012.6320218Google ScholarCross Ref
- Irina Sánchez and Verónica Vilaplana. 2018. Brain MRI super-resolution using 3D generative adversarial networks. arXiv preprint arXiv:1812.11440(2018).Google Scholar
- Umme Sara, Morium Akter, and Mohammad Shorif Uddin. 2019. Image quality assessment through FSIM, SSIM, MSE and PSNR—a comparative study. Journal of Computer and Communications 7, 3 (2019), 8–18.Google ScholarCross Ref
- Radu Timofte, Vincent De Smet, and Luc Van Gool. 2013. Anchored neighborhood regression for fast example-based super-resolution. In Proceedings of the IEEE international conference on computer vision. 1920–1927.Google ScholarDigital Library
- Jack Tulloch, Reza Zamani, and Mohammad Akrami. 2020. Machine learning in the prevention, diagnosis and management of diabetic foot ulcers: a systematic review. IEEE Access 8(2020), 198977–199000.Google ScholarCross Ref
- Kensuke Umehara, Junko Ota, and Takayuki Ishida. 2017. Super-resolution imaging of mammograms based on the super-resolution convolutional neural network. Open Journal of Medical Imaging 7, 4 (2017), 180–195.Google ScholarCross Ref
- Kensuke Umehara, Junko Ota, and Takayuki Ishida. 2018. Application of super-resolution convolutional neural network for enhancing image resolution in chest CT. Journal of digital imaging 31, 4 (2018), 441–450.Google ScholarCross Ref
- Pascal Vincent, Hugo Larochelle, Yoshua Bengio, and Pierre-Antoine Manzagol. 2008. Extracting and composing robust features with denoising autoencoders. In Proceedings of the 25th international conference on Machine learning. 1096–1103.Google ScholarDigital Library
- Athanasios Voulodimos, Nikolaos Doulamis, Anastasios Doulamis, and Eftychios Protopapadakis. 2018. Deep learning for computer vision: A brief review. Computational intelligence and neuroscience 2018 (2018).Google Scholar
- Xintao Wang, Ke Yu, Shixiang Wu, Jinjin Gu, Yihao Liu, Chao Dong, Yu Qiao, and Chen Change Loy. 2018. Esrgan: Enhanced super-resolution generative adversarial networks. In Proceedings of the European conference on computer vision (ECCV) workshops. 0–0.Google Scholar
- Junyuan Xie, Linli Xu, and Enhong Chen. 2012. Image denoising and inpainting with deep neural networks. In Advances in neural information processing systems. 341–349.Google Scholar
- Moi Hoon Yap, Bill Cassidy, Joseph M Pappachan, Claire O’Shea, David Gillespie, and Neil D Reeves. 2021. Analysis towards classification of infection and ischaemia of diabetic foot ulcers. In 2021 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI). IEEE, 1–4.Google ScholarCross Ref
- Moi Hoon Yap, Ryo Hachiuma, Azadeh Alavi, Raphael Brüngel, Bill Cassidy, Manu Goyal, Hongtao Zhu, Johannes Rückert, Moshe Olshansky, Xiao Huang, 2021. Deep learning in diabetic foot ulcers detection: a comprehensive evaluation. Computers in Biology and Medicine(2021), 104596.Google Scholar
- Moi Hoon Yap, Neil Reeves, Andrew Boulton, Satyan Rajbhandari, David Armstrong, Arun G. Maiya, Bijan Najafi, Eibe Frank, and Justina Wu. 2020. Diabetic Foot Ulcers Grand Challenge 2020. https://doi.org/10.5281/zenodo.3731068Google Scholar
- Yulun Zhang, Yapeng Tian, Yu Kong, Bineng Zhong, and Yun Fu. 2018. Residual dense network for image super-resolution. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2472–2481.Google ScholarCross Ref
Index Terms
- Diabetic foot ulcers monitoring by employing super resolution and noise reduction deep learning techniques
Recommendations
An embedded wearable device for monitoring diabetic foot ulcer parameters
PETRA '20: Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive EnvironmentsDiabetic foot complication is one of the leading cause of non-traumatic lower extremity amputations. Due to diabetic complications such as neuropathy, diabetic patients do not feel any pain in their feet. Due to this they are often unaware of any ulcer ...
Application of Deep Learning Autoencoders as Features Extractor of Diabetic Foot Ulcer Images
Intelligent Computing MethodologiesAbstractDiabetic Foot Ulcer is one of the most common diabetic complications that can lead to amputation if not treated appropriately and timely. When diagnosed by professionals, diabetic foot ulcers can be extremely successful, but the diagnosis comes at ...
Diabetic Retinopathy Detection from Fundus Images Using Machine Learning Techniques : A Review
AbstractDiabetic retinopathy is one of the leading causes of blindness in today’s world. One of the major causes of Diabetic retinopathy is diabetes and also this occurs due to hereditary reasons. DR is classified into proliferative, non-proliferative and ...
Comments