Abstract
Deep (convolutional) neural networks (DCNN) have recently gained popularity, and shown improved performance in the field of image enhancement (de-noising and super-resolution, for instance). However, the central issue of recovering finer texture details in images still remains unsolved. State-of-the-art objective functions used in DCNN mostly focus on minimizing the mean squared reconstruction error. The resulting image estimates have high peak signal-to-noise ratios, but they are often lacking high-frequency details, and are therefore error-prone with respect to fine-scale, possibly clinically relevant details.
In this article, we present GANReDL, a generative adversarial network (GAN) for image enhancement equipped with a real-order derivative induced loss functions (ReDL) which we will show gives improved images, in particular wrt to the reconstruction of fine-scale details. To the best of our knowledge, this is the first framework that incorporates non-integer order derivatives in loss functions. To this aim, we propose a discriminator network that is trained to differentiate between the enhanced images and ground-truth images, and propose a new loss function motivated by real-order derivatives which is capable of also capturing global image features rather than pixel-wise features only. We show, with several numerical experiments, that GANReDL is better in reconstructing the high-frequency image details, and therefore show improved performance for image enhancement over other state-of-the-art methods.
We acknowledge support by the EPSRC Centre for Mathematical Imaging in Healthcare.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aly, H.A., Dubois, E.: Image up-sampling using total-variation regularization with a new observation model. IEEE Trans. Image Process. 14(10), 1647–1659 (2005)
Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 694–711. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46475-6_43
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: ICLR (2015)
Podlubny, I.: Fractional Differential Equations: An Introduction to Fractional Derivatives, Fractional Differential Equations, to Methods of Their Solution and Some of Their Applications. Academic Press Inc., San Diego (1999)
Kundu, D., Evans, B.L.: Full-reference visual quality assessment for synthetic images: a subjective study. In 2015 IEEE International Conference on Image Processing (ICIP), pp. 2374–2378. IEEE (2015)
Ledig, C., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4681–4690 (2017)
Lions, P., Osher, S., Rudin, L.: Denoising and deblurring images using constrained nonlinear partial differential equations, pp. 2800–2828. Preprint, Cognitech Inc. (1993)
Liu, P., Lu, X.Y.: Real order (an)-isotropic total variation in image processing - Part II: learning of optimal structures. arXiv e-prints arXiv:1903.08513 (2019)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)
Zhang, J., Chen, K.: A total fractional-order variation model for image restoration with nonhomogeneous boundary conditions and its numerical solution. SIAM J. Imaging Sci. 8(4), 2487–2518 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Liu, P., Li, C., Schönlieb, CB. (2019). GANReDL: Medical Image Enhancement Using a Generative Adversarial Network with Real-Order Derivative Induced Loss Functions. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11766. Springer, Cham. https://doi.org/10.1007/978-3-030-32248-9_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-32248-9_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32247-2
Online ISBN: 978-3-030-32248-9
eBook Packages: Computer ScienceComputer Science (R0)