Skip to main content

GANReDL: Medical Image Enhancement Using a Generative Adversarial Network with Real-Order Derivative Induced Loss Functions

  • Conference paper
  • First Online:
Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 (MICCAI 2019)

Abstract

Deep (convolutional) neural networks (DCNN) have recently gained popularity, and shown improved performance in the field of image enhancement (de-noising and super-resolution, for instance). However, the central issue of recovering finer texture details in images still remains unsolved. State-of-the-art objective functions used in DCNN mostly focus on minimizing the mean squared reconstruction error. The resulting image estimates have high peak signal-to-noise ratios, but they are often lacking high-frequency details, and are therefore error-prone with respect to fine-scale, possibly clinically relevant details.

In this article, we present GANReDL, a generative adversarial network (GAN) for image enhancement equipped with a real-order derivative induced loss functions (ReDL) which we will show gives improved images, in particular wrt to the reconstruction of fine-scale details. To the best of our knowledge, this is the first framework that incorporates non-integer order derivatives in loss functions. To this aim, we propose a discriminator network that is trained to differentiate between the enhanced images and ground-truth images, and propose a new loss function motivated by real-order derivatives which is capable of also capturing global image features rather than pixel-wise features only. We show, with several numerical experiments, that GANReDL is better in reconstructing the high-frequency image details, and therefore show improved performance for image enhancement over other state-of-the-art methods.

We acknowledge support by the EPSRC Centre for Mathematical Imaging in Healthcare.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aly, H.A., Dubois, E.: Image up-sampling using total-variation regularization with a new observation model. IEEE Trans. Image Process. 14(10), 1647–1659 (2005)

    Article  Google Scholar 

  2. Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 694–711. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46475-6_43

    Chapter  Google Scholar 

  3. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: ICLR (2015)

    Google Scholar 

  4. Podlubny, I.: Fractional Differential Equations: An Introduction to Fractional Derivatives, Fractional Differential Equations, to Methods of Their Solution and Some of Their Applications. Academic Press Inc., San Diego (1999)

    MATH  Google Scholar 

  5. Kundu, D., Evans, B.L.: Full-reference visual quality assessment for synthetic images: a subjective study. In 2015 IEEE International Conference on Image Processing (ICIP), pp. 2374–2378. IEEE (2015)

    Google Scholar 

  6. Ledig, C., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4681–4690 (2017)

    Google Scholar 

  7. Lions, P., Osher, S., Rudin, L.: Denoising and deblurring images using constrained nonlinear partial differential equations, pp. 2800–2828. Preprint, Cognitech Inc. (1993)

    Google Scholar 

  8. Liu, P., Lu, X.Y.: Real order (an)-isotropic total variation in image processing - Part II: learning of optimal structures. arXiv e-prints arXiv:1903.08513 (2019)

  9. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  Google Scholar 

  10. Zhang, J., Chen, K.: A total fractional-order variation model for image restoration with nonhomogeneous boundary conditions and its numerical solution. SIAM J. Imaging Sci. 8(4), 2487–2518 (2015)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pan Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, P., Li, C., Schönlieb, CB. (2019). GANReDL: Medical Image Enhancement Using a Generative Adversarial Network with Real-Order Derivative Induced Loss Functions. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11766. Springer, Cham. https://doi.org/10.1007/978-3-030-32248-9_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32248-9_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32247-2

  • Online ISBN: 978-3-030-32248-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics