Abstract
In this work we introduce a novel operator \(\displaystyle \varDelta _{(p,q)}\) as an extended family of operators that generalize the p-Laplace operator. The operator is derived with an emphasis on image processing applications, and particularly, with a focus on image denoising applications. We propose a non-linear transition function, coupling p and q, which yields a non-linear filtering scheme analogous to adaptive spatially dependent total variation and linear filtering. Well-posedness of the final parabolic PDE is established via pertubation theory and connection to classical results in functional analysis. Numerical results demonstrates the applicability of the novel operator \(\displaystyle \varDelta _{(p,q)}\).
You have full access to this open access chapter, Download conference paper PDF
1 Introduction
A well known inverse problem in image processing is image denoising [4]. In the last decades the energy functional approach together with its corresponding Euler-Lagrange (E-L) equation has attracted great attention in solving inverse problems applied to image reconstruction. One important case of E-L equations is the one which involves the p-Laplace operator
associated with the evolution equation of p-Laplacian
where \(\displaystyle \varOmega \) is a bounded domain in \(\displaystyle \mathbf{R}^2\) and \(\displaystyle u_0:\varOmega \rightarrow \mathbf{R}\) is a given degraded image [5, 7, 13] and \(\displaystyle \nabla u\) is the gradient. The degenerate parabolic Eq. in (2) has been studied by many authors and we limit ourselves here to refer the reader to [10]. It is well known that the case \(\displaystyle p=2\) gives the linear Gaussian filter, which however, impose strong spatial regularity and therefore image details such as lines and edges are oversmoothed. \(\displaystyle p=1\) is often refereed to as the method of total variation [13] and \(\displaystyle p=0\) is an instance of the so called balanced forward backward evolution [9].
In this work we study a decoupled form of the p-Laplace operator, expressed as a non-linear combination of the \(\displaystyle \varDelta _1\) and \(\displaystyle \varDelta _\infty \) operators, introduced below. We call our new operator \(\displaystyle \varDelta _{(p,q)}\). Via established existence theory we show that the corresponding perturbed parabolic equation is well-posed and close to the original operator.
In Sect. 2 we review some of the properties of the p-Laplace operator applied in image denoising and compare it with Perona-Malik models. Our main contribution is in Sect. 3 where we extend the p-Laplace operator to a new operator \(\displaystyle \varDelta _{(p,q)}\) with focus on image denoising. We consider the corresponding variable version \(\displaystyle \varDelta _{(p(x),q(x))}\) in Sect. 4. Finally, in Sect. 5 we demonstrates the applicability of \(\displaystyle \varDelta _{(p,q)}\) by numerical results.
2 p-Laplacian for Image Denosing
An important feature in any evolution process for image denoising is preservation of certain geometrical features of the underlying image. In the case of image restoration these features include edges and corners. It is straight-forward to express the p-Laplace operator (1) as
where \(\displaystyle \varDelta _1 u= \,\mathrm {div}\Big (\frac{\nabla u}{|\nabla u|}\Big )\), \(\displaystyle \varDelta _{\infty }u = \frac{\nabla u }{|\nabla u|}\cdot (D^2u) \frac{\nabla u }{|\nabla u|}\) and \(\displaystyle D^2u\) is the Hessian of u. However, an intuitive way to represent \(\displaystyle \varDelta _{p}\), giving direct interpretation of the diffusivity directions is to express \(\displaystyle \varDelta _{p}\) by using Gauge coordinates \(\displaystyle (x, y) \rightarrow (\eta ,\xi )\):
where
and
From (4) it is now clear that \(\displaystyle \varDelta _p\) imposes the same diffusivity strength in both directions \(\displaystyle \xi \) and \(\displaystyle \eta \) independent of the magnitude of the gradient. In an attempt to resolve this drawback, Perona and Malik (P-M) [12] proposed to replace \(\displaystyle |\nabla u|^{p-2}\) with \(\displaystyle g(|\nabla u|^2)\) in (1). The idea is that the weight should satisfy \(\displaystyle g(s)\rightarrow 0\), \(\displaystyle s\rightarrow \infty \) and \(\displaystyle g(s)\rightarrow 1\), \(\displaystyle s\rightarrow 0^+\). P-M studied weights like \(\displaystyle g=k/(k+s)\) and \(\displaystyle g=e^{-ks}\) and demonstrated the advantages of these weight functions for edge preservations. Rewriting the operator given by the P-M method in Gauge coordinates, we obtain
where \(\displaystyle \phi (s)=(sg(s))'\). Thus the diffusion in the direction \(\displaystyle \eta \) differs from the diffusion in the direction \(\displaystyle \xi \). Since \(\displaystyle \phi (s)\) is negative for large s, the evolution will be of backward diffusion effect near edges. This backward evolution cause problem for the well-posedness of the model and could also lead to staircasing problem [17].
The Perona-Malik PDE is a forward-backward type equation, and the diffusion is forward in the region \(\displaystyle \{ |\nabla u | < k \}\) and is backward and hence ill-posed in the region \(\displaystyle \{ |\nabla u | > k \}\). From evolution point of view, the forward-backward type equation may have infinitely many solutions and from variational minimization perspective the energy functional may have infinitely many minima [17]. To overcome the ill-posedness in the P-M model the authors in [17] introduced a regularization and proposed the following model
where \(\displaystyle G_{\sigma }\) is a Gaussian function with standard deviation \(\displaystyle \sigma \). A similar but time dependent variance \(\displaystyle \sigma (t)\) was used in [16]. However, it’s rather tricky to choose \(\displaystyle \sigma (t)\) since it should neither decay too fast nor too slow during the evolution.
3 Extending the p-Laplace Operator
3.1 Anisotropic Decomposition via Constant Coefficients
The p-Laplace operator in (1), is an isotropic operator and expanding the divergence we obtain the equivalent form
An anisotropic behavior of the \(\displaystyle \varDelta _p\)-operator is induced by suppressing mixed derivatives, i.e., we define
In the case \(\displaystyle p=1\), (8) is known as isotropic TV and (9) is anisotropic TV [8]. By decoupling the exponents in (9) one obtains the operator \(\displaystyle L_{(p_1, p_2)}\)
which has previously appeared in fluid mechanics and we refer to [2, 3].
Next, to see how the diffusion appears in the operator (10) we reformulate it in Gauge coordinates (5) by making the following definition.
Definition 1
The \(\displaystyle L_{(p_1,p_2)}\)-operator is given by
where \(\displaystyle 1\le p_1,p_2<\infty \).
The above operator \(\displaystyle L_{(p_1,p_2)}\) is in fact a generalization of several known operators. We have
-
1.
The case \(\displaystyle p_1=p_2=2\). The operator \(\displaystyle L_{(2,2)}\) in (11) is the Laplacian, by now well studied. Due to the Laplacian’s rotation invariance property we get
$$\begin{aligned} L_{(2,2)} u =\partial _{\xi }(\partial _{\xi } u) + \partial _{\eta }(\partial _{\eta } u) = \varDelta u = u_{xx}+u_{yy}. \end{aligned}$$(12) -
2.
The case \(\displaystyle p_1=2\) and \(\displaystyle p_2=1\). The operator \(\displaystyle L_{(p_1,p_2)}\) in (11) is then given by
$$\begin{aligned} L_{(2,1)} u = \partial _{\xi }( \partial _{\xi } u) + \partial _{\eta }(|\partial _{\eta } u|^{-1} \partial _{\eta } u). \end{aligned}$$(13)Since we have \(\displaystyle |\partial _{\eta }u|^{-1} \partial _{\eta } u= 1\), it follows that \(\displaystyle L_{(2,1)} u = u_{\xi \xi }\). In Cartesian coordinates this corresponds to
$$\begin{aligned} L_{(2,1)} u = |\nabla u| \varDelta _1 u, \end{aligned}$$(14)i.e. the mean curvature equation (see e.g., [6]). The corresponding regularized (weighted) mean curvature equation is given by
$$\begin{aligned} \partial _t u = g(|\nabla G_{\sigma } * u|)|\nabla u| \varDelta _1 u \end{aligned}$$(15)previously studied in the context of image analysis, see e.g., [1].
-
3.
The case \(\displaystyle p_1=2\) and \(\displaystyle p_2=p\in (1,2)\). It follows from (11) that
$$\begin{aligned} L_{(2,p)} u&= \partial _{\xi \xi } u + \partial _{\eta }({|\partial _{\eta }u|^{p-2}\partial _{\eta } u}) = \partial _{\xi \xi } u + (p-1)u_{\eta }^{p-2}u_{\eta \eta } \end{aligned}$$(16a)$$\begin{aligned}&= |\nabla u| \varDelta _1 u + (p-1) |\nabla u|^{p-2}\varDelta _{\infty }u \end{aligned}$$(16b)i.e. a mean curvature operator (14) with a second order term corresponding to (3). Note that the second order term induce invariant smoothing of the image data. Since (16) is merely a special case of (3), we further relax the mean curvature term next to better reflect the trade-off between edge-preservation and obtained smoothness. Although this modification appears straight-forward, its implications are non-trivial, however.
The anisotropic \(\displaystyle L_{(2,p)}\) operator is given by
Definition 2
The operator \(\displaystyle \varDelta _{(p,q)}\) is
Remark 1
Definition 2 is a straight-forward relaxation of the exponents in (3), motivated by the discussion in above point 3. The introduction of q in (17), defines an additional degree of freedom, allowing us to control the trade-off between \(\displaystyle \varDelta _1\) and \(\displaystyle \varDelta _\infty \), i.e., a trade-off between edge preservation and smoothness.
The corresponding evolution problem of the operator \(\displaystyle \varDelta _{(p,q)}\) is
Definition 3
The evolution problem of \(\displaystyle \varDelta _{(p,q)}\) is given by
We point out that \(\displaystyle q=0, p=1\) yields the familiar isotropic TV regularizer and \(\displaystyle q=1, p=2\) results in the heat equation, i.e., isotropic filtering. In the next section, we propose to couple p and q via a smooth non-linear transition function such that \(\displaystyle \varDelta _{(p,q)}\) can be thought of a spatially variant TV and isotropic regularizer.
4 Variable Coefficients
4.1 Coefficient Coupling
In the previous section we motivated the \(\displaystyle \varDelta _{(p,q)}\) operator and advocated to introduce variable coefficients, depending on the image data. The behavior of the operator \(\displaystyle \varDelta _{(p(x),q(x))}\) that we seek, is the edge-preserving effect of TV leading to \(\displaystyle \varDelta _{(p(x),q(x))}\rightarrow \varDelta _{(1,0)}\) (the case of TV) as \(\displaystyle |\nabla u|\rightarrow \infty \). In regions with small gradients we define the (p(x), q(x))-coefficients such that the operator is a linear filter leading to \(\displaystyle \varDelta _{(p(x),q(x))}\rightarrow \varDelta _{(2,1)}=\varDelta \) (the case of isotropic diffusion) as \(\displaystyle |\nabla u|\rightarrow 0\). To see how the diffusion appears in \(\displaystyle \varDelta _{(p(x),q(x))}\) we rewrite the operator in Gauge coordinates.
Lemma 1
The operator \(\displaystyle \varDelta _{(p,q)}\) in (17) can be written as
Proof
Using the relations in (6) and by rotation invariance of Laplacian, we obtain
Now we observe that the operator \(\displaystyle \varDelta _1 u\) can be expanded as
and using this in (20) gives
Thus, the \(\displaystyle \varDelta _{(p,q)}\) operator in (17) reformulates to
which shows the result. \(\displaystyle \square \)
Next, we couple p and q via the relation
and from which we derive the following result.
Lemma 2
If \(\displaystyle p(x)=1+q(x)\), then
Proof
The proof follows immediately from Lemma 1. \(\displaystyle \square \)
In this study, we couple p and q via the negative exponential function (although other selections are possible), i.e., we set
where \(\displaystyle k_1>0\) and \(\displaystyle 0<k_2 <1\). Under this selection we form the following parabolic PDE
One easily checks that (26) describes a smooth transition between total variation and linear filtering for the selection of p, q in (). By using \(\displaystyle |\nabla u|\varDelta _{1}u=\varDelta u-\varDelta _{\infty }u\), the operator \(\displaystyle \varDelta _{(1+q,q)}\) becomes
Remark 2
The operator \(\displaystyle \varDelta _{(1+q,q)}\) is non-linear and have unbounded coefficients. In this first study, we perturb the \(\displaystyle \varDelta _{(1+q,q)}\)-operator to obtain a regularized version of the evolution problem (18). This regularization enables us to pose the necessary conditions for well-posedness, introduced next.
4.2 Regularity of Solutions
In order to set up the framework for numerical calculation, we define
Definition 4
Let \(\displaystyle 0<\varepsilon ,\delta <1\) and q as in (25). Then
Thus we study the regularized evolution equation
where
and \(\displaystyle \zeta =\nabla u\). Given \(\displaystyle u^{(k)}\), we obtain the next update \(\displaystyle u^{(k+1)}\) by solving the following, equivalent (see [15]), initial value problem iteratively
Proposition 1
If the initial data \(\displaystyle u^{(0)} =0\) then the solution \(\displaystyle u^{(k)}\) to (31) exists and is in \(\displaystyle C^{\infty }(\varOmega \times (0,T))\).
Proof
If the initial guess \(\displaystyle u^{(0)} =0, \) then \(\displaystyle \sum a_{ij}^{\varepsilon ,\delta }(0)u_{ij} =(1+\delta ) \varepsilon ^{q(0)-1}\varDelta u\) and we deduce from Theorem 4.31 in [10] that \(\displaystyle u^{(1)} \) exists and is \(\displaystyle C^{\infty }(\varOmega \times (0,T))\). Given \(\displaystyle u^{(k)} \in C^{\infty }\), then \(\displaystyle ||u^{(k)}||_{C^1(\varOmega \times (0,T))}\) is bounded, \(\displaystyle (|\zeta |^{2}+\varepsilon ^{2})^{(q(|\zeta |)-1)/2}\) is bounded from below and \(\displaystyle a_{ij}^{\varepsilon , \delta }\) are also \(\displaystyle C^{\infty }(\varOmega \times (0,T))\). Hence, there are constants \(\displaystyle c=c(\varepsilon , \delta , k)\) and \(\displaystyle C=C(\varepsilon , \delta , k) >0\), depending only on \(\displaystyle \varepsilon , \delta , ||u^{(k)}||_{C^1}\), such that
It follows once again from Theorem 4.31 in [10] that \(\displaystyle u^{(k+1)}\) exists and also is \(\displaystyle C^{\infty }(\varOmega \times (0,T))\). \(\displaystyle \square \)
5 Evaluation
5.1 Implementation
The parabolic PDE is discretized by using finite differences and a simple forward Euler scheme. We used a state of the art Split Bregman (SB) implementation of total variation. For details on SB see [8]. The regularization parameter for the SB was optimized in the range [0.01, 1] in increasing steps of 0.11. The regularization parameter of the Bregman-variables of SB was set to 1 and the scheme was terminated as \(\displaystyle 10^{-3} > ||u^{(k)}-u^{(k-1)}||_2/||u^{(k-1)}||_2\) and we choose the regularization parameter that produces highest SSIM value [14]. We also report the peak signal-to-noise value (PSNR). For the (p(x), q(x))-operator we found that \(\displaystyle k_1=k_2=0.1\) and the update stepsize as \(\displaystyle \alpha =10^{-5}\) and \(\displaystyle \tau =0.5\) works well for the considered noise level of 20 standard deviations of additive Gaussian noise. These values are ad-hoc and future work include methods for parameter estimation.
5.2 Results
First we test our algorithm on a synthetic test image seen in Fig. 1. We see that the result of the proposed operator appears smoother than the result of TV in the center region, but yet preserves the corner point well. In Fig. 2 (cropped \(\displaystyle 256\times 256\) pixels of image 35049.jpg [11]) we compare the visual quality and the SSIM-values for a range of p, q-values. As expected for \(\displaystyle \varDelta _{(2,1)}\) (isotropic filtering) performs the worst whereas the operator produce improved result w.r.t. SSIM as well as perceptual appearance. In the case of non-adaptive parameters, TV performs the best. However, the operator with adaptive coefficients improve both SSIM, PSNR values and produces less oversmoothing (down-right figure). We also include the result from a grayscale image “Castle” (cropped \(\displaystyle 256\times 256\) pixels of image 102061.jpg [11]) in Fig. 3. In this image TV performs very well in the sky (detail up right with green/thick frame) whereas the result from the \(\displaystyle \varDelta _{(p,q)}\) operator appears less noisy and looks visually more crisp. In both examples the proposed operator shows an improvement in PSNR as well as SSIM values.
6 Conclusion
In this paper we introduced a new family of operators, \(\displaystyle \varDelta _{(p,q)}\). Preliminary numerical results indicate that there could be a relationship between p(x) and q(x) that further improves the restoration effect. In forthcoming works we will investigate the operator \(\displaystyle \varDelta _{(p,q)}\) further regarding both regularity and different areas of applications.
References
Alvarez, L., Lions, P.L., Morel, J.M.: Image selective smoothing and edge detection by nonlinear diffusion. SIAM J. Numer. Anal. 29(3), 845–866 (1992)
Antontsev, S.N., Shmarev, S.I.: Existence and uniqueness of solutions of degenerate parabolic equations with variable exponents of nonlinearity. Fundam. Prikl. Mat. 12(4), 3–19 (2006)
Antontsev, S., Shmarev, S.: Elliptic equations with anisotropic nonlinearity and nonstandard growth conditions. In: Handbook of Differential Equations. Stationary Partial Differential Equations, vol. 3, pp. 1–100. Elsevier/North Holland, Amsterdam (2006)
Aubert, G., Kornprobst, P.: Mathematical Problems in Image Processing. Applied Mathematical Sciences, vol. 147, 2nd edn. Springer, New York (2006)
Baravdish, G., Svensson, O., Åström, F.: On backward \(p(x)\)-parabolic equations for image enhancement. Numer. Funct. Anal. Optim. 36(2), 147–168 (2015)
Chen, Y.G., Giga, Y., Goto, S.: Uniqueness and existence of viscosity solutions of generalized mean curvature flow equations. J. Differ. Geom. 33(3), 749–786 (1991)
Does, K.: An evolution equation involving the normalized \(p\)-laplacian. Commun. Pure Appl. Anal. 10(1), 361–396 (2011)
Goldstein, T., Osher, S.: The split Bregman method for l1-regularized problems. SIAM J. Imaging Sci. 2(2), 323–343 (2009)
Keeling, S.L., Stollberger, R.: Nonlinear anisotropic diffusion filtering for multiscale edge enhancement. Inverse Prob. 18(1), 175–190 (2002)
Lieberman, G.M.: Second Order Parabolic Differential Equations. World Scientific Publishing Co., Inc., River Edge (1996)
Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: ICCV, vol. 2, pp. 416–423 (2001)
Perona, P., Malik, J.: Scale-space and edge detection using anisotropic diffusion. IEEE Trans. PAMI 12, 629–639 (1990)
Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D 60(1–4), 259–268 (1992)
Wang, Z., Bovik, A., Sheikh, H., Simoncelli, E.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)
Vogel, C.R., Oman, M.E.: Iterative methods for total variation denoising. SIAM J. Sci. Comput. 17, 227–238 (1996)
Whitaker, R.T., Pizer, S.M.: A multi-scale approach to nonuniform diffusion. CVGIP: Image Underst. 57(1), 99–110 (1993)
You, Y.L., Xu, W., Tannenbaum, A., Kaveh, M.: Behavioral analysis of anisotropic diffusion in image processing. IEEE Trans. Image Process. 5(11), 1539–1553 (1996)
Acknowledgment
Support by the German Science Foundation and the Research Training Group (GRK 1653) is gratefully acknowledged.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 IFIP International Federation for Information Processing
About this paper
Cite this paper
Baravdish, G., Cheng, Y., Svensson, O., Åström, F. (2016). Extension of p-Laplace Operator for Image Denoising. In: Bociu, L., Désidéri, JA., Habbal, A. (eds) System Modeling and Optimization. CSMO 2015. IFIP Advances in Information and Communication Technology, vol 494. Springer, Cham. https://doi.org/10.1007/978-3-319-55795-3_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-55795-3_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-55794-6
Online ISBN: 978-3-319-55795-3
eBook Packages: Computer ScienceComputer Science (R0)