Discrete Laplace operator

For the discrete equivalent of the Laplace transform, see Z-transform.

In mathematics, the discrete Laplace operator is an analog of the continuous Laplace operator, defined so that it has meaning on a graph or a discrete grid. For the case of a finite-dimensional graph (having a finite number of edges and vertices), the discrete Laplace operator is more commonly called the Laplacian matrix.

The discrete Laplace operator occurs in physics problems such as the Ising model and loop quantum gravity, as well as in the study of discrete dynamical systems. It is also used in numerical analysis as a stand-in for the continuous Laplace operator. Common applications include image processing, where it is known as the Laplace filter, and in machine learning for clustering and semi-supervised learning on neighborhood graphs.

Definitions

Graph Laplacians

There are various definitions of the discrete Laplacian for graphs, differing by sign and scale factor (sometimes one averages over the neighboring vertices, other times one just sums; this makes no difference for a regular graph). The traditional definition of the graph Laplacian, given below, corresponds to the negative continuous Laplacian on a domain with a free boundary.

Let $G=(V,E)$ be a graph with vertices $\scriptstyle V$ and edges $\scriptstyle E$. Let $\phi \colon V\to R$ be a function of the vertices taking values in a ring. Then, the discrete Laplacian $\Delta$ acting on $\phi$ is defined by

$(\Delta \phi )(v)=\sum _{{w:\,d(w,v)=1}}\left[\phi (v)-\phi (w)\right]\,$

where $d(w,v)$ is the graph distance between vertices w and v. Thus, this sum is over the nearest neighbors of the vertex v. For a graph with a finite number of edges and vertices, this definition is identical to that of the Laplacian matrix. That is, $\phi$ can be written as a column vector; and so $\Delta \phi$ is the product of the column vector and the Laplacian matrix, while $(\Delta \phi )(v)$ is just the v'th entry of the product vector.

If the graph has weighted edges, that is, a weighting function $\gamma \colon E\to R$ is given, then the definition can be generalized to

$(\Delta _{\gamma }\phi )(v)=\sum _{{w:\,d(w,v)=1}}\gamma _{{wv}}\left[\phi (v)-\phi (w)\right]$

where $\gamma _{{wv}}$ is the weight value on the edge $wv\in E$.

Closely related to the discrete Laplacian is the averaging operator:

$(M\phi )(v)={\frac {1}{\deg v}}\sum _{{w:\,d(w,v)=1}}\phi (w).$

Mesh Laplacians

In addition to considering the connectivity of nodes and edges in a graph, mesh laplace operators take into account the geometry of a surface (e.g. the angles at the nodes). For triangle meshes, for example, different discretizations exist, some of them are an extension of the graph operator, while other approaches are based on the finite element method (see below) and allow for higher order approximations. An overview on some mesh operators and a comparison is given in.^[1]

Finite differences

Approximations of the Laplacian, obtained by the finite-difference method or by the finite-element method, can also be called discrete Laplacians. For example, the Laplacian in two dimensions can be approximated using the five-point stencil finite-difference method, resulting in

${\displaystyle \Delta f(x,y)\approx {\frac {f(x-h,y)+f(x+h,y)+f(x,y-h)+f(x,y+h)-4f(x,y)}{h^{2}}},}$

where the grid size is h in both dimensions, so that the five-point stencil of a point (x, y) in the grid is

${\displaystyle \{(x-h,y),(x,y),(x+h,y),(x,y-h),(x,y+h)\}.}$

If the grid size h = 1, the result is the negative discrete Laplacian on the graph, which is the square lattice grid. There are no constraints here on the values of the function f(x, y) on the boundary of the lattice grid, thus this is the case of the homogeneous Neumann boundary condition, i.e., free boundary. Other types of boundary conditions, e.g., the homogeneous Dirichlet boundary condition, where f(x, y) = 0 on the boundary of the grid, are rarely used for graph Laplacians, but are common in other applications.

Multidimensional discrete Laplacians on rectangular cuboid regular grids have very special properties, e.g., they are Kronecker sums of one-dimensional discrete Laplacians, see Kronecker sum of discrete Laplacians, in which case all its eigenvalues and eigenvectors can be explicitly calculated.

Finite-element method

In this approach, the domain is discretized into smaller elements, often triangles or tetrahedra, but other elements such as rectangles or cuboids are possible. The solution space is then approximated using so called form-functions of a pre-defined degree. The differential equation containing the Laplace operator is then transformed into a variational formulation, and a system of equations is constructed (linear or eigenvalue problems). The resulting matrices are usually very sparse and can be solved with iterative methods.

Image Processing

Discrete Laplace operator is often used in image processing e.g. in edge detection and motion estimation applications.^[2] The discrete Laplacian is defined as the sum of the second derivatives Laplace operator#Coordinate expressions and calculated as sum of differences over the nearest neighbours of the central pixel.

Implementation in image processing

For one-, two- and three-dimensional signals, the discrete Laplacian can be given as convolution with the following kernels:

1D filter: ${\vec {D}}_{x}^{2}={\begin{bmatrix}1&-2&1\end{bmatrix}}$,

2D filter: ${\mathbf {D}}_{{xy}}^{2}={\begin{bmatrix}0&1&0\\1&-4&1\\0&1&0\end{bmatrix}}$.

$\mathbf{D}^2_{xy}$ corresponds to the finite-difference formula seen previously. Other approximations include the diagonals:

2D filter: ${\displaystyle \mathbf {D} _{xy}^{2}={\begin{bmatrix}0.25&0.5&0.25\\0.5&-3&0.5\\0.25&0.5&0.25\end{bmatrix}}}$,

3D filter: ${\mathbf {D}}_{{xyz}}^{2}$ is given by: first plane = ${\begin{bmatrix}0&0&0\\0&1&0\\0&0&0\end{bmatrix}}$; second plane = ${\begin{bmatrix}0&1&0\\1&-6&1\\0&1&0\end{bmatrix}}$; third plane = ${\begin{bmatrix}0&0&0\\0&1&0\\0&0&0\end{bmatrix}}$.

nD filter: For the element $a_{{x_{1},x_{2},\dots ,x_{n}}}$ of the kernel ${\mathbf {D}}_{{x_{1},x_{2},\dots ,x_{n}}}^{2},$

${\displaystyle a_{x_{1},x_{2},\dots ,x_{n}}=\left\{{\begin{array}{ll}-2n&{\text{if }}s=n,\\1&{\text{if }}s=n-1,\\0&{\text{otherwise,}}\end{array}}\right.}$

where x_i is the position (either −1, 0 or 1) of the element in the kernel in the i-th direction, and s is the number of directions i for which x_i = 0.

Note that the nD version, which is based on the graph generalization of the Laplacian, assumes all neighbors to be at an equal distance, and hence leads to the following 2D filter with diagonals included, rather than the version above:

2D filter: ${\mathbf {D}}_{{xy}}^{2}={\begin{bmatrix}1&1&1\\1&-8&1\\1&1&1\end{bmatrix}}.$

These kernels are deduced by using discrete differential quotients.

In can be shown^[3][4] that the following discrete approximation of the two-dimensional Laplacian operator as a convex combination of difference operators

$\nabla _{{\gamma }}^{2}=(1-\gamma )\nabla _{{5}}^{2}+\gamma \nabla _{{\times }}^{2}=(1-\gamma ){\begin{bmatrix}0&1&0\\1&-4&1\\0&1&0\end{bmatrix}}+\gamma {\begin{bmatrix}1/2&0&1/2\\0&-2&0\\1/2&0&1/2\end{bmatrix}}$

for γ ∈ [0, 1] is compatible with discrete scale-space properties, where specifically the value γ = 1/3 gives the best approximation of rotational symmetry. Regarding three-dimensional signals, it is shown^[4] that the Laplacian operator can be approximated by the two-parameter family of difference operators

${\displaystyle \nabla _{\gamma _{1},\gamma _{2}}^{2}=(1-\gamma _{1}-\gamma _{2})\,\nabla _{7}^{2}+\gamma _{1}\,\nabla _{+^{3}}^{2}+\gamma _{2}\,\nabla _{\times ^{3}}^{2}),}$

where

${\displaystyle (\nabla _{7}^{2}f)_{0,0,0}=f_{-1,0,0}+f_{+1,0,0}+f_{0,-1,0}+f_{0,+1,0}+f_{0,0,-1}+f_{0,0,+1}-6f_{0,0,0},}$

$(\nabla _{{+^{3}}}^{2}f)_{{0,0,0}}={\frac {1}{4}}(f_{{-1,-1,0}}+f_{{-1,+1,0}}+f_{{+1,-1,0}}+f_{{+1,+1,0}}+f_{{-1,0,-1}}+f_{{-1,0,+1}}+f_{{+1,0,-1}}+f_{{+1,0,+1}}+f_{{0,-1,-1}}+f_{{0,-1,+1}}+f_{{0,+1,-1}}+f_{{0,+1,+1}}-12f_{{0,0,0}}),$

$(\nabla _{{\times ^{3}}}^{2}f)_{{0,0,0}}={\frac {1}{4}}(f_{{-1,-1,-1}}+f_{{-1,-1,+1}}+f_{{-1,+1,-1}}+f_{{-1,+1,+1}}+f_{{+1,-1,-1}}+f_{{+1,-1,+1}}+f_{{+1,+1,-1}}+f_{{+1,+1,+1}}-8f_{{0,0,0}}).$

Spectrum

The spectrum of the discrete Laplacian is of key interest; since it is a self-adjoint operator, it has a real spectrum. For the convention $\Delta =I-M$, the spectrum lies within $[0,2]$ (as the averaging operator has spectral values in $[-1,1]$). The smallest non-zero eigenvalue is denoted $\lambda _{1}$ and is called the spectral gap. There is also the notion of the spectral radius, commonly taken as the largest eigenvalue.

The eigenvectors don't depend on the convention above (for regular graphs), and are the same as for the averaging operator (as they differ by adding a multiple of the identity), though the eigenvalues differ according to the convention.

For operators that approximate the underlying continuous Laplacian the eigenvalues are a sequence of positive real numbers. The first eigenvalue is zero, if the domain has a boundary and the Neumann boundary condition is used, or if the shape contains no boundary (e.g. the sphere).

Theorems

If the graph is an infinite square lattice grid, then this definition of the Laplacian can be shown to correspond to the continuous Laplacian in the limit of an infinitely fine grid. Thus, for example, on a one-dimensional grid we have

${\frac {\partial ^{2}F}{\partial x^{2}}}=\lim _{{\epsilon \rightarrow 0}}{\frac {[F(x+\epsilon )-F(x)]+[F(x-\epsilon )-F(x)]}{\epsilon ^{2}}}.$

This definition of the Laplacian is commonly used in numerical analysis and in image processing. In image processing, it is considered to be a type of digital filter, more specifically an edge filter, called the Laplace filter.

Discrete Schrödinger operator

Let $P:V\rightarrow R$ be a potential function defined on the graph. Note that P can be considered to be a multiplicative operator acting diagonally on $\phi$

$(P\phi )(v)=P(v)\phi (v).\,$

Then $H=\Delta +P$ is the discrete Schrödinger operator, an analog of the continuous Schrödinger operator.

If the number of edges meeting at a vertex is uniformly bounded, and the potential is bounded, then H is bounded and self-adjoint.

The spectral properties of this Hamiltonian can be studied with Stone's theorem; this is a consequence of the duality between posets and Boolean algebras.

On regular lattices, the operator typically has both traveling-wave as well as Anderson localization solutions, depending on whether the potential is periodic or random.

Discrete Green's function

The Green's function of the discrete Schrödinger operator is given in the resolvent formalism by

$G(v,w;\lambda )=\left\langle \delta _{v}\left|{\frac {1}{H-\lambda }}\right|\delta _{w}\right\rangle$

where $\delta _{w}$ is understood to be the Kronecker delta function on the graph: $\delta _{w}(v)=\delta _{{wv}}$; that is, it equals 1 if v=w and 0 otherwise.

For fixed $w\in V$ and $\lambda$ a complex number, the Green's function considered to be a function of v is the unique solution to

$(H-\lambda )G(v,w;\lambda )=\delta _{w}(v).\,$

ADE classification

Certain equations involving the discrete Laplacian only have solutions on the simply-laced Dynkin diagrams (all edges multiplicity 1), and are an example of the ADE classification. Specifically, the only positive solutions to the homogeneous equation:

$\Delta \phi =\phi ,$

in words,

"Twice any label is the sum of the labels on adjacent vertices,"

are on the extended (affine) ADE Dynkin diagrams, of which there are 2 infinite families (A and D) and 3 exceptions (E). The resulting numbering is unique up to scale, and if the smallest value is set at 1, the other numbers are integers, ranging up to 6.

The ordinary ADE graphs are the only graphs that admit a positive labeling with the following property:

Twice any label minus two is the sum of the labels on adjacent vertices.

In terms of the Laplacian, the positive solutions to the inhomogeneous equation:

$\Delta \phi =\phi -2.$

The resulting numbering is unique (scale is specified by the "2"), and consists of integers; for E₈ they range from 58 to 270, and have been observed as early as 1968.^[5]

See also

• Spectral shape analysis
• Electrical network
• Kronecker sum of discrete Laplacians

References

1. Reuter, M. and Biasotti, S. and Giorgi, D. and Patane, G. and Spagnuolo, M.", (2009). "Discrete Laplace-Beltrami operators for shape analysis and segmentation". Computers & Graphics. Elsevier. 33 (3): 381–390df. doi:10.1016/j.cag.2009.03.005.
2. Forsyth, D. A.; Ponce, J. (2003). Computer Vision. Pearson. doi:10.1016/j.cag.2009.03.005.
3. Lindeberg, T., "Scale-space for discrete signals", PAMI(12), No. 3, March 1990, pp. 234–254.
4. Lindeberg, T., Scale-Space Theory in Computer Vision, Kluwer Academic Publishers, 1994, ISBN 0-7923-9418-6.
5. Bourbaki, Nicolas (1968), "Chapters 4–6", Groupes et algebres de Lie, Paris: Hermann

• T.Sunada, Discrete geometric analysis, Proceedings of Symposia in Pure Mathematics (ed. by P. Exner, J. P. Keating, P. Kuchment, T. Sunada, A. Teplyaev), 77(2008), 51-86

External links

• Definition and application to spectral gap