Understanding the Laplace operator conceptually

Question

The Laplace operator: those of you who now understand it, how would you explain what it "does" conceptually? How do you wish you had been taught it?
Any good essays (combining both history and conceptual understanding) on the Laplace operator, and its subsequent variations (e.g. Laplace-Bertrami) that you would highly recommend?

Actually this question has been previously asked and well-answered. See Intuitive interpretation of the Laplacian. Also Nice way of thinking about the Laplace operator. Also Why is the Laplacian important in Riemannian geometry? — John M, Jun 3 '14 at 4:25
@JohnM You are very right! I feel terrible for asking a duplicate now. Can it be merged? Should it be made into a community wiki? — user89, Jun 3 '14 at 5:05
I just wanted to point out those other answers in case they are of interest to you. — John M, Jun 3 '14 at 15:44

Anthony Carapetis · Accepted Answer · 2014-05-28 04:23:00Z

The Laplacian

Δf(p) is the lowest-order measurement of how

f deviates from

f(p) "on average" - you can interpret this either probabilistically (expected change in

f as you take a random walk) or geometrically (the change in the average of

f over balls centred at

p ). To make this second interpretation precise, write the Taylor series

f (p + x) = f (p) + f i (p) x i + 1 2 f i j (p) x i x j + \dots

and integrate:

\int B r (p) f = f (p) V (B r) + f i (p) \int B r (0) x i d x + 1 2 f i j (p) \int B r (0) x i x j d x + \dots .

The integrals

∫x i dx vanish because

x i is an odd function under reflection in the

x i direction, and similarly the integrals

∫x i x j dx vanish whenever

i≠j ; so this simplifies to

1 V ( B r ) \int B r (p) f = f (p) + C Δ f (p) r 2 + \dots

where

C is a constant depending only on the dimension.
The Laplace-Beltrami operator is essentially the same thing in the more general Riemannian setting - all the nasty curvy terms will be higher order, so the same formula should hold.

Dear Anthony, I have accepted your answer, but wonder if you could write a little about why the Laplace operator is sometimes called the "diffusion operator"? Also, do I understand it correctly that in only one "spatial dimension" x , it simply reduces to the second derivative? I.e. u xx =Δu ? — user89, May 28 '14 at 8:35
@user89: Correct on the second question. Diffusion is a process that smooths out some density function by changing the value at each point to be closer to the values at surrounding points, and is modelled by the equation ∂f/∂t=Δf . — Anthony Carapetis, May 28 '14 at 10:08

John M · Answer 2 · 2014-05-28 05:15:31Z

up vote15down vote

I think the most important property of the Laplace operator

Δ is that it is invariant under rotations. In fact, if a differential operator on Euclidean space is rotation and translation invariant, then it must be a polynomial in

Δ . That is why it is of such prominence in physical problems.
Some good books on the subject:

Rosenberg's The Laplacian on a Riemannian Manifold.
Gurarie's Symmetries and Laplacians.

answered May 28 '14 at 5:15

John M
3,757526

Is the Laplacian invariant under rotations because it takes into account all points in the neighbourhood of the point in question? – user89 May 28 '14 at 8:32

3

Yes, because it takes into account all the points in a symmetric way. – John M May 28 '14 at 12:59

John, if I consider the function

f(x)=x 2 in 2D, rotating my axes can give me different values for the second derivative at a particular point (the second derivative being what the Laplace operator reduces to in one spatial dimension). This does not seem to be invariant -- why is that? – user89 May 29 '14 at 0:23

Nice thing to try to check! It is invariant: If

f(x,y)=x 2 in

R 2 , then

Δf=(∂ f /∂x 2 )+(∂ f /∂y 2 )=2+0=2 . On the other hand, if you rotate your axes 45 degrees clockwise, you get

f(x,y)=x 2 /2+y 2 /2 . This also has

Δf=1+1=2 . Rotate you axes another 45 degrees to get

f(x,y)=y 2 . Again

Δf=0+2=2 . – John M May 29 '14 at 1:34

Ah. Hmm. I was simply flipping the graph of

f(x)=x 2 , so that in some new axis system, it would be

f ′ (x ′ )=−(x ′2 ) (i.e. rotating it 180 degrees). Then, the second derivative of that would be

−2 . I know I am making an incredibly silly error here, but I can't seem to be able to catch it. – user89 May 29 '14 at 5:13

| show 4 more comments

Phillip Andreae · Answer 3 · 2014-05-28 14:35:32Z

To gain some (very rough) intuition for the Laplacian, I think it's helpful to think of the Laplacian on

R , which is just the second derivative

d 2 dx 2 . (This answer may be more elementary than the OP was looking for, but I wish I had kept some of these things in mind when I first learned about the Laplacian.)
Just as Anthony's answer discusses, the second derivative at

p∈R measures how much

f(p) deviates from average values of

f on either side of it. If the second derivative is positive, then

f(p) is smaller than the average of

f(p+h) and

f(p−h) for small

h . (As I would tell my calculus students, the trapezoid rule for Riemann sums is an overestimate when the second derivative is positive.)
Generally, a function is harmonic if and only if it satisfies the mean value property. In

R , harmonic functions are simply linear polynomials, which of course are precisely the functions that satisfy the mean value property.
The maximum principle states roughly that if

Δu≥0 , then local maxima of

u do not occur. This is a generalization of the familiar "second derivative test" from calculus, which says that if the second derivative of

u is positive, then local maxima of

u do not occur (the graph of

u is concave up).
Finally, let me go up one dimension and mention some of my intuition for harmonic functions

u(x,y) of two variables, in which case

Δu=∂ 2 u∂x 2 +∂ 2 u∂y 2 . If

u is harmonic, then

∂ 2 u∂x 2 =−∂ 2 u∂y 2 . This says that the graph of

u must always look like a saddle: if, say, the graph is concave up in the

x -direction (

∂ 2 u∂x 2 >0 ), then it must be concave down in the

y -direction (

∂ 2 u∂y 2 <0 ). When I picture a saddle-shaped graph in my head, I think I can also see why the maximum principle has to hold for harmonic functions, since a saddle has no local extrema.

user7530 · Answer 4 · 2014-06-03 03:59:36Z

Another view along the lines of the answers above:
Suppose you have some region in the plane

Ω , and you are given the value of some scalar function

f along the boundary

∂Ω . You now want to fill in

f on the interior of

Ω "as smoothly as possible." (A common physical interpretation is that

f is the heat of the region: you are fixing the temperature of the boundary of

Ω and want to know what the temperature on the interior will be at steady state.)
What does "as smooth as possible" mean? Well, one measure of the smoothness of

f is to look at its gradient

∇f and measure

E (f) = \int Ω ∥ \nabla f ∥ 2 d A .

Notice that this integral, called the Dirichlet energy of

f , achieves its lowest possible value of

0 when

f is constant. The less smooth (to first order) that

f is, the higher the Dirichlet energy will be. Making

f as smooth as possible means finding the

f that satisfies the boundary conditions and minimizes

E .
How do we minimize

E ? We "take the derivative and set it to zero":

\nabla f E = 0.

It may look a little weird to differentiate a scalar (the Dirichlet energy) with respect to a function, but the idea is the same as when you work with the ordinary gradient. Recall that for an ordinary scalar function

g(x,y,z):R 3 →R , the gradient

∇g at a point is the unique vector that, when you dot it with any direction

v , tells you the directional derivative of

g in that direction:

\nabla g (x, y, z) \cdot v = d d t g [(x, y, z) + t v] ∣ ∣ ∣ t \to 0 .

The gradient of

E works the same way: it gives you the unique function over

Ω that, when you take the inner product of

∇E(f) with any variation

δf of

f , gives you the directional derivative of

E in that "direction":

\int Ω \nabla E (f) δ f d A = d d t E (f + t δ f) ∣ ∣ ∣ t \to 0 .

You can do the multivariable calculus and after some integration by parts, you will see that

∇E(f)=−Δf. Several takeaways from this:

The function f that interpolates the boundary conditions as smoothly as possible (in the sense of minimizing the Dirichlet energy) is the solution to the Laplace equation −Δf=0 .
Given some function f that interpolates the boundary conditions but does not minimize the Dirichlet energy, the gradient of E , −Δf , is the "direction of steepest ascent" of E -- the direction to change f if you want to most quickly increase E . The negative of this, Δf , is the direction that most quickly decreases E : if you are trying to smooth f , this is then the direction that you want to flow f in. This insight leads to the heat equation $d f d t = Δ f$ which, given initial temperatures on Ω , flows in the direction that best decreases the Dirichlet energy until the heat has diffused as smoothly as possible over the surface.
Nowhere in the above discussion was it essential that Ω was a piece of a plane: as long as you can define functions on Ω and take gradients of f to get the Dirichlet energy, the above works equally well, and is one way of motivating the Laplace-Beltrami operator on arbitrary manifolds in R 3 . The physical picture here is that you have some conductive plate in empty space, and heat up the boundary of the plate, and look at how the heat equalizes over the plate.

It's interesting that some approaches to image denoising / deblurring / restoration minimize an objective function that contains a discrete version of the Dirichlet energy of the restored image, in order to encourage the restored image to be smooth. More sophisticated approaches use a penalty term E(f)=∫ Ω ∥∇f∥ 1 dA , which allows sharp edges in an image to be preserved. (It seems interesting to work out a differential equation based on this energy, as you did for the Dirichlet energy.) — littleO, Jun 3 '14 at 6:42

score 9 · Answer 5

Here is some intuition:
I think the most basic thing to know about the Laplacian

Δ is that

−Δ=−div∇ , and

−div is the adjoint of

∇ . Hence,

−Δ has the familiar form

A T A which recurs throughout linear algebra. We see that

−Δ is a self-adjoint positive semidefinite operator, and so we would expect (or hope) that the familiar properties of positive semidefinite operators in linear algebra hold true for

−Δ . Namely, we expect that

−Δ has real nonnegative eigenvalues, and that there should exist (in some sense) an orthonormal basis of eigenfunctions for

−Δ . This provides some intuition or motivation for the topic of "eigenfunctions of the Laplacian". (By the way, I think the Laplacian should have been defined to be

−div∇ .)
Notice that the integration by parts formula can be interpreted as telling us that

−ddx is the adjoint of

ddx (in a setting where boundary terms vanish). Fourier series can be discovered by computing the eigenfunctions of the anti-self-adjoint operator

ddx in an appropriate setting. Moreover, a multivariable integration by parts formula can be interpreted as telling us that

−div is the adjoint of

∇ . Green's second identity can be interpreted as expressing the self-adjointness of the Laplacian.

Wednesday, March 25, 2015

Dr. Alexander D. Wissner-Gross AI alexwg.org cognitive niche theory how intelligence can become an ecological niche and thereby influence natural selection.

in this conversation

Sign in with

or pick a name

Disqus is a conversation network

Wednesday, February 12, 2014

A new Equation for Intelligence F = T ∇ Sτ - a Force that Maximises the Future Freedom of Action

Intelligence is a Force with the Power to Change the World

Intelligence is a Force that Maximises the Future Freedom of Action

The new Equation for Intelligence F = T ∇ Sτ

An Algorithmic Explanation of the Equation

The Physical Force of Intelligence

It is Really a New Force?

How to Measure the Force of Intelligence?

Is it a Break-Thru Like Chaos Theory?

The Problem of Ambiguity of the Future

Implications

Intelligence Needs a Dynamic Model of the World

Intelligence Needs Power to Act

What is an Intelligent System?

Hierarchy of Intelligent Systems

Competition of Intelligent Systems

Brute Force Versus the Force of Intelligence

Why is the Force Directed to Future Freedom of Action?

Evolution on Steroids

How to increase the force of intelligence?

Other Implications

Conclusions

42 comments:

Links to this post

A new Equation for Intelligence F = T ∇ Sτ - a Force that Maximises the Future Freedom of Action

Intelligence is a Force with the Power to Change the World

Intelligence is a Force that Maximises the Future Freedom of Action

The new Equation for Intelligence F = T ∇ Sτ

Understanding the Laplace operator conceptually

5 Answers 5

No comments:

Post a Comment