Mathematics · Advanced Topics

Variational Methods

Variational principles — minimizing or extremizing functionals — underlie nearly all of physics. Hamilton's principle (classical mechanics), Fermat's principle (optics), the variational principle in quantum mechanics, and the Einstein-Hilbert action all express physics as the search for an extremal path.

PrerequisitesLagrangian mechanics (Ch. L) · Differential equations (Ch. 26) · Calculus (Ch. 25) · Linear algebra (Ch. LA)
Learning Goals
  • Derive the Euler-Lagrange equation from the stationary-action condition δJ=0\delta J = 0 and apply it to standard physical functionals.
  • Use the Beltrami identity to reduce problems with no explicit x-dependence, and apply it to the brachistochrone and catenary.
  • Compute a functional derivative δF/δρ\delta F/\delta\rho and state the Hohenberg-Kohn theorem underlying density functional theory.
  • Apply the Rayleigh-Ritz method to bound the ground-state energy of the hydrogen atom using a Gaussian trial wavefunction.
  • Interpret Feynman's path integral as a sum over all paths weighted by eiS/ℏe^{iS/\hbar} and relate the classical limit ℏ→0\hbar\to 0 to the stationary-phase approximation.

VM.1 The Euler-Lagrange Equation

A functional maps functions to numbers: J[y]=∫abF(x,y,y′) dxJ[y] = \int_a^b F(x, y, y')\, dx. The calculus of variations finds functions y(x) that make J stationary.

Theorem VM.1 — Euler-Lagrange Equation
A necessary condition for y(x) to extremize J[y]=∫abF(x,y,y′) dxJ[y] = \int_a^b F(x, y, y')\, dx(with y fixed at endpoints) is:∂F∂y−ddx(∂F∂y′)=0\dfrac{\partial F}{\partial y} - \dfrac{d}{dx}\left(\dfrac{\partial F}{\partial y'}\right) = 0Derivation: let y→y+εηy \to y + \varepsilon\eta where η(a)=η(b)=0\eta(a) = \eta(b) = 0. Then δJ=ε∫[∂F/∂yη+∂F/∂y′η′]dx=ε∫[∂F/∂y−d/dx(∂F/∂y′)]ηdx=0\delta J = \varepsilon \int[\partial F/\partial y \eta + \partial F/\partial y' \eta'] dx = \varepsilon \int[\partial F/\partial y - d/dx(\partial F/\partial y')] \eta dx = 0 for all η→E−L\eta \to E-L equation. Extensions: multiple functions yi(x)→oneE−Ly_{i}(x) \to one E-L equation per yiy_{i}. Higher derivatives F(y, y', y'', ...) → Ostrogradsky equation.

First integrals: if F has no explicit x-dependence: H = y' ∂F/∂y' − F = const (Beltrami identity — Hamiltonian!). If F has no explicit y-dependence: ∂F/∂y' = const (conserved momentum).

Example VM.1 — Brachistochrone Problem

Find the curve of fastest descent between two points A=(0,0)A = (0,0) and B=(x1,y1)B = (x_{1}, y_{1}) under gravity (the brachistochrone).

Time functional:dt=ds/vdt = ds/v where v=2gyv = \sqrt{2gy} (energy conservation from rest). ds=1+y′2dxds = \sqrt{1+y'^{2}} dx. T=∫0x11+y′22gy dxT = \int_0^{x_1} \sqrt{\dfrac{1 + y'^2}{2gy}}\, dx. Minimize T.
F has no x:Use Beltrami: F−y′∂F/∂y′F - y' \partial F/\partial y' = const. F=(1+y′2)/(2gy).∂F/∂y′=y′/2gy(1+y′2)F = \sqrt{(1+y'^{2})/(2gy)}. \partial F/\partial y' = y'/\sqrt{2gy(1+y'^{2})}. Beltrami: 1/2gy(1+y′2)=1/2gc21/\sqrt{2gy(1+y'^{2})} = 1/\sqrt{2g c^{2}} (constant).
Simplify:y(1+y′2)=c2y(1+y'^{2}) = c^{2} = const. Parametric solution: x=c2(θ−sin⁡θ)/2,y=c2(1−cos⁡θ)/2x = c^{2}(\theta - \sin\theta)/2, y = c^{2}(1 - \cos\theta)/2. This is a cycloid — traced by a point on the rim of a rolling circle of radius R=c2/2R = c^{2}/2.
Result:The fastest path is NOT the straight line, NOT the circular arc, but the cycloid. Johann Bernoulli (1696) — first solved by Newton, Leibniz, l'Hôpital, and Bernoulli using different methods. The brachistochrone is also the tautochrone (period independent of starting point).

VM.2 Functional Derivatives

For a functional F[ρ] = ∫ f(r, ρ(r), ∇ρ(r)) d³r, the functional derivative is:

δFδρ(r)=∂f∂ρ−∇⋅(∂f∂(∇ρ))(functional derivative)\frac{\delta F}{\delta \rho(\mathbf{r})} = \frac{\partial f}{\partial \rho} - \nabla \cdot \left(\frac{\partial f}{\partial (\nabla \rho)}\right) \qquad \text{(functional derivative)}(VM.1)

This is the continuum analog of a partial derivative. The condition δF/δρ = 0 gives the Euler-Lagrange equation for field theories.

Density functional theory (DFT): Hohenberg-Kohn theorem (1964) states that the ground-state energy of an N-electron system is a functional E[ρ] of the electron density ρ(r) alone. The Kohn-Sham equations minimize E[ρ] variationally — replacing the interacting problem with an effective non-interacting problem. DFT is the workhorse of computational quantum chemistry (Nobel 1998 to Kohn).

VM.3 Rayleigh-Ritz Method

Approximate the solution by a finite-dimensional trial function: y(x) ≈ Σᵢ cᵢ φᵢ(x). The functional becomes a function of the cᵢ. Minimize: ∂J/∂cᵢ = 0 → linear system for the coefficients.

For the variational principle in quantum mechanics — approximate ψ by trial functionψtrial(α1,α2,…)\psi_{\text{trial}}(\alpha_1, \alpha_2, \ldots):

Etrial=⟨ψtrial∣H∣ψtrial⟩⟨ψtrial∣ψtrial⟩≥E0(variational bound)E_{\text{trial}} = \frac{\langle \psi_{\text{trial}} | H | \psi_{\text{trial}} \rangle}{\langle \psi_{\text{trial}} | \psi_{\text{trial}} \rangle} \ge E_0 \qquad \text{(variational bound)}(VM.2)

EtrialE_{\text{trial}} is always an upper bound on the ground state energy. The best trial function minimizes EtrialE_{\text{trial}}. Gaussian basis sets in quantum chemistry (Pople 6-31G* etc.) use the Rayleigh-Ritz method to compute electronic structure. The finite element method (FEM) for PDEs is another application: divide space into elements, minimize energy.

VM.4 Isoperimetric Problems and Constraints

Constrained optimization with a functional constraint G[y] = const uses aLagrange multiplier: extremize J[y] − λ G[y]. The E-L equation becomes: ∂(F − λG)/∂y − d/dx ∂(F − λG)/∂y' = 0.

Isoperimetric problem: maximize the enclosed area for a fixed perimeter → solution is a circle (proven rigorously by Weierstrass). Equivalent: for a soap bubble, surface tension minimizes area for fixed volume → spherical shape.

Plateau's problem: find the minimal surface with a given boundary. E-L equation: H = 0 (mean curvature = 0). Solutions: catenoid (rotation of a catenary), helicoid (helix surface), Schwarz surfaces (triply periodic). Soap films realize these automatically.

VM.5 Path Integrals as Functional Integrals

Feynman's path integral quantizes a system by summing over all paths:

K(xf,tf;xi,ti)=∫Dx(t) eiS[x]/ℏ(Feynman path integral)K(x_f, t_f; x_i, t_i) = \int \mathcal{D}x(t)\, e^{iS[x]/\hbar} \qquad \text{(Feynman path integral)}(VM.3)

where S[x]=∫titfL(x,x˙) dtS[x] = \int_{t_i}^{t_f} L(x, \dot{x})\, dt is the action. The classical path (δS = 0 → E-L equations) dominates in the limit ℏ → 0 (stationary phase). Quantum fluctuations around the classical path give O(ℏ) corrections — the WKB approximation, loop expansion in QFT.

The stationary phase approximation:∫eiS[x]/ℏ Dx≈eiScl/ℏ×[det⁡(−δ2Sδx2)]−1/2\int e^{iS[x]/\hbar}\, \mathcal{D}x \approx e^{iS_{\text{cl}}/\hbar} \times \left[\det\left(-\frac{\delta^2 S}{\delta x^2}\right)\right]^{-1/2} — functional determinant. This connects semiclassical mechanics (WKB) to one-loop quantum corrections.

Definition VM.1 — Common Traps
  • Stationary does not always mean minimum: actions can be saddle points.
  • Boundary conditions are part of the variation: fixed endpoints change which terms vanish.
  • Generalized coordinates need not be Cartesian: choose coordinates that match constraints.
  • Constraints introduce multipliers or reduced coordinates: ignoring them gives unphysical variations.
Exercises — VM.1–VM.5 Variational Methods
1.Find the shape of a hanging chain (catenary) by minimizing the potential energy subject to the constraint of fixed length. Derive the result y=ccosh⁡(x/c)y = c \cosh(x/c).
Straightforward
2.
Apply the variational principle to the hydrogen atom using trial function ψ=e−αr\psi = e^{-\alpha r}. Show that minimizing ⟨H⟩ over α gives the exact ground state energy (eV).
eV
Intermediate
3.Find the minimal surface of revolution (catenoid) as a solution to the Euler-Lagrange equation. What is the Goldschmidt discontinuity?
Intermediate
4.Compute the one-loop path integral for the harmonic oscillator in Euclidean time to find the partition function Z=Tre−βHZ = Tr e^{-\beta H}. Show the functional determinant gives the correct energy levels.
Challenging
Key Takeaways
  • Euler-Lagrange: ∂F/∂y−d/dx(∂F/∂y′)=0\partial F/\partial y - d/dx(\partial F/\partial y') = 0. Derived from δJ=0\delta J = 0 for all variations.
  • Beltrami identity: if F has no x, then F−y′∂F/∂y′F - y'\partial F/\partial y' = const (energy conservation analog).
  • Rayleigh-Ritz: approximate by trial functions → upper bound on ground state energy.
  • Functional derivative: δF/δρ=∂f/∂ρ−∇⋅(∂f/∂∇ρ)\delta F/\delta\rho = \partial f/\partial\rho - \nabla\cdot(\partial f/\partial\nabla\rho). DFT minimizes E[ρ]E[\rho] over density.
  • Brachistochrone → cycloid. Catenary →cosh⁡\to \cosh. Minimal surface → catenoid. All from E-L.
  • Path integral: K=∫DxeiS/ℏK = \int Dx e^{iS/\hbar}. Classical path dominates (ℏ→0\hbar\to 0). Quantum corrections from fluctuations.