Variational principles — minimizing or extremizing functionals — underlie nearly all of physics. Hamilton's principle (classical mechanics), Fermat's principle (optics), the variational principle in quantum mechanics, and the Einstein-Hilbert action all express physics as the search for an extremal path.
Derive the Euler-Lagrange equation from the stationary-action condition δJ=0 and apply it to standard physical functionals.
Use the Beltrami identity to reduce problems with no explicit x-dependence, and apply it to the brachistochrone and catenary.
Compute a functional derivative δF/δρ and state the Hohenberg-Kohn theorem underlying density functional theory.
Apply the Rayleigh-Ritz method to bound the ground-state energy of the hydrogen atom using a Gaussian trial wavefunction.
Interpret Feynman's path integral as a sum over all paths weighted by eiS/ℏ and relate the classical limit ℏ→0 to the stationary-phase approximation.
VM.1 The Euler-Lagrange Equation
A functional maps functions to numbers: J[y]=∫abF(x,y,y′)dx. The calculus of variations finds functions y(x) that make J stationary.
Theorem VM.1 — Euler-Lagrange Equation
A necessary condition for y(x) to extremize J[y]=∫abF(x,y,y′)dx(with y fixed at endpoints) is:∂y∂F−dxd(∂y′∂F)=0Derivation: let y→y+εη where η(a)=η(b)=0. Then δJ=ε∫[∂F/∂yη+∂F/∂y′η′]dx=ε∫[∂F/∂y−d/dx(∂F/∂y′)]ηdx=0 for all η→E−L equation. Extensions: multiple functions yi(x)→oneE−L equation per yi. Higher derivatives F(y, y', y'', ...) → Ostrogradsky equation.
First integrals: if F has no explicit x-dependence: H = y' ∂F/∂y' − F = const (Beltrami identity — Hamiltonian!). If F has no explicit y-dependence: ∂F/∂y' = const (conserved momentum).
Example VM.1 — Brachistochrone Problem
Find the curve of fastest descent between two points A=(0,0) and B=(x1,y1) under gravity (the brachistochrone).
Time functional:dt=ds/v where v=2gy (energy conservation from rest). ds=1+y′2dx. T=∫0x12gy1+y′2dx. Minimize T.
F has no x:Use Beltrami: F−y′∂F/∂y′ = const. F=(1+y′2)/(2gy).∂F/∂y′=y′/2gy(1+y′2). Beltrami: 1/2gy(1+y′2)=1/2gc2 (constant).
Simplify:y(1+y′2)=c2 = const. Parametric solution: x=c2(θ−sinθ)/2,y=c2(1−cosθ)/2. This is a cycloid — traced by a point on the rim of a rolling circle of radius R=c2/2.
Result:The fastest path is NOT the straight line, NOT the circular arc, but the cycloid. Johann Bernoulli (1696) — first solved by Newton, Leibniz, l'Hôpital, and Bernoulli using different methods. The brachistochrone is also the tautochrone (period independent of starting point).
VM.2 Functional Derivatives
For a functional F[ρ] = ∫ f(r, ρ(r), ∇ρ(r)) d³r, the functional derivative is:
This is the continuum analog of a partial derivative. The condition δF/δρ = 0 gives the Euler-Lagrange equation for field theories.
Density functional theory (DFT): Hohenberg-Kohn theorem (1964) states that the ground-state energy of an N-electron system is a functional E[ρ] of the electron density ρ(r) alone. The Kohn-Sham equations minimize E[ρ] variationally — replacing the interacting problem with an effective non-interacting problem. DFT is the workhorse of computational quantum chemistry (Nobel 1998 to Kohn).
VM.3 Rayleigh-Ritz Method
Approximate the solution by a finite-dimensional trial function: y(x) ≈ Σᵢ cᵢ φᵢ(x). The functional becomes a function of the cᵢ. Minimize: ∂J/∂cᵢ = 0 → linear system for the coefficients.
For the variational principle in quantum mechanics — approximate ψ by trial functionψtrial(α1,α2,…):
Etrial is always an upper bound on the ground state energy. The best trial function minimizes Etrial. Gaussian basis sets in quantum chemistry (Pople 6-31G* etc.) use the Rayleigh-Ritz method to compute electronic structure. The finite element method (FEM) for PDEs is another application: divide space into elements, minimize energy.
Isoperimetric problem: maximize the enclosed area for a fixed perimeter → solution is a circle (proven rigorously by Weierstrass). Equivalent: for a soap bubble, surface tension minimizes area for fixed volume → spherical shape.
Plateau's problem: find the minimal surface with a given boundary. E-L equation: H = 0 (mean curvature = 0). Solutions: catenoid (rotation of a catenary), helicoid (helix surface), Schwarz surfaces (triply periodic). Soap films realize these automatically.
VM.5 Path Integrals as Functional Integrals
Feynman's path integral quantizes a system by summing over all paths:
where S[x]=∫titfL(x,x˙)dt is the action. The classical path (δS = 0 → E-L equations) dominates in the limit ℏ → 0 (stationary phase). Quantum fluctuations around the classical path give O(ℏ) corrections — the WKB approximation, loop expansion in QFT.
The stationary phase approximation:∫eiS[x]/ℏDx≈eiScl/ℏ×[det(−δx2δ2S)]−1/2 — functional determinant. This connects semiclassical mechanics (WKB) to one-loop quantum corrections.
Definition VM.1 — Common Traps
Stationary does not always mean minimum: actions can be saddle points.
Boundary conditions are part of the variation: fixed endpoints change which terms vanish.
Generalized coordinates need not be Cartesian: choose coordinates that match constraints.
Constraints introduce multipliers or reduced coordinates: ignoring them gives unphysical variations.
Exercises — VM.1–VM.5 Variational Methods
1.Find the shape of a hanging chain (catenary) by minimizing the potential energy subject to the constraint of fixed length. Derive the result y=ccosh(x/c).
Straightforward
2.
Apply the variational principle to the hydrogen atom using trial function ψ=e−αr. Show that minimizing ⟨H⟩ over α gives the exact ground state energy (eV).
eV
Intermediate
3.Find the minimal surface of revolution (catenoid) as a solution to the Euler-Lagrange equation. What is the Goldschmidt discontinuity?
Intermediate
4.Compute the one-loop path integral for the harmonic oscillator in Euclidean time to find the partition function Z=Tre−βH. Show the functional determinant gives the correct energy levels.
Challenging
Key Takeaways
Euler-Lagrange: ∂F/∂y−d/dx(∂F/∂y′)=0. Derived from δJ=0 for all variations.
Beltrami identity: if F has no x, then F−y′∂F/∂y′ = const (energy conservation analog).
Rayleigh-Ritz: approximate by trial functions → upper bound on ground state energy.
Functional derivative: δF/δρ=∂f/∂ρ−∇⋅(∂f/∂∇ρ). DFT minimizes E[ρ] over density.
Brachistochrone → cycloid. Catenary →cosh. Minimal surface → catenoid. All from E-L.