Thermodynamics · Upper Division

Statistical Mechanics

Statistical mechanics derives thermodynamics from first principles by counting microscopic states. Temperature, entropy, and pressure emerge from probability theory applied to systems with ~10²³ particles.

PrerequisitesLaws of thermodynamics (Ch. 14) · Quantum mechanics (Ch. 22) for quantum statistics · Basic calculus and probability
Learning Goals
  • State Boltzmann's entropy formula S=kBln⁡ΩS = k_{B} \ln \Omega and use it to compare likelihoods of macrostates.
  • Derive the Boltzmann distribution from the maximum-entropy principle and define the partition function Z.
  • Extract mean energy and free energy from Z using the standard thermodynamic relations.
  • Apply the equipartition theorem to predict heat capacities of monatomic and diatomic gases.
  • Contrast Fermi-Dirac and Bose-Einstein statistics and describe their physical consequences.

S.1 Microstates and the Boltzmann Entropy

The central insight of statistical mechanics is that macroscopic thermodynamic quantities — temperature, pressure, entropy — correspond to averages over an enormous number of microscopic configurations (microstates). Each microstate is a complete specification of every particle's position and momentum.

Definition S.1 — Boltzmann Entropy
The entropy of a macrostate is proportional to the logarithm of the number of microstates Ω consistent with it:S=kBln⁡Ω(kB=1.381×10−23 J/K)S = k_B \ln \Omega \qquad (k_B = 1.381\times10^{-23}\ \text{J/K})This is carved on Boltzmann's gravestone. It connects the microscopic world (Ω, counting) to the macroscopic (S, measurable). A system evolves toward states of maximum Ω—\Omega — the second law is just the law of large numbers.
Example S.1 — Entropy of a Two-State System

N=100N = 100 coins, each showing heads (H) or tails (T). How many ways can exactly 50 be heads? Compare to all-heads. What does this say about the second law?

Ω(50H)\Omega(50H):C(100,50)=100!/(50!50!)≈1029—C(100,50) = 100!/(50!50!) \approx 10^{29} — an astronomical number
Ω(100H)\Omega(100H):C(100,100)=1C(100,100) = 1
Entropy difference:ΔS=kBln⁡(1029/1)=kB×29×ln⁡10≈10−21J/K\Delta S = k_{B} \ln(10^{29}/1) = k_{B} \times 29 \times \ln10 \approx 10^{-21} J/K
Moral:The all-heads state is fantastically improbable. For1023For 10^{23} coins (moles of gas molecules), the overwhelmingly most probable macrostate is the uniform distribution. Deviations are essentially impossible — this is the second law.

S.2 The Boltzmann Distribution

Consider a small system in contact with a large thermal reservoir at temperature T. The probability that the system occupies a microstate with energy E is theBoltzmann distribution:

P(E)=1Ze−E/kBT=1Ze−βE(β≡1kBT)P(E) = \frac{1}{Z} e^{-E/k_B T} = \frac{1}{Z} e^{-\beta E} \qquad \left(\beta \equiv \frac{1}{k_B T}\right)(S.1)

The partition function Z=∑ie−βEiZ = \sum_i e^{-\beta E_i} (sum over all microstates) is the normalization factor and encodes all thermodynamic information. Once Z is known:

⟨E⟩=−∂ln⁡Z∂βF=−kBTln⁡ZS=−∂F∂T\langle E\rangle = -\frac{\partial \ln Z}{\partial \beta} \qquad F = -k_B T \ln Z \qquad S = -\frac{\partial F}{\partial T}(S.2)

The partition function is to statistical mechanics what the wavefunction is to quantum mechanics — everything follows from it.

Example S.2 — Two-Level System

A system has two energy levels: E=0E = 0 and E=εE = \varepsilon. Find the partition function, mean energy, and heat capacity.

Z:Z=e−β⋅0+e−βε=1+e−βεZ = e^{-\beta\cdot 0} + e^{-\beta\varepsilon} = 1 + e^{-\beta\varepsilon}
ln Z:ln⁡Z=ln⁡(1+e−βε)\ln Z = \ln(1 + e^{-\beta\varepsilon})
⟨E⟩:⟨E⟩=−∂(lnZ)/∂β=εe−βε/(1+e−βε)=ε/(eβε+1)E⟩ = -\partial(lnZ)/\partial\beta = \varepsilon e^{-\beta\varepsilon}/(1 + e^{-\beta\varepsilon}) = \varepsilon/(e^{\beta\varepsilon} + 1)
Heat capacity:C=d⟨E⟩/dT=kB(βε)2eβε/(eβε+1)2C = d⟨E⟩/dT = k_{B} (\beta\varepsilon)^{2} e^{\beta\varepsilon}/(e^{\beta\varepsilon}+1)^{2}
Schottky anomaly:C peaks at kBT≈0.42εk_{B} T \approx 0.42\varepsilon then decays. At high T(kBT≫ε):⟨E⟩→ε/2T (k_{B} T ≫ \varepsilon): ⟨E⟩ \to \varepsilon/2 (equal population). At low T: system freezes into ground state.

S.3 The Equipartition Theorem

Theorem S.1 — Equipartition Theorem
In thermal equilibrium at temperature T, every quadratic degree of freedom contributes ½kBTk_{B} T to the mean energy:⟨12mx˙2⟩=12kBT\left\langle \tfrac{1}{2} m\dot{x}^2 \right\rangle = \tfrac{1}{2} k_B T    for each translational, rotational, or vibrational modeA monatomic ideal gas has 3 translational DOF→⟨E⟩=3/2kBTDOF \to ⟨E⟩ = 3/2 k_{B} T per particle. A diatomic molecule has 3 translational + 2 rotational = 5DOF→⟨E⟩=5/2kBT5 DOF \to ⟨E⟩ = 5/2 k_{B} T. This gives Cv=(f/2)NkBCv = (f/2)Nk_{B}, where f is the number of active quadratic modes.

The equipartition theorem breaks down at low temperatures where quantum effects freeze out modes with spacing ε≫kBT\varepsilon \gg k_B T. This is why the heat capacity of hydrogen drops from 52NkB\tfrac{5}{2} N k_B (room temperature, 5 modes) to 32NkB\tfrac{3}{2} N k_B (low temperature, only translation) — a purely quantum effect first measured by Arnold Eucken in 1912 but not understood until quantum mechanics.

S.4 Quantum Statistics

Identical quantum particles obey one of two statistics, depending on their spin:

Definition S.2 — Quantum Distribution Functions
Bosons(integer spin, e.g., photons, 4He^{4}He): Bose-Einstein distribution   ⟨nk⟩=1eβ(εk−μ)−1\langle n_k\rangle = \dfrac{1}{e^{\beta(\varepsilon_k-\mu)} - 1}Fermions(half-integer spin, e.g., electrons, protons): Fermi-Dirac distribution   ⟨nk⟩=1eβ(εk−μ)+1\langle n_k\rangle = \dfrac{1}{e^{\beta(\varepsilon_k-\mu)} + 1}μ is the chemical potential. AtT=0At T=0, the Fermi-Dirac distribution is a step function — all states below the Fermi energy EFE_{F} are filled, all above are empty.

Fermi-Dirac statistics explains why metals conduct electricity (electrons near EFE_Fare mobile), why white dwarf stars don't collapse (electron degeneracy pressure), and why the specific heat of metals is linear in TT (only electrons within ~kBTk_B T of EFE_F contribute). Bose-Einstein statistics permits stimulated emission (laser light) and Bose-Einstein condensation — all bosons collapsing into the ground state below a critical temperature.

Definition S.3 — Common Traps
  • Microstates and macrostates are different levels: entropy counts microscopic arrangements compatible with one macrostate.
  • Z is more than normalization: derivatives of ln Z generate energy, entropy, and free energy.
  • Equipartition has limits: quantum level spacing freezes out modes when kBTk_{B} T is too small.
  • Fermions and bosons differ by occupancy rules: the plus/minus sign changes low-temperature behavior completely.
Exercises — S.1–S.4 Statistical Mechanics
1.
Using equipartition, derive the heat capacity Cv of a monatomic ideal gas. Express in terms of N,kBN, k_{B} and as a number for one mole.
J/(mol·K)
Straightforward
2.For the two-level system (E=0,E=εE=0, E=\varepsilon), plot the heat capacity C(T) qualitatively. Where is the Schottky peak? What happens as T→0T\to 0 and T→∞T\to\infty?
Intermediate
3.Derive the Planck blackbody distribution from the Bose-Einstein distribution (μ=0\mu=0). Show how this resolves the ultraviolet catastrophe.
Intermediate
4.Calculate the Fermi energy EFE_{F} for a free electron gas with density n. Find the total ground-state energy and the degeneracy pressure. Why is Cv of electrons linear in T rather than constant?
Challenging
Key Takeaways
  • S=kBln⁡Ω—S = k_{B} \ln \Omega — entropy counts microstates; the second law is just probability theory at scale.
  • Boltzmann distribution: P(E)∝e−βE,β=1/kBTP(E) \propto e^{-\beta E}, \beta = 1/k_{B} T. Higher energy → exponentially less probable.
  • Partition function Z=∑e−βEZ = \sum e^{-\beta E} encodes all thermodynamics: ⟨E⟩=−∂lnZ/∂βE⟩ = -\partial lnZ/\partial\beta.
  • Equipartition: ½kBTk_{B} T per quadratic DOF. Breaks down when kBT≪εk_{B} T ≪ \varepsilon (quantum freezeout).
  • Fermions obey Fermi-Dirac: at T=0T=0 all states below EFE_{F} filled — explains metals, white dwarfs.
  • Bosons obey Bose-Einstein: photons → blackbody spectrum; at low T → Bose-Einstein condensation.