Statistical mechanics derives thermodynamics from first principles by counting microscopic states. Temperature, entropy, and pressure emerge from probability theory applied to systems with ~10²³ particles.
PrerequisitesLaws of thermodynamics (Ch. 14) · Quantum mechanics (Ch. 22) for quantum statistics · Basic calculus and probability
Learning Goals
State Boltzmann's entropy formula S=kBlnΩ and use it to compare likelihoods of macrostates.
Derive the Boltzmann distribution from the maximum-entropy principle and define the partition function Z.
Extract mean energy and free energy from Z using the standard thermodynamic relations.
Apply the equipartition theorem to predict heat capacities of monatomic and diatomic gases.
Contrast Fermi-Dirac and Bose-Einstein statistics and describe their physical consequences.
S.1 Microstates and the Boltzmann Entropy
The central insight of statistical mechanics is that macroscopic thermodynamic quantities — temperature, pressure, entropy — correspond to averages over an enormous number of microscopic configurations (microstates). Each microstate is a complete specification of every particle's position and momentum.
Definition S.1 — Boltzmann Entropy
The entropy of a macrostate is proportional to the logarithm of the number of microstates Ω consistent with it:S=kBlnΩ(kB=1.381×10−23J/K)This is carved on Boltzmann's gravestone. It connects the microscopic world (Ω, counting) to the macroscopic (S, measurable). A system evolves toward states of maximum Ω— the second law is just the law of large numbers.
Example S.1 — Entropy of a Two-State System
N=100 coins, each showing heads (H) or tails (T). How many ways can exactly 50 be heads? Compare to all-heads. What does this say about the second law?
Ω(50H):C(100,50)=100!/(50!50!)≈1029— an astronomical number
Moral:The all-heads state is fantastically improbable. For1023 coins (moles of gas molecules), the overwhelmingly most probable macrostate is the uniform distribution. Deviations are essentially impossible — this is the second law.
S.2 The Boltzmann Distribution
Consider a small system in contact with a large thermal reservoir at temperature T. The probability that the system occupies a microstate with energy E is theBoltzmann distribution:
P(E)=Z1e−E/kBT=Z1e−βE(β≡kBT1)(S.1)
The partition functionZ=∑ie−βEi (sum over all microstates) is the normalization factor and encodes all thermodynamic information. Once Z is known:
⟨E⟩=−∂β∂lnZF=−kBTlnZS=−∂T∂F(S.2)
The partition function is to statistical mechanics what the wavefunction is to quantum mechanics — everything follows from it.
Example S.2 — Two-Level System
A system has two energy levels: E=0 and E=ε. Find the partition function, mean energy, and heat capacity.
Z:Z=e−β⋅0+e−βε=1+e−βε
ln Z:lnZ=ln(1+e−βε)
⟨E⟩:⟨E⟩=−∂(lnZ)/∂β=εe−βε/(1+e−βε)=ε/(eβε+1)
Heat capacity:C=d⟨E⟩/dT=kB(βε)2eβε/(eβε+1)2
Schottky anomaly:C peaks at kBT≈0.42ε then decays. At high T(kBT≫ε):⟨E⟩→ε/2 (equal population). At low T: system freezes into ground state.
S.3 The Equipartition Theorem
Theorem S.1 — Equipartition Theorem
In thermal equilibrium at temperature T, every quadratic degree of freedom contributes ½kBT to the mean energy:⟨21mx˙2⟩=21kBT for each translational, rotational, or vibrational modeA monatomic ideal gas has 3 translational DOF→⟨E⟩=3/2kBT per particle. A diatomic molecule has 3 translational + 2 rotational = 5DOF→⟨E⟩=5/2kBT. This gives Cv=(f/2)NkB, where f is the number of active quadratic modes.
The equipartition theorem breaks down at low temperatures where quantum effects freeze out modes with spacing ε≫kBT. This is why the heat capacity of hydrogen drops from 25NkB (room temperature, 5 modes) to 23NkB (low temperature, only translation) — a purely quantum effect first measured by Arnold Eucken in 1912 but not understood until quantum mechanics.
S.4 Quantum Statistics
Identical quantum particles obey one of two statistics, depending on their spin:
Definition S.2 — Quantum Distribution Functions
Bosons(integer spin, e.g., photons, 4He): Bose-Einstein distribution ⟨nk⟩=eβ(εk−μ)−11Fermions(half-integer spin, e.g., electrons, protons): Fermi-Dirac distribution ⟨nk⟩=eβ(εk−μ)+11μ is the chemical potential. AtT=0, the Fermi-Dirac distribution is a step function — all states below the Fermi energy EF are filled, all above are empty.
Fermi-Dirac statistics explains why metals conduct electricity (electrons near EFare mobile), why white dwarf stars don't collapse (electron degeneracy pressure), and why the specific heat of metals is linear in T (only electrons within ~kBT of EF contribute). Bose-Einstein statistics permits stimulated emission (laser light) and Bose-Einstein condensation — all bosons collapsing into the ground state below a critical temperature.
Definition S.3 — Common Traps
Microstates and macrostates are different levels: entropy counts microscopic arrangements compatible with one macrostate.
Z is more than normalization: derivatives of ln Z generate energy, entropy, and free energy.
Equipartition has limits: quantum level spacing freezes out modes when kBT is too small.
Fermions and bosons differ by occupancy rules: the plus/minus sign changes low-temperature behavior completely.
Exercises — S.1–S.4 Statistical Mechanics
1.
Using equipartition, derive the heat capacity Cv of a monatomic ideal gas. Express in terms of N,kB and as a number for one mole.
J/(mol·K)
Straightforward
2.For the two-level system (E=0,E=ε), plot the heat capacity C(T) qualitatively. Where is the Schottky peak? What happens as T→0 and T→∞?
Intermediate
3.Derive the Planck blackbody distribution from the Bose-Einstein distribution (μ=0). Show how this resolves the ultraviolet catastrophe.
Intermediate
4.Calculate the Fermi energy EF for a free electron gas with density n. Find the total ground-state energy and the degeneracy pressure. Why is Cv of electrons linear in T rather than constant?
Challenging
Key Takeaways
S=kBlnΩ— entropy counts microstates; the second law is just probability theory at scale.
Boltzmann distribution: P(E)∝e−βE,β=1/kBT. Higher energy → exponentially less probable.
Partition function Z=∑e−βE encodes all thermodynamics: ⟨E⟩=−∂lnZ/∂β.
Equipartition: ½kBT per quadratic DOF. Breaks down when kBT≪ε (quantum freezeout).
Fermions obey Fermi-Dirac: at T=0 all states below EF filled — explains metals, white dwarfs.
Bosons obey Bose-Einstein: photons → blackbody spectrum; at low T → Bose-Einstein condensation.