Physics is inherently probabilistic at the quantum level and practical level alike. Probability theory, distributions, and statistical inference are tools every physicist uses — from analyzing data to formulating quantum mechanics.
PrerequisitesCalculus (Ch. 25) · Basic probability concepts
Learning Goals
Identify the Gaussian, Poisson, Maxwell-Boltzmann, and Lorentzian distributions and their physical applications.
Apply the central limit theorem to determine how measurement uncertainty decreases with sample size.
Propagate errors through a function of multiple independent measurements using partial derivatives.
Update beliefs from data using Bayes' theorem, distinguishing prior, likelihood, and posterior.
Interpret the chi-squared statistic and reduced chi-squared to assess goodness of fit.
PR.1 Probability Distributions
Definition PR.1 — Key Distributions in Physics
Gaussian (Normal):P(x)=2πσ21e−(x−μ)2/(2σ2). Appears whenever many independent random contributions add (CLT). Quantum measurement uncertainties, thermal fluctuations, noise.Poisson:P(k)=e−λλk/k! — probability of k events when mean is λ. Radioactive decay counting, photon shot noise, rare events.Maxwell-Boltzmann:f(v)=4πn(2πkBTm)3/2v2e−mv2/(2kBT). Speed distribution of ideal gas molecules.Cauchy (Lorentzian):P(x)=(Γ/π)/(x2+Γ2). Heavy tails; resonance line shapes, random walk in 2D. No finite mean or variance!
PR.2 Central Limit Theorem and Error Propagation
Theorem PR.1 — Central Limit Theorem
IfX1,X2,⋯,Xn are independent identically distributed random variables with mean μ and variance σ2, then the sample mean Xˉ=(X1+⋯+Xn)/n satisfies:(Xˉ−μ)/(σ/n)→N(0,1) as n→∞regardless of the distribution of individual Xi (provided the variance is finite). The standard error of the mean is σ/n— averaging n measurements reduces uncertainty by n. This is why averaging works and why the Gaussian distribution is universal.
Error propagation: if a quantity z = f(x, y, ...) depends on measured quantities with uncertainties σx,σy:
For independent measurements (σxy=0): σz2=∑i(∂f/∂xi)2σi2. For z = x·y:(σz/z)2=(σx/x)2+(σy/y)2 (relative errors add in quadrature).
Example PR.1 — Radioactive Decay Counting Statistics
A Geiger counter records an average count rate λ=100 counts/minute. How precisely is this known after T=5 minutes?
Poisson statistics:For N events counted, variance = N (Poisson property).
Total counts:N=λT=100×5=500 counts
Statistical uncertainty:σN=N=500≈22.4
Uncertainty in rate:σλ=σN/T=22.4/5=4.5 counts/min
Relative precision:σλ/λ=1/N=1/500=4.5. To get 1% precision: need N=10,000 counts (T=100min).
Systematic check:After T minutes, if we see N=λT by more than 3λT, investigate systematic errors. TheN rule is fundamental — shot noise is irreducible.
PR.3 Bayesian Inference
Bayesian statistics provides a framework for updating beliefs with data:
P(θ∣data)∝P(data∣θ)×P(θ)(Bayes’ theorem)(PR.2)
Here P(θ) is the prior (belief before seeing data), P(data|θ) is thelikelihood (probability of observing the data given parameter θ), and P(θ|data) is the posterior (updated belief). Bayesian methods are especially powerful when: (1) Prior information is available (previous experiments). (2) Data is limited. (3) Model comparison is needed. In gravitational wave detection, Bayesian parameter estimation recovers black hole masses, spins, and sky location from the noisy LIGO signal.
PR.4 The χ² Distribution and Goodness of Fit
For fitting a model with k free parameters to n data points, thechi-squared statistic is:
χ2=i∑σi2(yi−f(xi))2(chi-squared)(PR.3)
Under the null hypothesis (model is correct), χ²/(n−k) should be approximately 1 (reduced chi-squared). Values much greater than 1 indicate poor fit or underestimated errors; values much less than 1 indicate overestimated errors or overfitting.
The p-value — probability of observing χ² this large or larger by chance — is computed from the chi-squared distribution with ν = n−k degrees of freedom. Convention: p < 0.05 → reject null hypothesis at 95% confidence; in particle physics, p < 2.87×10⁻⁷ (5σ) is the "discovery" threshold.
Example PR.2 — Fitting a Decay Curve
You measure N(t)=N0e−λt at 5 time points. Find the best λ by maximum likelihood.
Likelihood:Each measurement Ni at time ti has Poisson uncertainty. Log-likelihood: lnL=∑i[Niln(N0e−λti)−N0e−λti].
Maximize over λ:d(lnL)/dλ=∑i[−Niti+N0tie−λti]=0
Equation:∑iNiti=N0∑itie−λti— solve numerically for λ^.
Uncertainty:σλ2=−1/(d2lnL/dλ2)=1/(N0∑iti2e−λti)— from the Fisher information.
Practical:For Gaussian noise, maximum likelihood reduces to least squares. For Poisson data (counting experiments), use Poisson likelihood.
Definition PR.2 — Common Traps
Probability density is not probability: integrate density over an interval to get probability.
Independence is an assumption: uncorrelated variables need not be independent.
Bayes' theorem updates beliefs with evidence: priors and likelihoods play different roles.
Standard deviation and standard error differ: one describes spread, the other uncertainty in a mean.
Exercises — PR.1–PR.4 Probability and Statistics
1.
A Geiger counter records 500 total counts. What is the relative statistical uncertainty on the count rate?
%
Straightforward
2.
A count rate of 100 counts/min is measured over T=5min. Find the uncertainty in the measured rate.
counts/min
Straightforward
3.For nitrogen molecules (M=28g/mol) at T=300K, find the mean, rms, and most probable speeds. Compare to the speed of sound.
Straightforward
4.Explain the t-test for comparing two experimental means. When is 2σ sufficient and when is 5σ required? What is the look-elsewhere effect?
Intermediate
5.Propagate errors for the pendulum measurement g=4π2L/T2: length L=1.000±0.001m, period T=2.007±0.002s. What is σg?
Intermediate
6.Connect information entropy S=−∑pilnpi to thermodynamic entropy via Jaynes's maximum entropy principle. State the Cramér-Rao bound and its quantum analog.