Fluctuations & Response Theory
Reading time: ~55 minutes | Difficulty: Advanced | Prerequisites: Partition functions, ensemble theory
Thermal equilibrium is not static. Every observable quantity fluctuates spontaneously around its mean value, and these fluctuations carry deep information about how the system responds to external perturbations. The fluctuation-dissipation theorem establishes this profound connection: equilibrium noise determines out-of-equilibrium response.
Central Idea
A system in equilibrium at temperature $T$ undergoes spontaneous fluctuations in energy, volume, particle number, and other observables. These fluctuations are not random noise to be discarded — they encode the system's thermodynamic response functions (heat capacity, compressibility, susceptibility). Measuring the magnitude of fluctuations in equilibrium tells us how strongly the system will respond when driven out of equilibrium by an external force.
Why This Matters
- Thermal noise in electronic circuits (Johnson-Nyquist noise) is directly related to electrical resistance
- Brownian motion of colloidal particles reveals the viscosity of the surrounding fluid
- Density fluctuations in fluids determine light scattering intensity (critical opalescence)
- Magnetic susceptibility can be extracted from spin fluctuation measurements
Derivation 1: The Fluctuation-Dissipation Theorem
We derive the fundamental connection between equilibrium fluctuations and thermodynamic response functions. The key insight is that the variance of a thermodynamic quantity is determined by the derivative of its conjugate variable.
Energy Fluctuations and Heat Capacity
In the canonical ensemble, the probability of microstate $i$ with energy $E_i$ is:
The mean energy is $\langle E \rangle = \sum_i E_i P_i$. We compute the variance of energy by differentiating the partition function. Starting from the definition:
Differentiating again with respect to $\beta$:
Since $\beta = 1/(k_B T)$, we have $d\beta = -dT/(k_B T^2)$, so:
Result: Energy Fluctuations
Energy fluctuations are directly proportional to the heat capacity. Large $C_V$ means large energy fluctuations — the system easily exchanges energy with its surroundings.
Volume Fluctuations and Compressibility
In the isothermal-isobaric ensemble (constant $T, P, N$), the partition function is:
The mean volume is $\langle V \rangle = -(\partial \ln \Delta / \partial(\beta P))_T$. Differentiating again yields the volume fluctuations:
Result: Volume Fluctuations
where $\kappa_T = -(1/V)(\partial V / \partial P)_T$ is the isothermal compressibility. A highly compressible system has large volume fluctuations.
Number Fluctuations and Compressibility
In the grand canonical ensemble (constant $T, V, \mu$), particle number fluctuates. The grand partition function is:
The mean particle number is $\langle N \rangle = k_B T (\partial \ln \mathcal{Z} / \partial \mu)_{T,V}$. Taking a second derivative:
Using the thermodynamic identity $(\partial \mu / \partial N)_{T,V} = V/(N^2 \kappa_T)$(derived from $\mu = (\partial G / \partial N)_{T,P}$ and the Gibbs-Duhem relation):
Result: Number Fluctuations
For an ideal gas, $\kappa_T = 1/P = V/(Nk_BT)$, giving $\langle (\Delta N)^2 \rangle = N$ (Poisson statistics). Near a critical point, $\kappa_T \to \infty$, so number fluctuations diverge — this is critical opalescence.
Relative Fluctuations and the Thermodynamic Limit
For all three cases, the relative fluctuation scales as $\sqrt{\langle (\Delta X)^2 \rangle}/\langle X \rangle \sim 1/\sqrt{N}$. For $N \sim 10^{23}$, relative fluctuations are of order $10^{-12}$, justifying thermodynamics as an exact science for macroscopic systems. However, for nanoscale systems ($N \sim 100$), fluctuations become comparable to mean values, and statistical mechanics is essential.
Derivation 2: Einstein Theory of Fluctuations
Einstein's approach inverts the Boltzmann relation $S = k_B \ln \Omega$ to express the probability of a fluctuation in terms of the entropy change it produces. This provides a general framework for analyzing fluctuations of any set of thermodynamic variables.
Probability of a Fluctuation
From Boltzmann's relation, the number of microstates corresponding to a macrostate is $\Omega = e^{S/k_B}$. The probability of observing a macrostate with entropy $S$ relative to the equilibrium state with entropy $S_0$ is:
Since fluctuations represent departures from the equilibrium maximum of $S$, we have $\Delta S \leq 0$, ensuring that the equilibrium state is the most probable.
Gaussian Approximation
Let $\{x_i\}$ denote a set of fluctuating extensive variables (energy, volume, etc.) with equilibrium values $\{x_i^{(0)}\}$. Define deviations $\Delta x_i = x_i - x_i^{(0)}$. Expanding the entropy to second order:
The first-order terms vanish at equilibrium (entropy is maximized). Defining the matrix:
the probability distribution becomes a multivariate Gaussian:
Einstein Fluctuation Formula
The matrix $g_{ij}$ must be positive definite for the equilibrium to be stable (Le Chatelier's principle).
Correlation Matrix
For a multivariate Gaussian, the correlation matrix is the inverse of the coefficient matrix. This gives the fundamental result:
Fluctuation Correlations
This elegant result recovers all the specific fluctuation formulas derived earlier. For example, taking $x = E$ at constant $V$ and $N$, we have $\partial^2 S / \partial E^2 = -1/(T^2 C_V)$, recovering $\langle (\Delta E)^2 \rangle = k_B T^2 C_V$.
Cross-Correlations
Einstein's theory also predicts cross-correlations between different variables. For instance, energy and volume fluctuations are correlated in general:
These cross-correlations vanish only when the off-diagonal elements of the entropy Hessian are zero, which corresponds to statistical independence of the fluctuating variables.
Derivation 3: Onsager Reciprocal Relations
Lars Onsager's 1931 breakthrough extended the fluctuation-dissipation connection to irreversible transport processes. The Onsager reciprocal relations state that cross-transport coefficients are symmetric, a consequence of microscopic reversibility (time-reversal symmetry).
Linear Irreversible Thermodynamics
Near equilibrium, the rate of entropy production can be written as a bilinear form of thermodynamic fluxes $J_i$ and forces $X_i$:
The linear phenomenological relations express fluxes as linear combinations of forces:
where $L_{ij}$ are the phenomenological (Onsager) transport coefficients. The diagonal coefficients ($L_{ii}$) represent direct transport (e.g., thermal conductivity, electrical conductivity), while the off-diagonal coefficients ($L_{ij}, i \neq j$) represent cross-effects (e.g., thermoelectric coupling, the Soret effect).
Regression Hypothesis
Onsager's key insight was the regression hypothesis: spontaneous fluctuations in a system at equilibrium decay, on average, according to the same macroscopic transport equations that govern the relaxation of externally imposed perturbations. If $\alpha_i(t)$ denotes the deviation of variable $i$ from equilibrium:
where the conditional average is taken over all microstates that produce a specific fluctuation at $t = 0$, and $M_{ij}$ are the same relaxation coefficients appearing in the macroscopic equations.
Derivation of Reciprocal Relations
From microscopic reversibility (the equations of motion are invariant under time reversal), the time correlation functions satisfy:
Differentiating with respect to $\tau$ and evaluating at $\tau = 0$:
Applying the regression hypothesis and using $\langle \alpha_i \alpha_k \rangle = k_B (g^{-1})_{ik}$ from Einstein's theory, this becomes:
Onsager Reciprocal Relations
The matrix of transport coefficients is symmetric. This is a direct consequence of time-reversal invariance of the microscopic dynamics. For variables that are odd under time reversal (e.g., magnetic field, angular momentum), the relation becomes $L_{ij}(B) = L_{ji}(-B)$.
Application: Thermoelectric Effects
The coupled transport of heat and electric charge provides a classic application. The fluxes are heat current $J_Q$ and electrical current $J_e$, driven by temperature gradient and electrochemical potential gradient:
The Onsager relation $L_{Qe} = L_{eQ}$ connects three experimentally distinct phenomena:
- Seebeck effect: A temperature difference generates a voltage (thermocouples). The Seebeck coefficient is $\mathcal{S} = -L_{eQ}/(T \, L_{ee})$.
- Peltier effect: An electric current carries heat (thermoelectric cooling). The Peltier coefficient is $\Pi = L_{Qe}/L_{ee}$.
- Thomson relation: From $L_{Qe} = L_{eQ}$, it follows that $\Pi = T\mathcal{S}$, connecting Seebeck and Peltier coefficients.
Derivation 4: Time Correlation Functions
Time correlation functions extend the fluctuation-dissipation framework to dynamics. They describe how fluctuations persist and decay over time, encoding both the magnitude and the timescale of equilibrium fluctuations.
Definition and Properties
For a dynamical variable $A(t)$ fluctuating in equilibrium, the time autocorrelation function is defined as:
Key properties of time correlation functions:
- $C_{AA}(0) = \langle A^2 \rangle$ — the equal-time value gives the mean-square fluctuation
- $C_{AA}(t) \to \langle A \rangle^2$ as $t \to \infty$ — correlations decay at long times
- $C_{AA}(t) = C_{AA}(-t)$ — time-reversal symmetry (even function)
- $|C_{AA}(t)| \leq C_{AA}(0)$ — the autocorrelation is bounded by its initial value
The normalized autocorrelation function is:
which satisfies $\hat{C}(0) = 1$ and $\hat{C}(\infty) = 0$. The correlation time is:
Green-Kubo Relations
The Green-Kubo relations express transport coefficients as time integrals of equilibrium current-current correlation functions. They are the dynamical generalization of the static fluctuation-dissipation relations.
The general form for a transport coefficient $L$ associated with a flux $J$ is:
Green-Kubo Formula
Diffusion Coefficient from Velocity Autocorrelation
Consider a particle undergoing Brownian motion. Its position evolves as:
The mean-square displacement is:
For long times, Einstein's diffusion relation gives $\langle |\Delta \mathbf{r}|^2 \rangle = 6Dt$ in 3D, leading to:
Green-Kubo Relation for Diffusion
The diffusion coefficient equals one-third of the time integral of the velocity autocorrelation function. The factor of 1/3 accounts for three spatial dimensions.
Other Green-Kubo Relations
- Shear viscosity: $\eta = \frac{V}{k_B T} \int_0^{\infty} \langle \sigma_{xy}(0) \, \sigma_{xy}(t) \rangle \, dt$ where $\sigma_{xy}$ is the off-diagonal stress tensor
- Thermal conductivity: $\lambda = \frac{V}{k_B T^2} \int_0^{\infty} \langle J_Q(0) \, J_Q(t) \rangle \, dt$ where $J_Q$ is the heat current
- Electrical conductivity: $\sigma = \frac{V}{k_B T} \int_0^{\infty} \langle J_e(0) \, J_e(t) \rangle \, dt$ where $J_e$ is the electric current density
Applications
Dynamic Light Scattering
Light scattered from density fluctuations in a fluid carries information about the density-density time correlation function. The power spectrum of scattered light is the Fourier transform of $\langle \rho(\mathbf{q},0)\,\rho(-\mathbf{q},t)\rangle$, giving the dynamic structure factor $S(\mathbf{q}, \omega)$. For dilute colloidal suspensions, the intensity autocorrelation decays as $e^{-Dq^2 t}$, directly yielding the diffusion coefficient and hence particle size via the Stokes-Einstein relation.
NMR Relaxation
Nuclear magnetic resonance relaxation times $T_1$ and $T_2$ are determined by the spectral density of local magnetic field fluctuations at the nuclear site. The spectral density $J(\omega)$ is the Fourier transform of the dipolar correlation function. Molecular tumbling modulates dipole-dipole interactions, and the correlation time $\tau_c$ determines whether relaxation is in the fast-motion ($\omega\tau_c \ll 1$) or slow-motion ($\omega\tau_c \gg 1$) regime.
Johnson-Nyquist Noise
An electrical resistor at temperature $T$ generates a random voltage across its terminals with power spectral density $S_V(f) = 4k_BT R$. This is a direct application of the fluctuation-dissipation theorem: the dissipative element (resistance $R$) determines the magnitude of equilibrium voltage fluctuations. Nyquist derived this in 1928, and it sets the fundamental thermal noise floor for electronic measurements.
Brownian Motion
Einstein's 1905 analysis of Brownian motion was the first fluctuation-dissipation result. The diffusion coefficient of a spherical particle of radius $a$ in a fluid of viscosity $\eta$ is $D = k_BT/(6\pi\eta a)$ (Stokes-Einstein relation). The thermal energy $k_BT$ drives fluctuations, while the friction coefficient $\gamma = 6\pi\eta a$ dissipates them. This allowed Perrin to determine Avogadro's number experimentally, confirming the atomic hypothesis.
Historical Context
1905 — Einstein's Brownian Motion
Albert Einstein showed that the observable diffusion of microscopic particles results from molecular bombardment, relating the diffusion coefficient to temperature and friction ($D = k_BT/\gamma$). This was the first quantitative fluctuation-dissipation result and provided decisive evidence for the existence of atoms. Independently, Marian Smoluchowski derived similar results using a different approach.
1928 — Nyquist's Thermal Noise Formula
Harry Nyquist derived the thermal noise voltage in resistors using thermodynamic arguments applied to transmission lines. Johnson experimentally confirmed the prediction in the same year. The result $\langle V^2 \rangle = 4k_BTR\,\Delta f$ established that equilibrium electrical noise is determined solely by resistance and temperature.
1931 — Onsager's Reciprocal Relations
Lars Onsager combined the regression hypothesis with microscopic reversibility to prove that cross-transport coefficients are symmetric ($L_{ij} = L_{ji}$). This work, which founded the field of irreversible thermodynamics, earned Onsager the 1968 Nobel Prize in Chemistry. The relations unified previously disconnected phenomena in thermoelectricity, electrokinetics, and coupled diffusion.
1957 — Kubo's Linear Response Theory
Ryogo Kubo formulated the general quantum mechanical theory of linear response, deriving the fluctuation-dissipation theorem in its full generality. The Kubo formula expresses the response of any observable to an external perturbation in terms of equilibrium time correlation functions, unifying all previous results into a single theoretical framework and providing the Green-Kubo relations for transport coefficients.
Python Simulation: Brownian Motion & Green-Kubo Diffusion
We simulate a Brownian particle using the Langevin equation, compute the velocity autocorrelation function, and extract the diffusion coefficient via the Green-Kubo relation. The Langevin equation for a particle of mass $m$ with friction coefficient $\gamma$ is:
Brownian Motion: Langevin Dynamics & Green-Kubo Diffusion Coefficient
PythonClick Run to execute the Python code
Code will be executed with Python 3 on the server
Fortran Simulation: Ideal Gas Fluctuation Properties
We compute the fluctuation properties and response functions for an ideal gas, verifying the fluctuation-dissipation relations analytically and numerically. The program calculates energy, volume, and number fluctuations and compares them with the corresponding response functions.
Ideal Gas Fluctuations & Response Functions
FortranClick Run to execute the Fortran code
Code will be compiled with gfortran and executed on the server