← Part IV/Fluctuations & Response Theory

Fluctuations & Response Theory

Reading time: ~55 minutes | Difficulty: Advanced | Prerequisites: Partition functions, ensemble theory

Thermal equilibrium is not static. Every observable quantity fluctuates spontaneously around its mean value, and these fluctuations carry deep information about how the system responds to external perturbations. The fluctuation-dissipation theorem establishes this profound connection: equilibrium noise determines out-of-equilibrium response.

Central Idea

A system in equilibrium at temperature $T$ undergoes spontaneous fluctuations in energy, volume, particle number, and other observables. These fluctuations are not random noise to be discarded — they encode the system's thermodynamic response functions (heat capacity, compressibility, susceptibility). Measuring the magnitude of fluctuations in equilibrium tells us how strongly the system will respond when driven out of equilibrium by an external force.

Why This Matters

  • Thermal noise in electronic circuits (Johnson-Nyquist noise) is directly related to electrical resistance
  • Brownian motion of colloidal particles reveals the viscosity of the surrounding fluid
  • Density fluctuations in fluids determine light scattering intensity (critical opalescence)
  • Magnetic susceptibility can be extracted from spin fluctuation measurements

Derivation 1: The Fluctuation-Dissipation Theorem

We derive the fundamental connection between equilibrium fluctuations and thermodynamic response functions. The key insight is that the variance of a thermodynamic quantity is determined by the derivative of its conjugate variable.

Energy Fluctuations and Heat Capacity

In the canonical ensemble, the probability of microstate $i$ with energy $E_i$ is:

$$P_i = \frac{e^{-\beta E_i}}{Z}, \quad Z = \sum_i e^{-\beta E_i}, \quad \beta = \frac{1}{k_B T}$$

The mean energy is $\langle E \rangle = \sum_i E_i P_i$. We compute the variance of energy by differentiating the partition function. Starting from the definition:

$$\langle E \rangle = -\frac{\partial \ln Z}{\partial \beta}$$

Differentiating again with respect to $\beta$:

$$\frac{\partial \langle E \rangle}{\partial \beta} = -\frac{\partial^2 \ln Z}{\partial \beta^2} = -\left(\langle E^2 \rangle - \langle E \rangle^2\right) = -\langle (\Delta E)^2 \rangle$$

Since $\beta = 1/(k_B T)$, we have $d\beta = -dT/(k_B T^2)$, so:

$$\frac{\partial \langle E \rangle}{\partial T} = C_V = \frac{\langle (\Delta E)^2 \rangle}{k_B T^2}$$

Result: Energy Fluctuations

$$\boxed{\langle (\Delta E)^2 \rangle = k_B T^2 C_V}$$

Energy fluctuations are directly proportional to the heat capacity. Large $C_V$ means large energy fluctuations — the system easily exchanges energy with its surroundings.

Volume Fluctuations and Compressibility

In the isothermal-isobaric ensemble (constant $T, P, N$), the partition function is:

$$\Delta(T, P, N) = \sum_V \sum_i e^{-\beta(E_i + PV)}$$

The mean volume is $\langle V \rangle = -(\partial \ln \Delta / \partial(\beta P))_T$. Differentiating again yields the volume fluctuations:

$$\langle (\Delta V)^2 \rangle = -k_B T \frac{\partial \langle V \rangle}{\partial P}\bigg|_T = k_B T V \kappa_T$$

Result: Volume Fluctuations

$$\boxed{\langle (\Delta V)^2 \rangle = k_B T V \kappa_T}$$

where $\kappa_T = -(1/V)(\partial V / \partial P)_T$ is the isothermal compressibility. A highly compressible system has large volume fluctuations.

Number Fluctuations and Compressibility

In the grand canonical ensemble (constant $T, V, \mu$), particle number fluctuates. The grand partition function is:

$$\mathcal{Z} = \sum_{N=0}^{\infty} e^{\beta \mu N} Z(T, V, N)$$

The mean particle number is $\langle N \rangle = k_B T (\partial \ln \mathcal{Z} / \partial \mu)_{T,V}$. Taking a second derivative:

$$\langle (\Delta N)^2 \rangle = k_B T \frac{\partial \langle N \rangle}{\partial \mu}\bigg|_{T,V}$$

Using the thermodynamic identity $(\partial \mu / \partial N)_{T,V} = V/(N^2 \kappa_T)$(derived from $\mu = (\partial G / \partial N)_{T,P}$ and the Gibbs-Duhem relation):

Result: Number Fluctuations

$$\boxed{\langle (\Delta N)^2 \rangle = \frac{k_B T N^2 \kappa_T}{V}}$$

For an ideal gas, $\kappa_T = 1/P = V/(Nk_BT)$, giving $\langle (\Delta N)^2 \rangle = N$ (Poisson statistics). Near a critical point, $\kappa_T \to \infty$, so number fluctuations diverge — this is critical opalescence.

Relative Fluctuations and the Thermodynamic Limit

For all three cases, the relative fluctuation scales as $\sqrt{\langle (\Delta X)^2 \rangle}/\langle X \rangle \sim 1/\sqrt{N}$. For $N \sim 10^{23}$, relative fluctuations are of order $10^{-12}$, justifying thermodynamics as an exact science for macroscopic systems. However, for nanoscale systems ($N \sim 100$), fluctuations become comparable to mean values, and statistical mechanics is essential.

Derivation 2: Einstein Theory of Fluctuations

Einstein's approach inverts the Boltzmann relation $S = k_B \ln \Omega$ to express the probability of a fluctuation in terms of the entropy change it produces. This provides a general framework for analyzing fluctuations of any set of thermodynamic variables.

Probability of a Fluctuation

From Boltzmann's relation, the number of microstates corresponding to a macrostate is $\Omega = e^{S/k_B}$. The probability of observing a macrostate with entropy $S$ relative to the equilibrium state with entropy $S_0$ is:

$$P \propto \Omega = e^{S/k_B} \propto e^{(S - S_0)/k_B} = e^{\Delta S / k_B}$$

Since fluctuations represent departures from the equilibrium maximum of $S$, we have $\Delta S \leq 0$, ensuring that the equilibrium state is the most probable.

Gaussian Approximation

Let $\{x_i\}$ denote a set of fluctuating extensive variables (energy, volume, etc.) with equilibrium values $\{x_i^{(0)}\}$. Define deviations $\Delta x_i = x_i - x_i^{(0)}$. Expanding the entropy to second order:

$$\Delta S = S - S_0 = \underbrace{\sum_i \frac{\partial S}{\partial x_i}\bigg|_0 \Delta x_i}_{= 0 \text{ (equilibrium)}} + \frac{1}{2} \sum_{ij} \frac{\partial^2 S}{\partial x_i \partial x_j}\bigg|_0 \Delta x_i \, \Delta x_j + \cdots$$

The first-order terms vanish at equilibrium (entropy is maximized). Defining the matrix:

$$g_{ij} = -\frac{\partial^2 S}{\partial x_i \partial x_j}\bigg|_0$$

the probability distribution becomes a multivariate Gaussian:

Einstein Fluctuation Formula

$$\boxed{P(\Delta x_1, \ldots, \Delta x_n) \propto \exp\!\left(-\frac{1}{2k_B} \sum_{ij} g_{ij} \, \Delta x_i \, \Delta x_j\right)}$$

The matrix $g_{ij}$ must be positive definite for the equilibrium to be stable (Le Chatelier's principle).

Correlation Matrix

For a multivariate Gaussian, the correlation matrix is the inverse of the coefficient matrix. This gives the fundamental result:

Fluctuation Correlations

$$\boxed{\langle \Delta x_i \, \Delta x_j \rangle = k_B \left(g^{-1}\right)_{ij} = -k_B \left(\frac{\partial^2 S}{\partial x_i \partial x_j}\right)^{-1}}$$

This elegant result recovers all the specific fluctuation formulas derived earlier. For example, taking $x = E$ at constant $V$ and $N$, we have $\partial^2 S / \partial E^2 = -1/(T^2 C_V)$, recovering $\langle (\Delta E)^2 \rangle = k_B T^2 C_V$.

Cross-Correlations

Einstein's theory also predicts cross-correlations between different variables. For instance, energy and volume fluctuations are correlated in general:

$$\langle \Delta E \, \Delta V \rangle = k_B T \left[T\left(\frac{\partial P}{\partial T}\right)_V - P\right] V \kappa_T$$

These cross-correlations vanish only when the off-diagonal elements of the entropy Hessian are zero, which corresponds to statistical independence of the fluctuating variables.

Derivation 3: Onsager Reciprocal Relations

Lars Onsager's 1931 breakthrough extended the fluctuation-dissipation connection to irreversible transport processes. The Onsager reciprocal relations state that cross-transport coefficients are symmetric, a consequence of microscopic reversibility (time-reversal symmetry).

Linear Irreversible Thermodynamics

Near equilibrium, the rate of entropy production can be written as a bilinear form of thermodynamic fluxes $J_i$ and forces $X_i$:

$$\frac{dS}{dt} = \sum_i J_i X_i \geq 0$$

The linear phenomenological relations express fluxes as linear combinations of forces:

$$J_i = \sum_j L_{ij} X_j$$

where $L_{ij}$ are the phenomenological (Onsager) transport coefficients. The diagonal coefficients ($L_{ii}$) represent direct transport (e.g., thermal conductivity, electrical conductivity), while the off-diagonal coefficients ($L_{ij}, i \neq j$) represent cross-effects (e.g., thermoelectric coupling, the Soret effect).

Regression Hypothesis

Onsager's key insight was the regression hypothesis: spontaneous fluctuations in a system at equilibrium decay, on average, according to the same macroscopic transport equations that govern the relaxation of externally imposed perturbations. If $\alpha_i(t)$ denotes the deviation of variable $i$ from equilibrium:

$$\frac{d\langle \alpha_i(t) \rangle_{\text{conditional}}}{dt} = -\sum_j M_{ij} \langle \alpha_j(t) \rangle_{\text{conditional}}$$

where the conditional average is taken over all microstates that produce a specific fluctuation at $t = 0$, and $M_{ij}$ are the same relaxation coefficients appearing in the macroscopic equations.

Derivation of Reciprocal Relations

From microscopic reversibility (the equations of motion are invariant under time reversal), the time correlation functions satisfy:

$$\langle \alpha_i(0) \, \alpha_j(\tau) \rangle = \langle \alpha_i(\tau) \, \alpha_j(0) \rangle = \langle \alpha_j(0) \, \alpha_i(\tau) \rangle$$

Differentiating with respect to $\tau$ and evaluating at $\tau = 0$:

$$\langle \alpha_i(0) \, \dot{\alpha}_j(0) \rangle = \langle \alpha_j(0) \, \dot{\alpha}_i(0) \rangle$$

Applying the regression hypothesis and using $\langle \alpha_i \alpha_k \rangle = k_B (g^{-1})_{ik}$ from Einstein's theory, this becomes:

Onsager Reciprocal Relations

$$\boxed{L_{ij} = L_{ji}}$$

The matrix of transport coefficients is symmetric. This is a direct consequence of time-reversal invariance of the microscopic dynamics. For variables that are odd under time reversal (e.g., magnetic field, angular momentum), the relation becomes $L_{ij}(B) = L_{ji}(-B)$.

Application: Thermoelectric Effects

The coupled transport of heat and electric charge provides a classic application. The fluxes are heat current $J_Q$ and electrical current $J_e$, driven by temperature gradient and electrochemical potential gradient:

$$\begin{pmatrix} J_Q \\ J_e \end{pmatrix} = \begin{pmatrix} L_{QQ} & L_{Qe} \\ L_{eQ} & L_{ee} \end{pmatrix} \begin{pmatrix} \nabla(1/T) \\ -\nabla(\mu/T) \end{pmatrix}$$

The Onsager relation $L_{Qe} = L_{eQ}$ connects three experimentally distinct phenomena:

  • Seebeck effect: A temperature difference generates a voltage (thermocouples). The Seebeck coefficient is $\mathcal{S} = -L_{eQ}/(T \, L_{ee})$.
  • Peltier effect: An electric current carries heat (thermoelectric cooling). The Peltier coefficient is $\Pi = L_{Qe}/L_{ee}$.
  • Thomson relation: From $L_{Qe} = L_{eQ}$, it follows that $\Pi = T\mathcal{S}$, connecting Seebeck and Peltier coefficients.

Derivation 4: Time Correlation Functions

Time correlation functions extend the fluctuation-dissipation framework to dynamics. They describe how fluctuations persist and decay over time, encoding both the magnitude and the timescale of equilibrium fluctuations.

Definition and Properties

For a dynamical variable $A(t)$ fluctuating in equilibrium, the time autocorrelation function is defined as:

$$C_{AA}(t) = \langle A(0) \, A(t) \rangle = \lim_{\mathcal{T} \to \infty} \frac{1}{\mathcal{T}} \int_0^{\mathcal{T}} A(t') \, A(t' + t) \, dt'$$

Key properties of time correlation functions:

  • $C_{AA}(0) = \langle A^2 \rangle$ — the equal-time value gives the mean-square fluctuation
  • $C_{AA}(t) \to \langle A \rangle^2$ as $t \to \infty$ — correlations decay at long times
  • $C_{AA}(t) = C_{AA}(-t)$ — time-reversal symmetry (even function)
  • $|C_{AA}(t)| \leq C_{AA}(0)$ — the autocorrelation is bounded by its initial value

The normalized autocorrelation function is:

$$\hat{C}_{AA}(t) = \frac{\langle \delta A(0) \, \delta A(t) \rangle}{\langle (\delta A)^2 \rangle}, \quad \delta A = A - \langle A \rangle$$

which satisfies $\hat{C}(0) = 1$ and $\hat{C}(\infty) = 0$. The correlation time is:

$$\tau_c = \int_0^{\infty} \hat{C}_{AA}(t) \, dt$$

Green-Kubo Relations

The Green-Kubo relations express transport coefficients as time integrals of equilibrium current-current correlation functions. They are the dynamical generalization of the static fluctuation-dissipation relations.

The general form for a transport coefficient $L$ associated with a flux $J$ is:

Green-Kubo Formula

$$\boxed{L = \frac{V}{k_B T} \int_0^{\infty} \langle J(0) \, J(t) \rangle \, dt}$$

Diffusion Coefficient from Velocity Autocorrelation

Consider a particle undergoing Brownian motion. Its position evolves as:

$$\mathbf{r}(t) - \mathbf{r}(0) = \int_0^t \mathbf{v}(t') \, dt'$$

The mean-square displacement is:

$$\langle |\mathbf{r}(t) - \mathbf{r}(0)|^2 \rangle = \int_0^t \int_0^t \langle \mathbf{v}(t_1) \cdot \mathbf{v}(t_2) \rangle \, dt_1 \, dt_2$$

For long times, Einstein's diffusion relation gives $\langle |\Delta \mathbf{r}|^2 \rangle = 6Dt$ in 3D, leading to:

Green-Kubo Relation for Diffusion

$$\boxed{D = \frac{1}{3} \int_0^{\infty} \langle \mathbf{v}(0) \cdot \mathbf{v}(t) \rangle \, dt}$$

The diffusion coefficient equals one-third of the time integral of the velocity autocorrelation function. The factor of 1/3 accounts for three spatial dimensions.

Other Green-Kubo Relations

  • Shear viscosity: $\eta = \frac{V}{k_B T} \int_0^{\infty} \langle \sigma_{xy}(0) \, \sigma_{xy}(t) \rangle \, dt$ where $\sigma_{xy}$ is the off-diagonal stress tensor
  • Thermal conductivity: $\lambda = \frac{V}{k_B T^2} \int_0^{\infty} \langle J_Q(0) \, J_Q(t) \rangle \, dt$ where $J_Q$ is the heat current
  • Electrical conductivity: $\sigma = \frac{V}{k_B T} \int_0^{\infty} \langle J_e(0) \, J_e(t) \rangle \, dt$ where $J_e$ is the electric current density

Applications

Dynamic Light Scattering

Light scattered from density fluctuations in a fluid carries information about the density-density time correlation function. The power spectrum of scattered light is the Fourier transform of $\langle \rho(\mathbf{q},0)\,\rho(-\mathbf{q},t)\rangle$, giving the dynamic structure factor $S(\mathbf{q}, \omega)$. For dilute colloidal suspensions, the intensity autocorrelation decays as $e^{-Dq^2 t}$, directly yielding the diffusion coefficient and hence particle size via the Stokes-Einstein relation.

NMR Relaxation

Nuclear magnetic resonance relaxation times $T_1$ and $T_2$ are determined by the spectral density of local magnetic field fluctuations at the nuclear site. The spectral density $J(\omega)$ is the Fourier transform of the dipolar correlation function. Molecular tumbling modulates dipole-dipole interactions, and the correlation time $\tau_c$ determines whether relaxation is in the fast-motion ($\omega\tau_c \ll 1$) or slow-motion ($\omega\tau_c \gg 1$) regime.

Johnson-Nyquist Noise

An electrical resistor at temperature $T$ generates a random voltage across its terminals with power spectral density $S_V(f) = 4k_BT R$. This is a direct application of the fluctuation-dissipation theorem: the dissipative element (resistance $R$) determines the magnitude of equilibrium voltage fluctuations. Nyquist derived this in 1928, and it sets the fundamental thermal noise floor for electronic measurements.

Brownian Motion

Einstein's 1905 analysis of Brownian motion was the first fluctuation-dissipation result. The diffusion coefficient of a spherical particle of radius $a$ in a fluid of viscosity $\eta$ is $D = k_BT/(6\pi\eta a)$ (Stokes-Einstein relation). The thermal energy $k_BT$ drives fluctuations, while the friction coefficient $\gamma = 6\pi\eta a$ dissipates them. This allowed Perrin to determine Avogadro's number experimentally, confirming the atomic hypothesis.

Historical Context

1905 — Einstein's Brownian Motion

Albert Einstein showed that the observable diffusion of microscopic particles results from molecular bombardment, relating the diffusion coefficient to temperature and friction ($D = k_BT/\gamma$). This was the first quantitative fluctuation-dissipation result and provided decisive evidence for the existence of atoms. Independently, Marian Smoluchowski derived similar results using a different approach.

1928 — Nyquist's Thermal Noise Formula

Harry Nyquist derived the thermal noise voltage in resistors using thermodynamic arguments applied to transmission lines. Johnson experimentally confirmed the prediction in the same year. The result $\langle V^2 \rangle = 4k_BTR\,\Delta f$ established that equilibrium electrical noise is determined solely by resistance and temperature.

1931 — Onsager's Reciprocal Relations

Lars Onsager combined the regression hypothesis with microscopic reversibility to prove that cross-transport coefficients are symmetric ($L_{ij} = L_{ji}$). This work, which founded the field of irreversible thermodynamics, earned Onsager the 1968 Nobel Prize in Chemistry. The relations unified previously disconnected phenomena in thermoelectricity, electrokinetics, and coupled diffusion.

1957 — Kubo's Linear Response Theory

Ryogo Kubo formulated the general quantum mechanical theory of linear response, deriving the fluctuation-dissipation theorem in its full generality. The Kubo formula expresses the response of any observable to an external perturbation in terms of equilibrium time correlation functions, unifying all previous results into a single theoretical framework and providing the Green-Kubo relations for transport coefficients.

Python Simulation: Brownian Motion & Green-Kubo Diffusion

We simulate a Brownian particle using the Langevin equation, compute the velocity autocorrelation function, and extract the diffusion coefficient via the Green-Kubo relation. The Langevin equation for a particle of mass $m$ with friction coefficient $\gamma$ is:

$$m\frac{dv}{dt} = -\gamma v + \xi(t), \quad \langle \xi(t)\xi(t')\rangle = 2\gamma k_BT\,\delta(t-t')$$

Brownian Motion: Langevin Dynamics & Green-Kubo Diffusion Coefficient

Python
script.py144 lines

Click Run to execute the Python code

Code will be executed with Python 3 on the server

Fortran Simulation: Ideal Gas Fluctuation Properties

We compute the fluctuation properties and response functions for an ideal gas, verifying the fluctuation-dissipation relations analytically and numerically. The program calculates energy, volume, and number fluctuations and compares them with the corresponding response functions.

Ideal Gas Fluctuations & Response Functions

Fortran
program.f90287 lines

Click Run to execute the Fortran code

Code will be compiled with gfortran and executed on the server