Microcanonical ensemble

The micro-canonical ensemble is sometimes considered to be the fundamental distribution of statistical thermodynamics, as its form can be justified on elementary grounds such as the principle of indifference: the micro-canonical ensemble describes the possible states of an isolated mechanical system when the energy is known exactly, but without any more information about the internal state. Also, in some special systems the evolution is ergodic in which case the micro-canonical ensemble is equal to the time-ensemble when starting out with a single state of energy E (a time-ensemble is the ensemble formed of all future states evolved from a single initial state).

In practice, the micro-canonical ensemble does not correspond to an experimentally realistic situation. With a real physical system there is at least some uncertainty in energy, due to uncontrolled factors in the preparation of the system. Besides the difficulty of finding an experimental analogue, it is difficult to carry out calculations that satisfy exactly the requirement of fixed energy since it prevents logically independent parts of the system from being analyzed separately. Moreover, there are ambiguities regarding the appropriate definitions of quantities such as entropy and temperature in the micro-canonical ensemble.[1]

Systems in thermal equilibrium with their environment have uncertainty in energy, and are instead described by the canonical ensemble or the grand canonical ensemble, the latter if the system is also in equilibrium with its environment in respect to particle exchange.

Early work in statistical mechanics by Ludwig Boltzmann led to his eponymous entropy equation for a system of a given total energy, S = k log W, where W is the number of distinct states accessible by the system at that energy. Boltzmann did not elaborate too deeply on what exactly constitutes the set of distinct states of a system, besides the special case of an ideal gas. This topic was investigated to completion by Josiah Willard Gibbs who developed the generalized statistical mechanics for arbitrary mechanical systems, and defined the micro-canonical ensemble described in this article.[1] Gibbs investigated carefully the analogies between the micro-canonical ensemble and thermodynamics, especially how they break down in the case of systems of few degrees of freedom. He introduced two further definitions of micro-canonical entropy that do not depend on ω - the volume and surface entropy described above. (Note that the surface entropy differs from the Boltzmann entropy only by an ω-dependent offset.)

The volume entropy S_v and associated T_v form a close analogy to thermodynamic entropy and temperature. It is possible to show exactly that

${\displaystyle dE=T_{\rm {v}}dS_{\rm {v}}-\langle P\rangle dV,}$

(⟨P⟩ is the ensemble average pressure) as expected for the first law of thermodynamics. A similar equation can be found for the surface (Boltzmann) entropy and its associated T_s, however the "pressure" in this equation is a complicated quantity unrelated to the average pressure.[1]

The micro-canonical T_v and T_s are not entirely satisfactory in their analogy to temperature. Outside of the thermodynamic limit, a number of artifacts occur.

• Nontrivial result of combining two systems: Two systems, each described by an independent micro-canonical ensemble, can be brought into thermal contact and be allowed to equilibriate into a combined system also described by a micro-canonical ensemble. Unfortunately, the energy flow between the two systems cannot be predicted based on the initial T's. Even when the initial T's are equal, there may be energy transferred. Moreover, the T of the combination is different from the initial values. This contradicts the intuition that temperature should be an intensive quantity, and that two equal-temperature systems should be unaffected by being brought into thermal contact.[1]
• Strange behavior for few-particle systems: Many results such as the micro-canonical Equipartition theorem acquire a one- or two-degree of freedom offset when written in terms of T_s. For a small systems this offset is significant, and so if we make S_s the analogue of entropy, several exceptions need to be made for systems with only one or two degrees of freedom.[1]
• Spurious negative temperatures: A negative T_s occurs whenever the density of states is decreasing with energy. In some systems the density of states is not monotonic in energy, and so T_s can change sign multiple times as the energy is increased.[4][5]

The preferred solution to these problems is avoid use of the micro-canonical ensemble. In many realistic cases a system is thermostatted to a heat bath so that the energy is not precisely known. Then, a more accurate description is the canonical ensemble or grand canonical ensemble, both of which have complete correspondence to thermodynamics.[6]

The precise mathematical expression for a statistical ensemble depends on the kind of mechanics under consideration—quantum or classical—since the notion of a "micro-state" is considerably different in these two cases. In quantum mechanics, diagonalization provides a discrete set of micro-states with specific energies. The classical mechanical case involves instead an integral over canonical phase space, and the size of micro-states in phase space can be chosen somewhat arbitrarily.

To construct the micro-canonical ensemble, it is necessary in both types of mechanics to first specify a range of energy. In the expressions below the function ${\displaystyle f({\tfrac {H-E}{\omega }})}$ (a function of H, peaking at E with width ω) will be used to represent the range of energy in which to include states. An example of this function would be[1]

${\displaystyle f(x)={\begin{cases}1,&\mathrm {if} ~|x|<{\tfrac {1}{2}},\\0,&\mathrm {otherwise.} \end{cases}}}$

or, more smoothly,

${\displaystyle f(x)=e^{-\pi x^{2}}.}$

Quantum mechanical

Example of microcanonical ensemble for a quantum system consisting of one particle in a potential well.

Plot of all possible states of this system. The available stationary states displayed as horizontal bars of varying darkness according to |ψ_i(x)|².

An ensemble containing only those states within a narrow interval of energy. As the energy width is taken to zero, a microcanonical ensemble is obtained (provided the interval contains at least one state).

The particle's Hamiltonian is Schrödinger-type, Ĥ = U(x) + p²/2m (the potential U(x) is plotted as a red curve). Each panel shows an energy-position plot with the various stationary states, along with a side plot showing the distribution of states in energy.

Further information on the representation of ensembles in quantum mechanics: Statistical ensemble (mathematical physics)

A statistical ensemble in quantum mechanics is represented by a density matrix, denoted by ${\displaystyle {\hat {\rho }}}$. The micro-canonical ensemble can be written using bra–ket notation, in terms of the system's energy eigenstates and energy eigenvalues. Given a complete basis of energy eigenstates |ψ_i⟩, indexed by i, the micro-canonical ensemble is

${\displaystyle {\hat {\rho }}={\frac {1}{W}}\sum _{i}f\left({\tfrac {H_{i}-E}{\omega }}\right)|\psi _{i}\rangle \langle \psi _{i}|,}$

where the H_i are the energy eigenvalues determined by ${\displaystyle {\hat {H}}|\psi _{i}\rangle =H_{i}|\psi _{i}\rangle }$ (here Ĥ is the system's total energy operator, i. e., Hamiltonian operator). The value of W is determined by demanding that ${\displaystyle {\hat {\rho }}}$ is a normalized density matrix, and so

${\displaystyle W=\sum _{i}f\left({\tfrac {H_{i}-E}{\omega }}\right).}$

The state volume function (used to calculate entropy) is given by

${\displaystyle v(E)=\sum _{H_{i}<E}1.}$

The micro-canonical ensemble is defined by taking the limit of the density matrix as the energy width goes to zero, however a problematic situation occurs once the energy width becomes smaller than the spacing between energy levels. For very small energy width, the ensemble does not exist at all for most values of E, since no states fall within the range. When the ensemble does exist, it typically only contains one (or two) states, since in a complex system the energy levels are only ever equal by accident (see random matrix theory for more discussion on this point). Moreover, the state-volume function also increases only in discrete increments, and so its derivative is only ever infinite or zero, making it difficult to define the density of states. This problem can be solved by not taking the energy range completely to zero and smoothing the state-volume function, however this makes the definition of the ensemble more complicated, since it becomes then necessary to specify the energy range in addition to other variables (together, an NVEω ensemble).

Classical mechanical

Example of microcanonical ensemble for a classical system consisting of one particle in a potential well.

Plot of all possible states of this system. The available physical states are evenly distributed in phase space, but with an uneven distribution in energy; the side-plot displays dv/dE.

An ensemble restricted to only those states within a narrow interval of energy. This ensemble appears as a thin shell in phase space. As the energy width is taken to zero, a microcanonical ensemble is obtained.

Each panel shows phase space (upper graph) and energy-position space (lower graph). The particle's Hamiltonian is H = U(x) + p²/2m, with the potential U(x) shown as a red curve. The side plot shows the distribution of states in energy.

Further information on the representation of ensembles in classical mechanics: Statistical ensemble (mathematical physics)

In classical mechanics, an ensemble is represented by a joint probability density function ρ(p₁, … p_n, q₁, … q_n) defined over the system's phase space.[1] The phase space has n generalized coordinates called q₁, … q_n, and n associated canonical momenta called p₁, … p_n.

The probability density function for the micro-canonical ensemble is:

${\displaystyle \rho ={\frac {1}{h^{n}C}}{\frac {1}{W}}f({\tfrac {H-E}{\omega }}),}$

where

• H is the total energy (Hamiltonian) of the system, a function of the phase (p₁, … q_n),
• h is an arbitrary but predetermined constant with the units of energy×time, setting the extent of one micro-state and providing correct dimensions to ρ.[note 2]
• C is an overcounting correction factor, often used for particle systems where identical particles are able to change place with each other.[note 3]

Again, the value of W is determined by demanding that ρ is a normalized probability density function:

${\displaystyle W=\int \ldots \int {\frac {1}{h^{n}C}}f({\tfrac {H-E}{\omega }})\,dp_{1}\ldots dq_{n}}$

This integral is taken over the entire phase space. The state volume function (used to calculate entropy) is defined by

${\displaystyle v(E)=\int \ldots \int _{H<E}{\frac {1}{h^{n}C}}\,dp_{1}\ldots dq_{n}.}$

As the energy width ω is taken to zero, the value of W decreases in proportion to ω as W = ω (dv/dE).

Based on the above definition, the micro-canonical ensemble can be visualized as an infinitesimally thin shell in phase space, centered on a constant-energy surface. Although the micro-canonical ensemble is confined to this surface, it is not necessarily uniformly distributed over that surface: if the gradient of energy in phase space varies, then the micro-canonical ensemble is "thicker" (more concentrated) in some parts of the surface than others. This feature is an unavoidable consequence of requiring that the micro-canonical ensemble is a steady-state ensemble.

Let's use the microcanonical description for characterize a perfect gas composed of N punctual particles in a volume V, of masse m and a void spin. The isolated gas has a total energy ${\displaystyle E\pm dE}$. As a reminder, the energy of a particule is quantified : ${\displaystyle E={\frac {\hbar ^{2}k^{2}}{2m}},k_{i}=n_{i}{\frac {2\pi }{L_{i}}}~n_{i}\in \mathbb {Z} }$. First of all, we should determine the number of vector having a norm such as ${\displaystyle {\frac {\hbar ^{2}k^{2}}{2m}}\leq E\iff k^{2}\leq {\frac {2mE}{\hbar ^{2}}}}$ while respecting the discretization of ${\displaystyle k}$.

Thus the phase volume function v(E) could be considered as the number of elementary mesh that we could put in a sphere of radius ${\displaystyle {\sqrt {\frac {2mE}{\hbar }}}}$. For N particles gas, k dimension is equal to 3N, the elementary mesh is then a hypercube of volume ${\displaystyle (k_{x}k_{y}k_{z})^{N}={\frac {V^{N}}{(2\pi )^{3N}}}}$ and the (3N-hyper) sphere of radius ${\displaystyle {\sqrt {\frac {2mE}{\hbar }}}}$ has a volume of ${\displaystyle {\frac {\pi ^{\frac {3N}{2}}}{\Gamma ({\frac {3N}{2}}+1)}}\left({\sqrt {\frac {2mE}{\hbar }}}\right)^{3N}}$, where ${\displaystyle \Gamma (x)}$ is the gamma function.

Hence, ${\displaystyle v(E)={\frac {Volume~of~the~hypersphere~of~radius{\sqrt {\frac {2mE}{\hbar }}}}{Volume~of~the~elementary~mesh}}}$

In order to determine the entropy we must exprimed ${\displaystyle {\frac {dv}{dE}}={\frac {V^{N}}{(2\pi )^{3N}}}({\frac {2m}{\hbar ^{2}}})^{\frac {3N}{2}}{\frac {\pi ^{\frac {3N}{2}}}{\Gamma ({\frac {3N}{2}}+1)}}{\frac {3N}{2}}E^{{\frac {3N}{2}}-1}}$

Particles being indistinguishable we divide the number of possible state by N! as part of Maxwell-Boltzmann approximation.

The entropy is then egal to : ${\displaystyle S=k~log\left({\frac {dv}{dE}}\right)=kN\left(log\left({\frac {V}{N}}\right)+{\frac {3}{2}}log\left({\frac {mE}{3\pi \hbar ^{2}N}}\right)+{\frac {5}{2}}\right)}$,where we used Stirling's approximation with ${\displaystyle N\gg 1}$, finally we find the Sackur–Tetrode equation.

We find easily the microcanonical temperatures ${\displaystyle {\frac {1}{T}}={\frac {\partial S}{\partial E}}={\frac {3}{2}}{\frac {N}{E}}k\iff E={\frac {3}{2}}kNT}$, we find the well known result of Kinetic theory of gases.

Moreover we find the famous ideal gas law, indeed we have ${\displaystyle {\frac {p}{T}}={\frac {\partial S}{\partial V}}={\frac {kN}{V}}\iff pV=NkT}$