What Is Entropy?

Note 1. Rudolf Clausius, “Ueber verschiedene für die Anwendung bequeme Formen der Hauptgleichungen der mechanischen Wärmetheorie,” Annalen der Physik 201 (1865): 353-400. Clausius introduced the term entropy from the Greek τροπή (transformation), deliberately echoing energy to emphasize the connection between the two concepts.

Note 2. Bejan, Adrian, “Constructal-theory network of conducting paths for cooling a heat generating volume,” International Journal of Heat and Mass Transfer 40 (1997): 799-816. Bejan’s Constructal Law formalizes the principle that flow systems evolve toward configurations that provide easier access to currents — explaining why rivers carve canyons and why branching structures recur at every scale.

Note 3. England, Jeremy, “Statistical physics of self-replication,” Journal of Chemical Physics 139 (2013): 121923. England’s dissipation-driven adaptation framework proposes a thermodynamic account of life’s emergence: matter driven by an external energy source while in contact with a heat bath tends to self-organize into configurations that absorb and dissipate that energy more efficiently.

Note 4. Penrose, Roger, The Road to Reality: A Complete Guide to the Laws of the Universe (2004), Chapters 27-28. Penrose’s discussion of the arrow of time connects entropy increase to the directionality of memory and experience. See also Barbour’s The Janus Point (2020) for an alternative account of time’s arrow grounded in shape complexity rather than thermodynamic entropy.

Note 4a. Thomas Hertog, On the Origin of Time: Stephen Hawking’s Final Theory (Bantam Press, 2023). Hertog and Hawking’s holographic cosmology proposes that the laws of physics evolved with the universe rather than preceding it — that going back toward the Big Bang, the distinction between space and time dissolves and even the concept of physical law “evaporates.” The framework uses the holographic principle to embed the observer’s perspective within the cosmological model, yielding an evolutionary rather than Platonic account of why the laws are what they are. See also Hertog’s interview with Janna Levin, “Why Did The Universe Begin?” The Joy of Why, Quanta Magazine (July 2025). For the technical framework: Hertog, T. and Hawking, S.W., “A smooth exit from eternal inflation?” Journal of High Energy Physics 2018:147 (2018).

Note 5. Amir Haji-Akbari et al., “Disordered, quasicrystalline and crystalline phases of densely packed tetrahedra,” Nature 462 (2009): 773-777. The simulation used no forces at all beyond hard-particle exclusion, the rule that particles cannot overlap. The quasicrystal emerged from entropy alone. For the “entropy is about options” framing of Sharon Glotzer, the study’s senior author, see the Joy of x podcast interview with Steven Strogatz (Quanta Magazine, 2021).

Note 5a. Shannon, Claude E. “A Mathematical Theory of Communication.” Bell System Technical Journal 27 (1948): 379-423, 623-656.

Note 5b. Tsallis, Constantino. “Possible Generalization of Boltzmann-Gibbs Statistics.” Journal of Statistical Physics 52 (1988): 479-487.

Note 5c. Baez, J.C., Fritz, T., and Leinster, T., “A characterization of entropy in terms of information loss,” Entropy 13(11): 1945-1957 (2011). The theorem characterizes entropy loss over finite probability spaces as a functor from the category FinProb, grounding Khinchin’s conditions in category theory. A category is a collection of objects together with all the legitimate ways of getting from one object to another; FinProb holds every finite probability distribution (a loaded die, a shuffled deck, the possible states of a small gas) along with the processes that turn one distribution into another. A functor is a map out of such a collection that respects composition: whatever it says about running two processes back to back is fixed by what it says about each one alone, the way a good translation carries the grammar of one language faithfully into another. Whenever a process throws information away, entropy is what measures the loss, and it is the only measure (up to a choice of units) consistent with how processes compose. Khinchin’s additivity condition (two cups of tea on opposite desks) reappears here as the demand that the map respect composition. The practical consequence: entropy does not merely happen to follow the same rules at different scales; it must, because it is the only quantity that respects how systems combine.

Note 5d. Sekiya, R., Itahashi, K. et al., “Excitation Spectra of the ¹²C(p,d) Reaction near the η′-Meson Emission Threshold Measured in Coincidence with High-Momentum Protons,” Physical Review Letters 136(14) (2026), DOI: 10.1103/6vsl-ng7x. Two features of the vacuum give the η′ meson its unusually large mass: the chiral condensate, a pervasive background pairing of quarks and antiquarks that fills what looks like empty space, and the axial U(1) quantum anomaly of QCD, the quantum theory’s violation of a symmetry the classical equations respect. Both belong to the surroundings rather than to the particle, which is why a dense environment can shift the mass. The reported in-nucleus lightening is a roughly two-sigma indication after the look-elsewhere correction, not yet a confirmed measurement.

Note 6. Paul Erker et al., “Autonomous Quantum Clocks: Does Thermodynamics Limit Our Ability to Measure Time?” Physical Review X 7 (2017): 031022. The fundamental accuracy-entropy tradeoff was confirmed experimentally by Anna Pearson, Natalia Ares, et al., “Measuring the Thermodynamic Cost of Timekeeping,” Physical Review X 11 (2021): 021029. Milburn’s characterization: Gerard Milburn, “The thermodynamics of clocks,” Contemporary Physics 61 (2020): 69-95.