Notes: Chapter 1: What Is Entropy?

Chapter notes for “Chapter 1: What Is Entropy?”

Notes

¹ Rudolf Clausius, “On the Mechanical Theory of Heat” (1865). Clausius introduced the term entropy from the Greek τροπή (transformation), deliberately echoing energy to emphasize the connection between the two concepts.

² Bejan, Adrian, “Constructal-theory network of conducting paths for cooling a heat generating volume,” International Journal of Heat and Mass Transfer 40 (1997): 799-816. Bejan’s Constructal Law formalizes the principle that flow systems evolve toward configurations that provide easier access to currents — explaining why rivers carve canyons and why branching structures recur at every scale.

³ England, Jeremy, “Statistical physics of self-replication,” Journal of Chemical Physics 139 (2013): 121923. England’s dissipation-driven adaptation framework provides a thermodynamic basis for why life emerges: matter in contact with a heat bath tends to self-organize into configurations that dissipate energy more efficiently.

⁴ Penrose, Roger, The Road to Reality: A Complete Guide to the Laws of the Universe (2004), Chapters 27-28. Penrose’s discussion of the arrow of time connects entropy increase to the directionality of memory and experience. See also Barbour’s The Janus Point (2020) for an alternative account of time’s arrow grounded in shape complexity rather than thermodynamic entropy.

^4a Thomas Hertog, On the Origin of Time: Stephen Hawking’s Final Theory (Bantam Press, 2023). Hertog and Hawking’s holographic cosmology proposes that the laws of physics evolved with the universe rather than preceding it — that going back toward the Big Bang, the distinction between space and time dissolves and even the concept of physical law “evaporates.” The framework uses the holographic principle to embed the observer’s perspective within the cosmological model, yielding an evolutionary rather than Platonic account of why the laws are what they are. See also Hertog’s interview with Janna Levin, “Why Did The Universe Begin?” The Joy of Why, Quanta Magazine (July 2025). For the technical framework: Hertog, T. and Hawking, S.W., “A smooth exit from eternal inflation?” Journal of High Energy Physics 2018:147 (2018).

⁵ Amir Haji-Akbari et al., “Disordered, quasicrystalline and crystalline phases of densely packed tetrahedra,” Nature 462 (2009): 773-777. The simulation used only hard-particle exclusion — no attractive or repulsive forces. The quasicrystal emerged from entropy alone. For Glotzer’s “entropy is about options” framing, see the Joy of x podcast interview with Steven Strogatz (Quanta Magazine, 2021).

^5a Shannon, Claude E. “A Mathematical Theory of Communication.” Bell System Technical Journal 27 (1948): 379-423, 623-656.

^5b Tsallis, Constantino. “Possible Generalization of Boltzmann-Gibbs Statistics.” Journal of Statistical Physics 52 (1988): 479-487.

^5c Baez, J.C., Fritz, T., and Leinster, T., “A characterization of entropy in terms of information loss,” Entropy 13(11): 1945-1957 (2011). The theorem characterizes entropy loss over finite probability spaces as a functor from the category FinProb, grounding Khinchin’s conditions in category theory. A category is a collection of objects together with all the legitimate ways of getting from one object to another; FinProb holds every finite probability distribution (a loaded die, a shuffled deck, the possible states of a small gas) along with the processes that turn one distribution into another. A functor is a map out of such a collection that respects composition: whatever it says about running two processes back to back is fixed by what it says about each one alone, the way a good translation carries the grammar of one language faithfully into another. Whenever you lose information about a system, entropy increases, and it does so in the only way consistent with how systems compose. Khinchin’s additivity condition (two cups of tea on opposite desks) reappears here as the demand that the map respect composition. The practical consequence: entropy does not merely happen to follow the same rules at different scales; it must, because it is the only quantity that respects how systems combine.

^5d Sekiya, R., Itahashi, K. et al., “Excitation Spectra of the ¹²C(p,d) Reaction near the η′-Meson Emission Threshold Measured in Coincidence with High-Momentum Protons,” Physical Review Letters 136(14) (2026), DOI: 10.1103/6vsl-ng7x. Two features of the vacuum give the η′ meson its unusually large mass: the chiral condensate, a pervasive background pairing of quarks and antiquarks that fills what looks like empty space, and the axial U(1) quantum anomaly of QCD, the quantum theory’s violation of a symmetry the classical equations respect. Both belong to the surroundings rather than to the particle, which is why a dense environment can shift the mass. The reported in-nucleus lightening is a roughly two-sigma indication after the look-elsewhere correction, not yet a confirmed measurement.

⁶ Paul Erker et al., “Autonomous Quantum Clocks: Does Thermodynamics Limit Our Ability to Measure Time?” Physical Review X 7 (2017): 031022. The fundamental accuracy-entropy tradeoff was confirmed experimentally by Anna Pearson, Natalia Ares, et al., “Measuring the Thermodynamic Cost of Timekeeping,” Physical Review X 11 (2021): 021029. Milburn’s characterization: Gerard Milburn, “The thermodynamics of clocks,” Contemporary Physics 61 (2020): 69-95.