This site is only a doorway

Everything here is gathered from things other people actually researched, thought through, and built: books, papers, historical records, and the people behind them. If something here catches your interest, go look at the original sources listed at the bottom of the page. They carry more depth than a page like this ever can.

Why Do Messy Rooms Never Tidy Themselves? What Entropy Really Means

Category: Nature

A bedroom often looks messier after a week of use, and if nobody moves anything, it never tidies itself. The room is only a picture, but physicists have a word for the one-way slide it stands for: entropy. The short answer is that there are vastly more ways for things to be messy than tidy, so a random shuffle almost always lands on a messy one. This article follows how that idea was found, from steam engines in the 1820s to an argument about whether atoms were real.

1. Why Are Messy Arrangements So Much More Likely Than Tidy Ones?

Take ten books on a shelf. Exactly one order is alphabetical by author. But the same ten books can be lined up in 3,628,800 different orders (that is 10 × 9 × 8 × … × 1). If the books were put back in a completely random order, the chance of landing on the alphabetical one would be about one in 3.6 million. Every other order would look "messy" to you.

Now try a deck of 52 cards. The number of possible orders is about 8 followed by 67 zeros. One of them is "ace to king, suit by suit." The chance is so tiny that, for all practical purposes, you should not expect a well-shuffled deck to land there.

That is the heart of entropy. A "tidy" state is one of very few arrangements; a "messy" state is one of a gigantic number. If things get stirred around randomly, they drift toward whatever there are the most of. A caution: a real bedroom does not shuffle itself, because books do not move unless someone moves them. The room is only a picture of the idea. The real action is among atoms and molecules, which are constantly jiggling and swapping places. The rest of this article is about how people worked out that picture[5].

2. How Did Steam Engines Lead to the Idea of Entropy?

The story starts with a practical problem, not a messy room. In the early 1800s steam engines pumped water out of mines and drove mills, but they wasted a lot of fuel. A young French engineer and army officer, Sadi Carnot, wanted to know how good an engine could possibly be. In June 1824 he published his only work, Reflections on the Motive Power of Fire, which gave the first successful theory of the maximum efficiency of heat engines[2][1].

About forty years later the German physicist Rudolf Clausius built on Carnot's result. He showed that for an ideal Carnot cycle, which moves heat between a hot and a cold reservoir and turns some of it into work, the most work you can get from a given amount of heat depends only on the temperatures of the two reservoirs, not on what the engine is made of[4]. In everyday words: you can never turn all the heat into useful motion, because some must always flow on to something colder.

In 1865 Clausius gave a name to the quantity he had been working with. In his own words, translated into English, he wrote that he had "intentionally formed the word entropy so as to be as similar as possible to the word energy," because the two quantities are "so nearly allied in their physical meanings"[3]. Clausius's lasting legacy is the idea that entropy increases in a way that cannot be undone[4]. Energy is not used up, but its usefulness is, and that one-way loss is what the second law of thermodynamics describes. So Clausius had found that something always runs one way. What he had not explained is why.

3. How Did Boltzmann Explain Why Entropy Keeps Going Up?

The explanation came from the Austrian physicist Ludwig Boltzmann. His key insight was that the one-way slide happens because of probability: a system drifts toward states that can be arranged in more ways[5]. In 1877 he gave the definition of entropy still used today, written S = k log W (modern books often write ln). Here W is the number of microscopic arrangements of the particles that all correspond to the same large-scale state you can see from outside (this is Boltzmann's statistical definition), and k is a fixed number later named the Boltzmann constant[5].

Here is a way to picture it. Open a bottle of perfume in a corner of a room. The scent molecules could be bunched near the bottle, or spread all over the room. There are enormously more arrangements of the second kind, so random molecular motion carries them there. There is no rule telling them to spread out; spreading out is simply what almost every arrangement looks like. This is the same counting as the books and cards in section 1, with astronomically bigger numbers.

4. Why Did Many Scientists Doubt Boltzmann, and How Was the Argument Settled?

Boltzmann's counting only makes sense if matter is made of atoms and molecules. Today that sounds obvious. In his time, some well-known scientists, including the physicist and philosopher Ernst Mach and the chemist Wilhelm Ostwald, did not believe atoms were real. Most chemists accepted them, but much of the physics world did not[5]. Boltzmann spent a great deal of effort in his later years defending his ideas[5]. In May 1906 he had to resign his university position because he was unwell, and he died on 5 September 1906 while on vacation near Trieste[5].

Within a few years the doubters were answered. Building on Albert Einstein's 1905 theory of why tiny specks dance in water, the French physicist Jean Perrin measured their motion in 1908 and 1909. His results matched the values for atoms and the Boltzmann constant, convincing the scientific world that the tiny particles really exist[5]. In 1926 Perrin received the Nobel Prize in Physics "for his work on the discontinuous structure of matter"[6]. In his Nobel lecture he said that by then the reasons favouring the atomists had grown so strong that it could "finally be said the certainty" was on their side[6]. Boltzmann is buried in Vienna's Central Cemetery, and his tombstone is carved with his entropy formula[5].

5. Why Did Eddington Rank the Second Law Above Other Laws of Nature?

The second law of thermodynamics says that the total entropy of an isolated system (one that exchanges neither matter nor energy with its surroundings) does not decrease, and increases in ordinary irreversible processes. The British astronomer Arthur Eddington, in his 1927 Gifford Lectures (published as The Nature of the Physical World in 1928), said this law "holds, I think, the supreme position among the laws of Nature." If your pet theory disagrees with Maxwell's equations of electricity and magnetism, he joked, so much the worse for Maxwell's equations; if observation contradicts it, "these experimentalists do bungle things sometimes." But a theory that contradicts the second law, he said, has "nothing for it but to collapse in deepest humiliation"[7].

Why would a law about messiness rank so high? A guess, not Eddington's own explanation: because it rests on counting, not on the details of any one force or material. It applies to steam engines, perfume and shuffled cards alike. Note one more thing for fairness: tidying a room does not break the law. When you tidy, you lower the entropy of the room, but your body releases heat and uses energy, which raises entropy elsewhere by more. Applying the idea to the entire universe is a harder question that this article does not try to settle.

6. How Can You Try the Counting Yourself?

You need only a deck of cards. Sort it in order, then shuffle it a few times and look: does it ever come back to perfect order? Next, try a smaller version with three cards. There are only 3 × 2 × 1 = 6 orders, so perfect order shows up fairly often. Add cards one at a time and see how quickly the chance shrinks. Multiplying a few numbers on paper is enough to see why a random shuffle is so much more likely to look "messy."

If you want to dig deeper, look up Maxwell's demon, a famous thought experiment about whether a tiny being could beat the second law. Perrin's Nobel lecture is available on the Nobel Prize website; it was written for an audience of scientists.

Sources

Pages marked "read" were fetched and checked for the facts used. Several facts were cross-checked across more than one page. Wikipedia is used for dates and background, so claims that only Wikipedia supports are worded cautiously.

  1. MacTutor History of Mathematics (University of St Andrews), "Sadi Carnot" https://mathshistory.st-andrews.ac.uk/Biographies/Carnot_Sadi/ (Read in full. Used for the steam-engine problem Carnot was working on.)
  2. Wikipedia, "Nicolas Léonard Sadi Carnot" https://en.wikipedia.org/wiki/Nicolas_L%C3%A9onard_Sadi_Carnot (Only the opening summary was read. Used for the June 1824 publication and its subject; the date is supported by this page alone.)
  3. Irmgard K. Howard, "S Is for Entropy. U Is for Energy. What Was Clausius Thinking?", Journal of Chemical Education 78(4), April 2001 https://giovannibachelet.it/FG1-14-15/settimana_12/Howard_2001.pdf (About the first half was read. It quotes Clausius's 1865 sentence on forming "entropy" to resemble "energy", from the 1867 English translation.)
  4. MacTutor History of Mathematics, "Rudolf Clausius" https://mathshistory.st-andrews.ac.uk/Biographies/Clausius/ (Read in full. Used for the work-from-heat result and for entropy's irreversible increase as Clausius's legacy.)
  5. Wikipedia, "Ludwig Boltzmann" https://en.wikipedia.org/wiki/Ludwig_Boltzmann (About the first third was read, including biography, 1877 entropy formula, the atoms dispute, Perrin's 1908–1909 work, and the grave. It is the only source in this list for several of these details, such as the dates of Perrin's measurements and the tombstone.)
  6. Jean Perrin, Nobel Lecture "Discontinuous Structure of Matter", 11 December 1926, NobelPrize.org https://www.nobelprize.org/prizes/physics/1926/perrin/lecture/ (Only the opening of the lecture and the prize citation were read, not the later sections on the measurements.)
  7. Arthur Eddington, The Nature of the Physical World (Gifford Lectures 1927; book 1928), as quoted on a JILA (University of Colorado) page https://jila.colorado.edu/%7Eajsh/talks/insidebh/eddington.html (Read, but it is a quotation page, not the book itself. The book is listed as public domain on Wikisource, but its chapter text was not opened.)