Indexing the archive…
Your Universe of Digital Possibilities
Every bit crosses a channel that flips it with probability p. Unprotected, the picture rots into snow. Spend redundancy — repeat each bit, or wrap four in a Hamming(7,4) block — and the receiver votes the errors back out, healing the image. But every code carries a rate R, and Shannon drew a hard wall: once noise drags the capacity C = 1 − H(p) below R, no code can cross it. Open Capacity to see exactly where the wall stands.
Surprise, in bits — the average doubt in one channel use. Maximal (one full bit) when p = ½, the channel a pure coin flip; zero when the outcome is certain. This is the thing a good code never wastes.
The bits per use you can send with vanishing error. Noise eats capacity; at p = ½ the channel carries nothing at all — input and output share no information.
The headline of 1948: codes exist that drive error to zero for any rate below capacity — and none above it. The wall p* is where R meets C. Our codes give out earlier; better ones reach all the way to it.
Codewords sit at least three flips apart, so any single error still lands nearest its original — sphere-packing in bit-space. A 3-bit syndrome names the flipped position outright. Hamming, 1950.
The same sum The Arrow carves as heat (S = k·ln Ω): there it counts microstates and points time forward, here it counts bits and bounds what a channel can carry. Entropy and information are one measure, read in two worlds.
Compression and correction are one coin: to squeeze a signal you must predict it, and to defend it you spend the bits prediction saved. This is the law beneath every hard drive, QR code and deep-space probe — and the exact transform The Spectrum runs to fold an image into JPEG. It is the information face of The Arrow’s entropy, the two readings of −Σ p log p meeting at last; the stochastic channel The Walk’s noise lives in; and the home of the bits-per-cell probe The Rulealready measures. For a builder who suspects information is the bedrock of the real, it is the rack’s most direct question: how much can be known, sent and saved — and the price the universe sets on each.