Claude Shannon: Juggling ones and zeros

His inventions spanned the spectrum from playful to paramount.

Claude Shannon's robotic mouse Enlarge
Working on their living room floor, Shannon’s wife Betty assembled most of the wiring for the robotic mouse and maze that Shannon designed. Courtesy of MIT Museum.

Claude Shannon (B.S. 1936, B.S.E. Elec ’36, Hon. D.Sc. ’61) reached into the guts of the computer, calibrating its settings to suit the math equation that a visiting researcher wanted to solve. He adjusted gears, switches, wheels, and rotating shafts, walking across the room from one end of the machine to the other. It filled the whole space with its 100-ton heft; required 2,000 vacuum tubes to function, along with thousands of electrically operated switches and 150 motors; and mechanically calculated solutions in a record time of several hours. The complicated device was one of the first operating computers in existence.

Shannon couldn’t get enough of working with its bulky array of circuits. As a boy growing up in Gaylord, Michigan, his idea of fun was building a telegraph system out of barbed wire between his and a friend’s house half a mile away. He finished high school at 16 years old and graduated from U-M when he was 20 with a double major in math and electrical engineering. In his senior year at Michigan, Shannon found an ad on a campus bulletin board for a work-study job. That was how he ended up oiling the gears of the huge computer at MIT after graduation, helping in the lab as a research assistant while working toward his master’s degree.

The giant gadget thrilled Shannon, but he craved a better solution to replace the laborious calibrations and trial-and-error design of its circuits. He found his answer in philosophy.

To Shannon, the switches in the computer resembled the binary logic he learned about in the philosophy course he took at U-M to meet his liberal arts requirement. Open and closed circuits reminded him of the true and false variables in Boolean algebra, which had come up in class. Shannon figured he could apply the ideas to simplify circuit systems—all he had to do was invent a new kind of math. He’d base his new math on the logical principles of Boolean algebra and the binary language of ones and zeros, and he’d use straightforward equations to design on paper the simplest, cheapest circuits before even needing to start messing with wires and hardware.

Shannon’s insight became his MIT master’s thesis, which he published formally in 1948. His ideas became the basis of all digital technology today.

Claude Shannon's Rubik's cube solver Enlarge
A device that mechanically solves Rubik’s cube puzzles. Shannon loved Rubik’s cubes so much that he wrote a song about them. Courtesy MIT Museum.

Back in the 1800s, before we buried them underground, telephone wires formed thick curtains above sidewalks and city blocks. Those bulky wires transmitted conversations between callers by converting someone’s voice into electrical signals. Sound waves in the air translated directly into electromagnetic waves in the wires, with the waves matching as if drawn on tracing paper—that was analog technology.

As Shannon thought more about the binary variables in his new math, he realized that any information—not just computer circuits, but also phone conversations, telegraph messages, music on the radio, and television shows—could be standardized in the language of ones and zeros. Shannon wanted to try something different than sending sound through phone lines as waves directly translated. Instead, he wanted to convert sound waves into series of discrete points, as though he were drawing connect-the-dot waves; represent those points as a sequence of ones and zeros; and send the binary sequences through wires as electrical signals.

He’d just invented digital technology.

Engineers in the habit of building bulky transmission wires could hardly believe what Shannon suggested. Shannon said that any type of information could be standardized and sent through the same lines—which made for much less cumbersome infrastructure. The long analog phone wires of the day created a problem of electrical signals fading as electricity traveled farther away from the source. Up to this point, engineers tried to fight telephone static with brute force by cranking up transmission power, but such techniques were expensive and potentially dangerous. Amplifiers, originally intended to boost weak signals, merely amplified the mistakes in transmission that accumulated along the wires. With enough amplified errors, noise would be the only thing a person could hear on the other end of the phone line.

Shannon’s new idea to reduce noisy transmissions built upon his digital system. Instead of amplifying signals (simply turning up the volume and stretching sound waves ever larger), Shannon proposed adding signals by tacking error-correcting codes onto binary sequences (stringing on a few more ones and zeros). A receiving end could check the codes to verify whether an incoming message accrued any errors en route, fix the mistakes, and restore the original message. The tricky part would be to add extra signals without killing the efficiency of data transfer—ideally, error-correcting codes would keep message bloat to a minimum by adding the fewest, but most informative, extra signals.

To everyone’s surprise (including his own!), Shannon showed that in theory, perfectly error-free transmission was possible—even at high speeds.

But he never said exactly how.

Claude Shannon's toy truck Enlarge
Shannon developed early remote controls for toys. On this truck, metal brushes on the chassis are designed to scrape against a special copper floor. Courtesy of MIT Museum.

In the decades following Shannon’s theoretical solution, researchers toiled over finding a practical one. When the NASA Voyager space probes first launched in 1977, they took off with early versions of error-correcting codes on board. The technology made it possible for the probes to transmit back to Earth their mesmerizing images of Jupiter, Saturn, Neptune, and Uranus. One of those spacecraft codes still lets you listen to scratched CDs without the music skipping, and others help reliably save data to hard drives. Error-correcting codes continued to grow in sophistication, culminating by 1993 in turbo codes—an innovation that came the closest yet to reaching a maximum speed of data transmission.

Of course, no one expected that those Voyager images from deep space would be perfect—and Shannon argued that they didn’t need to be. People don’t need every last bit of a message to understand it completely. Fr xmpl, mst ppl hv lttl dffclty rdng ths sntnc, thgh th vwls r mssng. By exploiting redundancies in communication (such as vowels we may not need), Shannon hoped to make transmission faster and more efficient. He began by working out the statistics of the English language and its Roman alphabet. Of course, E shows up more often than Q, so Shannon opted to translate E into fewer ones and zeros to save space. U almost always follows Q, so “QU” should require fewer binary digits, and the frequent combination of “THE” fewer still.

The same principles of reducing redundancies help stream media on a cell phone. Data streaming works because a video loads only the changes between frames and not the stationary background; an audio file mutes inaudible frequencies; and an image discards unnecessary pixels. These tolerable omissions don’t detract from the experience, and they shrink file sizes to the point that cell phone networks can handle the data loads—all thanks to digital compression, another familiar part of the modern world where Shannon left his mark.

Shannon wrote a quick dissertation on the math of genetics and moved on not long after getting his Ph.D. from MIT. He spent a year at the Institute for Advanced Study in Princeton, New Jersey, and the next 15 years working at Bell Labs, where he supported the war effort by studying the theory and practice of codebreaking. After spending so much time determining how to best transmit a message to an endpoint clearly and quickly, Shannon now sought the opposite in his work on encryption: to transmit information so that almost no one could intercept and understand it. And yet he came to the same conclusion as before. Just as perfectly clear communication is possible with error-correcting codes, perfect secrecy also is possible if you encode a message just right. Shannon wound up helping to create the encryption apparatus that Franklin D. Roosevelt and Winston Churchill used in their secret conversations across the Atlantic during World War II, a system that still hasn’t been hacked.

Claude Shannon's Hex game Enlarge
Shannon’s mechanical version of Hex, a game familiar to math nerds. He secretly designed it so the computer would always win. Courtesy MIT Museum.

Dozens of unusual unicycles leaned up against the wall in Shannon’s garage, each one an experiment. Some of them shrank increasingly smaller; he hoped to build the tiniest unicycle in the world. One had a square tire, one had no pedals, and a particularly precarious model was meant for two riders—probably the only tandem unicycle in existence. Shannon became famous for unicycling through Bell Labs hallways, practicing his balance while juggling. In his yard, he strung a 40-foot steel cable between tree stumps and found he could juggle while unicycling along the tightrope. Through the bay windows of his house outside Boston, where he eventually returned as a professor at MIT, Shannon could view the cart and track he built for his kids, winding through the yard toward the lake in back. A huge pair of Styrofoam shoes allowed him, every once in a while, to surprise his neighbors by walking on the water’s surface.

Shannon kept on tinkering and inventing throughout his life, devising a flame-throwing trumpet, rocket-powered Frisbee, Rubik’s cube solver, and chess-playing robots. He filled his basement with electronics and mechanical gadgets, constructing toys from stranded components. He built a mind-reading machine that could predict with above-average accuracy whether a human coin-flipper would choose heads or tails. He also built what he called the ultimate machine: a small, nondescript box with a single switch. Flipping the switch caused a tiny hand to emerge, reverse the switch, and return to rest inside the box, its one function to turn itself off again. Completely useless—if simple, playful fun counts for nothing.

Shannon always worked on his research with no eye toward the future, unconcerned about the engineering advancements that his discoveries would make possible. His motivations revolved around simple curiosity and the joy of playing around. But while Shannon didn’t care about practical applications, his work found them. The robotic mouse he crafted, which could find its way through a maze and remember the fastest path, helped steer research in artificial intelligence. Shannon collaborated on the first wearable computer—a wrist device the size of a cigarette pack, wired to a tiny speaker hidden in his ear and connected to a switch inside his shoe, which he learned to operate by big toe—with the aim of surreptitiously predicting the fate of a roulette ball and beating casinos in Las Vegas. More legitimately—but drawing from the same expertise in math and circuits—he hit the jackpot by applying algorithms to the stock market. And of course, Shannon’s imaginative thinking created the digital world and connected all of us within it.

Shannon’s innovations have stayed completely invisible in the world today because they were designed to be overlooked. Error-correcting codes, compression techniques, online encryption—these inventions work best when they pass unnoticed, embedded in digital technology. When we make a static-free phone call, communicate instantaneously by email, hear the sounds of a CD not skipping, pocket modern microprocessors soldered with millions of circuits, watch videos on a cell phone while riding the bus, or find photos of outer space, we don’t thank Claude Shannon.

Maybe we should.

By Elizabeth Wason, Science writer with the University of Michigan College of Literature, Science, and the Arts

February 24, 2021 :

Voices of Victors: Claude Shannon

The Michigan Alumni Association features the life and career of ECE alum Claude Shannon, the Father of Information Theory, in their podcast series "Voices of Victors."
Alumni News; Profile