The Information (58 page)

Read The Information Online

Authors: James Gleick

Tags: #Non-Fiction

BOOK: The Information
5.28Mb size Format: txt, pdf, ePub

101
013

 
 

The telegraph operator (or theorist, or compression algorithm) must pay attention to the whole message. Nonetheless, the extra information is minimal; the message can still be compressed, wherever pattern exists. We may say it contains a redundant part and an arbitrary part.

It was Shannon who first showed that anything nonrandom in a message allows compression:

F: 101
101
0111
1011
0110
1011
1010
1110
1111
0100
1110
1101
0011
1101
110

 

Other books

Dark Prophecy by Anthony E. Zuiker
In Medias Res by Yolanda Wallace
Closing the Deal by Marie Harte
The Next Decade by George Friedman
Diplomat at Arms by Keith Laumer
Back to Moscow by Guillermo Erades