Claude Shannon: A Mathematical Theory of Communication

Claude Shannon demonstrated how to generate "english looking" text using Markov chains and how this gives a satisfactory representation of the statistical structure of any message. He uses this model as a framework with which to define 'information sources' and how they should be measured.