A Mathematical Theory of Communication


Author: Shannon, C. E.


Conference/Journal: Bell Systems Technical Journal
Date published: 1948 July, October
Other:
 Volume ID: 27   ,  Pages: 379-423, 623-656   ,  Word Count: 116  
    THE recent development of various methods of modulation such as PCM and PPM which exchange

bandwidth for signal-to-noise ratio has intensified the interest in a general theory of communication. A

basis for such a theory is contained in the important papers of Nyquist1 and Hartley2 on this subject. In the

present paper we will extend the theory to include a number of new factors, in particular the effect of noise

in the channel, and the savings possible due to the  statistical structure of the original message and due to the

nature of the final destination of the information.



http://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf



keywords chaos entropy information theory