Entropy and Information Theory

• Main Author: Gray, Robert M. (Author)
• Corporate Author: SpringerLink (Online service)
• Format: Electronic eBook
• Language: English
• Published: Boston, MA : Springer US, 2011.
• Subjects: Engineering.; Coding theory.; Probabilities.; Statistics.; Electrical engineering.; Signal, Image and Speech Processing.; Communications Engineering, Networks.; Statistics for Engineering, Physics, Computer Science, Chemistry and Earth Sciences.; Probability Theory and Stochastic Processes.; Coding and Information Theory.

This book is an updated version of the information theory classic, first published in 1990. About one-third of the book is devoted to Shannon source and channel coding theorems; the remainder addresses sources, channels, and codes and on information and distortion measures and their properties. New...

Table of Contents:

• Preface
• Introduction
• Information Sources
• Pair Processes: Channels, Codes, and Couplings
• Entropy
• The Entropy Ergodic Theorem
• Distortion and Approximation
• Distortion and Entropy
• Relative Entropy
• Information Rates
• Distortion vs. Rate
• Relative Entropy Rates
• Ergodic Theorems for Densities
• Source Coding Theorems
• Coding for Noisy Channels
• Bibliography
• References
• Index.