Information Theory and Network Coding

1. Front Matter

   Pages I-XX

   PDF

2. The Science of Information

   1. Front Matter

      Pages 1-1

      PDF

   2. The Science of Information

      • Raymond W. Yeung

      Pages 1-4

3. Fundamentals of Network Coding

   1. Front Matter

      Pages 6-6

      PDF

   2. Information Measures

      • Raymond W. Yeung

      Pages 7-50

   3. Information Measures

      • Raymond W. Yeung

      Pages 51-80

   4. Zero-Error Data Compression

      • Raymond W. Yeung

      Pages 81-100

   5. Weak Typicality

      • Raymond W. Yeung

      Pages 101-112

   6. Strong Typicality

      • Raymond W. Yeung

      Pages 113-136

   7. Discrete Memoryless Channels

      • Raymond W. Yeung

      Pages 137-182

   8. Rate-Distortion Theory

      • Raymond W. Yeung

      Pages 183-210

   9. The Blahut–Arimoto Algorithms

      • Raymond W. Yeung

      Pages 211-228

   10. Differential Entropy

       • Raymond W. Yeung

       Pages 229-256

   11. Continuous-Valued Channels

       • Raymond W. Yeung

       Pages 257-298

   12. Markov Structures

       • Raymond W. Yeung

       Pages 299-322

   13. Information Inequalities

       • Raymond W. Yeung

       Pages 323-338

   14. Shannon-Type Inequalities

       • Raymond W. Yeung

       Pages 339-360

   15. Beyond Shannon-Type Inequalities

       • Raymond W. Yeung

       Pages 361-386

   16. Entropy and Groups

       • Raymond W. Yeung

       Pages 387-408

4. Fundamentals of Network Coding

   1. Front Matter

      Pages 410-410

      PDF

This book is an evolution from my book A First Course in Information Theory published in 2002 when network coding was still at its infancy. The last few years have witnessed the rapid development of network coding into a research ?eld of its own in information science. With its root in infor- tion theory, network coding has not only brought about a paradigm shift in network communications at large, but also had signi?cant in?uence on such speci?c research ?elds as coding theory, networking, switching, wireless c- munications,distributeddatastorage,cryptography,andoptimizationtheory. While new applications of network coding keep emerging, the fundamental - sults that lay the foundation of the subject are more or less mature. One of the main goals of this book therefore is to present these results in a unifying and coherent manner. While the previous book focused only on information theory for discrete random variables, the current book contains two new chapters on information theory for continuous random variables, namely the chapter on di?erential entropy and the chapter on continuous-valued channels. With these topics included, the book becomes more comprehensive and is more suitable to be used as a textbook for a course in an electrical engineering department.

• Shannon
• algorithms
• coding theory
• communication
• complexity
• complexity theory
• computer
• computer network
• data compression
• information
• information theory

From the reviews:

"This book could serve as a reference in the general area of information theory and would be of interest to electrical engineers, computer engineers, or computer scientists with an interest in information theory. Each chapter has an appropriate problem set at the end and a brief paragraph that provides insight into the historical significance of the material covered therein. … Summing Up: Recommended. Upper-division undergraduate through professional collections." (J. Beidler, Choice, Vol. 46 (9), May, 2009)

"The book consisting of 21 chapters is divided into two parts. Part I, Components of Information Theory … . Part II Fundamentals of Network Coding … . A comprehensive instructor’s manual is available. This is a well planned comprehensive book on the subject. The writing style of the author is quite reader friendly. … it is a welcome addition to the subject and will be very useful to students as well as to the researchers in the field." (Arjun K. Gupta, Zentralblatt MATH, Vol. 1154, 2009)

• Department of Information Engineering, The Chinese University of Hong Kong, Hong Kong, People’s Republic of China

  Raymond W. Yeung

Policies and ethics