Skip to main content
  • Book
  • © 2020

Theory of Information and its Value

  • Broadens understanding of information theory and the value of information
  • English translation of Rouslan L. Stratonovich’s original "Theory of Information"
  • Unifies theories of information, optimization, and statistical physics
  • Supplies opportunities to practice techniques through unique examples

Buy it now

Buying options

eBook USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 129.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

This is a preview of subscription content, log in via an institution to check for access.

Table of contents (13 chapters)

  1. Front Matter

    Pages i-xxii
  2. Definition of information and entropy in the absence of noise

    • Roman V. Belavkin, Panos M. Pardalos, Jose C. Principe, Ruslan L. Stratonovich
    Pages 1-33
  3. Encoding of discrete information in the absence of noise and penalties

    • Roman V. Belavkin, Panos M. Pardalos, Jose C. Principe, Ruslan L. Stratonovich
    Pages 35-51
  4. Encoding in the presence of penalties. First variational problem

    • Roman V. Belavkin, Panos M. Pardalos, Jose C. Principe, Ruslan L. Stratonovich
    Pages 53-75
  5. First asymptotic theorem and related results

    • Roman V. Belavkin, Panos M. Pardalos, Jose C. Principe, Ruslan L. Stratonovich
    Pages 77-101
  6. Computation of entropy for special cases. Entropy of stochastic processes

    • Roman V. Belavkin, Panos M. Pardalos, Jose C. Principe, Ruslan L. Stratonovich
    Pages 103-171
  7. Information in the presence of noise. Shannon’s amount of information

    • Roman V. Belavkin, Panos M. Pardalos, Jose C. Principe, Ruslan L. Stratonovich
    Pages 173-215
  8. Message transmission in the presence of noise. Second asymptotic theorem and its various formulations

    • Roman V. Belavkin, Panos M. Pardalos, Jose C. Principe, Ruslan L. Stratonovich
    Pages 217-247
  9. Channel capacity. Important particular cases of channels

    • Roman V. Belavkin, Panos M. Pardalos, Jose C. Principe, Ruslan L. Stratonovich
    Pages 249-288
  10. Definition of the value of information

    • Roman V. Belavkin, Panos M. Pardalos, Jose C. Principe, Ruslan L. Stratonovich
    Pages 289-325
  11. Value of Shannon’s information for the most important Bayesian systems

    • Roman V. Belavkin, Panos M. Pardalos, Jose C. Principe, Ruslan L. Stratonovich
    Pages 327-352
  12. Asymptotic results about the value of information. Third asymptotic theorem

    • Roman V. Belavkin, Panos M. Pardalos, Jose C. Principe, Ruslan L. Stratonovich
    Pages 353-390
  13. Information theory and the second law of thermodynamics

    • Roman V. Belavkin, Panos M. Pardalos, Jose C. Principe, Ruslan L. Stratonovich
    Pages 391-408
  14. Correction to: Theory of Information and its Value

    • Roman V. Belavkin, Panos M. Pardalos, Jose C. Principe, Ruslan L. Stratonovich
    Pages C1-C1
  15. Back Matter

    Pages 409-419

About this book

This English version of Ruslan L. Stratonovich’s Theory of Information (1975) builds on theory and provides methods, techniques, and concepts toward utilizing critical applications. Unifying theories of information, optimization, and statistical physics, the value of information theory has gained recognition in data science, machine learning, and artificial intelligence. With the emergence of a data-driven economy, progress in machine learning, artificial intelligence algorithms, and increased computational resources, the need for comprehending information is essential. This book is even more relevant today than when it was first published in 1975. It extends the classic work of R.L. Stratonovich, one of the original developers of the symmetrized version of stochastic calculus and filtering theory, to name just two topics.

Each chapter begins with basic, fundamental ideas, supported by clear examples; the material then advances to great detail and depth.  The reader is not required to be familiar with the more difficult and specific material. Rather, the treasure trove of examples of stochastic processes and problems makes this book accessible to a wide readership of researchers, postgraduates, and undergraduate students in mathematics, engineering, physics and computer science who are specializing in information theory, data analysis, or machine learning.

Reviews

“The book could be useful in advanced graduate courses with students, who are not afraid of integrals and probabilities.” (Jaak Henno, zbMATH 1454.94002, 2021)

Authors, Editors and Affiliations

  • Faculty of Science and Technology, Middlesex University, London, UK

    Roman V. Belavkin

  • Industrial and Systems Engineering, University of Florida, Gainesville, USA

    Panos M. Pardalos

  • Electrical & Computer Engineering, University of Florida, Gainesville, USA

    Jose C. Principe

  • (deceased), Moscow, Russia

    Ruslan L. Stratonovich

About the editors

 

Bibliographic Information

Buy it now

Buying options

eBook USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 129.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access