Skip to main content
Book cover

Formal Theories of Information

From Shannon to Semantic Information Theory and General Concepts of Information

  • Book
  • © 2009

Overview

Part of the book series: Lecture Notes in Computer Science (LNCS, volume 5363)

Part of the book sub series: Theoretical Computer Science and General Issues (LNTCS)

This is a preview of subscription content, log in via an institution to check access.

Access this book

eBook USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

Licence this eBook for your library

Institutional subscriptions

Table of contents (10 chapters)

  1. Introduction

  2. Philosophical Reflections

  3. The Syntactical Approach

  4. The Semantical Approach

  5. Beyond the Semantical Approach

  6. Philosophical Conclusions

Keywords

About this book

It is commonly assumed that computers process information. But what is inf- mation? In a technical, important, but nevertheless rather narrow sense, Sh- non’sinformationtheorygivesa?rstanswertothisquestion.Thistheoryfocuses on measuring the information content of a message. Essentially this measure is the reduction of the uncertainty obtained by receiving a message. The unc- tainty of a situation of ignorance in turn is measured by entropy. This theory hashad an immense impact on the technologyof information storage,data c- pression, information transmission and coding and still is a very active domain of research. Shannon’s theory has also attractedmuch interest in a more philosophic look at information, although it was readily remarked that it is only a “syntactic” theory of information and neglects “semantic” issues. Several attempts have been made in philosophy to give information theory a semantic ?avor, but still mostly based on or at least linked to Shannon’s theory. Approaches to semantic informationtheoryalsoveryoftenmakeuseofformallogic.Thereby,information is linked to reasoning, deduction and inference, as well as to decision making. Further, entropy and related measure were soon found to have important connotations with regard to statistical inference. Surely, statistical data and observation represent information, information about unknown, hidden para- ters. Thus a whole branch of statistics developed around concepts of Shannon’s information theory or derived from them. Also some proper measurements - propriate for statistics, like Fisher’s information, were proposed.

Reviews

From the reviews:

“This new anthology on formal theories of information is based upon research presented at the May 2006 Muenchenwiler seminar of the Information and Knowledge research groups of the computer science departments of the universities of Bern, Fribourg, and Neuchatel. … This is probably the clearest account of algorithmic information theory that one will come across. … Formal theories of information and their philosophical analysis are being developed right now, and this is what makes a volume of this quality so welcome.” (Sebastian Sequoiah-Grayson, Minds and Machines, Vol. 22, 2012)

Editors and Affiliations

  • Department of Informatics, University of Fribourg, Fribourg, Switzerland

    Giovanni Sommaruga

Bibliographic Information

Publish with us