Novelty, Information and Surprise

This revised edition provides a more general approach to information theory than the classical Shannon approach, defining information for an arbitrary cover of Ω and introducing novelty and information and surprise concepts. It discusses their interrelationships and presents applications in statistics and neuroscience.

Format: Hardback
Length: 293 pages
Publication date: 03 January 2023
Publisher: Springer-Verlag Berlin and Heidelberg GmbH & Co. KG

This revised edition presents a comprehensive approach to information theory that expands upon the classical framework established by Shannon. Traditionally, information is defined for an alphabet of symbols or a set of mutually exclusive propositions, where the probabilities of these propositions sum up to 1, forming a partition of the probability space Ω. However, the new definition encompasses an arbitrary cover of Ω, which includes a set of possibly overlapping propositions. This generalized concept of information is termed novelty, and it is accompanied by two derived concepts: information and surprise. Information pertains to the classical understanding of information theory, while surprise relates more to the classical concept of statistical significance.

In the discussion of these three concepts and their interrelations, several properties or classes of covers are defined, which are revealed to be lattices. These lattices provide a framework for understanding the relationships and properties of information, novelty, and surprise.

The book also showcases numerous applications of these concepts, primarily in the fields of statistics and neuroscience. By delving into these applications, the book offers valuable insights into the practical uses and implications of information theory in various domains.

This revised edition provides a deeper understanding of information theory, offering a broader perspective that goes beyond the traditional confines of Shannon's classical approach. It is a valuable resource for researchers, scholars, and practitioners interested in exploring the complexities of information, communication, and cognition.

Weight: 641g
Dimension: 235 x 155 (mm)
ISBN-13: 9783662658741
Edition number: 2nd ed. 2022