Information as a measure of variation
In many applications of information theory, information measures the reduction of uncertainty that results from the knowledge that an event has occurred. Even so, an item of information learned need not be the occurrence of an event but, rather, the change in probability distribution associated with an ensemble of events. This paper examines the basic account of information, which focuses on events, and reviews how it may be naturally generalized to probability distributions/measures. The resulting information measure is special case of the Rényi information divergence (also known as the Rényi entropy). This information measure, herein dubbed the variational information, meaningfully assigns a numerical bit-value to arbitrary state transitions of physical systems. The information topology of these state transitions is characterized canonically by a right and left continuity spectrum defined in terms of the Kantorovich- Wasserstein metric. These continuity spectra provide a theoretical framework for characterizing the informational continuity of evolving systems and for rigorously assessing the degree to which such systems exhibit, or fail to exhibit, continuous change.
|Keywords||No keywords specified (fix it)|
|Categories||categorize this paper)|
References found in this work BETA
No references found.
Citations of this work BETA
No citations found.
Similar books and articles
On a Supposed Conceptual Inadequacy of the Shannon Information in Quantum Mechanics.G. C. - 2003 - Studies in History and Philosophy of Science Part B 34 (3):441-468.
On the Information-Theoretical Meaning of Hill's Parametric Evenness.C. Ricotta & G. C. Avena - 2002 - Acta Biotheoretica 50 (1):63-71.
Pre-Cognitive Semantic Information.Orlin Vakarelov - 2010 - Knowledge, Technology & Policy 23 (2):193-226.
On the Supposed Conceptual Inadequacy of the Shannon Information.Christopher Gordon Timpson - unknown
Some Varieties of Information.Jaakko Hintikka - 1984 - Information Processing and Management 20 (1-2):175-181.
Added to index2009-01-28
Total downloads18 ( #267,956 of 2,158,407 )
Recent downloads (6 months)1 ( #354,697 of 2,158,407 )
How can I increase my downloads?