Counting distinctions: On the conceptual foundations of Shannon's information theory
Synthese 168 (1):119 - 149 (2009)
| Abstract | Categorical logic has shown that modern logic is essentially the logic of subsets (or “subobjects”). In “subset logic,” predicates are modeled as subsets of a universe and a predicate applies to an individual if the individual is in the subset. Partitions are dual to subsets so there is a dual logic of partitions where a “distinction” [an ordered pair of distinct elements (u, u′) from the universe U] is dual to an “element”. A predicate modeled by a partition π on U would apply to a distinction if the pair of elements was distinguished by the partition π, i.e., if u and u′ were in different blocks of π. Subset logic leads to finite probability theory by taking the (Laplacian) probability as the normalized size of each subset-event of a finite universe. The analogous step in the logic of partitions is to assign to a partition the number of distinctions made by a partition normalized by the total number of ordered |U|2 pairs from the finite universe. That yields a notion of “logical entropy” for partitions and a “logical information theory.” The logical theory directly counts the (normalized) number of distinctions in a partition while Shannon’s theory gives the average number of binary partitions needed to make those same distinctions. Thus the logical theory is seen as providing a conceptual underpinning for Shannon’s theory based on the logical notion of “distinctions.”. | |||||||||
| Keywords | No keywords specified (fix it) | |||||||||
| Categories | ||||||||||
| Options |
|
|||||||||
Download options| PhilPapers Archive |
Upload a copy of this paper Check publisher's policy on self-archival Papers currently archived: 5,701 |
| External links |
  Try with proxy. |
| Through your library | Configure |
Similar books and articlesLloyd Humberstone (2008). Parts and Partitions. Theoria 66 (1):41-82.
Timothy Bays (2001). Partitioning Subsets of Stable Models. Journal of Symbolic Logic 66 (4):1899-1908.
Peter D. Grünwald & Paul M. B. Vitányi (2003). Kolmogorov Complexity and Information Theory. With an Interpretation in Terms of Questions and Answers. Journal of Logic, Language and Information 12 (4):497-529.
Charlie Kurth (2011). Logic for Morals, Morals From Logic. Philosophical Studies 155 (2):161-180.
Jörg Brendle & Shuguo Zhang (2006). Converse Dual Cardinals. Journal of Symbolic Logic 71 (1):22 - 34.
David Ellerman (2010). The Logic of Partitions: Introduction to the Dual of the Logic of Subsets. Review of Symbolic Logic 3 (2):287-350.
Analytics
Monthly downloads |
Added to index2009-01-28Total downloads21 ( #58,767 of 549,124 )Recent downloads (6 months)1 ( #63,361 of 549,124 )How can I increase my downloads? |
My notes
Discussion
