Abstract

Information is commonly understood as knowledge or facts acquired or derived from, e.g., study, instruction or observation (Macmillan Contemporary Dictionary, 1979). On this notion, information is presumed to be both meaningful and veridical, and to have some appropriate connection to its object; it is concerned with representations and symbols in the most general sense MacKay 1969 ). Information might be misleading, but it can never be false. Deliberately misleading data is misinformation. The scientific notion of information abstracts from the representational idea, and includes anything that could potentially serve as a source of information. The most fundamental notion of information, attributed to a number of different authors, is "a distinction that makes a difference" MacKay 1969 ), or "a differnece that makes a difference" Bateson 1973 : 428). Information theory, then, is fundamentally the rigorous study of distinctions and their relations, inasmuch as they make a difference