Cognition or higher brain activity is sometimes seen as a phenomenon greater than the sum of its parts. This viewpoint however is largely dependent on the state of the art of experimental techniques that endeavor to characterize morphology and its association to function. Retinal ganglion cells are readily accessible for this work and we discuss recent advances in computational techniques in identifying novel parameters that describe structural attributes possibly associated with specific function. These parameters are based on calculating wavelet (...) gradients from cell images followed by the extraction of meaningful measures including 2nd wavelet moment, entropy of orientation, and curvature. For the three cell types analyzed, the mean 2nd wavelet moment, which relates to the field of influence of the dendritic-tree segments was significantly different. cells had the highest mean 2nd wavelet moment, followed by the and cells (134 ± 22, 93 ± 19 and 63 ± 12, respectively). There was no significant difference between cells for entropy of orientation, indicating no class with a preferential orientation of their dendritic tree. Curvature provided similar results to the 2nd wavelet moment with cells having the highest curvature followed by and the cells (mean ± SD: 161 ± 15; 134 ± 22; 121 ± 15). Our feature space analysis also indicated a difference between these cell types. No difference was found between the and cell types and their physiological counterparts the Y and X cells based on wavelet analysis. Both the X and Y cells can be divided into two subtypes, the ON- and OFF-center cells based on the stratification level of the dendritic tree within the retina. Using 2nd wavelet moment, a difference in their morphological attributes, not reported previously, was noted for these subtypes. The 2nd wavelet moment and curvature are further discussed with respect to explaining regularity of spacing and coverage associated with retinal ganglion cell mosaics. (shrink)

Image data play important role in various real-time online and offline applications. Biomedical field has adopted the imaging system to detect, diagnose, and prevent several types of diseases and abnormalities. The biomedical imaging data contain huge information which requires huge storage space. Moreover, currently telemedicine and IoT based remote health monitoring systems are widely developed where data is transmitted from one place to another. Transmission of this type of huge data consumes more bandwidth. Along with this, during this transmission, the (...) attackers can attack the communication channel and obtain the important and secret information. Hence, biomedical image compression and encryption are considered the solution to deal with these issues. Several techniques have been presented but achieving desired performance for combined module is a challenging task. Hence, in this work, a novel combined approach for image compression and encryption is developed. First, image compression scheme using wavelet transform is presented and later a cryptography scheme is presented using confusion and diffusion schemes. The outcome of the proposed approach is compared with various existing techniques. The experimental analysis shows that the proposed approach achieves better performance in terms of autocorrelation, histogram, information entropy, PSNR, MSE, and SSIM. (shrink)

The quantification of phase synchrony between neuronal signals is of crucial importance for the study of large-scale interactions in the brain. Two methods have been used to date in neuroscience, based on two distinct approaches which permit a direct estimation of the instantaneous phase of a signal [Phys. Rev. Lett. 81 (1998) 3291; Human Brain Mapping 8 (1999) 194]. The phase is either estimated by using the analytic concept of Hilbert transform or, alternatively, by convolution with a complex wavelet. (...) In both methods the stability of the instantaneous phase over a window of time requires quantification by means of various statistical dependence parameters (standard deviation, Shannon entropy or mutual information). The purpose of this paper is to conduct a direct comparison between these two methods on three signal sets: (1) neural models; (2) intracranial signals from epileptic patients; and (3) scalp EEG recordings. Levels of synchrony that can be considered as reliable are estimated by using the technique of surrogate data. Our results demonstrate that the differences between the methods are minor, and we conclude that they are fundamentally equivalent for the study of neuroelectrical signals. This offers a common language and framework that can be used for future research in the area of synchronization. © 2001 Published by Elsevier Science B.V. (shrink)

A new medical image enhancement algorithm based on spatial frequency domain is presented in this article. The medical image is first divided into several sub-images based on dyadic wavelet scale analysis. At each level, different directional sub-band images can reflect the different characteristics of the image. A low-frequency sub-band image maintains the original image content information, and high-frequency sub-band images represent image details such as edges and regional boundaries. The corresponding sub-band images are then enhanced by different Butterworth homomorphic (...) filtering functions, which can attenuate the low frequencies and amplify the high frequencies. A linear adjustment is carried out on the low frequency of the highest level. Then, the wavelet reconstruction course is used to obtain the final enhanced image. Experiments on magnetic resonance images of temporomandibular joint soft tissues have shown that the proposed method can effectively eliminate the non-uniform luminance distribution of medical images. Its performance is much better than traditional Butterworth homomorphic filtering algorithm whether in subjective vision quality or objective evaluations such as detailed information entropy and average gradient. (shrink)

Comment Bachelard, fils d'un cordonnier, professeur de physique et chimie, a-t-il pu devenir cet humaniste aussi savant que philosophe, aussi penseur que poète? Il n'a pas emprunté les chemins balisés, ceux des élites universitaires et culturelles. Il a contrarié les pronostics et les conventions. Il s'est adjugé contre vents et marées le droit de penser par lui-même en bousculant les frontières des savoirs et de la culture et en dérangeant les us et coutumes établis. "Un ouvrage aussi lumineux que la (...) destinée et l'oeuvre de Gaston Bachelard. Au plus près de sa vie et de sa pensée". (Philippe Meirieu). (shrink)

Electroencephalogram has been widely utilized in emotion recognition. Psychologists have found that emotions can be divided into conscious emotion and unconscious emotion. In this article, we explore to classify subliminal emotions with EEG signals elicited by subliminal face stimulation, that is to select appropriate features to classify subliminal emotions. First, multi-scale sample entropy, wavelet packet energy, and wavelet packet entropy of EEG signals are extracted. Then, these features are fed into the decision tree and improved random (...) forest, respectively. The classification accuracy with Ei and WpEn is higher than MSpEn, which shows that Ei and WpEn can be used as effective features to classify subliminal emotions. We compared the classification results of different features combined with the decision tree algorithm and the improved random forest algorithm. The experimental results indicate that the improved random forest algorithm attains the best classification accuracy for subliminal emotions. Finally, subliminal emotions and physiological proof of subliminal affective priming effect are discussed. (shrink)

In special application scenarios, such as portable anesthesia depth monitoring, portable emotional state recognition and portable sleep monitoring, electroencephalogram (EEG) signal acquisition equipment is required to be convenient and easy to use. It is difficult to remove electrooculogram (EOG) artifacts when the number of EEG acquisition channels is small, especially when the number of observed signals is less than that of the source signals, and the overcomplete problem will arise. The independent component analysis (ICA) algorithm commonly used for artifact removal (...) requires the number of basis vectors to be smaller than the dimension of the input data due to a set of standard orthonormal bases learned during the convergence process, so it cannot be used to solve the overcomplete problem. The empirical mode decomposition method decomposes the signal into several independent intrinsic mode functions so that the number of observed signals is more than that of the source signals, solving the overcomplete problem. However, when using this method to solve overcompleteness, the modal aliasing problem will arise, which is caused by abnormal events such as sharp signals, impulse interference, and noise. Aiming at the above problems, we propose a novel EEG artifact removal method based on discrete wavelet transform, complete empirical mode decomposition for adaptive noise (CEEMDAN) and ICA in this paper. First, the input signals are transformed by discrete wavelet (DWT), and then CEEMDAN is used to solve the overcomplete and mode aliasing problems, meeting the a priori conditions of the ICA algorithm. Finally, the components belonging to EOG artifacts are removed according to the sample entropy value of each independent component. Experiments show that this method can effectively remove EOG artifacts while solving the overcomplete and modal aliasing problems. (shrink)

In a digital communication environment, information security is mandatory. Three essential parameters used in the design process of a steganography algorithm are Payload, security, and fidelity. However, several methods are implemented in information hiding, such as Least Significant Bit (LBS), Discrete Wavelet Transform, Masking, and Discrete Cosine Transform. The paper aims to investigate novel steganography techniques based on agent technology. It proposes a Framework of Steganography based on agent for secret communication using LSB. The most common image steganography databases (...) are explored for training and testing. The methodology in this work is based on the statistical properties of the developed agent software using Matlab. The experiment design is based on six statistical feature measures, including Histogram, Mean, Standard deviation, Entropy, Variance and Energy. For steganography, an Ensemble classifier is used to test two scenarios: embedding a single language message and inserting bilingual messages. ROC Curve represents the evaluation metrics. The result shows that the designed agent-based system with 50% training/testing sample set and 0.2 Payload can pick out the best cover image for the provided hidden message size to avoid visual artifact. (shrink)

Crowd behaviour challenges our fundamental understanding of social phenomena. Involving complex interactions between multiple temporal and spatial scales of activity, its governing mechanisms defy conventional analysis. Using 1.5 million Twitter messages from the 15M movement in Spain as an example of multitudinous self-organization, we describe the coordination dynamics of the system measuring phase-locking statistics at different frequencies using wavelet transforms, identifying 8 frequency bands of entrained oscillations between 15 geographical nodes. Then we apply maximum entropy inference methods to (...) describe Ising models capturing transient synchrony in our data at each frequency band. The models show that all frequency bands of the system operate near critical points of their parameter space and while fast frequencies present only a few metastable states displaying all-or-none synchronization, slow frequencies present a diversity of metastable states of partial synchronization. Furthermore, describing the state at each frequency band using the energy of the corresponding Ising model, we compute transfer entropy to characterize cross-scale interactions between frequency bands, showing a cascade of upward information flows in which each frequency band influences its contiguous slower bands and downward information flows where slow frequencies modulate distant fast frequencies. (shrink)

Entropy is ubiquitous in physics, and it plays important roles in numerous other disciplines ranging from logic and statistics to biology and economics. However, a closer look reveals a complicated picture: entropy is defined differently in different contexts, and even within the same domain different notions of entropy are at work. Some of these are defined in terms of probabilities, others are not. The aim of this chapter is to arrive at an understanding of some of the (...) most important notions of entropy and to clarify the relations between them, After setting the stage by introducing the thermodynamic entropy, we discuss notions of entropy in information theory, statistical mechanics, dynamical systems theory and fractal geometry. (shrink)

Daniel R. Brooks and E. O. Wiley have proposed a theory of evolution in which fitness is merely a rate determining factor. Evolution is driven by non-equilibrium processes which increase the entropy and information content of species together. Evolution can occur without environmental selection, since increased complexity and organization result from the likely capture at the species level of random variations produced at the chemical level. Speciation can occur as the result of variation within the species which decreases the (...) probability of sharing genetic information. Critics of the Brooks-Wiley theory argue that they have abused terminology from information theory and t thermodynamics. In this paper I review the essentials of the theory, and give an account of hierarchical physical information systems within which the theory can be interpreted. I then show how the major conceptual objections can be answered. (shrink)

David Albert and Barry Loewer have argued that the temporal asymmetry of our concept of causal influence or control is grounded in the statistical mechanical assumption of a low-entropy past. In this paper I critically examine Albert's and Loewer 's accounts.

Logical information theory is the quantitative version of the logic of partitions just as logical probability theory is the quantitative version of the dual Boolean logic of subsets. The resulting notion of information is about distinctions, differences and distinguishability and is formalized using the distinctions of a partition. All the definitions of simple, joint, conditional and mutual entropy of Shannon information theory are derived by a uniform transformation from the corresponding definitions at the logical level. The purpose of this (...) paper is to give the direct generalization to quantum logical information theory that similarly focuses on the pairs of eigenstates distinguished by an observable, i.e., qudits of an observable. The fundamental theorem for quantum logical entropy and measurement establishes a direct quantitative connection between the increase in quantum logical entropy due to a projective measurement and the eigenstates that are distinguished by the measurement. Both the classical and quantum versions of logical entropy have simple interpretations as “two-draw” probabilities for distinctions. The conclusion is that quantum logical entropy is the simple and natural notion of information for quantum information theory focusing on the distinguishing of quantum states. (shrink)

Both a method of therapy and an exploration of psychic reality, free association is a fundamental element of psychoanalytical practices that refers to the way a patient is asked to describe what comes spontaneously to mind in the therapeutic setting. This paper examines the role of free association from the point of view of psychoanalysis and neuroscience in order to improve our understanding of therapeutic effects induced by psychoanalytic therapies and psychoanalysis. In this regard, we first propose a global overview (...) of the historical origins of the concept of free association in psychoanalysis and examine how Freud established its principles. Then, from Freud’s distinction between primary and secondary processes, we proceed to compare the psychoanalytic model with research originating from cognitive psychology and neuroscience. The notions of entropy and free energy appear particularly relevant at the intersection of these different domains. Finally, we propose the notion of symbolizing transmodality to describe certain specificities of symbolization processes within free association and we summarize the main functions of free association in psychoanalytic practices. (shrink)

For the first time Entropy has been completely revised and updated to include a new subtitle which reflects the expanded focus on the greenhouse effect--the largest crisis ever to face mankind.

The paper tries to demonstrate that the process of the increase of entropy does not explain the asymmetry of time itself because it is unable to account for its fundamental asymmetries, that is, the asymmetry of traces (we have traces of the past and no traces of the future), the asymmetry of causation (we have an impact on future events with no possibility of having an impact on the past), and the asymmetry between the fixed past and the open (...) future, To this end, the approaches of Boltzmann, Reichenbach (and his followers), and Albert are analysed. It is argued that we should look for alternative approaches instead of this, namely we should consider a temporally asymmetrical physical theory or seek a source of the asymmetry of time in metaphysics. This second approach may even turn out to be complementary if only we accept that metaphysics can complement scientific research programmes. (shrink)

This essay is, primarily, a discussion of four results about the principle of maximizing entropy (MAXENT) and its connections with Bayesian theory. Result 1 provides a restricted equivalence between the two: where the Bayesian model for MAXENT inference uses an "a priori" probability that is uniform, and where all MAXENT constraints are limited to 0-1 expectations for simple indicator-variables. The other three results report on an inability to extend the equivalence beyond these specialized constraints. Result 2 established a sensitivity (...) of MAXENT inference to the choice of the algebra of possibilities even though all empirical constraints imposed on the MAXENT solution are satisfied in each measure space considered. The resulting MAXENT distribution is not invariant over the choice of measure space. Thus, old and familiar problems with the Laplacian principle of Insufficient Reason also plague MAXENT theory. Result 3 builds upon the findings of Friedman and Shimony (1971; 1973) and demonstrates the absence of an exchangeable, Bayesian model for predictive MAXENT distributions when the MAXENT constraints are interpreted according to Jaynes's (1978) prescription for his (1963) Brandeis Dice problem. Lastly, Result 4 generalizes the Friedman and Shimony objection to cross-entropy (Kullback-information) shifts subject to a constraint of a new odds-ratio for two disjoint events. (shrink)

I discuss the statistical mechanics of gravitating systems and in particular its cosmological implications, and argue that many conventional views on this subject in the foundations of statistical mechanics embody significant confusion; I attempt to provide a clearer and more accurate account. In particular, I observe that (i) the role of gravity in entropy calculations must be distinguished from the entropy of gravity, that (ii) although gravitational collapse is entropy-increasing, this is not usually because the collapsing matter (...) itself increases in entropy, and that (iii) the Second Law of thermodynamics does not owe its validity to the statistical mechanics of gravitational collapse. (shrink)

This essay is an attempt to reconcile the disturbing contradiction between the striving for order in nature and in man and the principle of entropy implicit in the second law of thermodynamics - between the tendency toward greater organization and the general trend of the material universe toward death and disorder.

This book is about an important issue which has arisen within two of the branches of physical science - namely thermodynamics and statistical mechanics - where the notion of entropy plays an essential role. A number of scientists and information theorists have maintained that entropy is a subjective concept and is a measure of human ignorance. Such a view, if it is valid, would create some profound philosophical problems and would tend to undermine the objectivity of the scientific (...) enterprise. Whilst the present volume is not a treatise on thermodynamics or statistical mechanics, all relevant steps in the building up of these disciplines are carefully scrutinised and it is concluded that the charge of subjectivity cannot be upheld. The widely adopted view that entropy is a measure of disorder, or of lack of information, is shown to be ambiguous, although it may be of use in certain contexts. (shrink)

Neural complexity and brain entropy have gained greater interest in recent years. The dynamics of neural signals and their relations with information processing continue to be investigated through different measures in a variety of noteworthy studies. The BEN of spontaneous neural activity decreases during states of reduced consciousness. This evidence has been showed in primary consciousness states, such as psychedelic states, under the name of “the entropic brain hypothesis.” In this manuscript we propose an extension of this hypothesis to (...) physiological and pathological aging. We review this particular facet of the complexity of the brain, mentioning studies that have investigated BEN in primary consciousness states, and extending this view to the field of neuroaging with a focus on resting-state functional Magnetic Resonance Imaging. We first introduce historic and conceptual ideas about entropy and neural complexity, treating the mindbrain as a complex nonlinear dynamic adaptive system, in light of the free energy principle. Then, we review the studies in this field, analyzing the idea that the aim of the neurocognitive system is to maintain a dynamic state of balance between order and chaos, both in terms of dynamics of neural signals and functional connectivity. In our exploration we will review studies both on acute psychedelic states and more chronic psychotic states and traits, such as those in schizophrenia, in order to show the increase of entropy in those states. Then we extend our exploration to physiological and pathological aging, where BEN is reduced. Finally, we propose an interpretation of these results, defining a general trend of BEN in primary states and cognitive aging. (shrink)

This essay is an attempt to reconcile the disturbing contradiction between the striving for order in nature and in man and the principle of entropy implicit in the second law of thermodynamics - between the tendency toward greater organization and the general trend of the material universe toward death and disorder.

Although the laws of thermodynamics are well established for black hole horizons, much less has been said in the literature to support the extension of these laws to more general settings such as an asymptotic de Sitter horizon or a Rindler horizon (the event horizon of an asymptotic uniformly accelerated observer). In the present paper we review the results that have been previously established and argue that the laws of black hole thermodynamics, as well as their underlying statistical mechanical content, (...) extend quite generally to what we call here “causal horizons.” The root of this generalization is the local notion of horizon entropy density. (shrink)

The Madelung equations map the non-relativistic time-dependent Schrödinger equation into hydrodynamic equations of a virtual fluid. While the von Neumann entropy remains constant, we demonstrate that an increase of the Shannon entropy, associated with this Madelung fluid, is proportional to the expectation value of its velocity divergence. Hence, the Shannon entropy may grow due to an expansion of the Madelung fluid. These effects result from the interference between solutions of the Schrödinger equation. Growth of the Shannon (...) class='Hi'>entropy due to expansion is common in diffusive processes. However, in the latter the process is irreversible while the processes in the Madelung fluid are always reversible. The relations between interference, compressibility and variation of the Shannon entropy are then examined in several simple examples. Furthermore, we demonstrate that for classical diffusive processes, the “force” accelerating diffusion has the form of the positive gradient of the quantum Bohm potential. Expressing then the diffusion coefficient in terms of the Planck constant reveals the lower bound given by the Heisenberg uncertainty principle in terms of the product between the gas mean free path and the Brownian momentum. (shrink)

This editorial explains the scope of the special issue and provides a thematic introduction to the contributed papers.

I assess the thesis that counterfactual asymmetries are explained by an asymmetry of the global entropy at the temporal boundaries of the universe, by developing a method of evaluating counterfactuals that includes, as a background assumption, the low entropy of the early universe. The resulting theory attempts to vindicate the common practice of holding the past mostly fixed under counterfactual supposition while at the same time allowing the counterfactual's antecedent to obtain by a natural physical development. Although the (...) theory has some success in evaluating a wide variety of ordinary counterfactuals, it fails as an explanation of counterfactual asymmetry. (shrink)

Entropy and information are both emerging as currencies of interdisciplinary dialogue, most recently in evolutionary theory. If this dialogue is to be fruitful, there must be general agreement about the meaning of these terms. That this is not presently the case owes principally to the supposition of many information theorists that information theory has succeeded in generalizing the entropy concept. The present paper will consider the merits of the generalization thesis, and make some suggestions for restricting both (...) class='Hi'>entropy and information to specific arenas of discourse. (shrink)

Several authors have investigated the question of whether canonical logic-based accounts of belief revision, and especially the theory of AGM revision operators, are compatible with the dynamics of Bayesian conditioning. Here we show that Leitgeb's stability rule for acceptance, which has been offered as a possible solution to the Lottery paradox, allows to bridge AGM revision and Bayesian update: using the stability rule, we prove that AGM revision operators emerge from Bayesian conditioning by an application of the principle of maximum (...) entropy. In situations of information loss, or whenever the agent relies on a qualitative description of her information state - such as a plausibility ranking over hypotheses, or a belief set - the dynamics of AGM belief revision are compatible with Bayesian conditioning; indeed, through the maximum entropy principle, conditioning naturally generated AGM revision operators. This mitigates an impossibility theorem of Lin and Kelly for tracking Bayesian conditioning with AGM revision, and suggests an approach to the compatibility problem that highlights the information loss incurred by acceptance rules in passing from probabilistic to qualitative representations of beliefs. (shrink)

The Anthropocene crisis is frequently described as the rarefaction of resources or resources per capita. However, both energy and minerals correspond to fundamentally conserved quantities from the perspective of physics. A specific concept is required to understand the rarefaction of available resources. This concept, entropy, pertains to energy and matter configurations and not just to their sheer amount. However, the physics concept of entropy is insufficient to understand biological and social organizations. Biological phenomena display both historicity and systemic (...) properties. A biological organization, the ability of a specific living being to last over time, results from history, expresses itself by systemic properties, and may require generating novelties The concept of anti-entropy stems from the combination of these features. We propose that Anthropocene changes disrupt biological organizations by randomizing them, that is, decreasing anti-entropy. Moreover, second-order disruptions correspond to the decline of the ability to produce functional novelties, that is, to produce anti-entropy. (shrink)

Integrating concepts of maintenance and of origins is essential to explaining biological diversity. The unified theory of evolution attempts to find a common theme linking production rules inherent in biological systems, explaining the origin of biological order as a manifestation of the flow of energy and the flow of information on various spatial and temporal scales, with the recognition that natural selection is an evolutionarily relevant process. Biological systems persist in space and time by transfor ming energy from one state (...) to another in a manner that generates structures which allows the system to continue to persist. Two classes of energetic transformations allow this; heat-generating transformations, resulting in a net loss of energy from the system, and conservative transformations, changing unusable energy into states that can be stored and used subsequently. All conservative transformations in biological systems are coupled with heat-generating transformations; hence, inherent biological production, or genealogical proesses, is positively entropic. There is a self-organizing phenomenology common to genealogical phenomena, which imparts an arrow of time to biological systems. Natural selection, which by itself is time-reversible, contributes to the organization of the self-organized genealogical trajectories. The interplay of genealogical (diversity-promoting) and selective (diversity-limiting) processes produces biological order to which the primary contribution is genealogical history. Dynamic changes occuring on times scales shorter than speciation rates are microevolutionary; those occuring on time scales longer than speciation rates are macroevolutionary. Macroevolutionary processes are neither redicible to, nor autonomous from, microevolutionary processes. (shrink)

One well-known objection to the principle of maximum entropy is the so-called Judy Benjamin problem, first introduced by van Fraassen. The problem turns on the apparently puzzling fact that, on the basis of information relating an event’s conditional probability, the maximum entropy distribution will almost always assign to the event conditionalized on a probability strictly less than that assigned to it by the uniform distribution. In this article, I present an analysis of the Judy Benjamin problem that can (...) help to make sense of this seemingly odd feature of maximum entropy inference. My analysis is based on the claim that, in applying the principle of maximum entropy, Judy Benjamin is not acting out of a concern to maximize uncertainty in the face of new evidence, but is rather exercising a certain brand of epistemic charity towards her informant. This epistemic charity takes the form of an assumption on the part of Judy Benjamin that her informant’s evidential report leaves out no relevant information. Such a reconceptualization of the motives underlying Judy Benjamin’s appeal to the principle of maximum entropy can help to further our understanding of the true epistemological grounds of this principle and correct a common misapprehension regarding its relationship to the principle of insufficient reason. 1Introduction2The Principle of Maximum Entropy3An Apologia for Judy Benjamin4Conclusion: Entropy and Insufficient Reason. (shrink)

Michel Serres’s philosophy of entropy takes what he famously calls the ‘Northwest Passage’ between the sciences and the humanities. By contextualizing his approach to entropy and affirming the role of a philosophy of difference, this paper explores Serres’s approach by means of ‘entropic differences’. It claims that entropy – or rather, entropies – provide Serres with a paradigmatic case for critical translations between different domains of knowledge. From his early Hermès series, through to The Birth of Physics (...) and later writings on social and ethical themes, he keeps thermodynamical and informational – or ‘hard’ and ‘soft’ – understandings of entropy apart, while simultaneously exploring their relation. By focusing on the systematic significance of Serres’s ‘entropic difference’, this paper shows how it unfolds not necessarily as an ontological difference but as an operative function between the history and philosophy of science, epistemology, and a theory of negentropic (inter)subjectivity. (shrink)

Views the process of artistic creation in light of the conflict between man's quest for order and increasing universal disorder.

A new way of understanding entropy as a macroscopic property is presented. This is based on the fact that heat flows from a hot body to a cold one even when the hot one is smaller and has less energy. A quantity that determines the direction of flow is shown to be the increment of heat gained divided by the absolute temperature. The same quantity is shown to determine the direction of other processes taking place in isolated systems provided (...) that q is determined by the state of the system. Entropy emerges as the potent energy of a system [Σ], the potency being determined by 1/T. This is shown to tie in with the statistical mechanical interpretation of entropy. The treatment is shorter than the traditional one based on heat engines. (shrink)

In this essay I critically examine the role of entropy of mixing in articulating a macroscopic criterion for the sameness and difference of chemical substances. Consider three cases of mixing in which entropy change occurs: isotopic variants, spin isomers, and populations of atoms in different orthogonal quantum states. Using these cases I argue that entropy of mixing tracks differences between physical states, differences that may or may not correspond to a difference of substance. It does not provide (...) a criterion for the sameness and difference of substance that is appropriate to chemistry. (shrink)

The present paper is a survey of the economics of survival, a branch of ecological economics that stresses the preservation of the opportunities of future generations over an extended time horizon. It outlines the main analytical foundation of the branch - in which the concept of entropy is a major building block -, and its analysis of the interaction between the economic system and the environment. Regarding its outlook of the future, we see that the founders of the branch (...) were mainly concerned with the consequences of a serious depletion of natural resources - particularly the energetic capital of the earth. More recently, however, emphasis is being placed on problems that stem from the fragility of the global ecosystem in face of the disturbances caused by the entropic acceleration imposed by mankind. It is feared that the ongoing expansion of the scale of the economy may bring about irreversible damages to vital environmental functions, such as protection against undesirable consequences of solar radiation, maintenance of temperature within a range that will support life, and preservation of ecosystem resiliency. (shrink)

The idea that the changing entropy of a system is relevant to explaining why we know more about the system's past than about its future has been criticized on several fronts. This paper assesses the criticisms and clarifies the epistemology of the inference problem. It deploys a Markov process model to investigate the relationship between entropy and temporally asymmetric inference.

A new axiomatic characterization with a minimum of conditions for entropy as a function on the set of states in quantum mechanics is presented. Traditionally unspoken assumptions are unveiled and replaced by proven consequences of the axioms. First the Boltzmann–Planck formula is derived. Building on this formula, using the Law of Large Numbers—a basic theorem of probability theory—the von Neumann formula is deduced. Axioms used in older theories on the foundations are now derived facts.

A probability distribution can be given to the set of isomorphism classes of models with universe {1, ..., n} of a sentence in first-order logic. We study the entropy of this distribution and derive a result from the 0–1 law for first-order sentences.

We investigate uncertain reasoning with quantified sentences of the predicate calculus treated as the limiting case of maximum entropy inference applied to finite domains.

We review some notions for general quantum entropies. The entropy of the compound systems is discussed and a numerical computation of the quantum dynamical systems is carried for the noisy optical channel.