PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Entropy”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29Linked to original sources

Entropy production along a stochastic trajectory and an integral fluctuation theorem.

For stochastic nonequilibrium dynamics like a Langevin equation for a colloidal particle or a master equation for discrete states, entropy production along a single trajectory is studied. It involves both genuine particle entropy and entropy production in the surrounding medium. The integrated sum of both Delatas(tot) is shown to obey a fluctuation theorem (exp([-Deltas(tot) = 1 for arbitrary initial conditions and arbitrary time-dependent driving over a finite time interval.

Journal Article↗

Entropy of classical systems with long-range interactions.

We discuss the form of the entropy for classical Hamiltonian systems with long-range interaction using the Vlasov equation which describes the dynamics of a N particle in the limit N-->infinity. The stationary states of the Hamiltonian system are subject to infinite conserved quantities due to the Vlasov dynamics. We show that the stationary states correspond to an extremum of the Boltzmann-Gibbs entropy, and their stability is obtained from the condition that this extremum is a maximum. As a consequence, the entropy is a function of an infinite set of Lagrange multipliers that depend on the initial condition. We also discuss in this context the meaning of ensemble inequivalence and the temperature.

Journal Article↗

Average entropy dissipation in irreversible mesoscopic processes.

The Clausius inequality is rectified to obtain expressions for the entropy produced as the result of irreversible work and/or heat exchanges. These are combined with the Jarzynski equality and its generalizations to explicitly relate mean (as opposed to transient) entropy dissipation to experimental or simulation observables. The results are extended to nonisothermal processes which begin and end at nonequilibrium steady states, leading to a new exact expression and positive lower bound for the resulting average entropy dissipation. The Carnot engine emerges as a limiting case of a family of irreversible processes arising from an interface between materials at different temperatures, whose mapping onto reversible and irreversible molecular extension experiments is discussed.

Journal Article↗

Entanglement entropy of fermions in any dimension and the Widom conjecture.

We show that entanglement entropy of free fermions scales faster than area law, as opposed to the scaling L(d-1) for the harmonic lattice, for example. We also suggest and provide evidence in support of an explicit formula for the entanglement entropy of free fermions in any dimension d, S approximately c(deltagamma, deltaomega)L(d-1) logL as the size of a subsystem L-->infinity, where deltagamma is the Fermi surface and is the boundary of the region in real space. The expression for the constant c(deltagamma, deltaomega) is based on a conjecture due to Widom. We prove that a similar expression holds for the particle number fluctuations and use it to prove a two sided estimate on the entropy S.

Journal Article↗

Two-site entropy and quantum phase transitions in low-dimensional models.

We propose a new approach to study quantum phase transitions in low-dimensional lattice models. It is based on studying the von Neumann entropy of two neighboring central sites in a long chain. It is demonstrated that the procedure works equally well for fermionic and spin models, and the two-site entropy is a better indicator of quantum phase transition than calculating gaps, order parameters, or the single-site entropy. The method is especially convenient when the density-matrix renormalization-group algorithm is used.

Journal Article↗

Estimating the Shannon entropy: recurrence plots versus symbolic dynamics.

Recurrence plots were first introduced to quantify the recurrence properties of chaotic dynamics. A few years later, the recurrence quantification analysis was introduced to transform graphical representations into statistical analysis. Among the different measures introduced, a Shannon entropy was found to be correlated with the inverse of the largest Lyapunov exponent. The discrepancy between this and the usual interpretation of a Shannon entropy is solved here by using a new definition--still based on the recurrence plots--and it is verified that this new definition is correlated with the largest Lyapunov exponent, as expected from the Pesin conjecture. A comparison with a Shannon entropy computed from symbolic dynamics is also provided.

Journal Article↗

Entanglement entropy of 2D conformal quantum critical points: hearing the shape of a quantum drum.

The entanglement entropy of a pure quantum state of a bipartite system A union or logical sumB is defined as the von Neumann entropy of the reduced density matrix obtained by tracing over one of the two parts. In one dimension, the entanglement of critical ground states diverges logarithmically in the subsystem size, with a universal coefficient that for conformally invariant critical points is related to the central charge of the conformal field theory. We find that the entanglement entropy of a standard class of z=2 conformal quantum critical points in two spatial dimensions, in addition to a nonuniversal "area law" contribution linear in the size of the AB boundary, generically has a universal logarithmically divergent correction, which is completely determined by the geometry of the partition and by the central charge of the field theory that describes the critical wave function.

Journal Article↗

Entanglement entropy beyond the free case.

We present a perturbative method to compute the ground state entanglement entropy for interacting systems. We apply it to a collective model of mutually interacting spins in a magnetic field. At the quantum critical point, the entanglement entropy scales logarithmically with the subsystem size, the system size, and the anisotropy parameter. We determine the corresponding scaling prefactors and evaluate the leading finite-size correction to the entropy. Our analytical predictions are in perfect agreement with numerical results.

Journal Article↗

Entropy maximization constrained by solvent flatness: a new method for macromolecular phase extension and map improvement.

A practical generally applicable procedure for exponential modeling to maximum likelihood of macromolecular data sets constrained by a moderately large basis set of reliable phases and a molecular envelope is described, based on the computer program MICE [Bricogne & Gilmore (1990). Acta Cryst. A46, 284-297]. Procedures were first tested with simulated data sets. Exact and randomly perturbed amplitudes and phases were generated, together with a known envelope for solvent-free protein and for protein in an electron-dense crystal mother liquor typical of many real protein crystals. These experiments established useful guidelines and values for various parameters. Tests with basis sets chosen from the largest amplitudes indicate that exponential models with considerable correct extrapolated phase and amplitude information can be constructed from as few as 16% of the total number of reflections, with mean phase errors of about 30 degrees, at resolution limits of either 5 or 3 A. When the shape of the solvent channels in macromolecular crystals is known, it offers an important additional source of information. MICE was, therefore, adapted to average the density outside the molecular boundary defined by an input envelope. This flattening process imposes a uniform density distribution in solvent-filled channels as an additional constraint on the exponential model and is analogous to the treatment of solvent in conventional solvent flattening. Experimental data for cytidine deaminase, a structure recently solved by making extensive use of conventional solvent flattening, provides an example of the performance of maximum-entropy methods in a real situation and a compelling comparison of this method to standard procedures. Exponential models of the electron density constrained by the most reliable phases obtained by multiple isomorphous replacement with anomalous scattering (MIRAS) (figure of merit > 0.7, representing 34% of the total number of reflections) and by the envelope give rise to centroid electron-density maps which are quantitatively superior by numerous statistical criteria to conventionally solvent-flattened density. Similarity of these maps to the 2F(obs) - F(calc) map calculated with phases obtained after crystallographic refinement of the model implies that maximum-entropy extrapolation provides better phases for the remaining 66% of the reflections than the original centroid MIRAS distributions. Importantly, the solvent-flattened electron density, although it did permit interpretation of the map which was not readily accomplished with the MIRAS map, contains substantial errors. It is proposed that errors of this sort may account for previously noted deficiencies of the solvent-flattening method [Fenderson, Herriott & Adman (1990). J. Appl. Cryst. 23, 115-131] and for the occasional tendency of incorrect interpretations to be 'locked in' by crystallographic refinement [Brändén & Jones (1990). Nature (London), 343, 687-689, and references cited therein]. Solvent flattening with combined maximization of entropy and likelihood represents a phase-refinement path independent of atomic models, using the experimental amplitudes and the most reliable phases. It should, therefore, become a valuable and generally useful procedure in macromolecular crystal structure determination.

Journal Article↗

Automatic correction of motion artifacts in magnetic resonance images using an entropy focus criterion.

We present the use of an entropy focus criterion to enable automatic focusing of motion corrupted magnetic resonance images. We demonstrate the principle using illustrative examples from cooperative volunteers. Our technique can determine unknown patient motion or use knowledge of motion from other measures as a starting estimate. The motion estimate is used to compensate the acquired data and is iteratively refined using the image entropy. Entropy focuses the whole image principally by favoring the removal of motion induced ghosts and blurring from otherwise dark regions of the image. Using only the image data, and no special hardware or pulse sequences, we demonstrate correction for arbitrary rigid-body translational motion in the imaging plane and for a single rotation. Extension to three-dimensional (3-D) and more general motion should be possible. The algorithm is able to determine volunteer motion well. The mean absolute deviation between algorithm and navigator-echo-determined motion is comparable to the displacement step size used in the algorithm. Local deviations from the recorded motion or navigator-determined motion are explained and we indicate how enhanced focus criteria may be derived. In all cases we were able to compensate images for patient motion, reducing blurring and ghosting.

Artifacts↗

Volume image registration by cross-entropy optimization.

Cross-entropy (CE), an information-theoretic measure, quantifies the difference between two probability density functions. This measure is applied to volume image registration. When a good prior estimation of the joint distribution of the voxel values of two images in registration is available, the CE can be minimized to find an optimal registration. If such a prior estimation is not available, one seeks the registration which gives a joint distribution different from unlikely ones as much as possible, i.e., the CE is maximized to find an optimal registration. When the unlikely distribution is a uniform one, CE maximization reduces to joint entropy minimization; when the unlikely distribution is proportional to one of the marginal distributions, it reduces to conditional entropy minimization; when the unlikely distribution is the product of two marginal distributions, it degenerates to mutual-information maximization. These different CEs are added together and are used as criteria for image registration. The accuracy and robustness of this new approach are tested and compared using a likely joint distribution and various unlikely joint distributions and their combinations.

Adolescent↗

Prediction of PTZ-induced seizures using wavelet-based residual entropy of cortical and subcortical field potentials.

Our proposed algorithm for seizure prediction is based on the principle that seizure build-up is always preceded by constantly changing bursting levels. We use a novel measure of residual subband wavelet entropy (RSWE) to directly estimate the entropy of bursts, which is otherwise obscured by the ongoing background activity. Our results are obtained using a slow infusion anesthetized pentylenetetrazol (PTZ) rat model in which we record field potentials (FPs) from frontal cortex and two thalamic areas (anterior and posterior nuclei). In each frequency band, except for the theta-delta frequency bands, we observed a significant build-up of RSWE from the preictal period to the first ictal event (p < or = 0.05) in cortex. Significant differences were observed between cortical and thalamic RSWE (p < or = 0.05) subsequent to seizure development. A key observation is the twofold increase in mean cortical RSWE from the preictal to interictal period. Exploiting this increase, we develop a slope change detector to discern early acceleration of entropy and predict the approaching seizure. We use multiple observations through sequential detection of slope changes to enhance the sensitivity of our prediction. Using the proposed method applied to a cohort of four rats subjected to PTZ infusion, we were able to predict the first seizure episode 28 min prior to its occurrence.

Algorithms↗

Entropy-based dual-portal-to-3-DCT registration incorporating pixel correlation.

For patient setup verification in external beam radiotherapy (EBRT) of prostate cancer, we developed an information theoretic registration framework, called the minimax entropy registration framework, to simultaneously and iteratively segment portal images and register them to three-dimensional (3-D) computed tomography (CT) image data. The registration framework has two steps, the max step and the min step, and evaluates appropriate entropies to estimate segmentations of the portal images and to find the transformation parameters. In the initial version of the algorithm (Bansal et al. 1999), we assumed image pixels to be independently distributed, an assumption not true in general. Thus, to better segment the portal images and to improve the accuracy of the estimated registration parameters, in this initial formulation of the problem, the correlation among pixel intensities is modeled using a one-dimensional Markov random process. Line processes are incorporated into the model to improve the estimation of segmentation of the portal images. In the max step, the principle of maximum entropy is invoked to estimate the probability distribution on the segmentations. The estimated distribution is then incorporated into the min step to estimate the registration parameters. Performance of the proposed framework is evaluated and compared to that of a mutual information-based registration algorithm using both simulated and real patient data. In the proposed registration framework, registration of the 3-D CT image and the portal images is guided by an estimated segmentation of the pelvic bone. However, as the prostate can move with respect to the pelvic structure, further localization of the prostate using ultrasound image data is required, an issue to be further explored in future.

Algorithms↗

Temperature coefficients of affinity and entropies of adsorption from enantiomeric pairs of compounds acting at muscarinic receptors in the guinea-pig ileum.

1 The affinities of a series of enantiomeric pairs of esters of phenylcyclohexylglycollic acid, of a pair of esters of alpha-methyltropic acid and of hyoscyamine methiodide have been measured for the muscarinic receptors of the guinea-pig ileum at 30 degrees and 37 degrees C and estimates have been made of their free energies, enthalpies and entropies of adsorption. 2 With (-)-S-hyoscyamine methiodide the enthalpy of adsorption is negative whereas with the (+)-R-enantiomer it is positive. 3 With the esters of phenylcyclohexylglycollic acid the size of the onium group appears to be as important as the stereochemical configuration in determining entropy. Large onium groups appear to be associated with an increase in entropy though this can only be measured approximately because of the narrow range of temperature which can be used.

Adsorption↗

Wavelet entropy for subband segmentation of EEG during injury and recovery.

In this paper, subband wavelet entropy (SWE) is used for the segmentation of electroencephalographic signals (EEG) recorded during injury and recovery following global cerebral ischemia. Wavelet analysis is used to decompose the EEG into standard clinical subbands followed by computation of the Shannon entropy. The EEG was measured from rodent brains in a controlled experimental brain injury model by hypoxic-ischemic cardiac arrest. Results show that while the relative EEG power failed to reveal the order of bursting activity associated with recovery, SWE was used to segment the EEG and delineate the initial bursting periods in each subband. Based on entropy variations obtained from a cohort of animals with graded levels of hypoxic-ischemic cardiac arrest, an intermittent pattern of bursting was observed in the high frequency bands.

Algorithms↗

The effect of linguistic entropy on speech perception in noise in young and elderly listeners.

The rationale for a method to quantify the information content of linguistic stimuli, i.e., the linguistic entropy, is developed. The method is an adapted version of the letter-guessing procedure originally devised by Shannon [Bell Syst. Tech. J. 30, 50-64 (1951)]. It is applied to sentences included in a widely used test to measure speech-reception thresholds and originally selected to be approximately equally redundant. Results of a first experiment reveal that this method enables one to detect subtle differences between sentences and sentence lists with respect to linguistic entropy. Results of a second experiment show that (1) in young listeners and with the sentences employed, manipulating linguistic entropy can result in an effect on SRT of approximately 4 dB in terms of signal-to-noise ratio; (2) the range of this effect is approximately the same in elderly listeners.

Adult↗

Shannon entropy of partially polarized and partially coherent light with Gaussian fluctuations.

We propose to analyze Shannon entropy properties of partially coherent and partially polarized light with Gaussian probability distributions. It is shown that the Shannon entropy is a sum of simple functions of the intensity, of the degrees of polarization, and of the intrinsic degrees of coherence that have been recently introduced. This analysis clearly demonstrates the contribution of partial polarization and of partial coherence to the characterization of disorder of the light provided by the Shannon entropy, which is a standard measure of randomness. We illustrate these results on two simple examples.

Journal Article↗

Entropy and degree of polarization for nonlinear optical waves.

I show that the usual definitions of entropy and degree of polarization are not relevant for nonlinear optical waves, because they would lead to the erroneous conclusion that a genuine process of reversible propagation would be characterized by an irreversible process of entropy production. To circumvent this problem, I propose appropriate definitions of entropy and degree of polarization that depend on all the statistical moments of the nonlinear wave, so that they exhibit the satisfactory property to be conserved during a reversible propagation process.

Journal Article↗