Ensemble Estimation of Generalized Mutual Information With Applications to Genomics
Not provided.
Computer Science↗
SEARCH · Engineering Papers
Results for “mutual information”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Enhancing global aerosol retrieval from satellite data via deep learning with mutual information estimation
Explore the source record for details and available documents.
Xiaohu Sun↗
A mutual information criterion with applications to canonical correlation analysis and graphical models
Explore the source record for details and available documents.
Timothy DelSole↗
Holographic entanglement distillation from the surface state correspondence
We study correlations between geometric subfactors living on the Ryu-Takayanagi surface that bounds the entanglement wedge. Using the surface-state correspondence and the bit threads program, we are able to calculate mutual information and conditional mutual information between subfactors. This enables us to count the shared Bell pairs between subfactors, and we propose an entanglement distillation procedure over these subsystems via a SWAP gate protocol. We comment on extending to multipartite entanglement.
99 GENERAL AND MISCELLANEOUS↗
Information Theoretic Approaches to Rapid Discovery of Relationships in Large Climate Data Sets
Mutual information as the asymptotic Bayesian measure of independence is an excellent starting point for investigating the existence of possible relationships among climate-relevant variables in large data sets, As mutual information is a nonlinear function of of its arguments, it is not beholden to the assumption of a linear relationship between the variables in question and can reveal features missed in linear correlation analyses. However, as mutual information is symmetric in its arguments, it only has the ability to reveal the probability that two variables are related. it provides no information as to how they are related; specifically, causal interactions or a relation based on a common cause cannot be detected. For this reason we also investigate the utility of a related quantity called the transfer entropy. The transfer entropy can be written as a difference between mutual informations and has the capability to reveal whether and how the variables are causally related. The application of these information theoretic measures is rested on some familiar examples using data from the International Satellite Cloud Climatology Project (ISCCP) to identify relation between global cloud cover and other variables, including equatorial pacific sea surface temperature (SST), over seasonal and El Nino Southern Oscillation (ENSO) cycles.
Knuth, Kevin H.↗
Mutual information-assisted adaptive variational quantum eigensolver
Adaptive construction of ansatz circuits offers a promising route towards applicable variational quantum eigensolvers on near-term quantum hardware. Those algorithms aim to build up optimal circuits for a certain problem and ansatz circuits are adaptively constructed by selecting and adding entanglers from a predefined pool. In this work, we propose a way to construct entangler pools with reduced size by leveraging classical algorithms. Our method uses mutual information between the qubits in classically approximated ground state to rank and screen the entanglers. The density matrix renormalization group method is employed for classical precomputation in this work. We corroborate our method numerically on small molecules. Our numerical experiments show that a reduced entangler pool with a small portion of the original entangler pool can achieve same numerical accuracy. Here, we believe that our method paves a new way for adaptive construction of ansatz circuits for variational quantum algorithms.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Entanglement phase transitions in random stabilizer tensor networks
Here we explore a class of random tensor network models with “stabilizer” local tensors which we name random stabilizer tensor networks (RSTNs). For RSTNs defined on a two-dimensional square lattice, we perform extensive numerical studies of entanglement phase transitions between volume-law and area-law entangled phases of the one-dimensional boundary states. These transitions occur when either (a) the bond dimension D of the constituent tensors is varied or (b) the tensor network is subject to random breaking of bulk bonds, implemented by forced measurements. In the absence of broken bonds, we find that the RSTN supports a volume-law entangled boundary state with bond dimension D ≥ 3 where D is a prime number, and an area-law entangled boundary state for D = 2. Upon breaking bonds at random in the bulk with probability p, there exists a critical measurement rate p c for each D ≥ 3 above which the boundary state becomes area-law entangled. To explore the conformal invariance at these entanglement transitions for different prime D, we consider tensor networks on a finite rectangular geometry with a variety of boundary conditions, and extract universal operator scaling dimensions via extensive numerical calculations of the entanglement entropy, mutual information, and mutual negativity at their respective critical points. Our results at large D approach known universal data of percolation conformal field theory, while showing clear discrepancies at smaller D, suggesting a distinct entanglement transition universality class for each prime D. We further study universal entanglement properties in the volume-law phase and demonstrate quantitative agreement with the recently proposed description in terms of a directed polymer in a random environment.
36 MATERIALS SCIENCE↗
Comparison of the information contents of Landsat TM and MSS data
A communications-theory approach is taken to analyze the dispersion and concentration of signal values in various data spaces, irrespective of specific class membership. Entropy is used to quantify information, and mutual information is used to measure the information represented by subsets of spectral variables. Several different comparisons of information content are made. These include comparisons of system design capacities, of data volumes occupied by agricultural data in the spaces defined by original bands and by transformed spectral (Tasseled Cap) variables, of the information contents of original bands and Tasseled Cap variables, and of the information contents of TM and MSS for the given agricultural data sets. Also, the effects of sample size, scene content, and quantization level are examined.
Malila, W. A.↗
Comparison of the information contents of LANDSAT TM and MSS data
A communications-theory approach is taken to analyze the dispersion and concentration of signal values in various data spaces, irrespective of specific class membership. Entropy is used to quantify information, and mutual information is used to measure the information represented by subsets of spectral variables. Several different comparisons of information content are made. These include comparisons of system design capacities, of data volumes occupied by agricultural data in the spaces defined by original bands and by transformed spectral (Tasseled Cap) variables, of the information contents of original bands and Tasseled Cap variables, and of the information contents of TM and MSS for the given agricultural data sets. Also, the effects of sample size, scene content, and quantization level are examined.
Malila, W. A.↗
Revealing Relationships among Relevant Climate Variables with Information Theory
The primary objective of the NASA Earth-Sun Exploration Technology Office is to understand the observed Earth climate variability, thus enabling the determination and prediction of the climate's response to both natural and human-induced forcing. We are currently developing a suite of computational tools that will allow researchers to calculate, from data, a variety of information-theoretic quantities such as mutual information, which can be used to identify relationships among climate variables, and transfer entropy, which indicates the possibility of causal interactions. Our tools estimate these quantities along with their associated error bars, the latter of which is critical for describing the degree of uncertainty in the estimates. This work is based upon optimal binning techniques that we have developed for piecewise-constant, histogram-style models of the underlying density functions. Two useful side benefits have already been discovered. The first allows a researcher to determine whether there exist sufficient data to estimate the underlying probability density. The second permits one to determine an acceptable degree of round-off when compressing data for efficient transfer and storage. We also demonstrate how mutual information and transfer entropy can be applied so as to allow researchers not only to identify relations among climate variables, but also to characterize and quantify their possible causal interactions.
Knuth, Kevin H.↗
Approximate Quantum Codes From Long Wormholes
We discuss families of approximate quantum error correcting codes which arise as the nearly-degenerate ground states of certain quantum many-body Hamiltonians composed of non-commuting terms. For exact codes, the conditions for error correction can be formulated in terms of the vanishing of a two-sided mutual information in a low-temperature thermofield double state. We consider a notion of distance for approximate codes obtained by demanding that this mutual information instead be small, and we evaluate this mutual information for the SYK model and for a family of low-rank SYK models. After an extrapolation to nearly zero temperature, we find that both kinds of models produce fermionic codes with constant rate as the number, N , of fermions goes to infinity. For SYK, the distance scales as N 1 / 2 , and for low-rank SYK, the distance can be arbitrarily close to linear scaling, e.g. N .99 , while maintaining a constant rate. We also consider an analog of the no low-energy trivial states property which we dub the no low-energy adiabatically accessible states property and show that these models do have low-energy states that can be prepared adiabatically in a time that does not scale with system size N . We discuss a holographic model of these codes in which the large code distance is a consequence of the emergence of a long wormhole geometry in a simple model of quantum gravity.
Physics↗
Geometric decoherence time in Lindbladian dynamics
The onset of decoherence in open many-body systems lacks a dynamical timescale grounded in the loss of bipartite entanglement. Here, we introduce the geometric decoherence time, defined as the earliest moment the monotone relation between logarithmic negativity and Rényi-$\frac{1}{2}$ entropy—exactly equal across any bipartition for pure states—breaks down under open-system evolution, signaling entropy growth without accompanying entanglement growth. We establish this criterion in both single-particle Gaussian dynamics and many-body Lindbladian evolution. We show that quantum mutual information provides a complementary long-time diagnostic: Its asymptotic vanishing is equivalent to factorization of the steady state across the bipartition, a condition strictly stronger than separability, and whenever a product steady state is approached exponentially in trace norm, negativity and mutual information share the same decay rate. In the presence of a strong symmetry, this tracking can fail—residual classical correlations can survive after entanglement has vanished. In the Kitaev chain with balanced gain and loss, we derive a closed-form solution and show that the topological phase sustains longer coherence times than the trivial phase at identical dissipation, with a local minimum at the chiral-symmetric point. In the interacting XXZ chain, exact many-body evolution shows that local 𝑍 dephasing preserves residual classical correlations, whereas gain and loss restore the mutual-information tracking of negativity. Furthermore, our results establish the geometric decoherence time as a dynamical scale tracking the onset of decoherence.
74 ATOMIC AND MOLECULAR PHYSICS↗
Environmental Controls on Water Vapor Deuterium Excess in the Coastal Boundary Layer: An Information Theory Perspective
We use information theory to quantify the environmental controls on water vapor deuterium excess (D-excess) in coastal Southern California from June 2023 through February 2024. Using Shannon entropy, mutual information (MI), and joint mutual information, metrics that capture both linear and nonlinear relationships, we identify the most informative variables and variable combinations governing D-excess across contrasting marine and continental regimes. Relative humidity with respect to sea surface temperature (RHS) is consistently the strongest individual predictor, explaining up to 27% of D-excess variability during marine conditions but only 10% in continental air masses. The Relative humidity(RHS) + sea surface temperature (SST) combination demonstrates synergistic effects, where their joint influence (explaining up to 36% of D-excess variability) exceeds what either variable achieves individually, confirming their coupled influence on deuterium excess. Wind direction complements RHS most effectively during continental conditions. The best three-variable combination (RHS + SST + Planetary Boundary Layer height) explains 38% of D-excess variability in marine air, while no combination exceeds 20% explanatory power during continental periods. Information theory shows that heteroscedasticity in D-excess relationships indicates regime shifts in controlling processes and quantifies fundamental constraints on predictor variables: some environmental factors like surface pressure or water vapor flux contain insufficient information content to explain D-excess variability regardless of their physical relevance. These results highlight the different predictability limits between marine and continental regimes, challenging the adequacy of linear models and providing a rigorous framework for quantifying the information content of isotope-climate relationships with implications for both modern and paleoclimate applications.
information theory↗
Hidden quantum criticality and entanglement in quench dynamics
Entanglement exhibits universal behavior near the ground-state critical point where correlations are long ranged and the thermodynamic entropy is vanishing. On the other hand, a quantum quench imparts extensive energy and results in a build up of entropy, hence no critical behavior is expected at long times. In this work, we present a new paradigm in the quench dynamics of integrable spin chains which exhibit a ground-state order-disorder phase transition at a critical line. Specifically, we consider a quench along the critical line which displays a volume-law behavior of the entropy and exponentially decaying correlations; however, we show that quantum criticality is hidden in higher-order correlations and becomes manifest via measures such as the mutual information and logarithmic negativity. Furthermore, we showcase the scale invariance of the Rényi mutual information between disjoint regions as further evidence for genuine critical behavior. We attribute the emergent quantum criticality to the soft mode not getting excited in spite of the quench. Moreover, the results presented here are universal to models whose low-energy or long-wavelength dynamics are well described by a free-fermionic field theory. Our results are amenable to an experimental realization on different quantum simulator platforms, particularly the Rydberg simulators. Published by the American Physical Society 2024
Paul, Sanku↗
Informative and non-informative decomposition of turbulent flow fields
Not all the information in a turbulent field is relevant for understanding particular regions or variables in the flow. Here, we present a method for decomposing a source field into its informative Φ I (x, t) and residual Φ R (x, t) components relative to another target field. The method is referred to as informative and non-informative decomposition (IND). All the necessary information for physical understanding, reduced-order modelling and control of the target variable is contained in Φ I (x, t), whereas Φ R (x, t) offers no substantial utility in these contexts. The decomposition is formulated as an optimisation problem that seeks to maximise the time-lagged mutual information of the informative component with the target variable while minimising the mutual information with the residual component. The method is applied to extract the informative and residual components of the velocity field in a turbulent channel flow, using the wall shear stress as the target variable. We demonstrate the utility of IND in three scenarios: (i) physical insight into the effect of the velocity fluctuations on the wall shear stress; (ii) prediction of the wall shear stress using velocities far from the wall; and (iii) development of control strategies for drag reduction in a turbulent channel flow using opposition control. In case (i), IND reveals that the informative velocity related to wall shear stress consists of wall-attached high- and low-velocity streaks, collocated with regions of vertical motions and weak spanwise velocity. This informative structure is embedded within a larger-scale streak–roll structure of residual velocity, which bears no information about the wall shear stress. In case (ii), the best-performing model for predicting wall shear stress is a convolutional neural network that uses the informative component of the velocity as input, while the residual velocity component provides no predictive capabilities. Finally, in case (iii), we demonstrate that the informative component of the wall-normal velocity is closely linked to the observability of the target variable and holds the essential information needed to develop successful control strategies.
97 MATHEMATICS AND COMPUTING↗
Eavesdropping on the Decohering Environment: Quantum Darwinism, Amplification, and the Origin of Objective Classical Reality
“How much information about a system S can one extract from a fragment F of the environment E that decohered it?” is the central question of Quantum Darwinism. To date, most answers relied on the quantum mutual information of SF, or on the Holevo bound on the channel capacity of F to communicate the classical information encoded in S. Furthermore, these are reasonable upper bounds on what is really needed but much harder to calculate—the accessible information in the fragment F about S. We consider a model based on imperfect c-not gates where all the above can be computed, and discuss its implications for the emergence of objective classical reality. We find that all relevant quantities, such as the quantum mutual information as well as various bounds on the accessible information exhibit similar behavior. In the regime relevant for the emergence of objective classical reality this includes scaling independent of the quality of the imperfect c-not gates or the size of E, and even nearly independent of the initial state of S.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Analytical techniques for the study of some parameters of multispectral scanner systems for remote sensing
The author has identified the following significant results. The concept of average mutual information in the received spectral random process about the spectral scene was developed. Techniques amenable to implementation on a digital computer were also developed to make the required average mutual information calculations. These techniques required identification of models for the spectral response process of scenes. Stochastic modeling techniques were adapted for use. These techniques were demonstrated on empirical data from wheat and vegetation scenes.
Wiswell, E. R.↗
Mixed-state entanglement and information recovery in thermalized states and evaporating black holes
We study the universal behavior of quantum information-theoretic quantities in thermalized isolated quantum many-body systems and evaporating black holes. In particular, we study a genuine mixed-state entanglement measure called the logarithmic negativity, other correlation measures including the Renyi negativities and the mutual information, and a signature of multipartite entanglement called the reflected entropy. We also probe the feasibility of recovering quantum information from subsystems of a thermalized quantum many-body system or from the radiation of an evaporating black hole, using quantities such as relative entropy and Petz map fidelity. A recently developed technique called the equilibrium approximation allows us to probe these quantities at finite temperature. We find striking qualitative differences from the infinite temperature case, which has been the topic of previous studies using Haar-random states. In particular, we find regimes where the logarithmic negativity is extensive but the mutual information is sub-extensive, indicating a large amount of undistillable, bound entanglement in thermalized states. For evaporating black holes at finite temperature, both the logarithmic negativity and the Petz map fidelity reveal an important new time scale t b , which is earlier than the Page time t p by a finite fraction of the total evaporation time. We find that t b , as opposed to t p , is the time scale at which quantum entanglement between different parts of the radiation becomes extensive, and the fidelity of information recovery for a large diary thrown into the black hole starts to grow.
2D Gravity↗