Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “information entropy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS1985

Comparison of the information contents of LANDSAT TM and MSS data

A communications-theory approach is taken to analyze the dispersion and concentration of signal values in various data spaces, irrespective of specific class membership. Entropy is used to quantify information, and mutual information is used to measure the information represented by subsets of spectral variables. Several different comparisons of information content are made. These include comparisons of system design capacities, of data volumes occupied by agricultural data in the spaces defined by original bands and by transformed spectral (Tasseled Cap) variables, of the information contents of original bands and Tasseled Cap variables, and of the information contents of TM and MSS for the given agricultural data sets. Also, the effects of sample size, scene content, and quantization level are examined.

Malila, W. A.↗
NASA NTRS1975

Random coding strategies for minimum entropy

This paper proves that there exists a fixed random coding strategy for block coding a memoryless information source to achieve the absolute epsilon entropy of the source. That is, the strategy can be chosen independent of the block length. The principal new tool is an easy result on the semicontinuity of the relative entropy functional of one probability distribution with respect to another. The theorem generalizes a result from rate-distortion theory to the 'zero-infinity' case.

Posner, E. C.↗
DOE OSTI2020

Large-d phase transitions in holographic mutual information

In the AdS/CFT correspondence, the entanglement entropy of subregions in the boundary CFT is conjectured to be dual to the area of a bulk extremal surface at leading order in G N in the holographic limit. Under this dictionary, distantly separated regions in the CFT vacuum state have zero mutual information at leading order, and only attain nonzero mutual information at this order when they lie close enough to develop significant classical and quantum correlations. Previously, the separation at which this phase transition occurs for equal-size ball-shaped regions centered at antipodal points on the boundary was known analytically only in 3 spacetime dimensions. Inspired by recent explorations of general relativity at large- d , we compute the separation at which the phase transition occurs analytically in the limit of infinitely many spacetime dimensions, and find that distant regions cannot develop large correlations without collectively occupying the entire volume of the boundary theory. We interpret this result as illustrating the spatial decoupling of holographic correlations in the large- d limit, and provide intuition for this phenomenon using results from quantum information theory. We also compute the phase transition separation numerically for a range of bulk spacetime dimensions from 4 to 21, where analytic results are intractable but numerical results provide insight into the dimension-dependence of holographic correlations. For bulk dimensions above 5, our exact numerical results are well approximated analytically by working to next-to-leading order in the large- d expansion.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Mixed-state entanglement and information recovery in thermalized states and evaporating black holes

We study the universal behavior of quantum information-theoretic quantities in thermalized isolated quantum many-body systems and evaporating black holes. In particular, we study a genuine mixed-state entanglement measure called the logarithmic negativity, other correlation measures including the Renyi negativities and the mutual information, and a signature of multipartite entanglement called the reflected entropy. We also probe the feasibility of recovering quantum information from subsystems of a thermalized quantum many-body system or from the radiation of an evaporating black hole, using quantities such as relative entropy and Petz map fidelity. A recently developed technique called the equilibrium approximation allows us to probe these quantities at finite temperature. We find striking qualitative differences from the infinite temperature case, which has been the topic of previous studies using Haar-random states. In particular, we find regimes where the logarithmic negativity is extensive but the mutual information is sub-extensive, indicating a large amount of undistillable, bound entanglement in thermalized states. For evaporating black holes at finite temperature, both the logarithmic negativity and the Petz map fidelity reveal an important new time scale t b , which is earlier than the Page time t p by a finite fraction of the total evaporation time. We find that t b , as opposed to t p , is the time scale at which quantum entanglement between different parts of the radiation becomes extensive, and the fidelity of information recovery for a large diary thrown into the black hole starts to grow.

2D Gravity↗
DOE OSTI2026

Living on the edge: a non-perturbative resolution to the negativity of bulk entropies

Lin, Maldacena, Rozenberg, and Shan (LMRS) presented a new information paradox in black hole physics by noticing that the entanglement and Rényi entropies in a two-sided black hole can become negative when the geometry contains a very large number of matter excitations behind the black hole horizon. While originally this puzzle was presented in the context of BPS two-sided black holes in two-dimensional supergravity, the negativity in fact persists for more general two-sided black holes in the presence of a large number of matter excitations. Since the entanglement and Rényi entropies in ordinary quantum systems cannot be negative, resolving this puzzle is a necessary step towards understanding the quantum mechanical description of black holes. In this paper, we explain how to address the entanglement negativity puzzle, both in the original setting discussed by LMRS and in more general non-supersymmetric settings, by summing over all non-perturbative contributions to the gravitational path integral. We then interpret this result from the point of view of a dual matrix integral, which we use to extend our analysis beyond the regime of validity of the genus re-summation performed in the gravitational path integral. In this regime, positivity is rescued by new saddles of the matrix integral, a one-eigenvalue instanton and a two-eigenvalue instanton. Finally, we formulate a similar puzzle and its resolution using random tensor network techniques.

2D Gravity↗
DOE OSTI2025

Living on the edge: a non-perturbative resolution to the negativity of bulk entropies

Lin, Maldacena, Rozenberg, and Shan (LMRS) presented a new information paradox in black hole physics by noticing that the entanglement and Rényi entropies in a two-sided black hole can become negative when the geometry contains a very large number of matter excitations behind the black hole horizon. While originally this puzzle was presented in the context of BPS two-sided black holes in two-dimensional supergravity, the negativity in fact persists for more general two-sided black holes in the presence of a large number of matter excitations. Since the entanglement and Rényi entropies in ordinary quantum systems cannot be negative, resolving this puzzle is a necessary step towards understanding the quantum mechanical description of black holes. In this paper, we explain how to address the entanglement negativity puzzle, both in the original setting discussed by LMRS and in more general non-supersymmetric settings, by summing over all non-perturbative contributions to the gravitational path integral. We then interpret this result from the point of view of a dual matrix integral, which we use to extend our analysis beyond the regime of validity of the genus re-summation performed in the gravitational path integral. In this regime, positivity is rescued by new saddles of the matrix integral, a one-eigenvalue instanton and a two-eigenvalue instanton. Finally, we formulate a similar puzzle and its resolution using random tensor network techniques.

FOS: Physical sciences↗
DOE OSTI2024

Evidence of ordering in Cu-Ni alloys from experimental electronic entropy measurements

Phase diagrams exhibiting extended solid-solution and lenslike melting are often reproduced using ideal solutions, where ideal mixing considers a fully random configurational entropy of mixing. In the field of irreversible thermodynamics, experimental measurements of the composition variation of high-temperature electronic transport and molten-state properties suggest, however, a strong role for short-range atomic ordering in these systems. Herein, measurements of the thermopower and resistivity are reported for Cu-Ni solid solutions as a function of temperature and composition. The electronic transport properties were interpreted with an irreversible thermodynamic framework, revealing a large electronic contribution to the entropy of mixing. By considering a cluster model for the configurational entropy that uses the electronic contribution to inform the existence of ordered associates, we rationalize such a contribution of the electronic entropy with the ideal entropy of mixing commonly used to model such systems. In conclusion, these results suggest that the short-range order of the atoms plays a significant role in both solid and liquid states, even when there are no dominant intermetallic compounds in these alloys.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Entanglement rearrangement in self-consistent nuclear structure calculations

Background: Entanglement plays a central role in a diverse array of increasingly important research areas, including quantum computation, simulation, measurement, sensing, and communication. Extensive suites of investigations have been performed to better understand entanglement in atomic and molecular quantum many-body systems, while the exploration of entanglement in the structure of nuclei and their reactions is presently in its infancy. Purpose: The goal of this work is to begin investigating the entanglement properties of nuclei from first-principles nuclear many-body calculations. We attempt to identify common features and emergent structures of entanglement that could ultimately lead to new and natural many-body schemes. With an eye toward quantum accelerators in future hybrid-supercomputers, criteria for partitioning nuclear many-body calculations into quantum and classical components may provide advantages in future large-scale computations. Along the way we look for explanations of the relative success of phenomenological models such as the nuclear shell model, and for better ways to match to low-energy nuclear effective field theories and lattice QCD calculations to nuclear many-body techniques that are based upon entanglement. Method: We explore the entanglement between single-particle states in 4 He and 6 He. The patterns of entanglement emerging from different single-particle bases are compared, and possible links with the convergence of observables are explored, in particular, ground-state energies. The nuclear wave functions are obtained by performing active-space no-core configuration-interaction calculations using a two-body nucleon-nucleon interaction derived from chiral effective field theory. Entanglement measures within single-particle bases exhibiting different degrees of complexity are determined, in particular, harmonic oscillator (HO), Hartree-Fock (HF), natural (NAT) and variational natural (VNAT) bases. Specifically, single-orbital entanglement entropy, two-orbital mutual information, and negativity are studied. Results: The entanglement structures in 4 He and 6 He are found to be more localized within NAT and VNAT bases than within a HO basis for the optimal HO parameters we have worked with. In particular a core-valence structure clearly emerges from the full no-core calculation of 6 He. Here, the two-nucleon mutual information shows that the VNAT basis, which typically exhibits good convergence properties, effectively decouples the active and inactive spaces. Conclusions: Measures of one- and two-nucleon entanglement are found to be useful in analyzing the structure of nuclear wave functions, in particular the efficacy of basis states, and may provide useful metrics toward developing more efficient schemes for ab initio computations of the structure and reactions of nuclei, and quantum many-body systems more generally.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1996

Conditional Entropy-Constrained Residual VQ with Application to Image Coding

This paper introduces an extension of entropy-constrained residual vector quantization (VQ) where intervector dependencies are exploited. The method, which we call conditional entropy-constrained residual VQ, employs a high-order entropy conditioning strategy that captures local information in the neighboring vectors. When applied to coding images, the proposed method is shown to achieve better rate-distortion performance than that of entropy-constrained residual vector quantization with less computational complexity and lower memory requirements. Moreover, it can be designed to support progressive transmission in a natural way. It is also shown to outperform some of the best predictive and finite-state VQ techniques reported in the literature. This is due partly to the joint optimization between the residual vector quantizer and a high-order conditional entropy coder as well as the efficiency of the multistage residual VQ structure and the dynamic nature of the prediction.

Kossentini, Faouzi↗
DOE OSTI2023

On quantum information before the Page time

While recent progress in the black hole information problem has shown that the entropy of Hawking radiation follows a unitary Page curve, the quantum state of Hawking radiation prior the Page time is still treated as purely thermal, containing no information about the microstructure of the black hole. We demonstrate that there is significant quantum information regarding the quantum state of the black hole in the Hawking radiation prior to the Page time. By computing of the quantum fidelity in a 2D boundary conformal field theory (BCFT) model of black hole evaporation, we demonstrate that an observer outside of an evaporating black hole may distinguish different black holes via measurements of the Hawking radiation at any time during the evaporation process, albeit with an exponentially large number of measurements. Furthermore, our results are universal, applicable to general BCFTs including those with large central charge and rational BCFTs. The techniques we develop for computing the fidelity are more generally applicable to excited states in CFT. As such, we are able to characterize more general aspects of thermalization in 2D conformal field theory.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Thermodynamics of quantum measurement and Maxwell's demon's arrow of time

Here, we discuss the thermodynamic aspects of a single qubit based device, powered by weak quantum measurements, and feedback controlled by a quantum Maxwell's demon. We discuss both discrete and time-continuous operation of the measurement based device at finite temperature of the reservoir. In the discrete example where a demon acquires information via discrete weak measurements, we find that the thermodynamic variables including the heat exchanged, extractable work, and the entropy produced are completely determined by an information theoretic measure of the demon's perceived arrow of time. We also discuss a realistic time-continuous operation of the device where the feedback is applied after a sequence of weak measurements. In the time-continuous limit, we derive the exact finite-time statistics of work, heat and entropy changes along individual quantum trajectories of the quantum measurement process, and relate them to the demon's arrow of time.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Inferring Quantum Network Topology Using Local Measurements

Statistical correlations that can be generated across the nodes in a quantum network depend crucially on its topology. However, this topological information might not be known a priori, or it may need to be verified. In this paper, we propose an efficient protocol for distinguishing and inferring the topology of a quantum network. We leverage entropic quantities-namely, the von Neumann entropy and the measured mutual information-as well as measurement covariance to uniquely characterize the topology. We show that the entropic quantities are sufficient to distinguish two networks that prepare GHZ states. Moreover, if qubit measurements are available, both entropic quantities and covariance can be used to infer the network topology without state-preparation assumptions. We show that the protocol can be entirely robust to noise and can be implemented via quantum variational optimization. Numerical experiments on both classical simulators and quantum hardware show that covariance is generally more reliable for accurately and efficiently inferring the topology, whereas entropy-based methods are often better at identifying the absence of entanglement in the low-shot regime.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS1982

Pressure transfer function of a JT15D nozzle due to acoustic and convected entropy fluctuations

An acoustic transmission matrix analysis of sound propagation in a variable area duct with and without flow is extended to include convected entropy fluctuations. The boundary conditions used in the analysis are a transfer function relating entropy and pressure at the nozzle inlet and the nozzle exit impedance. The nozzle pressure transfer function calculated is compared with JT15D turbofan engine nozzle data. The one dimensional theory for sound propagation in a variable area nozzle with flow but without convected entropy is good at the low engine speeds where the nozzle exit Mach number is low (M=0.2) and the duct exit impedance model is good. The effect of convected entropy appears to be so negligible that it is obscured by the inaccuracy of the nozzle exit impedance model, the lack of information on the magnitude of the convected entropy and its phase relationship with the pressure, and the scatter in the data. An improved duct exit impedance model is required at the higher engine speeds where the nozzle exit Mach number is high (M=0.56) and at low frequencies (below 120 Hz).

Miles, J. H.↗
DOE OSTI2022

Entanglement between two gravitating universes

Abstract We study two disjoint universes in an entangled pure state. When only one universe contains gravity, the path integral for the n th Rényi entropy includes a wormhole between the n copies of the gravitating universe, leading to a standard ‘island formula’ for entanglement entropy consistent with unitarity of quantum information. When both universes contain gravity, gravitational corrections to this configuration lead to a violation of unitarity. However, the path integral is now dominated by a novel wormhole with 2 n boundaries connecting replica copies of both universes. The analytic continuation of this contribution involves a quotient by Z n replica symmetry, giving a cylinder connecting the two universes. When entanglement is large, this configuration has an effective description as a ‘swap wormhole’, a geometry in which the boundaries of the two universes are glued together by a ‘swaperator’. This description allows precise computation of a generalized entropy-like formula for entanglement entropy. The quantum extremal surface computing the entropy lives on the Lorentzian continuation of the cylinder/swap wormhole, which has a connected Cauchy slice stretching between the universes—a realization of the ER = EPR idea. The new wormhole restores unitarity of quantum information.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Tunneling between Multiple Histories as a Solution to the Information Loss Paradox

The information loss paradox associated with black hole Hawking evaporation is an unresolved problem in modern theoretical physics. In a recent brief essay, we revisited the evolution of the black hole entanglement entropy via the Euclidean path integral (EPI) of the quantum state and allow for the branching of semi-classical histories along the Lorentzian evolution. We posited that there exist at least two histories that contribute to EPI, where one is an information-losing history, while the other is an information-preserving one. At early times, the former dominates EPI, while at the late times, the latter becomes dominant. By doing so, we recovered the essence of the Page curve, and thus, the unitarity, albeit with the turning point, i.e., the Page time, much shifted toward the late time. In this full-length paper, we fill in the details of our arguments and calculations to strengthen our notion. One implication of this modified Page curve is that the entropy bound may thus be violated. We comment on the similarity and difference between our approach and that of the replica wormholes and the islands’ conjectures.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Bipartite mutual information in classical many-body dynamics

Information theoretic measures have helped to sharpen our understanding of many-body quantum states. As perhaps the most well-known example, the entanglement entropy (or more generally, the bipartite mutual information) has become a powerful tool for characterizing the dynamical growth of quantum correlations. By contrast, although computable, the bipartite mutual information (MI) is almost never explored in classical many particle systems; this owes in part to the fact that computing the MI requires keeping track of the evolution of the full probability distribution, a feat which is rarely done (or thought to be needed) in classical many-body simulations. Here, we utilize the MI to analyze the spreading of information in 1D elementary cellular automata (CA). Broadly speaking, we find that the behavior of the MI in these dynamical systems exhibits a few different types of scaling that roughly correspond to known CA universality classes. Of particular note is that we observe a set of automata for which the MI converges parametrically slowly to its thermodynamic value. We develop a microscopic understanding of this behavior by analyzing a two-species model of annihilating particles moving in opposite directions. Furthermore, our work suggests the possibility that information theoretic tools such as the MI might enable a more fine-grained characterization of classical many-body states and dynamics.

Cellular automata↗
DOE OSTI2024

Geometric quantum states beyond the AdS/CFT correspondence

We characterize the quantum states dual to entanglement wedges in arbitrary spacetimes, in settings where the matter entropy can be neglected compared to the geometric entropy. In AdS/CFT, such states obey special entropy inequalities known as the holographic entropy cone. In particular, the mutual information of CFT subregions is monogamous (MMI). We extend this result to arbitrary spacetimes, using a recent proposal for the generalized entanglement wedge e ( a ) of a gravitating region a . Given independent input regions a , b , and c , we prove MMI: Area [ e ( a ) ] + Area [ e ( b ) ] + Area [ e ( c ) ] − Area [ e ( a b ) ] − Area [ e ( b c ) ] − Area [ e ( c a ) ] + Area [ e ( a b c ) ] ≤ 0 . We expect that the full holographic entropy cone can be extended to arbitrary spacetimes using similar methods. Published by the American Physical Society 2024

Astronomy & Astrophysics↗