Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “information entropy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Toward the design of ultrahigh-entropy alloys via mining six million texts

Abstract It has long been a norm that researchers extract knowledge from literature to design materials. However, the avalanche of publications makes the norm challenging to follow. Text mining (TM) is efficient in extracting information from corpora. Still, it cannot discover materials not present in the corpora, hindering its broader applications in exploring novel materials, such as high-entropy alloys (HEAs). Here we introduce a concept of “context similarity" for selecting chemical elements for HEAs, based on TM models that analyze the abstracts of 6.4 million papers. The method captures the similarity of chemical elements in the context used by scientists. It overcomes the limitations of TM and identifies the Cantor and Senkov HEAs. We demonstrate its screening capability for six- and seven-component lightweight HEAs by finding nearly 500 promising alloys out of 2.6 million candidates. The method thus brings an approach to the development of ultrahigh-entropy alloys and multicomponent materials.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Slow thermalization and subdiffusion in $U$(1) conserving Floquet random circuits

Random quantum circuits are paradigmatic models of minimally structured and analytically tractable chaotic dynamics. We study a family of Floquet unitary circuits with Haar random U(1) charge conserving dynamics; the minimal such model has nearest-neighbor gates acting on spin-1/2 qubits, and a single layer of even/odd gates repeated periodically in time. We find that this minimal model is not robustly thermalizing at numerically accessible system sizes, and displays slow subdiffusive dynamics for long times. We map out the thermalization dynamics in a broader parameter space of charge conserving circuits, and understand the origin of the slow dynamics in terms of proximate localized and integrable regimes in parameter space. In contrast, we find that small extensions to the minimal model are sufficient to achieve robust thermalization; these include (i) increasing the interaction range to three-site gates, (ii) increasing the local Hilbert space dimension by appending an additional unconstrained qubit to the conserved charge on each site, or (iii) using a larger Floquet period comprised of two independent layers of gates. Furthermore, our results should inform future studies of charge conserving circuits, which are relevant for a wide range of topical theoretical questions.

1-dimensional spin chains↗
DOE OSTI2020

Local quenches, bulk entanglement entropy and a unitary Page curve

Quantum corrections to the entanglement entropy of matter fields interacting with dynamical gravity have proven to be very important in the study of the black hole information problem. We consider a one-particle excited state of a massive scalar field infalling in a pure AdS 3 geometry and compute these corrections for bulk subregions anchored on the AdS boundary. In the dual CFT 2 , the state is given by the insertion of a local primary operator and its evolution thereafter. We calculate the area and bulk entanglement entropy corrections at order $$ \mathcal{O}\left({N}^0\right), $$ O N 0 , both in AdS and its CFT dual. The two calculations match, thus providing a non-trivial check of the FLM formula in a dynamical setting. Further, we observe that the bulk entanglement entropy follows a Page curve. We explain the precise sense in which our setup can be interpreted as a simple model of black hole evaporation and comment on the implications for the information problem.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Horocycle regulator: Exact cutoff-independence in AdS/CFT

While the entanglement entropy of a single subregion in quantum field theory is formally infinite and requires regularization, certain combinations of entropies are perfectly finite in the limit that the regulator is removed, the mutual information being a common example. For generic regulator schemes, such as a holographic calculation with a uniform radial cutoff, these quantities show nontrivial dependence on the regulator at finite values of the cutoff. We investigate a holographic regularization scheme defined in three-dimensional anti-de Sitter space constructed from , curves in two-dimensional hyperbolic space perpendicular to all geodesics approaching a single point on the boundary, that leads to finite information measures that are cutoff independent, even at finite values of the regulator. We describe a broad class of such information measures, and describe how the field theory dual to the horocycle regulator is inherently nonlocal. Published by the American Physical Society 2024

Agrawal, Sristy↗
DOE OSTI2024

The expressivity of classical and quantum neural networks on entanglement entropy

Abstract Analytically continuing the von Neumann entropy from Rényi entropies is a challenging task in quantum field theory. While then-th Rényi entropy can be computed using the replica method in the path integral representation of quantum field theory, the analytic continuation can only be achieved for some simple systems on a case-by-case basis. In this work, we propose a general framework to tackle this problem using classical and quantum neural networks with supervised learning. We begin by studying several examples with known von Neumann entropy, where the input data is generated by representing$${\text {Tr}}\rho _A^n$$ Tr ρ A n with a generating function. We adopt KerasTuner to determine the optimal network architecture and hyperparameters with limited data. In addition, we frame a similar problem in terms of quantum machine learning models, where the expressivity of the quantum models for the entanglement entropy as a partial Fourier series is established. Our proposed methods can accurately predict the von Neumann and Rényi entropies numerically, highlighting the potential of deep learning techniques for solving problems in quantum information theory.

Physics↗
NASA NTRS1992

Discrete-time entropy formulation of optimal and adaptive control problems

The discrete-time version of the entropy formulation of optimal control of problems developed by G. N. Saridis (1988) is discussed. Given a dynamical system, the uncertainty in the selection of the control is characterized by the probability distribution (density) function which maximizes the total entropy. The equivalence between the optimal control problem and the optimal entropy problem is established, and the total entropy is decomposed into a term associated with the certainty equivalent control law, the entropy of estimation, and the so-called equivocation of the active transmission of information from the controller to the estimator. This provides a useful framework for studying the certainty equivalent and adaptive control laws.

Tsai, Yweting A.↗
DOE OSTI2021

Mutual information superadditivity and unitarity bounds

We derive the property of strong superadditivity of mutual information arising from the Markov property of the vacuum state in a conformal field theory and strong subadditivity of entanglement entropy. We show this inequality encodes unitarity bounds for different types of fields. These unitarity bounds are precisely the ones that saturate for free fields. This has a natural explanation in terms of the possibility of localizing algebras on null surfaces. A particular continuity property of mutual information characterizes free fields from the entropic point of view. We derive a general formula for the leading long distance term of the mutual information for regions of arbitrary shape which involves the modular flow of these regions. We obtain the general form of this leading term for two spheres with arbitrary orientations in spacetime, and for primary fields of any tensor representation. For free fields we further obtain the explicit form of the leading term for arbitrary regions with boundaries on null cones.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

The dual of non-extremal area: differential entropy in higher dimensions

The Ryu-Takayanagi formula relates entanglement entropy in a field theory to the area of extremal surfaces anchored to the boundary of a dual AdS space. It is interesting to ask if there is also an information theoretic interpretation of the areas of non-extremal surfaces that are not necessarily boundary-anchored. In general, the physics outside such surfaces is associated to observers restricted to a time-strip in the dual boundary field theory. When the latter is two-dimensional, it is known that the differential entropy associated to the strip computes the length of the dual bulk curve, and has an interpretation in terms of the information cost in Bell pairs of restoring correlations inaccessible to observers in the strip. A general realization of this formalism in higher dimensions is unknown. We first prove a no-go theorem eliminating candidate expressions for higher dimensional differential entropy based on entropic c-theorems. Then we propose a new formula in terms of an integral of shape derivatives of the entanglement entropy of ball shaped regions. Our proposal stems from the physical requirement that differential entropy must be locally finite and conformally invariant. Demanding cancelation of the well-known UV divergences of entanglement entropy in field theory guides us to our conjecture, which we test for surfaces in AdS 4 . Our results suggest a candidate c-function for field theories in arbitrary dimensions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS2001

Determining Biosignatures by Complexity Analysis in Antarctic Cryptoendolithic Communities

One of the most difficult problems of life detection is that of identifying biosignatures across a wide range of scales using multiple co-registered probes. The technique should be of equal utility across a wide range of search spaces from remote sensors probing volumes of space or planetary surfaces, visual eye or camera searches across the surface of a rock in Antarctica, low resolution microscopic scanning of a rock or a space craft in situ, or high resolution electron microscope and computerized tomography scanning of geobiological samples. We describe here an approach to this problem which derives in large part from past work done in the area of astrophysics - namely the analysis of complexity in galactic signals by data compression methods. This approach is a radically new one for geobiology and astrobiology, and allows us to assess the complexity (and thus potential biogenicity) of an object being examined. This is done by considering the information within pixels of an image (regardless the sensor used to gather the information) as an energetic system capable of description in terms of classical thermodynamics. The image data space is searched by an algorithm that judges complexity via data compression (e.g., the more compressible it is, the less complex, and vice versa) and maximum entropy as originally outlined by Shannon. At present we are implementing methods to utilize images from multiple sensors gathering different kinds of information (e.g., visible gray-scale data, color analyses, UV fluorescence, chemical information, etc). We present here preliminary data from deep UV fluorescence and ESEM (Environmental Scanning Electron Microscope) images from a layered cryptoendolithic community of an Antarctic rock.

Storrie-Lombardi, M. C.↗
NASA NTRS1984

A geometric approach to high resolution TVD schemes

A geometric approach, similar to Van Leer's MUSCL schemes, is used to construct a second-order accurate generalization of Godunov's method for solving scalar conservation laws. By making suitable approximations, a scheme is obtained which is easy to implement and total variation diminishing. The entropy condition is also investigated from the standpoint of the spreading of rarefaction waves. Quantitative information is obtained for Godunov's method on the rate of spreading which explain the kinks in rarefaction waves often observed at the sonic point.

Goodman, J. B.↗
DOE OSTI2021

Materials Fingerprinting Classification

Significant progress in many classes of materials could be made with the availability of experimentally-derived large datasets composed of atomic identities and three-dimensional coordinates. Methods for visualizing the local atomic structure, such as atom probe tomography (APT), which routinely generate datasets comprised of millions of atoms, are an important step in realizing this goal. However, state-of-the-art APT instruments generate noisy and sparse datasets that provide information about elemental type, but obscure atomic structures, thus limiting their subsequent value for materials discovery. The application of a materials fingerprinting process, a machine learning algorithm coupled with topological data analysis, provides an avenue by which here-to-fore unprecedented structural information can be extracted from an APT dataset. As a proof of concept, the material fingerprint is applied to high-entropy alloy APT datasets containing body-centered cubic (BCC) and face-centered cubic (FCC) crystal structures. A local atomic configuration centered on an arbitrary atom is assigned a topological descriptor, with which it can be characterized as a BCC or FCC lattice with near perfect accuracy, despite the inherent noise in the dataset. Finally, this successful identification of a fingerprint is a crucial first step in the development of algorithms which can extract more nuanced information, such as chemical ordering, from existing datasets of complex materials.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Entanglement Cost for Infinite-Dimensional Physical Systems

We prove that the entanglement cost equals the regularized entanglement of formation for any infinite-dimensional quantum state ρ ΑΒ with finite quantum entropy on at least one of the subsystems A or B. This generalizes a foundational result in quantum information theory that was previously formulated only for operations and states on finite-dimensional systems. The extension to infinite-dimensional systems is nontrivial because the conventional tools for establishing both the direct and converse bounds, i.e., strong typicality, monotonicity, and asymptotic continuity, are no longer directly applicable. To address this problem, we construct a new entanglement dilution protocol for infinite-dimensional states implementable by local operations and a finite amount of one-way classical communication (one-way LOCC), using weak and strong typicality multiple times. We also prove the optimality of this protocol among all protocols, even under infinite-dimensional separable operations, by developing an argument based on alternative forms of monotonicity and asymptotic continuity of the entanglement of formation for infinite-dimensional states. Along the way, we derive a new integral representation for the quantum entropy of infinite-dimensional states, which we believe to be of independent interest. Our results allow us to fully characterize an important operational entanglement measure—the entanglement cost—for all infinite-dimensional physical systems.

Complexity↗
NASA NTRS1995

Statistical and linguistic features of DNA sequences

We present evidence supporting the idea that the DNA sequence in genes containing noncoding regions is correlated, and that the correlation is remarkably long range--indeed, base pairs thousands of base pairs distant are correlated. We do not find such a long-range correlation in the coding regions of the gene. We resolve the problem of the "non-stationary" feature of the sequence of base pairs by applying a new algorithm called Detrended Fluctuation Analysis (DFA). We address the claim of Voss that there is no difference in the statistical properties of coding and noncoding regions of DNA by systematically applying the DFA algorithm, as well as standard FFT analysis, to all eukaryotic DNA sequences (33 301 coding and 29 453 noncoding) in the entire GenBank database. We describe a simple model to account for the presence of long-range power-law correlations which is based upon a generalization of the classic Levy walk. Finally, we describe briefly some recent work showing that the noncoding sequences have certain statistical features in common with natural languages. Specifically, we adapt to DNA the Zipf approach to analyzing linguistic texts, and the Shannon approach to quantifying the "redundancy" of a linguistic text in terms of a measurable entropy function. We suggest that noncoding regions in plants and invertebrates may display a smaller entropy and larger redundancy than coding regions, further supporting the possibility that noncoding regions of DNA may carry biological information.

Non-NASA Center↗
DOE OSTI2022

First principles prediction of the Al-Li phase diagram including configurational and vibrational entropic contributions

The whole Al-Li phase diagram is predicted from first principles calculations and statistical mechanics including the effect of configurational and vibrational entropy. The formation enthalpy of different configurations at different temperatures was accurately predicted by means of cluster expansions that were fitted from first principles calculations. The vibrational entropic contribution of each configuration was determined from the bond length vs. bond stiffness relationships for each type of bond and the Gibbs free energy of the different phases was obtained as a function of temperature from Monte Carlo simulations. The predicted phase diagram was in excellent agreement with the currently accepted experimental one in terms of the stable (AlLi, Al 2 Li 3 , AlLi 2 , Al 4 Li 9 ) and metastable (Al 3 Li) phases, of the phase boundaries between them and of the maximum stability temperature of line compounds. In addition, it provided accurate information about the gap between Al 3 Li and AlLi solvus lines. Finally, the influence of the vibrational entropy on the correct prediction of the phase diagram is discussed. Overall, the methodology shows that accurate phase diagrams of alloys of technological interest can be predicted from first principles calculations.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Quantifying unitary flow efficiency and entanglement for many-body localization

Holography tells us that there should be a mapping between a boundary Hamiltonian and bulk degrees of freedom. We probe the bulk geometry of the Wegner Wilson Flow (WWF) in the context of many-body localization by addressing efficiency and bulk entanglement growth measures through approximating upper bounds on the boundary entanglement entropy. Here, we connect these upper bounds to the Fubini-Study metric and clarify how a central quantity, the information fluctuation complexity, distinguishes bulk unitary rotation from entanglement production. We also give a short new proof of the small incremental entangling theorem in the absence of ancillas, achieving a dimension independent, universal factor of c = 2.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

The Python’s Lunch: geometric obstructions to decoding Hawking radiation

According to Harlow and Hayden [ arXiv:1301.4504 ] the task of distilling information out of Hawking radiation appears to be computationally hard despite the fact that the quantum state of the black hole and its radiation is relatively un-complex. We trace this computational difficulty to a geometric obstruction in the Einstein-Rosen bridge connecting the black hole and its radiation. Inspired by tensor network models, we conjecture a precise formula relating the computational hardness of distilling information to geometric properties of the wormhole — specifically to the exponential of the difference in generalized entropies between the two non-minimal quantum extremal surfaces that constitute the obstruction. Due to its shape, we call this obstruction the ‘Python’s Lunch’, in analogy to the reptile’s postprandial bulge.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS1982

A Study of Feature Extraction Using Divergence Analysis of Texture Features

An empirical study of texture analysis for feature extraction and classification of high spatial resolution remotely sensed imagery (10 meters) is presented in terms of specific land cover types. The principal method examined is the use of spatial gray tone dependence (SGTD). The SGTD method reduces the gray levels within a moving window into a two-dimensional spatial gray tone dependence matrix which can be interpreted as a probability matrix of gray tone pairs. Haralick et al (1973) used a number of information theory measures to extract texture features from these matrices, including angular second moment (inertia), correlation, entropy, homogeneity, and energy. The derivation of the SGTD matrix is a function of: (1) the number of gray tones in an image; (2) the angle along which the frequency of SGTD is calculated; (3) the size of the moving window; and (4) the distance between gray tone pairs. The first three parameters were varied and tested on a 10 meter resolution panchromatic image of Maryville, Tennessee using the five SGTD measures. A transformed divergence measure was used to determine the statistical separability between four land cover categories forest, new residential, old residential, and industrial for each variation in texture parameters.

Hallada, W. A.↗