SEARCH · Engineering Papers

Results for “information entropy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

All sources NASA NTRS DOE OSTI

NASA NTRS1972

Computer program for calculating supersonic flow about circular, elliptic, and bielliptic cones by the method of lines

A user's manual for a computer program which calculates the supersonic flow about circular, elliptic, and bielliptic cones at incidence and elliptic cones at yaw by the method of lines is presented. The program is automated to compute a case from known or easily calculated solution by changing the parameters through a sequence of steps. It provides information including the shock shape, flow field, isentropic surface properties, entropy layer, and force coefficients. A description of the program operation, sample computations, and a FORTRAN 4 listing are presented.

Klunker, E. B.↗

NASA NTRS2017

Information Theoretic Evaluation of Satellite Soil Moisture Retrievals

Microwave radiometry has a long legacy of providing estimates of remotely sensed near surfacesoil moisture measurements over continental and global scales. A consistent assessment of theerrors and uncertainties associated with these retrievals is important for their effective utilization in modeling, data assimilation and end-use application environments. This article presents an evaluationof soil moisture retrieval products from AMSR-E, ASCAT, SMOS, AMSR2 and SMAPinstruments using information theory-based metrics. These metrics rely on time series analysis ofsoil moisture retrievals for estimating the measurement error, level of randomness (entropy) andregularity (complexity) of the data. The results of the study indicate that the measurement errors inthe remote sensing retrievals are significantly larger than that of the ground soil moisture measurements.The SMAP retrievals, on the other hand, were found to have reduced errors (comparable to Preprint submitted to Remote Sensing of Environment October 1, 2017those of in-situ datasets), particularly over areas with moderate vegetation. The SMAP retrievals also demonstrate high information content relative to other retrieval products, with higher levelsof complexity and reduced entropy. Finally, a joint evaluation of the entropy and complexity ofremotely sensed soil moisture products indicates that the information content of the AMSR-E, ASCAT,SMOS and AMSR2 retrievals is low, whereas SMAP retrievals show better performance. The use of information theoretic assessments is effective in quantifying the required levels of improvements needed in the remote sensing soil moisture retrievals to enhance their utility and information content.

Information theory↗

DOE OSTI2023

Entropy-driven Optimal Sub-sampling of Fluid Dynamics for Developing Machine-learned Surrogates

Optimal sub-sampling of large datasets from fluid dynamics simulations is essential for training reduced-order machine learned models. A method using Shannon entropy was developed to weight flow features according to their level of information content, such that the most informative features can be extracted and used for training a surrogate model. The method is demonstrated in the canonical flow over a cylinder problem simulated with OpenFOAM. Both time-independent predictions and temporal forecasting were investigated as well as two types of prediction targets: local per-grid-point predictions and global per-time-step predictions. When tested on training a surrogate model, results indicate that our entropy-based sampling method typically outperforms random sampling and yields more reproducible results in less iterations. Finally, the method was used to train a surrogate model for modeling turbulence in magnetohydrodynamic flows, which revealed various challenges and opportunities for future research.

Brewer, Wes↗

DOE OSTI2024

Maximum Entropy Theory of Multiscale Coarse-Graining via Matching Thermodynamic Forces: Application to a Molecular Crystal (TATB)

The MSCG/FM (multiscale coarse-graining via force-matching) approach is an efficient supervised machine learning method to develop microscopically informed coarse-grained (CG) models. Here we present a theory based on the principle of maximum entropy (PME) enveloping the existing MSCG/FM approaches. This theory views the MSCG/FM method as a special case of matching the thermodynamic forces from the extended ensemble described by the set of thermodynamic (relevant) system coordinates. This set may include CG coordinates, the stress tensor, applied external fields, and so forth, and may be characterized by nonequilibrium conditions. Following the presentation of the theory, we discuss the consistent matching of both bonded and nonbonded interactions. The proposed PME formulation is used as a starting point to extend the MSCG/FM method to the constant strain ensemble, which together with the explicit matching of the bonded forces is better suited for coarse-graining anisotropic media at a submolecular resolution. The theory is demonstrated by performing the fine coarse-graining of crystalline 1,3,5-triamino-2,4,6-trinitrobenzene (TATB), a well-known insensitive molecular energetic material, which exhibits highly anisotropic mechanical properties.

1,3,5-triamino-2,4,6-trinitrobenzene↗

DOE OSTI2026

ZENN: A thermodynamics-inspired computational framework for heterogeneous data–driven modeling

Traditional entropy-based methods—such as cross-entropy loss in classification problems—have long been essential tools for representing the information uncertainty and physical disorder in data and for developing artificial intelligence algorithms. However, the rapid growth of data across various domains has introduced new challenges, particularly the integration of heterogeneous datasets with intrinsic disparities. To address this, we introduce a zentropy-enhanced neural network (ZENN), extending zentropy theory into the data science domain via intrinsic entropy, enabling more effective learning from heterogeneous data sources. ZENN simultaneously learns both energy and intrinsic entropy components, capturing the underlying structure of multisource data. To support this, we redesign the neural network architecture to better reflect the intrinsic properties and variability inherent in diverse datasets. We demonstrate the effectiveness of ZENN on classification tasks and energy landscape reconstructions, showing its superior generalization capabilities and robustness-particularly in predicting high-order derivatives. In image and text classification tasks, ZENN demonstrates superior generalization by introducing a learnable temperature variable that models latent multisource heterogeneity, allowing it to surpass state-of-the-art models on CIFAR-10/100, BBC News, and AG News. As a practical application in materials science, we employ ZENN to reconstruct the Helmholtz energy landscape of Fe3Pt using data generated from density functional theory and capture key material behaviors, including negative thermal expansion and the critical point in the temperature–pressure space. Overall, this work presents a zentropy-grounded framework for data-driven machine learning, positioning ZENN as a versatile and robust approach for scientific problems involving complex, heterogeneous datasets.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Energetically consistent model reduction for metriplectic systems

The metriplectic formalism is useful for describing complete dynamical systems which conserve energy and produce entropy. This creates challenges for model reduction, as the elimination of high-frequency information will generally not preserve the metriplectic structure which governs long-term stability of the system. Based on proper orthogonal decomposition, a provably convergent metriplectic reduced-order model is formulated which is guaranteed to maintain the algebraic structure necessary for energy conservation and entropy formation. Further, numerical results on benchmark problems show that the proposed method is remarkably stable, leading to improved accuracy over long time scales at a moderate increase in cost over naive methods.

42 ENGINEERING↗

DOE OSTI2024

Holographic entropy inequalities and multipartite entanglement

Abstract We study holographic entropy inequalities and their structural properties by making use of a judicious grouping of terms into certain multipartite information quantities. This allows us to recast cumbersome entropic expressions into much simpler ones which share interestingly rigid structures. By performing a systematic search over some of these structures, we are able to discover more than 1800 novel entropy inequalities for six parties, thereby demonstrating that these recastings provide a fruitful generating technique for uncovering new holographic entropy inequalities. In attempting to interpret the corresponding sign-definite quantities as correlation measures, we also obtain a no-go result: the superbalance property of holographic entropy inequalities turns out to preclude them from being monotonic under partial tracing. In the process, we also comment on the geometrical significance of multipartite information quantities and present various structural relations amongst them.

Physics↗

DOE OSTI2021

Modified Schwarzschild metric from a unitary accelerating mirror analog

We present a modified Schwarzschild solution for a model of evaporation of a black hole with information preservation. By drawing a direct analogy to the quantum pure accelerating mirror (dynamical Casimir effect of a 1D horizon), we derive a Schwarzschild metric with not only the usual Schwarzschild radius but an additional length scale related to the Planck length. The black hole has thermal particle production that leads to complete evaporation of the black hole, resulting in non-divergent entanglement entropy, Page curve turn-over, and an asymptotic quantum pure state with no information loss.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Applying Quantum Tomography to Hadronic Interactions

A proper description of inclusive reactions is expressed with density matrices. Quantum tomography reconstructs density matrices from experimental observables. We review recent work that applies quantum tomography to practical experimental data analysis. Almost all field-theoretic formalism and modeling used in a traditional approach is circumvented with great efficiency. Tomographically-determined density matrices can express information about quantum systems which cannot in principle be expressed with distributions defined by classical probability. Topics such as entanglement and von Neumann entropy can be accessed using the same natural language where they are defined. A deep relation exists between separability, as defined in quantum information science, and factorization, as defined in high energy physics. Factorization acquires a non-perturbative definition when expressed in terms of a conditional form of separability. An example illustrates how to go from data for momentum 4-vectors to a density matrix while bypassing almost all the formalism of the Standard Model.

Martens, J. C.↗

DOE OSTI2023

Exact solution of the topological symplectic Kondo problem

The Kondo effect is an archetypical phenomenon in the physics of strongly correlated electron systems. Recent attention has focused on the application of Kondo physics to quantum information science by exploiting overscreened Kondo impurities with residual anyon-like impurity entropy. While this physics was proposed in the fine-tuned multi-channel Kondo setup or in the Majorana-based topological Kondo effect, we here study the Kondo effect with symplectic symmetry Sp(2k) and present details about the implementation which importantly only involves conventional s-wave superconductivity coupled to an array of resonant levels and neither requires perfect channel symmetry nor Majorana fermions. Here we carefully discuss the role of perturbations and show that a global Zeeman drives the system to a 2-channel SU(k) fixed point. Exact results for the residual entropy, specific heat and magnetization are derived using the thermodynamic Bethe Ansatz for Sp(2k). This solution not only proves the existence of a quantum critical ground state with anyon-like Hilbert space dimension, but also a particularly weak non-Fermi liquid behavior at criticality. We interpret the weakness of non-analyticities as a manifestation of suppressed density of states at the impurity causing only a very weak connection of putative anyons and conduction electrons. Given this weak connection, the simplicity of the design and the stability of the effect, we conjecture that the symplectic Kondo effect may be particularly suitable for quantum information applications.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2021

Information transfer with a gravitating bath

Late-time dominance of entanglement islands plays a critical role in addressing the information paradox for black holes in AdS coupled to an asymptotic non-gravitational bath. A natural question is how this observation can be extended to gravitational systems. To gain insight into this question, we explore how this story is modified within the context of Karch-Randall braneworlds when we allow the asymptotic bath to couple to dynamical gravity. We find that because of the inability to separate degrees of freedom by spatial location when defining the radiation region, the entanglement entropy of radiation emitted into the bath is a time-independent constant, consistent with recent work on black hole information in asymptotically flat space. If we instead consider an entanglement entropy between two sectors of a specific division of the Hilbert space, we then find non-trivial time-dependence, with the Page time a monotonically decreasing function of the brane angle---provided both branes are below a particular angle. However, the properties of the entropy depend discontinuously on this angle, which is the first example of such discontinuous behavior for an AdS brane in AdS space.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS2007

Understanding Local Structure Globally in Earth Science Remote Sensing Data Sets

Empirical probability distributions derived from the data are the signatures of physical processes generating the data. Distributions defined on different space-time windows can be compared and differences or changes can be attributed to physical processes. This presentation discusses on ways to reduce remote sensing data in a way that preserves information, focusing on the rate-distortion theory and using the entropy-constrained vector quantization algorithm.

massive data sets↗

DOE OSTI2020

Effective entropy of quantum fields coupled with gravity

Entanglement entropy, or von Neumann entropy, quantifies the amount of uncertainty of a quantum state. For quantum fields in curved space, entanglement entropy of the quantum field theory degrees of freedom is well-defined for a fixed background geometry. In this paper, we propose a generalization of the quantum field theory entanglement entropy by including dynamical gravity. The generalized quantity named effective entropy, and its Renyi entropy generalizations, are defined by analytic continuation of a replica calculation. The replicated theory is defined as a gravitational path integral with multiple copies of the original boundary conditions, with a co-dimension-2 brane at the boundary of region we are studying. We discuss different approaches to define the region in a gauge invariant way, and show that the effective entropy satisfies the quantum extremal surface formula. When the quantum fields carry a significant amount of entanglement, the quantum extremal surface can have a topology transition, after which an entanglement island region appears. Our result generalizes the Hubeny-Rangamani-Takayanagi formula of holographic entropy (with quantum corrections) to general geometries without asymptotic AdS boundary, and provides a more solid framework for addressing problems such as the Page curve of evaporating black holes in asymptotic flat spacetime. We apply the formula to two example systems, a closed two-dimensional universe and a four-dimensional maximally extended Schwarzchild black hole. We discuss the analog of the effective entropy in random tensor network models, which provides more concrete understanding of quantum information properties in general dynamical geometries. We show that, in absence of a large boundary like in AdS space case, it is essential to introduce ancilla that couples to the original system, in order for correctly characterizing quantum states and correlation functions in the random tensor network. Using the superdensity operator formalism, we study the system with ancilla and show how quantum information in the entanglement island can be reconstructed in a state-dependent and observer-dependent map. We study the closed universe (without spatial boundary) case and discuss how it is related to open universe.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Knots and entanglement

We extend the entanglement bootstrap program to (3+1)-dimensions. We study knotted excitations of (3+1)-dimensional liquid topological orders and exotic fusion processes of loops. As in previous work in (2+1)-dimensions [Ann. Phys. 418, 168164 (2020), Phys. Rev. B 103, 115150 (2021)], we define a variety of superselection sectors and fusion spaces from two axioms on the ground state entanglement entropy. In particular, we identify fusion spaces associated with knots. We generalize the information convex set to a new class of regions called immersed regions, promoting various theorems to this new context. Examples from solvable models are provided; for instance, a concrete calculation of knot multiplicity shows that the knot complement of a trefoil knot can store quantum information. We define spiral maps that allow us to understand consistency relations for torus knots as well as spiral fusions of fluxes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

NASA NTRS1992

Decision analysis with approximate probabilities

This paper concerns decisions under uncertainty in which the probabilities of the states of nature are only approximately known. Decision problems involving three states of nature are studied. This is due to the fact that some key issues do not arise in two-state problems, while probability spaces with more than three states of nature are essentially impossible to graph. The primary focus is on two levels of probabilistic information. In one level, the three probabilities are separately rounded to the nearest tenth. This can lead to sets of rounded probabilities which add up to 0.9, 1.0, or 1.1. In the other level, probabilities are rounded to the nearest tenth in such a way that the rounded probabilities are forced to sum to 1.0. For comparison, six additional levels of probabilistic information, previously analyzed, were also included in the present analysis. A simulation experiment compared four criteria for decisionmaking using linearly constrained probabilities (Maximin, Midpoint, Standard Laplace, and Extended Laplace) under the eight different levels of information about probability. The Extended Laplace criterion, which uses a second order maximum entropy principle, performed best overall.

Whalen, Thomas↗

NASA NTRS2022

Linear Disturbance Amplification Over Blunted Flat Plates in High-Speed Flows

Modal and nonmodal instability characteristics of cylindrically blunted flat plates with varying leading edge radii are described for Mach 4 and Mach 6 freestream conditions. The selection of leading edge radii and freestream parameters is informed by experimental conditions. The investigation of this 2D problem provides a slow entropy layer swallowing which allows for an isolated development of perturbations seeded upstream within different wall-normal regions of the flow. At both Mach numbers, a decrease in modal instability amplification was seen as the leading edge radius was increased. Nonmodal analysis reveals amplifying perturbations in the boundary layer as well as in the entropy layer. The medium bluntness regime exhibits the strongest amplification of nonmodal disturbances that is nonmonotonic in character. Small amplitude boundary forcing at the plate surface or volumetric forcing at various wall-normal heights was used to account for receptivity effects. While wall forcing effectively induced modal instabilities, only an actuation above the boundary layer captured disturbances that amplify within the entropy layer. The optimal nonmodal theory’s entropy-layer disturbance evolution exhibited outstanding agreement with controlled forcing, including receptivity effects. The evolution of entropy-layer disturbances from the optimal nonmodal theory showed excellent agreement with the results of receptivity to controlled forcing. Therefore, the nonmodal optimal growth analysis may provide a useful as well as efficient technique to identify the complete disturbance spectrum in blunt hypersonic configurations, where both modal and nonmodal disturbances can amplify in the boundary-layer and entropy-layer regions.

Boundary layer transition↗

NASA NTRS2022

Linear Disturbance Amplification Over Blunted Flat Plates in High-Speed Flows

Boundary layer transition↗

NASA NTRS2020

Toward Transition Modeling in a Hypersonic Boundary Layer at Flight Conditions

An accurate physics-based transition prediction method integrated with computational fluid dynamics (CFD) solvers is pursued for hypersonic boundary layer flows over slender hypersonic vehicles at flight conditions. The geometry and flow conditions are selected to match relevant trajectory locations from the ascent phase of the HIFiRE-1 flight experiment, namely, a 7-degree half-angle cone with 2.5 mm nose radius, freestream Mach numbers in the range of 3.8 – 5.5 and freestream unit Reynolds numbers in the range of 3.3 × 10(exp 6) – 21.4 × 10(exp 6) m(exp -1). Earlier research had shown that the onset of transition during the HIFiRE-1 flight experiment correlated with an amplification factor of N ≈ 13.5 for the planar Mack modes. However, to incorporate the N-factor correlations into a CFD code, we investigate surrogate models for disturbance amplification that avoid the direct computation of stability characteristics. A commonly used approach for low-speed flows is based on an a priori database of stability characteristics for locally similar profiles. However, the results presented in this paper demonstrate that the application of this approach to hypersonic boundary layers over blunt spherical nose-tip cones leads to large, unacceptable errors in the predictions of amplification factors, mainly due to its failure in accounting for the effects of the entropy layer on the boundary-layer profiles along the length of the model. We propose and demonstrate an alternate approach that employs the stability computations for a canonical set of blunt cone configurations to train a physics-informed convolutional neural network model that is shown to provide substantially improved transition predictions for hypersonic flow configurations with entropy-layer effects. Furthermore, the excellent performance of the neural network model is also confirmed for cone configurations with nose radius and half-angle values that do not correspond to those used to build the database. Finally, the convolutional neural network model is shown to outperform the linear stability calculations for underresolved basic states.

Pedro Paredes↗