Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Information entropy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS1982

Entropy, instrument scan and pilot workload

Correlation and information theory which analyze the relationships between mental loading and visual scanpath of aircraft pilots are described. The relationship between skill, performance, mental workload, and visual scanning behavior are investigated. The experimental method required pilots to maintain a general aviation flight simulator on a straight and level, constant sensitivity, Instrument Landing System (ILS) course with a low level of turbulence. An additional periodic verbal task whose difficulty increased with frequency was used to increment the subject's mental workload. The subject's looppoint on the instrument panel during each ten minute run was computed via a TV oculometer and stored. Several pilots ranging in skill from novices to test pilots took part in the experiment. Analysis of the periodicity of the subject's instrument scan was accomplished by means of correlation techniques. For skilled pilots, the autocorrelation of instrument/dwell times sequences showed the same periodicity as the verbal task. The ability to multiplex simultaneous tasks increases with skill. Thus autocorrelation provides a way of evaluating the operator's skill level.

Tole, J. R.↗
NASA NTRS1985

Information theoretic comparisons of original and transformed data from Landsat MSS and TM

The dispersion and concentration of signal values in transformed data from the Landsat-4 MSS and TM instruments are analyzed using a communications theory approach. The definition of entropy of Shannon was used to quantify information, and the concept of mutual information was employed to develop a measure of information contained in several subsets of variables. Several comparisons of information content are made on the basis of the information content measure, including: system design capacities; data volume occupied by agricultural data; and the information content of original bands and Tasseled Cap variables. A method for analyzing noise effects in MSS and TM data is proposed.

Malila, W. A.↗
NASA NTRS1993

Information efficiency in visual communication

This paper evaluates the quantization process in the context of the end-to-end performance of the visual-communication channel. Results show that the trade-off between data transmission and visual quality revolves around the information in the acquired signal, not around its energy. Improved information efficiency is gained by frequency dependent quantization that maintains the information capacity of the channel and reduces the entropy of the encoded signal. Restorations with energy bit-allocation lose both in sharpness and clarity relative to restorations with information bit-allocation. Thus, quantization with information bit-allocation is preferred for high information efficiency and visual quality in optimized visual communication.

Alter-Gartenberg, Rachel↗
NASA NTRS2005

Revealing Relationships among Relevant Climate Variables with Information Theory

The primary objective of the NASA Earth-Sun Exploration Technology Office is to understand the observed Earth climate variability, thus enabling the determination and prediction of the climate's response to both natural and human-induced forcing. We are currently developing a suite of computational tools that will allow researchers to calculate, from data, a variety of information-theoretic quantities such as mutual information, which can be used to identify relationships among climate variables, and transfer entropy, which indicates the possibility of causal interactions. Our tools estimate these quantities along with their associated error bars, the latter of which is critical for describing the degree of uncertainty in the estimates. This work is based upon optimal binning techniques that we have developed for piecewise-constant, histogram-style models of the underlying density functions. Two useful side benefits have already been discovered. The first allows a researcher to determine whether there exist sufficient data to estimate the underlying probability density. The second permits one to determine an acceptable degree of round-off when compressing data for efficient transfer and storage. We also demonstrate how mutual information and transfer entropy can be applied so as to allow researchers not only to identify relations among climate variables, but also to characterize and quantify their possible causal interactions.

Knuth, Kevin H.↗
DOE OSTI2026

Investigation of Causal Relationships of the Cross‐Scale Wave Coupling Through Information Theoretical Approach

On 2015 October 2, MMS spacecraft observed an electron micro-injection event near the southern hemispheric high-altitude cusp, coinciding with intense wave activity across several frequency bands. Here, we investigated the MMS magnetic field and plasma during this event to explore cross-scale coupling among the wave modes. Employing the Hilbert-Huang transform, we perform an empirical mode decomposition to extract frequencies and amplitudes of the intrinsic mode functions (IMFs). In this analysis, we establish both linear and nonlinear relationships and examine the information transfer between the IMFs. Notably, the transfer entropy suggests that high frequency ion cyclotron waves may be driven by the mirror mode structures. Our case study effectively demonstrates the utility of the information theory based tools for studying cross-scale wave coupling phenomena.

Rivera, Elmer C. [Andrews University, Berrien Spri↗
DOE OSTI2024

Structural modeling of high-entropy oxides battery anodes using x-ray absorption spectroscopy

High-entropy oxides (HEOs) are single phase solid solutions where five or more metals share the same sublattice, giving rise to unexpected features in various fields of applications. Recently, HEOs have emerged as an alternative conversion electrode anode material for next-generation Li-ion batteries, where the combination of several different elements in a single solid solution can synergistically act to overcome some of its main drawbacks, improving performance. Due to their chemical complexity, x-ray absorption spectroscopy (XAS) emerges as an appropriate technique to study the electronic (x-ray absorption near edge structure, XANES) and local structure (extended x-ray absorption fine structure, EXAFS) of these compounds as a function of cycling. This work aims to highlight the capabilities of XAS as an element-specific probe to understand a material’s structure at the atomistic level through EXAFS modeling of (MgFeCoNiCuZn)O high-entropy system and how to extract valuable information about the bond distance, number of near neighbors, and local disorder, which are crucial to a full understanding of the electrochemical reaction mechanisms of such battery electrodes.

25 ENERGY STORAGE↗
DOE OSTI2025

High-dimensional maximum-entropy phase space tomography

Reconstructing 4D or 6D phase space distributions from 1D or 2D measurements is a challenging inverse problem encountered in particle accelerators. Entropy maximization is an established method to incorporate prior information in the reconstruction, but it is typically infeasible in high-dimensional spaces. In this paper, I review two recent approaches to high-dimensional entropy maximization. The first approach utilizes differentiable simulations and a class of generative models known as normalizing flows, whereas the second approach employs the method of Lagrange multipliers and Markov Chain Monte Carlo (MCMC) sampling. My aim is to provide a short explanation of each method using a common notation. I conclude by mentioning several unsolved problems in phase space tomography.

Hoover, Austin [ORNL] (ORCID:0000000153136962)↗
NASA NTRS1981

Information theory lateral density distribution for Earth inferred from global gravity field

Information Theory Inference, better known as the Maximum Entropy Method, was used to infer the lateral density distribution inside the Earth. The approach assumed that the Earth consists of indistinguishable Maxwell-Boltzmann particles populating infinitesimal volume elements, and followed the standard methods of statistical mechanics (maximizing the entropy function). The GEM 10B spherical harmonic gravity field coefficients, complete to degree and order 36, were used as constraints on the lateral density distribution. The spherically symmetric part of the density distribution was assumed to be known. The lateral density variation was assumed to be small compared to the spherically symmetric part. The resulting information theory density distribution for the cases of no crust removed, 30 km of compensated crust removed, and 30 km of uncompensated crust removed all gave broad density anomalies extending deep into the mantle, but with the density contrasts being the greatest towards the surface (typically + or 0.004 g cm 3 in the first two cases and + or - 0.04 g cm 3 in the third). None of the density distributions resemble classical organized convection cells. The information theory approach may have use in choosing Standard Earth Models, but, the inclusion of seismic data into the approach appears difficult.

Rubincam, D. P.↗
DOE OSTI2024

Transient anisotropic kernel for probabilistic learning on manifolds

PLoM (Probabilistic Learning on Manifolds) is a method introduced in 2016 for handling small training datasets by projecting an Itô equation from a stochastic dissipative Hamiltonian dynamical system, acting as the MCMC generator, for which the KDE-estimated probability measure with the training dataset is the invariant measure. PLoM performs a projection on a reduced-order vector basis related to the training dataset, using the diffusion maps (DMAPS) basis constructed with a time-independent isotropic kernel. In this paper, we propose a new ISDE projection vector basis built from a transient anisotropic kernel, providing an alternative to the DMAPS basis to improve statistical surrogates for stochastic manifolds with heterogeneous data. The construction ensures that for times near the initial time, the DMAPS basis coincides with the transient basis. For larger times, the differences between the two bases are characterized by the angle of their spanned vector subspaces. The optimal instant yielding the optimal transient basis is determined using an estimation of mutual information from Information Theory, which is normalized by the entropy estimation to account for the effects of the number of realizations used in the estimations. Consequently, this new vector basis better represents statistical dependencies in the learned probability measure for any dimension. Three applications with varying levels of statistical complexity and data heterogeneity validate the proposed theory, showing that the transient anisotropic kernel improves the learned probability measure.

Diffusion maps↗
DOE OSTI2026

Exploring the holographic entropy cone via reinforcement learning

We develop a reinforcement learning algorithm to study the holographic entropy cone. Given a target entropy vector, our algorithm searches for a graph realization whose min-cut entropies match the target vector. If the target vector does not admit such a graph realization, it must lie outside the cone, in which case the algorithm finds a graph whose corresponding entropy vector most nearly approximates the target and allows us to probe the location of the facets. For the N = 3 cone, we confirm that our algorithm successfully rediscovers monogamy of mutual information beginning with a target vector outside the holographic entropy cone. We then apply the algorithm to the N = 6 cone, analyzing the 6 mystery extreme rays of the subadditivity cone from [1] that satisfy all known holographic entropy inequalities yet lacked graph realizations. We found realizations for 3 of them, proving they are genuine extreme rays of the holographic entropy cone, while providing evidence that the remaining 3 are not realizable, implying unknown holographic inequalities exist for N = 6.

AdS-CFT correspondence↗
NASA NTRS1993

Redundancy reduction in image coding

We assess redundancy reduction in image coding in terms of the information acquired by the image-gathering process and the amount of data required to convey this information. A clear distinction is made between the theoretically minimum rate of data transmission, as measured by the entropy of the completely decorrelated data, and the actual rate of data transmission, as measured by the entropy of the encoded (incompletely decorrelated) data. It is shown that the information efficiency of the visual communication channel depends not only on the characteristics of the radiance field and the decorrelation algorithm, as is generally perceived, but also on the design of the image-gathering device, as is commonly ignored.

Rahman, Zia-Ur↗
NASA NTRS2002

Information Theoretic Approaches to Rapid Discovery of Relationships in Large Climate Data Sets

Mutual information as the asymptotic Bayesian measure of independence is an excellent starting point for investigating the existence of possible relationships among climate-relevant variables in large data sets, As mutual information is a nonlinear function of of its arguments, it is not beholden to the assumption of a linear relationship between the variables in question and can reveal features missed in linear correlation analyses. However, as mutual information is symmetric in its arguments, it only has the ability to reveal the probability that two variables are related. it provides no information as to how they are related; specifically, causal interactions or a relation based on a common cause cannot be detected. For this reason we also investigate the utility of a related quantity called the transfer entropy. The transfer entropy can be written as a difference between mutual informations and has the capability to reveal whether and how the variables are causally related. The application of these information theoretic measures is rested on some familiar examples using data from the International Satellite Cloud Climatology Project (ISCCP) to identify relation between global cloud cover and other variables, including equatorial pacific sea surface temperature (SST), over seasonal and El Nino Southern Oscillation (ENSO) cycles.

Knuth, Kevin H.↗
DOE OSTI2026

Operando Depth-Resolved Measurement of Solvation Entropy, Interfacial Transport, and Charge-Transfer Kinetics in Lithium-Ion Batteries

Understanding and improving the performance and longevity of lithium-ion batteries critically depends on insight into the dynamic processes occurring at buried electrode-electrolyte interfaces. However, direct, depth-resolved, and operando diagnosis of these interfaces remains a longstanding challenge due to their inaccessibility beneath bulk materials, the limitations of conventional surface- and bulk-sensitive characterization tools, and the difficulty of maintaining realistic cell environments during measurement. These challenges have made it nearly impossible to uniquely resolve important interfacial properties such as charge transfer resistance, SEI (solid electrolyte interphase) resistance, and solvation entropy at the individual electrode interfaces within a working cell, information that is essential for mechanistic insight and accelerated battery design. Here, in this study, we report the development of multiharmonic electro-thermal spectroscopy (METS), an operando technique that enables depth-resolved measurement of solvation entropy, interfacial transport resistance, charge-transfer resistance, and SEI resistance at individual electrode-electrolyte interfaces within practical lithium-ion batteries. By leveraging frequency-dependent, thermal-wave sensing and interface-specific modeling, METS uniquely attributes interfacial properties to specific electrodes, as validated by comparison with traditional electrochemical impedance spectroscopy (EIS). The ability to spatially and temporally resolve interfacial processes in real time provides new diagnostic capabilities that are crucial for mechanistic studies of battery degradation and for the rapid development of next-generation energy storage systems.

Chalise, Divya [University of California, Berkeley↗
DOE OSTI2024

Universal rapidity scaling of entanglement entropy inside hadrons from conformal invariance

When a hadron is probed at high energy, a nontrivial quantum entanglement entropy inside the hadron emerges due to the lack of complete information about the hadron wave function extracted from this measurement. In the high-energy limit, the hadron becomes a maximally entangled state, with a linear dependence of entanglement entropy on rapidity, as has been found in a recent analysis based on parton description. In this paper, we use an effective conformal field theoretic description of hadrons on the light cone to show that the linear dependence of the entanglement entropy on rapidity found in parton description is a general consequence of approximate conformal invariance and does not depend on the assumption of weak coupling. Our result also provides further evidence for a duality between the parton and string descriptions of hadrons. Published by the American Physical Society 2024

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Security Analysis of a Class of Spread Spectrum Systems Presentation

A method of adding physical layer security to a class of spread spectrum systems has been recently proposed. In this paper, we look into the rate at which an eavesdropper may gain information about the system to decipher the data symbols. The Shannon mutual information is used to measure the rate of information that may be gained by an eavesdropper. The k-nearest neighbors (k-NN) method is used to obtain estimates of relevant entropy values, which will then be used to quantify the rate of information recovery as more data is transmitted. It turns out that such information recovery requires the adoption of special methods that avoid any destructive bias in the estimates. Details of these methods are also presented.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Security Analysis of a Class of Secured Spread Spectrum Systems

Abstract—A method of adding physical layer security to a class of spread spectrum systems has been recently proposed. In this paper, we look into the rate at which an eavesdropper may gain information about the system to decipher the data symbols. The Shannon mutual information is used to measure the rate of information that may be gained by an eavesdropper. The k-nearest neighbors (k-NN) method is used to obtain the estimates of relevant entropy values which will be then used to quantify the rate of information recovery as more data are being transmitted. It turns out that such information recovery requires adoption of special methods that avoid any destructive bias in the estimates. Details of these methods are also presented.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Data Science Shows that Entropy Correlates with Accelerated Zeolite Crystallization in Monte Carlo Simulations

We have performed a data science study of Monte Carlo simulation trajectories to understand factors that can accelerate formation of zeolite nanoporous crystals, a process that can take days or even weeks. In previous work, Monte Carlo simulations predicted and experiments confirmed that using a secondary organic structure-directing agent (OSDA) accelerates crystallization of all-silica LTA zeolite, with experiments finding a three-fold speedup [PCCP 24, 142-148 (2022)]. However, it remains unclear what physical factors cause the speed-up. Here, we apply data science to analyze the simulation trajectories to discover what drives accelerated zeolite crystallization in Monte Carlo going from a one-OSDA synthesis (1OSDA) to a two-OSDA version (2OSDA). We encoded simulation snapshots using the Smooth Overlap of Atomic Positions approach, which represents all 2- and 3-body correlations within a given cutoff distance. Principal component analyses failed to discriminate datasets of structures from 1OSDA and 2OSDA simulations, while the Support Vector Machine (SVM) approach succeeded at classifying such structures with an area-under-curve (AUC) score of 0.99 (where AUC = 1 is a perfect classification) with all 3-body correlations, and as high as 0.94 with only 2-body correlations. SVM decision functions reveal relatively broad / narrow histograms for 1OSDA / 2OSDA datasets, suggesting that the two simulations differ strongly in information heterogeneity. Informed by these results, we performed pair (2-body) entropy calculations during crystallization, resulting in entropy differences that semi-quantitatively account for the speedup observed in the previous Monte Carlo simulations. We conclude that altering synthesis conditions in ways that substantially changes the entropy of labile silica networks may accelerate zeolite crystallization, and we discuss possible approaches for achieving such acceleration.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2025

Nonperturbative quantum gravity in a closed Lorentzian universe

We study how meaningful physical predictions can arise in nonperturbative quantum gravity in a closed Lorentzian universe. In such settings, recent developments suggest that the quantum gravitational Hilbert space is one-dimensional and real for each α-sector, as induced by spacetime wormholes. This appears to obstruct the conventional quantum-mechanical prescription of assigning probabilities via projection onto a basis of states. While previous approaches have introduced external observers or augmented the theory to resolve this issue, we argue that quantum gravity itself contains all the necessary ingredients to make physical predictions. We demonstrate that the emergence of classical observables and probabilistic outcomes can be understood as a consequence of partial observability: physical observers access only a subsystem of the universe. Tracing out the inaccessible degrees of freedom yields reduced density matrices that encode classical information, with uncertainties exponentially suppressed by the environment’s entropy. We develop this perspective using both the Lorentzian path integral and operator formalisms and support it with a simple microscopic model. Our results show that quantum gravity in a closed universe naturally gives rise to meaningful, robust predictions without recourse to external constructs.

AdS-CFT Correspondence↗