Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “information entropy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS1972

Kullback-Leibler information function and the sequential selection of experiments to discriminate among several linear models

A sequential adaptive experimental design procedure for a related problem is studied. It is assumed that a finite set of potential linear models relating certain controlled variables to an observed variable is postulated, and that exactly one of these models is correct. The problem is to sequentially design most informative experiments so that the correct model equation can be determined with as little experimentation as possible. Discussion includes: structure of the linear models; prerequisite distribution theory; entropy functions and the Kullback-Leibler information function; the sequential decision procedure; and computer simulation results. An example of application is given.

Sidik, S. M.↗
DOE OSTI2021

The entropy of Hawking radiation

In this review, we describe recent progress on the black hole information problem that involves a new understanding of how to calculate the entropy of Hawking radiation. We show how the method for computing gravitational fine-grained entropy, developed over the past 15 years, can be extended to capture the entropy of Hawking radiation. Furthermore, this technique reveals large corrections needed for the entropy to be consistent with unitary black hole evaporation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1982

Entropy, instrument scan and pilot workload

Correlation and information theory which analyze the relationships between mental loading and visual scanpath of aircraft pilots are described. The relationship between skill, performance, mental workload, and visual scanning behavior are investigated. The experimental method required pilots to maintain a general aviation flight simulator on a straight and level, constant sensitivity, Instrument Landing System (ILS) course with a low level of turbulence. An additional periodic verbal task whose difficulty increased with frequency was used to increment the subject's mental workload. The subject's looppoint on the instrument panel during each ten minute run was computed via a TV oculometer and stored. Several pilots ranging in skill from novices to test pilots took part in the experiment. Analysis of the periodicity of the subject's instrument scan was accomplished by means of correlation techniques. For skilled pilots, the autocorrelation of instrument/dwell times sequences showed the same periodicity as the verbal task. The ability to multiplex simultaneous tasks increases with skill. Thus autocorrelation provides a way of evaluating the operator's skill level.

Tole, J. R.↗
NASA NTRS1985

Information theoretic comparisons of original and transformed data from Landsat MSS and TM

The dispersion and concentration of signal values in transformed data from the Landsat-4 MSS and TM instruments are analyzed using a communications theory approach. The definition of entropy of Shannon was used to quantify information, and the concept of mutual information was employed to develop a measure of information contained in several subsets of variables. Several comparisons of information content are made on the basis of the information content measure, including: system design capacities; data volume occupied by agricultural data; and the information content of original bands and Tasseled Cap variables. A method for analyzing noise effects in MSS and TM data is proposed.

Malila, W. A.↗
NASA NTRS1993

Information efficiency in visual communication

This paper evaluates the quantization process in the context of the end-to-end performance of the visual-communication channel. Results show that the trade-off between data transmission and visual quality revolves around the information in the acquired signal, not around its energy. Improved information efficiency is gained by frequency dependent quantization that maintains the information capacity of the channel and reduces the entropy of the encoded signal. Restorations with energy bit-allocation lose both in sharpness and clarity relative to restorations with information bit-allocation. Thus, quantization with information bit-allocation is preferred for high information efficiency and visual quality in optimized visual communication.

Alter-Gartenberg, Rachel↗
DOE OSTI2024

Entropy removal of medical diagnostics

Shannon entropy is a core concept in machine learning and information theory, particularly in decision tree modeling. To date, no studies have extensively and quantitatively applied Shannon entropy in a systematic way to quantify the entropy of clinical situations using diagnostic variables (true and false positives and negatives, respectively). Decision tree representations of medical decision-making tools can be generated using diagnostic variables found in literature and entropy removal can be calculated for these tools. This concept of clinical entropy removal has significant potential for further use to bring forth healthcare innovation, such as quantifying the impact of clinical guidelines and value of care and applications to Emergency Medicine scenarios where diagnostic accuracy in a limited time window is paramount. This analysis was done for 623 diagnostic tools and provided unique insights into their utility. For studies that provided detailed data on medical decision-making algorithms, bootstrapped datasets were generated from source data to perform comprehensive machine learning analysis on these algorithms and their constituent steps, which revealed a novel and thorough evaluation of medical diagnostic algorithms.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2005

Revealing Relationships among Relevant Climate Variables with Information Theory

The primary objective of the NASA Earth-Sun Exploration Technology Office is to understand the observed Earth climate variability, thus enabling the determination and prediction of the climate's response to both natural and human-induced forcing. We are currently developing a suite of computational tools that will allow researchers to calculate, from data, a variety of information-theoretic quantities such as mutual information, which can be used to identify relationships among climate variables, and transfer entropy, which indicates the possibility of causal interactions. Our tools estimate these quantities along with their associated error bars, the latter of which is critical for describing the degree of uncertainty in the estimates. This work is based upon optimal binning techniques that we have developed for piecewise-constant, histogram-style models of the underlying density functions. Two useful side benefits have already been discovered. The first allows a researcher to determine whether there exist sufficient data to estimate the underlying probability density. The second permits one to determine an acceptable degree of round-off when compressing data for efficient transfer and storage. We also demonstrate how mutual information and transfer entropy can be applied so as to allow researchers not only to identify relations among climate variables, but also to characterize and quantify their possible causal interactions.

Knuth, Kevin H.↗
DOE OSTI2020

The vecro hypothesis

We consider three fundamental issues in quantum gravity: (a) the black hole information paradox (b) the unboundedness of entropy that can be stored inside a black hole horizon (c) the relation between the black hole horizon and the cosmological horizon. With help from the small corrections theorem, we convert each of these issues into a sharp conflict. We then argue that all three conflicts can be resolved by the following hypothesis: the vacuum wave functional of quantum gravity contains a “vecro” component made of virtual fluctuations of configurations of the same type that arise in the fuzzball structure of black hole microstates. Further, if we assume that causality holds to leading order in gently curved spacetime, then we must have such a vecro component in order to resolve the above conflicts. The term vecro stands for “Virtual Extended Compression-Resistant Object”, and characterizes the nature of the vacuum fluctuations that resolve the puzzles. It is interesting that puzzle (c) may relate the role of quantum gravity in black holes to observations in the sky.

Astronomy & Astrophysics↗
DOE OSTI2020

Asynchronous Ballistic Reversible Computing using Superconducting elements

Computing uses energy. At the bare minimum, erasing information in a computer increases the entropy. Landauer has calculated %7E k B T log(2) Joules is dissipated per bit of energy erased. While the success of Moores law has allowed increasing computing power and efficiency for many years, these improvements are coming to an end. This project asks if there is a way to continue those gains by circumventing Landauer through reversible computing. We explore a new reversible computing paradigm, asynchronous ballistic reversible computing or ABRC. The ballistic nature of data in ABRC matches well with superconductivity which provides a low-loss environment and a quantized bit encoding the fluxon. We discuss both these and our development of a superconducting fabrication process at Sandia. We describe a fully reversible 1-bit memory cell based on fluxon dynamics. Building on this model, we propose several other gates which may also offer reversible operation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Investigation of Causal Relationships of the Cross‐Scale Wave Coupling Through Information Theoretical Approach

On 2015 October 2, MMS spacecraft observed an electron micro-injection event near the southern hemispheric high-altitude cusp, coinciding with intense wave activity across several frequency bands. Here, we investigated the MMS magnetic field and plasma during this event to explore cross-scale coupling among the wave modes. Employing the Hilbert-Huang transform, we perform an empirical mode decomposition to extract frequencies and amplitudes of the intrinsic mode functions (IMFs). In this analysis, we establish both linear and nonlinear relationships and examine the information transfer between the IMFs. Notably, the transfer entropy suggests that high frequency ion cyclotron waves may be driven by the mirror mode structures. Our case study effectively demonstrates the utility of the information theory based tools for studying cross-scale wave coupling phenomena.

Rivera, Elmer C. [Andrews University, Berrien Spri↗
DOE OSTI2024

Structural modeling of high-entropy oxides battery anodes using x-ray absorption spectroscopy

High-entropy oxides (HEOs) are single phase solid solutions where five or more metals share the same sublattice, giving rise to unexpected features in various fields of applications. Recently, HEOs have emerged as an alternative conversion electrode anode material for next-generation Li-ion batteries, where the combination of several different elements in a single solid solution can synergistically act to overcome some of its main drawbacks, improving performance. Due to their chemical complexity, x-ray absorption spectroscopy (XAS) emerges as an appropriate technique to study the electronic (x-ray absorption near edge structure, XANES) and local structure (extended x-ray absorption fine structure, EXAFS) of these compounds as a function of cycling. This work aims to highlight the capabilities of XAS as an element-specific probe to understand a material’s structure at the atomistic level through EXAFS modeling of (MgFeCoNiCuZn)O high-entropy system and how to extract valuable information about the bond distance, number of near neighbors, and local disorder, which are crucial to a full understanding of the electrochemical reaction mechanisms of such battery electrodes.

25 ENERGY STORAGE↗
DOE OSTI2020

World Congress on High Entropy Alloys (HEA 2019) (Final Technical Report)

The World Congress on High Entropy Alloys (HEA 2019) was a new, cross-disciplinary technical forum designed to share the latest research advances in materials with high configurational entropy, including both single-phase and multiphase (compositionally complex) alloys. This inaugural World Congress on High Entropy Alloys (HEA 2019) was held in Seattle, Washington from November 17-20, 2019 with the goal of HEA 2019 to assemble the international community of HEA stakeholders – including researchers, educators, and engineers – to capture the current state-of-the-art, identify current gaps in HEA efforts, and to set the stage for the future growth and application of HEAs worldwide. HEA 2019 was the environment for leaders in this field to showcase their researc, and network with their peers to informally discuss the latest developments in high entropy alloys, while also making valuable professional connections. The goal of the organizers was to ensure a high-quality conference that held a strong international presence and aimed to highlight the important advances in HEA research on a global scale. Student participation was greatly encouraged in order to give students exposure to recent advances in this field. This meeting was open to all interested individuals and attempted to provide the most advanced technical meeting possible, with a mixture of attendees from research and development, industry, and education.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Quantized Information in Spectral Cyberspace

The constant-Q Gabor atom is developed for spectral power, information, and uncertainty quantification from time–frequency representations. Stable multiresolution spectral entropy algorithms are constructed with continuous wavelet and Stockwell transforms. The recommended processing and scaling method will depend on the signature of interest, the desired information, and the acceptable levels of uncertainty of signal and noise features. Selected Lamb wave signatures and information spectra from the 2022 Tonga eruption are presented as representative case studies. Resilient transformations from physical to information metrics are provided for sensor-agnostic signal processing, pattern recognition, and machine learning applications.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2025

High-dimensional maximum-entropy phase space tomography

Reconstructing 4D or 6D phase space distributions from 1D or 2D measurements is a challenging inverse problem encountered in particle accelerators. Entropy maximization is an established method to incorporate prior information in the reconstruction, but it is typically infeasible in high-dimensional spaces. In this paper, I review two recent approaches to high-dimensional entropy maximization. The first approach utilizes differentiable simulations and a class of generative models known as normalizing flows, whereas the second approach employs the method of Lagrange multipliers and Markov Chain Monte Carlo (MCMC) sampling. My aim is to provide a short explanation of each method using a common notation. I conclude by mentioning several unsolved problems in phase space tomography.

Hoover, Austin [ORNL] (ORCID:0000000153136962)↗
NASA NTRS1981

Information theory lateral density distribution for Earth inferred from global gravity field

Information Theory Inference, better known as the Maximum Entropy Method, was used to infer the lateral density distribution inside the Earth. The approach assumed that the Earth consists of indistinguishable Maxwell-Boltzmann particles populating infinitesimal volume elements, and followed the standard methods of statistical mechanics (maximizing the entropy function). The GEM 10B spherical harmonic gravity field coefficients, complete to degree and order 36, were used as constraints on the lateral density distribution. The spherically symmetric part of the density distribution was assumed to be known. The lateral density variation was assumed to be small compared to the spherically symmetric part. The resulting information theory density distribution for the cases of no crust removed, 30 km of compensated crust removed, and 30 km of uncompensated crust removed all gave broad density anomalies extending deep into the mantle, but with the density contrasts being the greatest towards the surface (typically + or 0.004 g cm 3 in the first two cases and + or - 0.04 g cm 3 in the third). None of the density distributions resemble classical organized convection cells. The information theory approach may have use in choosing Standard Earth Models, but, the inclusion of seismic data into the approach appears difficult.

Rubincam, D. P.↗
DOE OSTI2023

On the relation between the subadditivity cone and the quantum entropy cone

Given a multipartite quantum system, what are the possible ways to impose mutual independence among some subsystems, and the presence of correlations among others, such that there exists a quantum state which satisfies these demands? This question and the related notion of a pattern of marginal independence (PMI) were introduced in [1], and then argued in [2] to be central in the derivation of the holographic entropy cone. Here we continue the general information theoretic analysis of the PMIs allowed by strong subadditivity (SSA) initiated in [1]. We show how the computation of these PMIs simplifies when SSA is replaced by a weaker constraint, dubbed Klein’s condition (KC), which follows from the necessary condition for the saturation of subadditivity (SA). Formulating KC in the language of partially ordered sets, we show that the set of PMIs compatible with KC forms a lattice, and we investigate several of its structural properties. One of our main results is the identification of a specific lower dimensional face of the SA cone that contains on its boundary all the extreme rays (beyond Bell pairs) that can possibly be realized by quantum states. We verify that for four or more parties, KC is strictly weaker than SSA, but nonetheless the PMIs compatible with SSA can easily be derived from the KC-compatible ones. For the special case of 1-dimensional PMIs, we conjecture that KC and SSA are in fact equivalent. To make the presentation self-contained, we review the key ingredients from lattice theory as needed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Transient anisotropic kernel for probabilistic learning on manifolds

PLoM (Probabilistic Learning on Manifolds) is a method introduced in 2016 for handling small training datasets by projecting an Itô equation from a stochastic dissipative Hamiltonian dynamical system, acting as the MCMC generator, for which the KDE-estimated probability measure with the training dataset is the invariant measure. PLoM performs a projection on a reduced-order vector basis related to the training dataset, using the diffusion maps (DMAPS) basis constructed with a time-independent isotropic kernel. In this paper, we propose a new ISDE projection vector basis built from a transient anisotropic kernel, providing an alternative to the DMAPS basis to improve statistical surrogates for stochastic manifolds with heterogeneous data. The construction ensures that for times near the initial time, the DMAPS basis coincides with the transient basis. For larger times, the differences between the two bases are characterized by the angle of their spanned vector subspaces. The optimal instant yielding the optimal transient basis is determined using an estimation of mutual information from Information Theory, which is normalized by the entropy estimation to account for the effects of the number of realizations used in the estimations. Consequently, this new vector basis better represents statistical dependencies in the learned probability measure for any dimension. Three applications with varying levels of statistical complexity and data heterogeneity validate the proposed theory, showing that the transient anisotropic kernel improves the learned probability measure.

Diffusion maps↗