SEARCH · Engineering Papers

Results for “information entropy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

DOE OSTI2025

An entropy-based debiasing approach to quantifying experimental coverage for novel applications of interest in the nuclear community

This manuscript proposes a novel information-theoretic approach to the quantification of experimental relevance, i.e., coverage, to achieve optimal data assimilation results for nuclear engineering applications. Specifically, this work posits the need for a new metric, called coverage (q C ) of an application’s quantity of interest, i.e., eigenvalue or power peaking for an advanced reactor concept, defined herein as the theoretically maximum achievable reduction in the quantity’s uncertainty given measurements from a pool of experiments in a manner that is independent of the data assimilation procedure employed. Currently, reduction in a quantity’s uncertainty is strongly biased by the underlying assumptions of the assimilation procedure to account for the under-determined nature of such problems and the similarity criterion employed to identify relevant experiments. To address this challenge, this work has developed a coverage metric, q C , based on mutual information, which establishes a new conceptual framework for assessing coverage, one that is independent of the model parameters and responses degree of variations in both the experimental and application domains, i.e., linear vs non-linear, and their prior uncertainty distributions, i.e., Gaussian vs. non-Gaussian. The q C is an entropic measure capable of addressing coverage for general nonlinear problems with non-Gaussian uncertainties and inclusive of the measurement uncertainties from multiple experiments. Numerical experiments from manufactured analytical problems as well as a set of benchmarks from the ICSBEP handbook are employed to demonstrate its theoretical and practical performance as compared to the c k -based experiment selection methodology, commonly employed in the neutronic community. The manuscript then employs other well-known adaptations to existing data assimilation methodologies for nonlinear and non-Gaussian problems capable of achieving the coverage posited by q C .

Bayesian data assimilation↗

NASA NTRS1994

Coding For Compression Of Low-Entropy Data

Improved method of encoding digital data provides for efficient lossless compression of partially or even mostly redundant data from low-information-content source. Method of coding implemented in relatively simple, high-speed arithmetic and logic circuits. Also increases coding efficiency beyond that of established Huffman coding method in that average number of bits per code symbol can be less than 1, which is the lower bound for Huffman code.

Yeh, Pen-Shu↗

NASA NTRS1981

Entropy encoding applied to a video DM bit stream

This paper investigates bandwidth compression of delta modulated video signals using a variety of novel techniques. The video signal is encoded at 16 MHz with an adaptive delta modulator (ADM) using the Song video mode algorithm. One method of achieving bandwidth compression is through the detection and reduction of steady state patterns in the DM bit stream. Further reduction is obtained by deleting the horizontal and vertical drive information. Finally, a modified ADM algorithm is introduced to increase the frequency of steady state patterns. When the modified ADM is combined with entropy coding a 30-50% data compression can be realized.

Barba, J.↗

DOE OSTI2025

High-temperature quantum coherence of spinons in a rare-earth spin chain

Conventional wisdom dictates that quantum effects become unimportant at high temperatures. In magnets, when the thermal energy exceeds interactions between atomic magnetic moments, the moments are usually uncorrelated, and classical paramagnetic behavior is observed. This thermal decoherence of quantum spin behaviors is a major hindrance to quantum information applications of spin systems. Remarkably, our neutron scattering experiments on Yb chains in an insulating perovskite crystal defy these conventional expectations. We find a sharply defined spectrum of spinons, fractional quantum excitations of spin-1/2 chains, to persist to temperatures much higher than the scale of the interactions between Yb magnetic moments. The observed sharpness of the spinon continuum’s dispersive upper boundary indicates a spinon mean free path exceeding ≈ 35 inter-atomic spacings at temperatures more than an order of magnitude above the interaction energy scale. We thus discover an important and highly unique quantum behavior, which expands the realm of quantumness to high temperatures where entropy-governed classical behaviors were previously believed to dominate. Our results have profound implications for spin systems in quantum information applications operating at finite temperatures and motivate new developments in quantum metrology.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2020

Spin-momentum entanglement in a Bose–Einstein condensate

Here, entanglement is at the core of quantum information processing and may prove essential for quantum speed-up. Inspired by both theoretical and experimental studies of spin-momentum coupling in systems of ultra-cold atoms, we investigate the entanglement between the spin and momentum degrees of freedom of an optically trapped BEC of 87 Rb atoms. We consider entanglement that arises due to the coupling of these degrees of freedom induced by Raman and radio-frequency fields and examine its dependence on the coupling parameters by evaluating von Neumann entropy as well as concurrence as measures of the entanglement attained. Our calculations reveal that under proper experimental conditions significant spin-momentum entanglement can be obtained, with von Neumann entropy of 80% of the maximum attainable value. Our analysis sheds some light on the prospects of using BECs for quantum information applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Crystal Growth and Phase Formation of High-Entropy Rare-Earth Aluminum Perovskites

In this work, we demonstrate for the first time the crystal growth of high-entropy rare-earth (RE) aluminum perovskites (REAlO 3 ) using the micro-pulling-down method to inform future exploration of functional crystals. To determine how composition affects phase formation, we formulate equiatomic compositions containing five REs from the following list: Lu, Yb, Tm, Er, Y, Ho, Dy, Tb, Gd, Eu, Sm, Nd, Pr, Ce, La. To test whether combinations of REs with similar ionic radii may favor a single phase, compositions containing REs with consecutive or nonconsecutive ionic radius values were formulated. Powder and single-crystal X-ray diffraction indicate that crystals containing only REs with similar ionic radii that form orthorhombic single-RE REAlO 3 are a single phase. Crystals containing REs with dissimilar ionic radii or mixtures of REs that form orthorhombic, rhombohedral, and tetragonal single-RE REAlO 3 are a mixture of phases. The elemental distribution in single-phase crystals analyzed via electron probe microanalysis confirms no evidence of preferential incorporation of any of the constituent REs. The distribution and composition of secondary phases were analyzed via scanning electron microscopy and energy dispersive spectroscopy; secondary phases were seen as a small region in the center of the crystals with branching features closer to the outer surface.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Isopotential Electron Titration of Ammonia Charge Transfer on Metal Catalysts

Electron transfer between adsorbates and surfaces determines the binding strength and reactivity of chemical moieties on materials designed for separations and catalysis. To quantify electron exchange, the extent of charge transfer resulting from ammonia adsorption on a Ru surface was measured by isopotential electron titration (IET) on a Ru catalytic condenser, where isopotential conditions were maintained between Ru and silicon separated by an insulating HfO 2 layer during gas phase ammonia adsorption. Charge transfer upon ammonia adsorption on a Ru catalytic condenser increased from 40 to 1200 nC/cm 2 at 75 and 225 °C, respectively. Charge transfer measurements provided a direct estimate of ammonia adsorption thermodynamics on Ru without knowing surface coverages a priori, revealing an adsorption enthalpy of −53 ± 10 kJ/mol and entropy of −61 ± 26 J/mol·K. Combining experimentally-measured charge transfer with kinetic Monte Carlo simulations informed adsorbate surface coverages determined that 0.058 electrons were transferred to the Ru surface for each molecular ammonia adsorption event (δ NH 3 = 0.058 ± 0.005 e – /NH 3 *), consistent with calculated Bader charges. The ability to measure the extent of charge transfer for adsorbed species provides a fundamental descriptor to understand existing and new chemically functional surfaces, providing a foundational method for the emerging field of thermochemical surface coulometry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Real-time quantum error correction beyond break-even

The ambition of harnessing the quantum for computation is at odds with the fundamental phenomenon of decoherence. The purpose of quantum error correction (QEC) is to counteract the natural tendency of a complex system to decohere. This cooperative process, which requires participation of multiple quantum and classical components, creates a special type of dissipation that removes the entropy caused by the errors faster than the rate at which these errors corrupt the stored quantum information. Previous experimental attempts to engineer such a process faced an excessive generation of errors that overwhelmed the error-correcting capability of the process itself. Whether it is practically possible to utilize QEC for extending quantum coherence thus remains an open question. We answer it by demonstrating a fully stabilized and error-corrected logical qubit whose quantum coherence is significantly longer than that of all the imperfect quantum components involved in the QEC process, beating the best of them with a coherence gain of G=2.27±0.07. Here we achieve this performance by combining innovations in several domains including the fabrication of superconducting quantum circuits and model-free reinforcement learning.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

NASA NTRS2003

Real-Time Optical Monitoring and Simulations of Gas Phase Kinetics in InN Vapor Phase Epitaxy at High Pressure

Understanding the kinetics of nucleation and coalescence of heteroepitaxial thin films is a crucial step in controlling a chemical vapor deposition process, since it defines the perfection of the heteroepitaxial film both in terms of extended defect formation and chemical integrity of the interface. The initial nucleation process also defines the film quality during the later stages of film growth. The growth of emerging new materials heterostructures such as InN or In-rich Ga(x)In(1-x)N require deposition methods operating at higher vapor densities due to the high thermal decomposition pressure in these materials. High nitrogen pressure has been demonstrated to suppress thermal decomposition of InN, but has not been applied yet in chemical vapor deposition or etching experiments. Because of the difficulty with maintaining stochiometry at elevated temperature, current knowledge regarding thermodynamic data for InN, e.g., its melting point, temperature-dependent heat capacity, heat and entropy of formation are known with far less accuracy than for InP, InAs and InSb. Also, no information exists regarding the partial pressures of nitrogen and phosphorus along the liquidus surfaces of mixed-anion alloys of InN, of which the InN(x)P(1-x) system is the most interesting option. A miscibility gap is expected for InN(x)P(1-x) pseudobinary solidus compositions, but its extent is not established at this point by experimental studies under near equilibrium conditions. The extension of chemical vapor deposition to elevated pressure is also necessary for retaining stoichiometric single phase surface composition for materials that are characterized by large thermal decomposition pressures at optimum processing temperatures.

Dietz, Nikolaus↗

NASA NTRS2000

Bayesian Fusion of Color and Texture Segmentations

In many applications one would like to use information from both color and texture features in order to segment an image. We propose a novel technique to combine "soft" segmentations computed for two or more features independently. Our algorithm merges models according to a mean entropy criterion, and allows to choose the appropriate number of classes for the final grouping. This technique also allows to improve the quality of supervised classification based on one feature (e.g. color) by merging information from unsupervised segmentation based on another feature (e.g., texture.)

Manduchi, Roberto↗

DOE OSTI2023

Ultimate: Birdshot (Final Technical Report)

In ULTIMATE Phase 1, BIRDSHOT aimed to discover alloys capable of operating reliably above 1300°C, compatible with coatings. The challenge addressed by BIRDSHOT is how to find suitable alloys in the vast refractory high entropy alloy (RHEA) space efficiently and effectively, under stringent resource constraints? This challenge is unsolvable with traditional alloy R&D approaches; however, using a closed-loop multi-objective, multi-information source Bayesian approach to alloy design, we made significant progress in solving this materials design problem.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Thermodynamic origin of the pressure-induced Invar effect: General criterion and experimental study of Fe 68 ⁢Pd 32

Synchrotron X-ray diffraction measurements were performed on 57 Fe 68 Pd 32 at multiple pressures and two temperatures in a diamond-anvil cell. Between 4 and 11GPa, the thermal expansion was zero or slightly negative. This pressure-induced Invar effect was studied further with 57 Fe nuclear forward scattering and nuclear resonant inelastic X-ray scattering to obtain information on the pressure-induced changes in both the magnetization and the phonon density of states. Magnetic entropy and phonon entropy were obtained from these results, the latter with additional measurements from inelastic neutron scattering to account for the contributions from Pd atoms. The dependencies of these entropies on pressure gave the magnetic and phonon contributions to thermal expansion. These canceled in the region of pressure-induced Invar behavior, even though they individually increased by more than a factor of 2 below the Curie pressure. The behavior of phonons gives evidence for spin-phonon interactions in Fe 68 Pd 32 . A general explanation of the pressure-induced Invar effect is presented, showing that Invar behavior is typically expected at a pressure P* below a magnetic transition at pressure PC. The difference in pressure P C − P* scales with the fractional reduction in magnetic exchange interaction divided by the average Gr¨uneisen parameter.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

Analytic continuation of noisy data using Adams Bashforth residual neural network

We propose a data-driven learning framework for the analytic continuation problem in numerical quantum many-body physics. Designing an accurate and efficient framework for the analytic continuation of imaginary time using computational data is a grand challenge that has hindered meaningful links with experimental data. The standard Maximum Entropy (MaxEnt)-based method is limited by the quality of the computational data and the availability of prior information. Also, the MaxEnt is not able to solve the inversion problem under high level of noise in the data. Here we introduce a novel learning model for the analytic continuation problem using a Adams-Bashforth residual neural network (AB-ResNet). Additionally, the advantage of this deep learning network is that it is model independent and, therefore, does not require prior information concerning the quantity of interest given by the spectral function. More importantly, the ResNet-based model achieves higher accuracy than MaxEnt for data with higher level of noise. Finally, numerical examples show that the developed AB-ResNet is able to recover the spectral function with accuracy comparable to MaxEnt where the noise level is relatively small.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2018

Uncertainty in Heart Rate Complexity Metrics Caused by R-Peak Perturbations

Heart rate complexity (HRC) is a proven metric for gaining insight into human stress and physiological deterioration. To calculate HRC, the detection of the exact instance of when the heart beats, the R-peak, is necessary. Electrocardiogram (ECG) signals can often be corrupted by environmental noise (e.g., from electromagnetic interference, movement artifacts), which can potentially alter the HRC measurement, producing erroneous inputs which feed into decision support models. Current literature has only investigated how HRC is affected by noise when R-peak detection errors occur (false positives and false negatives). However, the numerical methods used to calculate HRC are also sensitive to the specific location of the fiducial point of the R-peak. This raises many questions regarding how this fiducial point is altered by noise, the resulting impact on the measured HRC, and how we can account for noisy HRC measures as inputs into our decision models. This work uses Monte Carlo simulations to systematically add white and pink noise at different permutations of signal-to-noise ratios (SNRs), time segments, sampling rates, and HRC measurements to characterize the influence of noise on the HRC measure by altering the fiducial point of the R-peak. Using the generated information from these simulations provides improved decision processes for system design which address key concerns such as permutation entropy being a more precise, reliable, less biased, and more sensitive measurement for HRC than sample and approximate entropy.

Napoli, Nicholas J.↗

NASA NTRS2019

Predictive Modeling for Differential Diagnosis and Mortality Risk Assessment

The prevalence of electronic health record (EHR) systems has brought prodigious biomedical informatics opportunity. Automated machine learning methods can effectively utilize such data and have become common tools for healthcare predictive modeling. Researches in medical informatics have explored the potential of deep learning and classical models in emergent care scenarios. In particular, predicting differential diagnoses for admissions have proven useful in decreasing unnecessary lab tests and improving inpatient triage decision-making. Moreover, identification of high-risk patients for in-hospital mortality is vitally important to maximize allocation of medical resources.The Medical Information Mart for Intensive Care (MIMIC-III) database, containing de-identified critical care inpatient was used in our study. This data set captures hospital patient laboratory measurements, pharmacologic prescriptions, diagnostic data and procedure event recordings. When considering adult patients and discounting admissions with ICU length of stay less than 24 hours, there were 37,787 unique admissions and 30,414 total patients. We examined the top 25 most prevalent ICD-9 group-level disease specificities in MIMIC-III using a multi-label classification model. In-hospital mortality was modeled as binary classification with 4,155 (13%) adult patients that expired, of which 3,138 (75.5%) were in the ICU setting. The metrics AUC, F1 score, sensitivity and specificity values calculated for each disease label measured prediction performance.The usage of ICD-9 group codes reduced feature dimension from 14,567 to 942 and greatly improved distribution of patient diagnostic categories. Disease temporal patterns were captured by considering the most frequently sampled 6 vital signs and 13 laboratory values. Missing data were imputed at each time-stamp. Time-series raw hourly average values were converted into 5 summary features (mean, standard deviation, number of observations, min & max values). Patient demographic variables such as age, gender, marital status and ethnicity were also factored into the modeling. Choi et al showed that contextual embedding of medical data, diagnostic and procedural codes alone can predict future diagnoses with sensitivity as high as 0.79. We utilized an embedding technique called word2vec which allowed sparse representations of medical history to be transformed into dense word vectors. The mappings captured contextual information by treating each admission as a sentence and learning the most likely neighboring words in a sliding window fashion. Binary and multi-label classification was achieved via collapse models, which do not consider temporal information, as well as recurrent neural networks with regularization, Softmax output layer activation together with categorical cross-entropy as the loss function.

US Army collaboration↗

DOE OSTI2020

Superbalance of holographic entropy inequalities

The domain of allowed von Neumann entropies of a holographic field theory carves out a polyhedral cone — the holographic entropy cone — in entropy space. Such polyhedral cones are characterized by their extreme rays. For an arbitrary number of parties, it is known that the so-called perfect tensors are extreme rays. In this work, we constrain the form of the remaining extreme rays by showing that they correspond to geometries with vanishing mutual information between any two parties, ensuring the absence of Bell pair type entanglement between them. This is tantamount to proving that besides subadditivity, all non-redundant holographic entropy inequalities are superbalanced, i.e. not only do UV divergences cancel in the inequality itself (assuming smooth entangling surfaces), but also in the purification thereof.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2022

Information transfer with a twist

Holographic duals for CFTs compactified on a Riemann surface Σ with a twist are cast in the language of wedge holography. Σ starts as part of the field theory geometry in the UV and becomes part of the internal space in the IR. This allows to associate entanglement entropies with splits of the internal space in the IR geometry. Decomposing the internal space in the IR and geometrizing the corresponding subsystems separately leads to two interacting gravitational systems, similar to the intermediate holographic description in braneworld models. For Σ = T 2 the setups are used to model information transfer from a black hole to a gravitating bath. This leads to Page curves with a phase structure which precisely mirrors that in braneworld models. The transition from geometric to non-geometric entropies is also discussed for Σ = S 2 as a model for more general internal spaces in AdS/CFT.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS1979

Feature selection via entropy minimization: An example using LANDSAT satellite data

The author has identified the following significant results. The minimum entropy model may provide several useful advantages over traditional techniques for processing LANDSAT data. Total computer time to conduct a complete pattern recognition process is reduced. Subjective (transformed image), as well as statistically derived information is made available to the analyst/user much earlier in the analysis process. A rapid feedback loop in which numerous training set combinations can be tested for difference and representativeness is available. Additional tests of LANDSAT data processing using the minimum entropy model are clearly justified.

Zandonella, A.↗