Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,585 records · Page 88
All sourcesNASA NTRSDOE OSTI
NASA NTRS2006

Equations for Scoring Rules When Data Are Missing

A document presents equations for scoring rules in a diagnostic and/or prognostic artificial-intelligence software system of the rule-based inference-engine type. The equations define a set of metrics that characterize the evaluation of a rule when data required for the antecedence clause(s) of the rule are missing. The metrics include a primary measure denoted the rule completeness metric (RCM) plus a number of subsidiary measures that contribute to the RCM. The RCM is derived from an analysis of a rule with respect to its truth and a measure of the completeness of its input data. The derivation is such that the truth value of an antecedent is independent of the measure of its completeness. The RCM can be used to compare the degree of completeness of two or more rules with respect to a given set of data. Hence, the RCM can be used as a guide to choosing among rules during the rule-selection phase of operation of the artificial-intelligence system..

James, Mark↗
DOE OSTI2024

Classification of compact objects and model comparison using EOS knowledge

Nuclear theory and experiments, alongside astrophysical observations, constrain the equation of state (EOS) of supranuclear-dense matter. Conversely, knowledge of the EOS allows an improved interpretation of nuclear or astrophysical data. In this article, we use several established constraints on the EOS and the new NICER measurement of PSR J0437-4715 to comment on the nature of the primary companion in GW230529 and the companion of PSR J0514-4002E. We find that, with a probability of ≳84% and ≳68%, respectively, both objects are black holes. These likelihoods increase to above 95% when one uses GW170817’s remnant as an upper limit on the TOV mass. We also demonstrate that the current knowledge of the EOS substantially disfavors high masses and radii for PSR J⁢0030+0451, inferred recently when combining NICER with XMM-Newton background data and using particular hot-spot models. Lastly, we also use our obtained EOS knowledge to comment on measurements of the nuclear symmetry energy, finding that the large value predicted by the PREX-II measurement displays some mild tension with other constraints on the EOS.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Bridging the Gap Between LLMs and LNS with Dynamic Data Format and Architecture Codesign

Deep neural networks (DNNs) have achieved tremendous success in the past few years. However, their training and inference demand exceptional computational and memory resources. Quantization has been shown as an effective approach to mitigate the cost, with the mainstream data types reduced from FP32 to FP16/BF16 and recently FP8 in the latest NVIDIA H100 GPUs. With increasingly aggressive quantization, however, the conventional floating-point formats suffer from limited precision in representing numbers around zero. Recently, NVIDIA demonstrated the potential of using a Logarithmic Number System (LNS) for the next generation of tensor cores. While LNS mitigates the hurdles in representing small numbers, in this work we observed a mismatch between LNS and the emerging Large Language Models (LLM), where LLM exhibits significant outliers when directly adopting the LNS format. In this paper, we present a data-format/architecture codesign to bright this gap. On the format side, we propose a dynamic LNS format to flexibly represent outliers at a higher precision, by exploiting asymmetry in the LNS representation and identifying outliers through a per-vector basis. On the architecture side, for demonstration, we realize the dynamic LNS format in a systolic array, which can handle the irregularity of the outliers at runtime. We implement our approach on an Alveo U280 FPGA as a prototype. Experimental results show that our design can effectively handle the outliers and resolve the mismatch between LNS and LLM, contributing to an accuracy improvement of 15.4% and 16% over the floating-point and the original LNS baselines, using four state-of-the-art LLM models. Our observation and design lay a solid foundation for the large-scale adoption of the LNS format in the next-generation deep learning hardware.

Haghi, Pouya↗
DOE OSTI2025

Rapid Inference of Logic Gate Neural Networks for Anomaly Detection in High Energy Physics

The increasing data rates and complexity of detectors at the Large Hadron Collider (LHC) necessitate fast and efficient machine learning models, particularly for rapid selection of what data to store, known as triggering. Building on recent work in differentiable logic gates, we present a public implementation of a Convolutional Differentiable Logic Gate Neural Network (CLGN). We apply this to detecting anomalies at the Level-1 Trigger at CMS using public data from the CICADA project. We demonstrate that the CLGN achieves physics performance on par with or superior to conventional quantized neural networks. We also synthesize an LGN for a Field-Programmable Gate Array (FPGA) and show highly promising FPGA characteristics, notably zero Digital Signal Processor (DSP) resource usage. This work highlights the potential of logic gate networks for high-speed, on-detector inference in High Energy Physics and beyond.

FOS: Physical sciences↗
DOE OSTI2022

What can simulation test beds teach us about social science? Results of the ground truth program

The ground truth program used simulations as test beds for social science research methods. The simulations had known ground truth and were capable of producing large amounts of data. This allowed research teams to run experiments and ask questions of these simulations similar to social scientists studying real-world systems, and enabled robust evaluation of their causal inference, prediction, and prescription capabilities. We tested three hypotheses about research effectiveness using data from the ground truth program, specifically looking at the influence of complexity, causal understanding, and data collection on performance. We found some evidence that system complexity and causal understanding influenced research performance, but no evidence that data availability contributed. The ground truth program may be the first robust coupling of simulation test beds with an experimental framework capable of teasing out factors that determine the success of social science research.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Data and Models: A Framework for Advancing AI in Science

On June 5, 2019, the Office of Science (SC) organized a one-day roundtable to focus on enhancing access to high-quality and fully traceable research data, models, and computing resources to increase the value of such resources for artificial intelligence (AI) research and development and the SC mission.1 In this report, we consider AI to be inclusive of, for example, machine learning (ML), deep learning (DL), neural networks (NN), computer vision, and natural language processing (NLP). We consider “data for AI” to mean the digital artifacts used to generate AI models and/or employed in combination with AI models during inference. In part, this roundtable was motivated by the recognition that a large portion of science data currently are not well suited for AI.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Development of an Optical Model for the MEDLI2 Radiometer

We present an optical model of the MEDLI2 radiometer, which was flown onboard the Mars 2020 vehicle during atmospheric entry on February 18, 2021. The proposed model takes into account the radiometer geometry and optical phenomena such as reflection, refraction, and absorption to estimate the signal loss inherent in the design of the radiometer. The model serves as a filter, which can be used to convert predicted total radiative heat fluxes on the radiometer window into predicted measured heat fluxes, enabling more accurate comparisons of the radiometer flight data with predicted radiometer measurements. Optical properties of the radiometer’s sapphire window are inferred from spectral transmissivity measurements. A modified Lorentz Oscillator Model is used to represent the dielectric function of the window and is fit to the transmission data. The resulting optical model of the radiometer is validated against experimental data used to measure the dependence of the radiometer output voltage on the incident angle of the light impinging on it. Comparison of predicted radiometer measurements with the MEDLI2 flight data show good agreement between the predicted and measured peak heat fluxes, though offset at different times. A linear increase in the signal loss due to radiometer optics alone is also demonstrated, suggesting that the changing shock angle over the course of the trajectory impacts the signal loss.

MEDLI2↗
DOE OSTI2022

Stellar kinematics of dwarf galaxies from multi-epoch spectroscopy: application to Triangulum II

ABSTRACT We present new MMT/Hectochelle spectroscopic measurements for 257 stars observed along the line of sight to the ultrafaint dwarf galaxy Triangulum II (Tri II). Combining results from previous Keck/DEIMOS spectroscopy, we obtain a sample that includes 16 likely members of Tri II, with up to 10 independent redshift measurements per star. To this multi-epoch kinematic data set, we apply methodology that we develop in order to infer binary orbital parameters from sparsely sampled radial velocity curves with as few as two epochs. For a previously identified (spatially unresolved) binary system in Tri II, we infer an orbital solution with period $296.0_{-3.3}^{+3.8} \rm ~ d$, semimajor axis $1.12^{+0.41}_{-0.24}\rm ~au$, and systemic velocity $-380.0 \pm 1.7 \rm ~km ~s^{-1}$ that we then use in the analysis of Tri II’s internal kinematics. Despite this improvement in the modelling of binary star systems, the current data remain insufficient to resolve the velocity dispersion of Tri II. We instead find a 95 per cent confidence upper limit of $\sigma _{v} \lesssim 3.4 \rm ~km~s^{-1}$.

Buttry, Rachel (ORCID:0000000155017609)↗
NASA NTRS1994

Data Analysis with Graphical Models: Software Tools

Probabilistic graphical models (directed and undirected Markov fields, and combined in chain graphs) are used widely in expert systems, image processing and other areas as a framework for representing and reasoning with probabilities. They come with corresponding algorithms for performing probabilistic inference. This paper discusses an extension to these models by Spiegelhalter and Gilks, plates, used to graphically model the notion of a sample. This offers a graphical specification language for representing data analysis problems. When combined with general methods for statistical inference, this also offers a unifying framework for prototyping and/or generating data analysis algorithms from graphical specifications. This paper outlines the framework and then presents some basic tools for the task: a graphical version of the Pitman-Koopman Theorem for the exponential family, problem decomposition, and the calculation of exact Bayes factors. Other tools already developed, such as automatic differentiation, Gibbs sampling, and use of the EM algorithm, make this a broad basis for the generation of data analysis software.

Buntine, Wray L.↗
NASA NTRS2001

Doppler and Reflectivity Measurements at Two Closely-Spaced Frequencies

Spaceborne and airborne radars are limited with a respect to the mass and size of the instrument and the power available to operate it. As a consequence, dual-wavelength radars that require separate antennas and power amplifiers are expensive and often impractical. However, if the frequency difference can be reduced so that a single antenna and the same radio-frequency subsystem can be used for both frequencies, dual- wavelength Doppler measurements can be made with a radar of about the same size and mass as its single-frequency counterpart. In the first part of the paper we present calculations of the reflectivity factor differences as functions of the center frequency from 10 to 35 GHz and for frequency differences between -10% and 10% of the center frequency. The results indicate that differential-frequency operation at Ka-band frequencies (26.5 - 40 GHz) provides relatively strong differential signals if the frequencies can be separated by at least 5%. Unlike lower frequency operation, the differential signals at Ka-band (both reflectivity and Doppler) are directly related to the median mass diameter. An important feature of the differential mean Doppler is that it depends only on the drop-size dependent part of the radial velocity. In principle, the mean and mean differential Doppler data from a nadir-looking platform can be used to infer vertical air motion and characteristics of the particle size distribution. To test the instrument concept, the ER-2 Doppler radar was modified for differential frequency operation. Measurements by the modified radar, operating at frequencies of 9.1 GHz and 10 GHz, were made using an 8 degree zenith-pointing offset parabolic antenna. Simultaneous data were taken with an optical rain gauge and an impact disdrometer. Measured and DSD-estimated values of the differential dBZ mean Doppler are presented.

Meneghini, Robert↗
DOE OSTI2022

Sensor selection and tool wear prediction with data‐driven models for precision machining

Abstract Estimation of tool wear in precision machining is vital in the traditional subtractive machining industry to reduce processing cost, improve manufacturing efficiency and product quality. In this vein, fusion of time and frequency‐domain features of commonly sensed signals can provide an early indication of tool wear and improve its prediction accuracy for prognostics and health management. This paper presents a data‐driven methodology and a complete tool chain for the inference of precision machining tool wear from fused machine measurements, such as cutting force, power, audio and vibration signals, and quantify the usefulness of each measurement. Indicators of tool wear are extracted from time‐domain signal statistics, frequency‐domain analysis, and time‐frequency domain analysis. Correlation coefficients between the extracted features (indicators) and the tool wear are used to select the most informative features. Principal Component Analysis and Partial Least‐Squares are used to reduce the dimensionality of the feature space. Regression models, including linear regression, support vector regression, Decision tree regression, neural network regression and Gaussian process regression, are used to predict the tool wear using data from a Haas milling machine performing spiral boss face milling. The performance of the regression models based on subsets of sensors validates the preliminary estimates about the saliency of the sensors. The experimental results show that the proposed methods can predict the machine tool wear precisely, with readily available sensor measurements. Neural network and Gaussian process regression were able to achieve good estimates of tool wear at different machine operating conditions. The most informative signal in predicting tool wear was shown to be the vibration signal. Time‐frequency domain features were the most informative features among the combination of features of three domains. In addition, using partial least squares components extracted from the original features of signals led to higher prediction accuracy.

Han, Seulki↗
NASA NTRS1963

SOME GEOLOGIC PROBLEMS OF MARS

Geological and geophysical knowledge and uncertainties concerning the surface and body of Mars are briefly discussed and evaluated. The large number of uncertainties in present data precludes an adequate model of Mars; reliable data are needed. Accurate values for the figure of the planet and the radii, seismic evidence of internal structure, and measurements of the outward heat flux across the surface are important and necessary for a satisfactory description of the body of Mars. Two types of television coverage from an orbiter are required to describe surface features. One type is needed to delineate gross topographic features, such as extensive highlands or basins, with resolution of about one kilometer. The second type is needed to search for evidence of orogenic and volcanic activity, areas of groundwater accumulation, sand dune patterns, etc., with resolution of about 10 meters. Some geological inferences which can be drawn from available photographic and photometric data concerning topography, areas of water accumulation, and biological activity are discussed. The priority of scientific geologic experiments is presented and some present instrumentation capabilities and deficiencies are listed.

Mars surface↗
DOE OSTI2021

Kimberlina 1.2 Velocity Models and Seismic Data

Kimberlina 1.2 Velocity model and synthetic seismic data, produced in collaboration of teams at the National Energy Technology Laboratory, Los Alamos National Laboratory, and Lawrence Livermore National Laboratory through the National Risk Assessment Partnership. Data is associated with the following publication: Zheng Zhou, Youzuo Lin, Zhongping Zhang, Yue Wu, Zan Wang, Robert Dilmore, and George Guthrie, "A Data-Driven CO2 Leakage Detection Using Seismic Data and Spatial-Temporal Densely Connected Convolutional Neural Networks," International Journal of Greenhouse Gas Control, Vol 90, 2019. The Kimberlina 1.2 Velocity models were produced by Zan Wang, Robert Dilmore, William Harbert, and Lianjie Huang at NETL. The following citations are directly related to the creation of the velocity models: Wang, Z. Harbert, W., Dilmore, R., Huang, L. Modeling of time-lapse seismic monitoring using CO2 leakage simulations for a model CO2 storage site with realistic geology: Application in assessment of early leak-detection capabilities. International Journal of Greenhouse Gas Control. V. 76, September 2018, Pages 39-52. https://doi.org/10.1016/j.ijggc.2018.06.011 Wang, Z., Dilmore, R., Harbert, W. Inferring CO2 saturation from synthetic surface seismic and downhole monitoring data using machine learning for leakage detection at CO2 sequestration sites. International Journal of Greenhouse Gas Control, V. 100, September 2020. https://doi.org/10.1016/j.ijggc.2020.103115 The velocity models were built based on the Kimberlina 1.2 aquifer impact data which is associated with the following publications: Buscheck, T.A., Mansoor, K., Yang, X., Wainwright, H., and Carroll, S. (2019). Downhole pressure and chemical monitoring for CO2 and brine leak detection in aquifers above a CO2 storage reservoir. International Journal of Greenhouse Gas Control. 91. 102812. 10.1016/j.ijggc.2019.102812. Xianjin Yang, Thomas A. Buscheck, Kayyum Mansoor, Zan Wang, Kai Gao, Lianjie Huang, Delphine Appriou, Susan A. Carroll, Assessment of geophysical monitoring methods for detection of brine and CO2 leakage in drinking water aquifers, International Journal of Greenhouse Gas Control, Volume 90, 2019, 102803, ISSN 1750-5836, https://doi.org/10.1016/j.ijggc.2019.102803 The synthetic seismic data was produced by Youzuo Lin and team at LANL, and are associated with the following citations: Jordan, P. D., and J. L. Wagoner. Characterizing Construction of Existing Wells to a CO2 Storage Target: The Kimberlina Site, California. Zheng Zhou, Youzuo Lin, Zhongping Zhang, Yue Wu, Zan Wang, Robert Dilmore, and George Guthrie, "A Data-Driven CO2 Leakage Detection Using Seismic Data and Spatial-Temporal Densely Connected Convolutional Neural Networks," International Journal of Greenhouse Gas Control, Vol 90, 2019.

CO2 Leakage↗
NASA NTRS2024

Transfer-AE: A novel autoencoder-based impact detection model for structural digital twin

Accurately detecting the location and intensity of impacts is crucial for ensuring structural safety. Currently, AI-based structural impact detection methods are widely used for their excellent detection accuracy. However, their generalization capability is limited by the scenarios present in the training data. Many complex and dangerous impact scenarios are difficult to conduct real-world experiments on to collect sufficient samples. To capture all impact scenarios and fully leverage the advantages of AI-based detection technologies, advanced methods involve combining real-world structural monitoring data with corresponding numerical models to construct digital twins. These methods continuously refine the created numerical models with limited real-world data and provide diverse impact scenarios through numerical model simulations. However, there are inevitable differences between digital models and physical models that are challenging to correct through mechanical means. This discrepancy in data distribution between the two models significantly hinders the application of digital twin technology in impact/event identification tasks. To address this challenge, this study proposes a novel model based on autoencoders, named Transfer-AE. Transfer-AE encodes the common features of digital twins in the latent space to bridge the uncertainty gap at a macro scale between numerical models and physical models and synchronously fits the magnitude and location of the impact load in the decoder. This enables consistent detection results for the same impact event, whether the sample comes from the numerical model or the physical model. Transfer-AE includes two operating modes: Mode 1 has a fixed computational complexity with stable inference speed, but the training cost and difficulty increase with data distribution. Mode 2's computational complexity increases with data distribution, but it has a fixed training cost and speed. In both cases involving the geodesic dome structure simulating a deep space habitat and the IASC-ASCE benchmark structure, Transfer-AE demonstrated the best performance in impact localization and quantification tasks compared to mainstream domain-adaptive transfer models.

Chengjia Han↗
DOE OSTI2024

Topological Interpretability for Deep Learning

With the growing adoption of AI-based systems across everyday life, the need to understand their decision-making mechanisms is correspondingly increasing. The level at which we can trust the statistical inferences made from AI-based decision systems is an increasing concern, especially in high-risk systems such as criminal justice or medical diagnosis, where incorrect inferences may have tragic consequences. Despite their successes in providing solutions to problems involving real-world data, deep learning (DL) models cannot quantify the certainty of their predictions. These models are frequently quite confident, even when their solutions are incorrect. This work presents a method to infer prominent features in two DL classification models trained on clinical and non-clinical text by employing techniques from topological and geometric data analysis. We create a graph of a model's feature space and cluster the inputs into the graph's vertices by the similarity of features and prediction statistics. We then extract subgraphs demonstrating high-predictive accuracy for a given label. These subgraphs contain a wealth of information about features that the DL model has recognized as relevant to its decisions. We infer these features for a given label using a distance metric between probability measures, and demonstrate the stability of our method compared to the LIME and SHAP interpretability methods. This work establishes that we may gain insights into the decision mechanism of a DL model. This method allows us to ascertain if the model is making its decisions based on information germane to the problem or identifies extraneous patterns within the data.

Spannaus, Adam↗
DOE OSTI2024

Impact of various DIII-D diagnostics on the accuracy of neural network surrogates for kinetic EFIT reconstructions

Abstract Kinetic equilibrium reconstructions make use of profile information such as particle density and temperature measurements in addition to magnetics data to compute a self-consistent equilibrium. They are used in a multitude of physics-based modeling. This work develops a multi-layer perceptron (MLP) neural network (NN) model as a surrogate for kinetic Equilibrium Fitting (EFITs) and trains on the 2019 DIII-D discharge campaign database of kinetic equilibrium reconstructions. We investigate the impact of including various diagnostic data and machine actuator controls as input into the NN. When giving various categories of data as input into NN models that have been trained using those same categories of data, the predictions on multiple equilibrium reconstruction solutions (poloidal magnetic flux, global scalars, pressure profile, current profile) are highly accurate. When comparing different models with different diagnostics as input, the magnetics-only model outputs accurate kinetic profiles and the inclusion of additional data does not significantly impact the accuracy. When the NN is tasked with inferring only a single target such as the EFIT pressure profile or EFIT current profile, we see a large increase in the accuracy of the prediction of the kinetic profiles as more data is included. These results indicate that certain MLP NN configurations can be reasonably robust to different burning-plasma-relevant diagnostics depending on the accuracy requirements for equilibrium reconstruction tasks.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Benchmarking of Different Inverse Point Kinetics Implementations for an Autocorrected Reactimeter Algorithm

In November 2017, the Transient Reactor Test Facility returned to operation. Since that time, many transient test series have been completed; each has provided valuable data for materials performance, reactor safety that can be applied in future designs. During each experimental series, detector count rates provided important information on the core behavior during transients. However, a limitation of these data is that variations in the neutron distribution during experiments cause errors when attempting to infer reactivity evolution from detector signals. Neutron physics codes can be used to compute the flux shape variations. However, this is a poor solution when the experimental data is used to do verification, validation and uncertainty quantification (VVUQ) on codes. Indeed, if the output of the code is used both as a reference and to correct what the reference is compared to, the circular dependency limits the quality of the VVUQ approach. To overcome this problem, an Autocorrected Reactimeter Algorithm (ACRA) has been developed. This approach infers time-dependent reactivity evolution by testing different spatial corrections and selecting the one that minimizes reactivity variations when the core is in a frozen configuration (i.e. when there is no variation in parameters affecting reactivity). However, the scope of this method was limited to transients where there were negligible thermal feedback. Indeed, the core is never in a frozen configuration when the fuel temperature varies during the whole transient. This is our motivation for the development of an improved version of the ACRA which does not require frozen configurations

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Why the observed spin evolution of older-than-solar-like stars might not require a dynamo mode change

ABSTRACT The spin evolution of main-sequence stars has long been of interest for basic stellar evolution, stellar ageing, stellar activity, and consequent influence on companion planets. Observations of older-than-solar late-type main-sequence stars have been interpreted to imply that a change from a dipole-dominated magnetic field to one with more prominent higher multipoles might be necessary to account for the data. The spin-down models that lead to this inference are essentially tuned to the Sun. Here, we take a different approach that considers individual stars as fixed points rather than just the Sun. We use a time-dependent theoretical model to solve for the spin evolution of low-mass main-sequence stars that includes a Parker-type wind and a time-evolving magnetic field coupled to the spin. Because the wind is exponentially sensitive to the stellar mass over radius and the coronal base temperature, the use of each observed star as a separate fixed point is more appropriate and, in turn, produces a set of solution curves that produces a solution envelope rather than a simple line. This envelope of solution curves, unlike a single line fit, is consistent with the data and does not unambiguously require a modal transition in the magnetic field to explain it.

Astronomy & Astrophysics↗