SEARCH · Engineering Papers

Results for “model interpretability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Streaming Generalized Canonical Polyadic Tensor Decompositions

In this paper, we develop a method which we call OnlineGCP for computing the Generalized Canonical Polyadic (GCP) tensor decomposition of streaming data. GCP differs from traditional canonical polyadic (CP) tensor decompositions as it allows for arbitrary objective functions which the CP model attempts to minimize. This approach can provide better fits and more interpretable models when the observed tensor data is strongly non-Gaussian. In the streaming case, tensor data is gradually observed over time and the algorithm must incrementally update a GCP factorization with limited access to prior data. In this work, we extend the GCP formalism to the streaming context by deriving a GCP optimization problem to be solved as new tensor data is observed, formulate a tunable history term to balance reconstruction of recently observed data with data observed in the past, develop a scalable solution strategy based on segregated solves using stochastic gradient descent methods, describe a software implementation that provides performance and portability to contemporary CPU and GPU architectures and integrates with Matlab for enhanced usability, and demonstrate the utility and performance of the approach and software on several synthetic and real tensor data sets.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1989

Space Shuttle Main Engine structural analysis and data reduction/evaluation. Volume 6: Primary nozzle diffuser analysis

The primary nozzle diffuser routes fuel from the main fuel valve on the Space Shuttle Main Engine (SSME) to the nozzle coolant inlet mainfold, main combustion chamber coolant inlet mainfold, chamber coolant valve, and the augmented spark igniters. The diffuser also includes the fuel system purge check valve connection. A static stress analysis was performed on the diffuser because no detailed analysis was done on this part in the past. Structural concerns were in the area of the welds because approximately 10 percent are in areas inaccessible by X-ray testing devices. Flow dynamics and thermodynamics were not included in the analysis load case. Constant internal pressure at maximum SSME power was used instead. A three-dimensional, finite element method was generated using ANSYS version 4.3A on the Lockheed VAX 11/785 computer to perform the stress computations. IDEAS Supertab on a Sun 3/60 computer was used to create the finite element model. Rocketdyne drawing number RS009156 was used for the model interpretation. The flight diffuser is denoted as -101. A description of the model, boundary conditions/load case, material properties, structural analysis/results, and a summary are included for documentation.

Foley, Michael J.↗

DOE OSTI2023

Interpretable boosted-decision-tree analysis for the Majorana Demonstrator

The Majorana Demonstrator is a leading experiment searching for neutrinoless double-beta decay with high purity germanium detectors (HPGe). Machine learning provides a new way to maximize the amount of information provided by these detectors, but the data-driven nature makes it less interpretable compared to traditional analysis. An interpretability study reveals the machine's decision-making logic, allowing us to learn from the machine to feedback to the traditional analysis. In this work, we have presented the first machine learning analysis of the data from the Majorana Demonstrator; this is also the first interpretable machine learning analysis of any germanium detector experiment. Two gradient boosted decision tree models are trained to learn from the data, and a game-theory-based model interpretability study is conducted to understand the origin of the classification power. By learning from data, this analysis recognizes the correlations among reconstruction parameters to further enhance the background rejection performance. By learning from the machine, this analysis reveals the importance of new background categories to reciprocally benefit the standard Majorana analysis. This model is highly compatible with next-generation germanium detector experiments like LEGEND since it can be simultaneously trained on a large number of detectors.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS1973

Evaluation of usefulness of Skylab EREP S-190 and S-192 imagery in multistage forest surveys

The author has identified the following significant results. A high-flight U-2 imagery (1:120,000) volume interpretation model was developed which could be used to explain 50% of the volume variation occurring on the ground. Two interpreters interpreted 40 GLO land sections with known timber volume in terms of eight variables that could be estimated from the imagery. A multiple regression study was performed to relate the interpreted variables to the ground volumes. It was found that the best model consisted of two basic variables and their squares, namely: (1) the percentage of large trees, and (2) the crown density of the conifers on the parcel. The multiple correlation coefficient was 0.694 for this model.

Langley, P. G.↗

DOE OSTI2025

A methodology for decay heat characterization in molten salt reactors

Accurate decay heat prediction in molten salt reactors (MSRs) faces dual challenges: complex operational uncertainties and the need for interpretable models compatible with engineering workflows. This work presents a hybrid machine learning and segmented polynomial methodology that addresses both requirements through three key innovations. First, a modular data architecture encodes MSR-specific operational parameters (power density: 1-100 W cm -3 , humidity: 0-0.1 wt %, air ingress: 0-0.1 mol %) with uncertainty-aware temporal discretization spanning 15 orders of magnitude. Second, region-optimized machine learning models achieve 92.3 % root mean square error (RMSE) reduction over conventional polynomials while maintaining physical interpretability through automated piecewise equation generation. Third, dual front-end interfaces accelerate safety analyses — a Jupyter environment enables researchers to explore 10,000+ parameter combinations via interactive widgets, while a Streamlit web application reduces design iteration cycles through production-grade visualization tools. Operational deployment demonstrates prediction times of only a couple hundred milliseconds for 10 4 years decay profiles, enabling real-time optimization of spent fuel container designs.

42 - ENGINEERING↗

DOE OSTI2025

Including frameworks of public health ethics in computational modelling of infectious disease interventions

Decisions on public health interventions to control infectious diseases are often informed by computational models. Interpreting the predicted outcomes of a public health decision requires not only high-quality modelling but also an ethical framework for assessing the benefits and harms associated with different options. The design and specification of ethical frameworks matured independently of computational modelling, so many values recognized as important for ethical decision-making are missing from computational models. We demonstrate a proof-of-concept approach to incorporate multiple public health values into the evaluation of a simple computational model for vaccination against a pathogen such as SARS-CoV-2. By examining a bounded space of alternative prioritizations of three values relevant to public health ethics (aggregate clinical burden, equity in clinical burden, equity in adverse effects from vaccination), we identify value trade-offs, where the outcomes of optimal strategies differ depending on the ethical framework. This work demonstrates an approach to incorporating diverse values into decision criteria used to evaluate outcomes of models of infectious disease interventions.

"Mathematical Biology"↗

DOE OSTI2024

Quarterly Research Performance Progress Report (Q8)

As part of Task 1, we have started by testing our modeling capabilities by reproducing isothermal DFIT simulations presented in the literature. Once satisfied with the results we have started by targeting the modeling of the DFITs at conducted at well 58-32. We have a identified a specific test (cycle 4 in zone 2) as the most interesting to be model with GEOS hydraulic fracturing module. Thus, we have first produced results with an isothermal model and adjusted model parameters to get a satisfying match with field pressure data. The, we have added thermal effects and compared the modeling results with and without thermal effects to estimate how thermal effects may influence test interpretation. Models seem to suggest that, for small volumes of fluid, thermal effects are moderate. In Task 2, we have adapted GEOS phase-field formulation to be able to simulate near-wellbore hydraulic fracture nucleation and propagation. We have devised a novel formulation that, compared to other existing ones, incorporates rock strengths. We have submitted a journal publication about our work. We are currently employing this phase-field formulation to model the experiments taking place at U Pitt and help us understand the effect of various parameters. In Task 3, we have built a model of the region surround well 16A and have started modeling stage 3 stimulation because of its simpler planar geometry. After calibrating simulation parameters using known analytical solutions, we have simulated the stage 3 stimulation using our isothermal hydraulic fracturing module, varying the permeability field, the stress conditions including different physics to get a better understanding of the numerical challenges and of the effects of varying these parameters on the simulation results. In Task 4 laboratory experimentation, a set of specialized drilling and injection tools has been customized and constructed to accommodate an inclined well with an orientation of up to 30 degrees relative to material anisotropy or principal stress axes. These inclined samples have also undergone thermal stress and hydraulic fracturing at a temperature of 190 degrees Celsius. Furthermore, both vertical and deviated sampling testing setups enable an extended analysis of post-peak pressure behaviors, facilitating post-test pressure analyses such as the G-function, step rate, and fracture reopening measurements. Thus, the key components of in-situ stress estimation can be extracted and validated through our experiment, providing a solid foundation for validating existing in-situ stress estimation theories or proposing new ones. Simultaneously, we are integrating computer vision techniques with traditional experimental fracture observation methods such as multi-overcore/slicing and water-penetration fracture observation. This combination will prove beneficial in populating the hydraulic fracture patterns database, generated under challenging EGS conditions. This approach aims to deepen our understanding of the complexities in EGS reservoirs and pave the way for future data-driven investigations. Additionally, PITT has also equipped the ELE International compression machine, which is now prepared for conducting indirect tensile and fracture toughness tests. These tests will aid in characterizing how rock fabrics influence the resulting fracture patterns. Additionally, we have completed the required personnel training and gained access to Scanning Electron Microscopy (SEM) and Energy Dispersive Spectroscopy (EDS) for conducting more detailed characterization and analysis of rock fabrics, as well as the examination of thermal and hydraulically induced fracture patterns. Thus, the PITT team has effectively demonstrated the capabilities of our experimental apparatuses in exploring the thermal effects, well deviation angles, material anisotropy, and operational choices (such as circulation rate, injection fluid viscosity, and injection rate) and their impact on pressure responses and fracture trajectories under the Utah FORGE conditions.

15 GEOTHERMAL ENERGY↗

DOE OSTI2025

Basin & Range Investigation for Developing Geothermal Energy

Hidden geothermal systems represent a potentially prolific energy resource that could support critical U.S. public and government energy priorities. Basin and Range Investigations for Developing Geothermal Energy (BRIDGE) addressed some the challenges associated with hidden system exploration by prioritizing cost-effective exploration early on through strategic workflow and informed decision-making that mitigates early risk and shifts resources to later exploration stages (e.g., drilling). Sandia National Laboratories partnered with U.S. Navy Geothermal Office, Geologic Geothermal Group, and independent consultants, with additional collaboration with U.S. Geological Survey and private industry. The primary tool of the BRIDGE project was to deploy a regional-scale airborne electromagnetic method to investigate the shallow resistivity structure in areas with high prospectivity. This was followed up at several prospects by a multidisciplinary exploration approach, including additional geologic, geophysical and geochemical studies. A central tenet to the BRIDGE methodology is that zones of low resistivity frequently occur over geothermal systems in the Basin and Range, and when paired with other data constraints, imaging these zones can enable discovery of these systems. In addition to exploring greenfield areas (i.e., Grover Point), the BRIDGE project also flew HTEM resistivity surveys over known geothermal systems including those with established power plants (Don A. Campbell and Salt Wells) and prospects that are known to the literature but remain undeveloped, at least in part, due to a lack of understanding on the location of their producible reservoirs. BRIDGE produced a comprehensive set of data from prospects identified in the Nevada Play Fairway Analysis along with conceptual models for top ranking prospects, wherein all of the observations are used to inform an interpreted model of the system. These models present a range of possible system parameters such as temperature and size, and they are further informed by system analogues in the Basin and Range province and elsewhere. The results of this work leave space for further exploration that may now occur at prospects ‘down the list’ rather than distribution exploration resources evenly across all prospects.

15 GEOTHERMAL ENERGY↗

DOE OSTI2021

Verification of Data-Driven Models of Physical Phenomena using Interpretable Approximation

Machine-learned models, specifically neural networks, are increasingly used as “closures” or “constitutive models” in engineering simulators to represent fine-scale physical phenomena that are too computationally expensive to resolve explicitly. However, these neural net models of unresolved physical phenomena tend to fail unpredictably and are therefore not used in mission-critical simulations. In this report, we describe new methods to authenticate them, i.e., to determine the (physical) information content of their training datasets, qualify the scenarios where they may be used and to verify that the neural net, as trained, adhere to physics theory. We demonstrate these methods with neural net closure of turbulent phenomena used in Reynolds Averaged Navier-Stokes equations. We show the types of turbulent physics extant in our training datasets, and, using a test flow of an impinging jet, identify the exact locations where the neural network would be extrapolating i.e., where it would be used outside the feature-space where it was trained. Using Generalized Linear Mixed Models, we also generate explanations of the neural net (à la Local Interpretable Model agnostic Explanations) at prototypes placed in the training data and compare them with approximate analytical models from turbulence theory. Finally, we verify our findings by reproducing them using two different methods.

42 ENGINEERING↗

DOE OSTI2026

Ripening of Rh Nanoparticle Catalysts in Reverse Water–Gas Shift via a Data-Driven Model Combining Physics, Theory, and Experiment

Degradation via sintering is an ongoing challenge that impedes the broad commercial success of supported metallic nanoparticle catalysts. To mitigate degradation via informed catalyst design and process operations, here we aim to disambiguate the underlying mechanisms of sintering by combining theory and experiment in a quantitative framework. While mechanistic sintering models exist, they only model a single sintering pathway, even though multiple sintering mechanisms can occur simultaneously or dominate at different stages of the process. Data-driven machine learning models have emerged as a means to represent complex processes through data regression. However, machine learning models have very large data needs and lack mechanistic insights due to their black-box encoding. To develop an interpretive model of catalyst degradation via sintering, we constructed a hybrid model combining mechanistic “physics-based” models and data-driven methods to obtain both reliable predictions and mechanistic insights regarding experimentally observed sintering phenomena. Focusing on nanoparticle sintering in the Rh–TiO 2 catalyst for the reverse water–gas shift (RWGS) reaction, the hybrid model couples a mechanistic term for Ostwald ripening with energy values calculated via density functional theory (DFT) with a parametric, data-driven discrepancy function term for unmodeled mechanisms. The hybrid model is trained using Bayesian inference with data collected from small-angle X-ray scattering (SAXS) in situ experiments wherein average nanoparticle diameter versus time was measured at three relevant operating temperatures. The calibrated hybrid model results show that an Ostwald ripening-only model parameterized with fixed DFT energies does not fully capture the time and temperature dependence of the SAXS-observed sintering kinetics, and that an additional functional contribution, or DFT energy calibration, is required to reconcile simulation and experiment. Analysis of the hybrid-model error confirms that the hybrid model outperforms both the purely mechanistic and purely data-driven alternatives in terms of expected predictive accuracy for time-evolving average particle sizes. Furthermore, the results support the hypothesis that the Ostwald ripening mechanism is less important for explaining the sintering phenomena as operating temperature increases under an assumed fixed DFT parameterization. This could be explained in one of two ways: either latent, unmodeled sintering mechanisms dominate at higher temperatures, or the DFT uncertainty increases with temperature. The proposed modeling approach directly links theory to experiments and simulations via a statistical hybrid modeling framework and can be extended to other catalytic systems to improve predictive models and mechanistic understanding.

Bayesian hybrid modeling↗

DOE OSTI2024

Jet classification using high-level features from anatomy of top jets

Recent advancements in deep learning models have significantly enhanced jet classification performance by analyzing low-level features (LLFs). However, this approach often leads to less interpretable models, emphasizing the need to understand the decision-making process and to identify the high-level features (HLFs) crucial for explaining jet classification. To address this, we consider the top jet tagging problems and introduce an analysis model (AM) that analyzes selected HLFs designed to capture important features of top jets. Our AM mainly consists of the following three modules: a relation network analyzing two-point energy correlations, mathematical morphology and Minkowski functionals for generalizing jet constituent multiplicities, and a recursive neural network analyzing subjet constituent multiplicity to enhance sensitivity to subjet color charges. We demonstrate that our AM achieves performance comparable to the Particle Transformer (ParT) while requiring fewer computational resources in a comparison of top jet tagging using jets simulated at the hadronic calorimeter angular resolution scale. Furthermore, as a more constrained architecture than ParT, the AM exhibits smaller training uncertainties because of the bias-variance tradeoff. We also compare the information content of AM and ParT by decorrelating the features already learned by AM. Lastly, we briefly comment on the results of AM with finer angular resolution inputs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

Evaluation and projection of long period return values of extreme daily precipitation in the CMIP5 and CMIP6 models

Using a non-stationary Generalized Extreme Value statistical method, we calculate selected extreme daily precipitation indices and their 20 year return values from the CMIP5 and CMIP6 climate models over the historical and future periods. We evaluate model performance of these indices and their return values in replicating similar quantities calculated from multiple gridded observational products. Difficulties in interpreting model quality in the context of observational uncertainties are discussed. Projections are framed in terms of specified global warming target temperatures rather than at specific times and under specific emissions scenarios. The change in framing shifts projection uncertainty due to differences in model climate sensitivity from the values of the projections to the timing of the global warming target. At their standard resolutions, we find there are no meaningful differences between the two generations of models in their quality or projections of simulated extreme daily precipitation.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

An interpretable machine learning framework to understand bikeshare demand before and during the COVID-19 pandemic in New York City

In recent years, bikesharing systems have become increasingly popular as affordable and sustainable micromobility solutions. Advanced mathematical models such as machine learning are required to generate good forecasts for bikeshare demand. Here, this study proposes a machine learning modeling framework to estimate hourly demand in a large-scale bikesharing system. Two Extreme Gradient Boosting models were developed: one using data from before the COVID-19 pandemic (March 2019 to February 2020) and the other using data from during the pandemic (March 2020 to February 2021). Furthermore, a model interpretation framework based on SHapley Additive exPlanations was implemented. Based on the relative importance of the explanatory variables considered in this study, share of female users and hour of day were the two most important explanatory variables in both models. However, the month variable had higher importance in the pandemic model than in the pre-pandemic model.

99 GENERAL AND MISCELLANEOUS↗

NASA NTRS1982

Multidimensional aspects: Ozone, temperature and transport

The capability for obtaining four-dimensional data on stratospheric structure, dynamics, and zone is discussed. Progress in the development of multidimensional models of the stratosphere is reported. The discussion of multidimensional aspects of the stratosphere is divided into four major sections: observations, analysis and interpretation, modeling, and transport of trace species.

Source record↗

NASA NTRS2011

In Situ Trace Element Measurements on Roda and the Origin of Diogenites

The origin of diogenites remains poorly understood. A recent model interprets many diogenites to have been formed from melts that were derived by remelting initial magma ocean cumulates, and these penultimate parent melts were then contaminated by melts derived from remelting of the basaltic (eucritic) crust to form the ultimate diogenite parent melts [1] (hereafter the remelting model). This is a very complicated petrogenesis that has profound implications for the geological evolution of 4 Vesta if correct. This model was developed based on trace element analyses of bulk rock samples that had been leached in acids to remove phosphates; the compositions of the residues were interpreted to be close to those of cumulus orthopyroxenes plagioclase, chromite and olivine [1]. In situ measurements of phases in diogenites can be used to test this model. We have begun a campaign of laser ablation ICP-MS of orthopyroxene grains in diogenites for this purpose. Here we report our first results on one diogenite, Roda. We have determined a suite of trace lithophile elements on nine, mm-sized pyroxene grains separated from Roda that have previously been studied [2, 3]. A key observation supporting the remelting model is the very low Eu/Eu* of leached residues; values too low to represent orthopyroxene that crystallized from melts with chondritic Sm/Eu and Gd/Eu [1]. (Eu* = Eu interpolated from REE diagrams.) Crustal remelts have low Sm/Eu and Gd/Eu, and orthopyroxenes that crystallized from parent melts contaminated by them would have very low Eu/Eu* [1]. Roda grains have Eu/Eu* of 0.243 to 0.026; the latter a value lower than any measured on bulk diogenite leached residues (0.041) [1]. There is a general negative correlation between Eu/Eu* and some incompatible elements (Zr, Nb, Hf), but not others (LREE). This appears inconsistent with the remelting model as it would suggest an evolving parent melt with La de-creasing as Zr increased and Eu/Eu* decreased. Grain R-15 includes trace-element-rich trapped melt phases [2, 3]. This grain has the highest Eu/Eu* and LREE contents, indicating that the trapped melt had a high Eu/Eu*. Thus, our first data on one diogenite do not provide support for the remelting model [1]. Roda is unusual in that its orthopyroxene grains show wide ranges in trace element contents [4]. Previous in situ REE analyses of grain R-15 did not reveal evidence for subsolidus equilibration with trace-element-rich trapped melt phases, and led to the suggestion that Roda may be polymict, with different grains representing different lithologies of diverse compositions [3]. Thus, based on our results on Roda, it is perhaps premature to abandon the remelting model. In situ measurements on a suite of diogenites is planned to further address this issue.

Mittlefehldt, David W.↗

DOE OSTI2026

Fully generalized, turbulent trace impurity transport with Gkeyll and Flan in the DIII-D far-SOL

The Monte Carlo trace impurity turbulent transport code Flan is introduced for the first time. Flan follows impurities in a turbulent background plasma from Gkeyll using the Lorentz force to resolve the full particle gyro orbit. Collisions are handled using the Nanbu collision algorithm (Nanbu 1997 Phys. Rev. E 55 4642–52), and ionization/recombination is handled via ADAS coupling. The far-SOL of a generic DIII-D L-mode is simulated with and without the collision model to show how collisions affect radial tungsten transport. Anomalous diffusion coefficient (D r ) and pinch velocity (v p ) profiles are extracted from fits to the results. With collisions, D r and v p are between 0–1.0 m 2 s −1 and −100–100 m s −1 , respectively. Without collisions, D r and v p are between 0–0.3 m 2 s −1 and −50–50 m s −1 , respectively. Exponential fits to the radial W density profiles and experimental data from W deposition along a collector probe are in good agreement, demonstrating Flan as a useful interpretive modeling tool. Additional simulations show that impurity transport away from the wall increases with atomic number, though it is not clear why. Flan has the potential to better interpret existing data and improve reactor scale predictions of core contamination because the underlying physics model is very general and does not rely on arbitrary user-defined transport coefficients.

DIII-D↗

DOE OSTI2022

Validation and parameterization of a novel physics-constrained neural dynamics model applied to turbulent fluid flow

We report, in fluid physics, data-driven models to enhance or accelerate time to solution are becoming increasingly popular for many application domains, such as alternatives to turbulence closures, system surrogates, or for new physics discovery. In the context of reduced order models of high-dimensional time-dependent fluid systems, machine learning methods grant the benefit of automated learning from data, but the burden of a model lies on its reduced-order representation of both the fluid state and physical dynamics. In this work, we build a physics-constrained, data-driven reduced order model for Navier–Stokes equations to approximate spatiotemporal fluid dynamics in the canonical case of isotropic turbulence in a triply periodic box. The model design choices mimic numerical and physical constraints by, for example, implicitly enforcing the incompressibility constraint and utilizing continuous neural ordinary differential equations for tracking the evolution of the governing differential equation. We demonstrate this technique on a three-dimensional, moderate Reynolds number turbulent fluid flow. In assessing the statistical quality and characteristics of the machine-learned model through rigorous diagnostic tests, we find that our model is capable of reconstructing the dynamics of the flow over large integral timescales, favoring accuracy at the larger length scales. More significantly, comprehensive diagnostics suggest that physically interpretable model parameters, corresponding to the representations of the fluid state and dynamics, have attributable and quantifiable impact on the quality of the model predictions and computational complexity.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

An interpretable machine learning model for advancing terrestrial ecosystem predictions

We apply an interpretable Long Short-Term Memory (iLSTM) network for land-atmosphere carbon flux predictions based on time series observations of seven environmental variables. iLSTM enables interpretability of variable importance and variable-wise temporal importance to the prediction of targets by exploring internal network structures. The application results indicate that iLSTM not only improves prediction performance by capturing different dynamics of individual variables, but also reasonably interprets the different contribution of each variable to the target and its different temporal relevance to the target. This variable and temporal importance interpretation of iLSTM advances terrestrial ecosystem model development as well as our predictive understanding of the system.

Lu, Dan↗