Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model interpretability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Geophysical Impacts and Spectroscopic Identification of a Hydrous Iron Sulfate on Icy Worlds

Over geologic time-scales, large volumes of exogenic sulfur ions from Io's plasma torus have been supplied to the surface of Europa and Ganymede, which, combined with recent interpretations of orbiter images, dynamical modeling, and surface-subsurface exchange, suggests further sulfur transport into the interior of the icy worlds. These observations motivate mixed-phase spectral modeling for interpreting orbiter spectroscopy data and determination of hydration states of candidate surface materials including hydrous sulfates. In this work, we present a combined experimental and theoretical study of the low temperature and high pressure vibrational spectral signature of the iron-sulfate monohydrate endmember, szomolnokite (FeSO 4 ·H 2 O). By employing synchrotron Fourier-transform infrared spectroscopy (FTIR) in the diamond anvil cell up to 23 GPa and down to 20 K, we explore the extreme range of pressure-temperature domains relevant to icy environments throughout our solar system and beyond. Combined with our density-functional theory quantum-mechanics molecular dynamics results, we demonstrate that experimentally observed infrared features in the O-H stretching region commonly associated with nH 2 O (n > 1) hydration states can be attributed to a pure monohydrate without the need for pressure-induced exsolved ice, other coexisting hydrous iron sulfates, or strong overtone and combination modes. We further discuss the possibility of lateral variations in density and shear properties on icy worlds associated with temperature variations and the high-pressure phases of kieserite group monohydrated sulfates.

Geosciences↗
DOE OSTI2025

The persistent shadow of the supermassive black hole of M87. II. Model comparisons and theoretical interpretations

The Event Horizon Telescope (EHT) observation of M87∗ in 2018 has revealed a ring with a diameter that is consistent with the 2017 observation. The brightest part of the ring is shifted to the southwest from the southeast. In this paper, we provide theoretical interpretations for the multi-epoch EHT observations for M87∗ by comparing a new general relativistic magnetohydrodynamics model image library with the EHT observations for M87∗ in both 2017 and 2018. The model images include aligned and tilted accretion with parameterized thermal and nonthermal synchrotron emission properties. The 2018 observation again shows that the spin vector of the M87∗ supermassive black hole is pointed away from Earth. A shift of the brightest part of the ring during the multi-epoch observations can naturally be explained by the turbulent nature of black hole accretion, which is supported by the fact that the more turbulent retrograde models can explain the multi-epoch observations better than the prograde models. The EHT data are inconsistent with the tilted models in our model image library. Assuming that the black hole spin axis and its large-scale jet direction are roughly aligned, we expect the brightest part of the ring to be most commonly observed 90 deg clockwise from the forward jet. This prediction can be statistically tested through future observations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Data for FUN-PROSE: A Deep Learning Approach to Predict Condition-Specific Gene Expression in Fungi

mRNA levels of all genes in a genome is a critical piece of information defining the overall state of the cell in a given environmental condition. Being able to reconstruct such condition-specific expression in fungal genomes is particularly important to metabolically engineer these organisms to produce desired chemicals in industrially scalable conditions. Most previous deep learning approaches focused on predicting the average expression levels of a gene based on its promoter sequence, ignoring its variation across different conditions. Here we present FUN-PROSE—a deep learning model trained to predict differential expression of individual genes across various conditions using their promoter sequences and expression levels of all transcription factors. We train and test our model on three fungal species and get the correlation between predicted and observed condition-specific gene expression as high as 0.85. We then interpret our model to extract promoter sequence motifs responsible for variable expression of individual genes. We also carried out input feature importance analysis to connect individual transcription factors to their gene targets. A sizeable fraction of both sequence motifs and TF-gene interactions learned by our model agree with previously known biological information, while the rest corresponds to either novel biological facts or indirect correlations.

Genomics↗
DOE OSTI2023

Nuclear Power's Future Role in a Decarbonized U.S. Electricity System

This study explores the potential future role of nuclear energy in a decarbonized U.S. electricity system through a multi-model comparison approach. We employ four state-of-the-art CEMs with native and harmonized input assumptions, layered with different policy and technology trajectories. Comparing outputs across models, technology assumptions, and policy scenarios informs model understanding, interpretation, and development decisions. Under current policies, models differ in their projections for nuclear retirements, but nuclear power plants consistently run with high capacity factors and new builds only occur in scenarios with very low nuclear costs. String power sector carbon policies drive models to align in keeping existing nuclear capacity and employing nuclear plant flexibility, but they may not be enough to bring new nuclear capacity online in the absence of significant cost declines. Therefore, significant economic deployment of new nuclear capacity requires both a stringent electric sector CO2 policy and very low cost assumptions for new nuclear. While these scenarios should not be interpreted as predictions, they are informative for understanding differing model assessments of the relative competitiveness of nuclear energy under a range of policy and technology conditions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Improving multiwell petrophysical interpretation from well logs via machine learning and statistical models

Well-log interpretation estimates in situ rock properties along well trajectory, such as porosity, water saturation, and permeability, to support reserve-volume estimation, production forecasts, and decision making in reservoir development. However, due to measurement errors, variability of well logs caused by multiple measurement vendors, different borehole tools, and nonuniform drilling/borehole conditions, estimations of rock properties with original well logs without proper preprocessing may not be accurate, especially in the context of multiwell estimation. Well-log normalization techniques such as two-point scaling and mean-variance normalization are commonly used to improve the robustness of multiwell rock-property estimation. However, these techniques do not consider the correlation between well logs and require subjective knowledge for their effective implementation. To reduce uncertainties and processing time associated with multiwell rock-property estimation from well logs, we develop discriminative adversarial (DA) and linear constraint models for well-log normalization and rock-property estimation. The DA neural network model developed for well-log normalization and interpretation can perform linear and nonlinear well-log normalization while considering the joint distribution of each well log and rock properties. However, the linear constraint model uses an ensemble of predictions from linear models to constrain well-log normalization and rock-property estimation. We also develop a divergence-based type well identification method to select type (training) wells for a test well based on the statistical similarity of associated well-log distributions instead of the interwell distance. We apply the DA model to perform well-log normalization and prediction of permeability for the Seminole San Andres Unit carbonate reservoir. Compared with the permeability predicted with the classical machine learning model without well-log normalization and models with two-point scaling normalization, the DA model yields the most accurate permeability prediction by decreasing the mean-squared error of permeability prediction by 20%–50%.

Geochemistry & Geophysics↗
DOE OSTI2025

Disturbance and Response Model (DRM)

The DRM is a framework to interpret ecosystem process model output for 3D fire behavior model input and interpret the 3D fire behavior model output for ecosystem process model inpu

Atchley, Adam↗
DOE OSTI2025

Explaining word embeddings with perfect fidelity: a case study in predicting research impact

The best-performing approaches for scholarly document quality prediction are based on embedding models. In addition to their performance when used in classifiers, embedding models can also provide predictions even for words that were not contained in the labelled training data for the classification model, which is important in the context of the ever-evolving research terminology. Although model-agnostic explanation methods, such as Local interpretable model-agnostic explanations, can be applied to explain machine learning classifiers trained on embedding models, these produce results with questionable correspondence to the model. We introduce a new feature importance method, Self-Model Entities Rated (SMER), for logistic regression-based classification models trained on word embeddings. We show that SMER has theoretically perfect fidelity with the explained model, as the average of logits of SMER scores for individual words (SMER explanation) exactly corresponds to the logit of the prediction of the explained model. Quantitative and qualitative evaluation is performed through five diverse experiments conducted on 50,000 research articles (papers) from the CORD-19 corpus. In conclusion, through an AOPC curve analysis, we experimentally demonstrate that SMER produces better explanations than LIME, SHAP and global tree surrogates.

Coarse-grained models↗
DOE OSTI2024

Symbolic diagnostics to interpret and analyze neural network models

Embedded machine-learned models (EMLMs) have the promise to improve the predictive accuracy of engineering simulators in environments of national interest. EMLMs often comprise complex input-output maps (e.g., neural networks), which make them unamenable to rigorous analysis and generally difficult to interpret. In the face of decades of theory, this lack of interpretability is a significant barrier to building confidence in these models. This work outlines an approach to interpret EMLMs using sparse polynomial regression for comparison with theoretical understanding. To do so, we build on the concept of Locally Interpretable Model-agnostic Explanations (LIME) using physics-informed clustering, prototype selection, and library construction. While general, we demonstrate our method on tensor-basis neural networks used in Reynolds-Averaged Navier-Stokes simulations of hypersonic fluid flows. Results are presented for a simulated toy model and for direct numerical simulations (DNS) of turbulent flows over a flat plate.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Temperature dependence of nitrate-reducing Fe(II) oxidation by Acidovorax strain BoFeN1 – evaluating the role of enzymatic vs. abiotic Fe(II) oxidation by nitrite

ABSTRACT Fe(II) oxidation coupled to nitrate reduction is a widely observed metabolism. However, to what extent the observed Fe(II) oxidation is driven enzymatically or abiotically by metabolically produced nitrite remains puzzling. To distinguish between biotic and abiotic reactions, we cultivated the mixotrophic nitrate-reducing Fe(II)-oxidizing Acidovorax strain BoFeN1 over a wide range of temperatures and compared it to abiotic Fe(II) oxidation by nitrite at temperatures up to 60°C. The collected experimental data were subsequently analyzed through biogeochemical modeling. At 5°C, BoFeN1 cultures consumed acetate and reduced nitrate but did not significantly oxidize Fe(II). Abiotic Fe(II) oxidation by nitrite at different temperatures showed an Arrhenius-type behavior with an activation energy of 80±7 kJ/mol. Above 40°C, the kinetics of Fe(II) oxidation were abiotically driven, whereas at 30°C, where BoFeN1 can actively metabolize, the model-based interpretation strongly suggested that an enzymatic pathway was responsible for a large fraction (ca. 62%) of the oxidation. This result was reproduced even when no additional carbon source was present. Our results show that at below 30°C, i.e. at temperatures representing most natural environments, biological Fe(II) oxidation was largely responsible for overall Fe(II) oxidation, while abiotic Fe(II) oxidation by nitrite played a less important role.

Microbiology↗
DOE OSTI2024

Theory and modeling of molecular modes in the NMR relaxation of fluids

Traditional theories of the nuclear magnetic resonance (NMR) autocorrelation function for intra-molecular dipole pairs assume a single-exponential decay, yet the calculated autocorrelation of realistic systems displays a rich, multi-exponential behavior, resulting in anomalous NMR relaxation dispersion (i.e., frequency dependence). We develop an approach to model and interpret the multi-exponential intra-molecular autocorrelation using simple, physical models within a rigorous statistical mechanical development that encompasses both rotational diffusion and translational diffusion in the same framework. Here, we recast the problem of evaluating the autocorrelation in terms of averaging over a diffusion propagator whose evolution is described by a Fokker–Planck equation. The time-independent part admits an eigenfunction expansion, allowing us to write the propagator as a sum over modes. Each mode has a spatial part that depends on the specified eigenfunction and a temporal part that depends on the corresponding eigenvalue (i.e., correlation time) with a simple, exponential decay. The spatial part is a probability distribution of the dipole pair, analogous to the stationary states of a quantum harmonic oscillator. Drawing inspiration from the idea of inherent structures in liquids, we interpret each of the spatial contributions as a specific molecular mode. These modes can be used to model and predict the NMR dipole–dipole relaxation dispersion of fluids by incorporating phenomena on the molecular level. We validate our statistical mechanical description of the distribution in molecular modes with molecular dynamics simulations interpreted without any relaxation models or adjustable parameters: the most important poles in the Padé–Laplace transform of the simulated autocorrelation agree with the eigenvalues predicted by the theory

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Explaining System-Level Prognostics with Established Machine Learning Methods

System-level prognostics is crucial for ensuring reliability and enabling predictive maintenance in complex systems with interconnected components. This study presents a framework that integrates data-driven methods to predict the remaining useful life (RUL) of a subsystem under multiple and concurrent faults within a nuclear power plant system with explainable artificial intelligence (XAI). A nuclear power plant (NPP) operation was simulated to model the degradation behavior of NPP components, and four machine learning models—Gradient Boosting Regressor (GBR), Support Vector Regressor (SVR), Fully Connected Neural Network (FCNN), and Long Short-Term Memory (LSTM)—were evaluated for prognostics with a novel system RUL parameter. The LSTM model demonstrated potential superior repeatability, while SHAP (SHapley Additive exPlanations) for explainability provided consistent and trustworthy global explanations. In contrast, LIME (Local Interpretable Model-agnostic Explanations) offered localized interpretability but showed reduced stability for sequential data. Key findings include the interplay between component-level degradation and system-wide performance, with LSTM effectively capturing these dynamics through sequence-level predictions. The XAI techniques enhanced transparency by identifying critical features influencing model predictions and aligning with domain knowledge. Furthermore, this framework has significant implications for improving trust and understanding in predictive maintenance, particularly in safety-critical industries like nuclear energy.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Interpretable, Extensible Linear Regression Model for Electron Density Prediction

This code allows us to generate a model to predict ground state electron densities directly from atomic structure thereby bypassing the need to perform direct DFT calculations. It is based on many body correlation descriptors defined in https://arxiv.org/abs/2004.14442 (IM release numbers: LLNL-JRNL- 808791 and LLNL-JRNL-840698). The code reads in electron densities, in CHGCAR format used by the DFT code VASP, calculates many-body correlation descriptors based on atoms surrounding a grid point and then uses linear regression to obtain the fitting parameters.

Kumar, Shashikant↗
DOE OSTI2024

When ancient numerical demons meet physics-informed machine learning: adjoint-based gradients for implicit differentiable modeling

Recent advances in differentiable modeling, a genre of physics-informed machine learning that trains neural networks (NNs) together with process-based equations, have shown promise in enhancing hydrological models' accuracy, interpretability, and knowledge-discovery potential. Current differentiable models are efficient for NN-based parameter regionalization, but the simple explicit numerical schemes paired with sequential calculations (operator splitting) can incur numerical errors whose impacts on models' representation power and learned parameters are not clear. Implicit schemes, however, cannot rely on automatic differentiation to calculate gradients due to potential issues of gradient vanishing and memory demand. Here we propose a “discretize-then-optimize” adjoint method to enable differentiable implicit numerical schemes for the first time for large-scale hydrological modeling. The adjoint model demonstrates comprehensively improved performance, with Kling–Gupta efficiency coefficients, peak-flow and low-flow metrics, and evapotranspiration that moderately surpass the already-competitive explicit model. Therefore, the previous sequential-calculation approach had a detrimental impact on the model's ability to represent hydrological dynamics. Furthermore, with a structural update that describes capillary rise, the adjoint model can better describe baseflow in arid regions and also produce low flows that outperform even pure machine learning methods such as long short-term memory networks. The adjoint model rectified some parameter distortions but did not alter spatial parameter distributions, demonstrating the robustness of regionalized parameterization. Despite higher computational expenses and modest improvements, the adjoint model's success removes the barrier for complex implicit schemes to enrich differentiable modeling in hydrology.

58 GEOSCIENCES↗
DOE OSTI2026

A Data-Driven Method for Modeling Creep-Fatigue Stress- Strain Behavior Using Neural ODEs

In this paper, we introduce a data-driven machine learning approach for modeling one-dimensional stress–strain behavior under cyclic loading, utilizing experimental data from the nickel-based Alloy 617. The study employs uniaxial creep–fatigue test data acquired under various loading histories and compares two distinct neural network-based ODE models. The first model, known as the black-box model, comprehensively describes the strain–stress relationship using a Neural ODE equation. To interpret this black-box model, we apply the Sparse Identification of Nonlinear Dynamical Systems (SINDy) technique, transforming the black-box model into an equation-based model using symbolic regression. The second model, the Neural flow rule model, incorporates Hooke’s Law for the linear elastic component, with the nonlinear part characterized by a Neural ODE. Both models are trained with experimental data to accurately reflect the observed stress–strain behavior. We conduct a detailed comparison with the standard Chaboche model, which includes three back stresses. Our results demonstrate that the neural network-based ODE models precisely capture the experimental creep–fatigue mechanical behavior, exceeding the standard Chaboche model’s accuracy. Furthermore, an interpretable model derived from the black-box neural ODE model through symbolic regression achieves accuracy comparable to the Chaboche model, enhancing its interpretability. The results highlight the potential of neural network-based ODE models to depict complex creep–fatigue behavior, eliminating the necessity for experts to define a specific, material-focused model form.

creep-fatigue↗
DOE OSTI2021

The interpretation of temperature and salinity variables in numerical ocean model output and the calculation of heat fluxes and heat content

Abstract. The international Thermodynamic Equation of Seawater 2010 (TEOS-10) defined the enthalpy and entropy of seawater, thus enabling the global ocean heat content to be calculated as the volume integral of the product of in situ density, ρ, and potential enthalpy, h0 (with reference sea pressure of 0 dbar). In terms of Conservative Temperature, Θ, ocean heat content is the volume integral of ρcp0Θ, where cp0 is a constant “isobaric heat capacity”. However, many ocean models in the Coupled Model Intercomparison Project Phase 6 (CMIP6) as well as all models that contributed to earlier phases, such as CMIP5, CMIP3, CMIP2, and CMIP1, used EOS-80 (Equation of State – 1980) rather than the updated TEOS-10, so the question arises of how the salinity and temperature variables in these models should be physically interpreted, with a particular focus on comparison to TEOS-10-compliant observations. In this article we address how heat content, surface heat fluxes, and the meridional heat transport are best calculated using output from these models and how these quantities should be compared with those calculated from corresponding observations. We conclude that even though a model uses the EOS-80, which expects potential temperature as its input temperature, the most appropriate interpretation of the model's temperature variable is actually Conservative Temperature. This perhaps unexpected interpretation is needed to ensure that the air–sea heat flux that leaves and arrives in atmosphere and sea ice models is the same as that which arrives in and leaves the ocean model. We also show that the salinity variable carried by present TEOS-10-based models is Preformed Salinity, while the salinity variable of EOS-80-based models is also proportional to Preformed Salinity. These interpretations of the salinity and temperature variables in ocean models are an update on the comprehensive Griffies et al. (2016) paper that discusses the interpretation of many aspects of coupled Earth system models.

54 ENVIRONMENTAL SCIENCES↗