Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “explainability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Machine Learning Explainability and Transferability for Path Navigation

Deep neural networks are powerful tools for machine perception. Unfortunately their decisions are difficult to explain due to the complexity and size of the networks. Previously we have alleviated this issue by using the representational portion of a deep neural network and combining it with a k-nearest neighbor (KNN) classifier. Through inspection of the decisions made by the KNN, we can directly see the training data responsible for the decisions, allowing us to determine the quality of the overall decision and the quality of the representational layer of the deep NN. While the technique worked well, it requires tens of thousands of latent vectors to be stored for classification. In addition, it lacks the ability to show how parts of an image influence the classification decision. Here we address these issues by 1) Using a radial basis function network (RBFN) in place of the KNN allowing far fewer images to be used in deployment and 2) Using an auto encoder network for explainability. In addition to these techniques, we examine the effects of transfer learning to determine that results are robust. All results are tested on a domain where an unmanned aerial vehicle (UAV) navigates a forest trail through a single camera.

explainable machine learning↗
NASA NTRSDate not supplied

Explaining Soft-Goal Conflicts through Constraint Relaxations

Recent work suggests to explain trade-offs between soft goals in terms of their conflicts, i. e., minimal unsolvable soft-goal subsets. But this does not explain the conflicts themselves: Why can a given set of soft-goals not be jointly achieved? Here we approach that question in terms of the underlying constraints on plans in the task at hand, namely resource availability and time windows. In this context, a natural form of explanation for a soft-goal conflict is a minimal constraint relaxation under which the conflict disappears (“if the deadline was 1 hour later, it would work”). We explore algorithms for computing such explanations. A baseline is to simply loop over all relaxed tasks and compute the conflicts for each separately. We improve over this by two algorithms that leverage information – conflicts, reachable states – across relaxed tasks. We show that these algorithms can exponentially outperform the baseline in theory, and we run experiments confirming that advantage in practice.

Planning↗
DOE OSTI2025

Role of Uncertainty Quantification in the Explainability of Large Language Models for the Nuclear Industry

The meteoric rise of generative artificial intelligence (AI) large language models (LLMs) has created an opportunity to utilize them to increase efficiencies in a multitude of industries. While LLMs carry great potential to revolutionize the manner in which work is performed, numerous known deficiencies limit their utility, including the black box nature of the models, the stochastic nature of the response (i.e., presenting the same prompt multiple times results in different responses), and the potential for hallucination. Widespread adoption of LLMs in safety-critical industries such as nuclear will require some form of explainability to assure end users that the LLM’s response to a given query is valid. Model uncertainty is inherently linked to the concepts of trust and explainability, and can be used to identify situations in which the model is insufficiently certain about its answer. Although uncertainty is not enough in and of itself to determine the suitability of an answer—a model can be very certain of an inaccurate answer—it still provides valuable supporting information. Practical methodologies for gauging or quantifying the uncertainty in LLM outputs are presented herein, along with examples based on nuclear-specific prompts.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2016

Root traits explain observed tundra vegetation nitrogen uptake patterns: Implications for trait-based land models: Tundra N Uptake Model-Data Comparison

Ongoing climate warming will likely perturb vertical distributions of nitrogen availability in tundra soils through enhancing nitrogen mineralization and releasing previously inaccessible nitrogen from frozen permafrost soil. But, arctic tundra responses to such changes are uncertain, because of a lack of vertically explicit nitrogen tracer experiments and untested hypotheses of root nitrogen uptake under the stress of microbial competition implemented in land models. We conducted a vertically explicit 15N tracer experiment for three dominant tundra species to quantify plant N uptake profiles. Then we applied a nutrient competition model (N-COM), which is being integrated into the ACME Land Model, to explain the observations. Observations using an 15 N tracer showed that plant N uptake profiles were not consistently related to root biomass density profiles, which challenges the prevailing hypothesis that root density always exerts first-order control on N uptake. By considering essential root traits (e.g., biomass distribution and nutrient uptake kinetics) with an appropriate plant-microbe nutrient competition framework, our model reasonably reproduced the observed patterns of plant N uptake. Additionally, we show that previously applied nutrient competition hypotheses in Earth System Land Models fail to explain the diverse plant N uptake profiles we observed. These results cast doubt on current climate-scale model predictions of arctic plant responses to elevated nitrogen supply under a changing climate and highlight the importance of considering essential root traits in large-scale land models. Finally, we provided suggestions and a short synthesis of data availability for future trait-based land model development.

15N tracer↗
DOE OSTI2016

Revisiting streamside trees that do not use stream water: can the two water worlds hypothesis and snowpack isotopic effects explain a missing water source?: Riparian tree water sources

We revisit a classic ecohydrological study that showed streamside riparian trees in a semiarid mountain catchment did not use perennial stream water. The original study suggested that mature individuals of Acer negundo, Acer grandidentatum, and other species were dependent on water from “deeper strata,” possibly groundwater. We used a dual stable isotope approach (δ 18 O and δ 2 H) to further examine the water sources of these trees. We tested the hypothesis that groundwater was the main tree water source, but found that neither groundwater nor stream water matched the isotope composition of xylem water during two growing seasons. Soil water (0–1 m depth) was closest to and periodically overlapped with xylem water isotope composition, but overall, xylem water was isotopically enriched compared to all measured water sources. The “two water worlds” hypothesis postulates that soil water comprises isotopically distinct mobile and less mobile pools that do not mix, potentially explaining this disparity. We further hypothesized that isotopic effects during snowpack metamorphosis impart a distinct isotope signature to the less mobile soil water that supplies summer transpiration. Depth trends in water isotopes following snowmelt were consistent with the two water worlds hypothesis, but snow metamorphic isotope effects could not explain the highly enriched xylem water. Thus, the dual isotope approach did not unambiguously determine the water source(s) of these riparian trees. Further exploration of physical, geochemical, and biological mechanisms of water isotope fractionation and partitioning is necessary to resolve these data, highlighting critical challenges in the isotopic determination of plant water sources.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

The channel-source hypothesis: Empirical evidence for in-channel sourcing of dissolved organic carbon to explain hysteresis in a headwater mountain stream

Catchment hydrologists have long puzzled over the question: How can catchments rapidly generate storm flows and pulses of solutes in response to storm events? Conceptual models viewing catchments as composed of discrete source areas generating flow at unique time scales and with unique chemical characteristics have been used to explain the observed changes in flow and water chemistry. Surprisingly, those conceptual models usually do not treat the stream channel as one of the potential source areas. We propose the channel-source hypothesis in which the stream itself should be considered as a potential source with the same rigour as other contributing areas. We pose this in the spirit of the scientific use of the word: a hypothesis is not a proven idea but rather a provisional supposition serving as the basis for further study. We suggest that the channel should be considered as a potential source for dissolved organic carbon (DOC). Channels store substantial amounts of organic matter, and stream ecologists have long studied stream carbon cycling. From those studies, we know that leaching and decomposition can generate DOC from particulate organic carbon (POC). Further, POC is stored in channel ‘dead-zones’—regions of low flow velocity - that can be activated as flow velocity increases, thus releasing accumulated DOC during storms. All catchments are different; there is no reason to assume that channel sources are always important, in every catchment, in every storm. Thus, the channel-source hypothesis does not replace existing conceptual models. Instead, it adds another potential mechanism that may explain DOC dynamics observed in streams. The channel-source hypothesis has substantial implications for catchment studies examining sources of DOC in stream water or using DOC as a tracer to determine the locations of, and proportional contributions of, different source areas for streamflow generation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Combination of deep neural network with attention mechanism enhances the explainability of protein contact prediction

Abstract Deep learning has emerged as a revolutionary technology for protein residue‐residue contact prediction since the 2012 CASP10 competition. Considerable advancements in the predictive power of the deep learning‐based contact predictions have been achieved since then. However, little effort has been put into interpreting the black‐box deep learning methods. Algorithms that can interpret the relationship between predicted contact maps and the internal mechanism of the deep learning architectures are needed to explore the essential components of contact inference and improve their explainability. In this study, we present an attention‐based convolutional neural network for protein contact prediction, which consists of two attention mechanism‐based modules: sequence attention and regional attention. Our benchmark results on the CASP13 free‐modeling targets demonstrate that the two attention modules added on top of existing typical deep learning models exhibit a complementary effect that contributes to prediction improvements. More importantly, the inclusion of the attention mechanism provides interpretable patterns that contain useful insights into the key fold‐determining residues in proteins. We expect the attention‐based model can provide a reliable and practically interpretable technique that helps break the current bottlenecks in explaining deep neural networks for contact prediction. The source code of our method is available at https://github.com/jianlin-cheng/InterpretContactMap .

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

Reducing conditions, reactive metals, and their interactions can explain spatial patterns of surface soil carbon in a humid tropical forest

Humid tropical forests support large stocks of surface soil carbon (C) that exhibit high spatial variability over scales of meters to landscapes (km). Reactive minerals and organo-metal complexes are known to contribute to C accumulation in these ecosystems, although potential interactions with environmental factors such as oxygen (O 2 ) availability have received much less attention. Reducing conditions can potentially contribute to C accumulation, yet anaerobic metabolic processes such as iron (Fe) reduction can also drive substantial C losses. We tested whether these factors could explain variation in soil C (0–10 and 10–20 cm depths) over multiple spatial scales in the Luquillo Experimental Forest, Puerto Rico, using reduced iron (Fe(II)) concentrations as an index of reducing conditions across sites differing in vegetation, topographic position, and/or climate. Fine root biomass and Fe(II) were the best overall correlates of site (n = 6) mean C concentrations and stocks from 0 to 20 cm depth (r = 0.99 and 0.98, respectively). Litterfall decreased as reducing conditions, total and dead fine root biomass, and soil C increased among sites, suggesting that decomposition rates rather than C inputs regulated soil C content at the landscape scale. Strong relationships between Fe(II) and dead fine root biomass suggest that reducing conditions suppressed particulate organic matter decomposition. The optimal mixed-effects regression model for individual soil samples (n = 149) showed that aluminum (Al) and Fe in citrate/ascorbate and oxalate extractions, Fe(II), fine root biomass, and interactions between Fe(II) and Al explained most of the variation in C concentrations (pseudo R 2 = 0.82). The optimal model of C stocks was similar but did not include fine root biomass (pseudo R 2 = 0.62). In these models, soil C concentrations and stocks increased with citrate/ascorbate-extractable Al and oxalate-extractable Fe. However, soil C decreased with citrate/ascorbate-extractable Fe, an index of Fe susceptible to anaerobic microbial reduction. At the site scale (n = 6), ratios of citrate/ascorbate to oxalate-extractable Fe consistently decreased across a landscape O 2 gradient as C increased. Finally, we suggest that the impact of reducing conditions on organic matter decomposition and the presence of organo-metal complexes and C sorption by short-range order Fe and Al contribute to C accumulation, whereas the availability of an Fe pool to sustain anaerobic respiration in soil microsites partially attenuates soil C accumulation in these ecosystems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Supercooled phase transitions in conformal dark sectors explain NANOGrav data

According to recent lore, it is difficult to explain the evidence for a stochastic gravitational wave background obtained by pulsar timing arrays with supercooled first-order phase transitions (FOPTs). We demonstrate that supercooled FOPTs in dark U(1) models with a conformal dark sector easily explain the nHz signal at NANOGrav.

Conformal models↗
DOE OSTI2020

Synoptic Meteorology Explains Temperate Forest Carbon Uptake

Abstract While substantial attention has been paid to the effects of both global climate oscillations and local meteorological conditions on the interannual variability of ecosystem carbon exchange, the relationship between the interannual variability of synoptic meteorology and ecosystem carbon exchange has not been well studied. Here we use a clustering algorithm to identify a summertime cyclonic precipitation system northwest of the Great Lakes to determine (a) the association at a daily scale between the occurrence of this system and the local meteorology and net ecosystem exchange at three Great Lakes region forested eddy covariance sites and (b) the association between the seasonal prevalence of this system and the summertime net ecosystem exchange of these sites. We find that temperature, in addition to precipitation and cloud cover, is an important explanatory factor for the suppression of net ecosystem productivity that occurs during these cyclonic events in this region. In addition, the prevalence of this cyclonic system can explain a significant proportion of the interannual variability in summertime forest ecosystem exchange in this region. This explanatory power is not due to a simple accumulation of low‐productivity days that cooccur with this meteorological event, but rather a broader association between the frequency of these events and several aspects of prevailing seasonal conditions. This work demonstrates the usefulness of conceptualizing meteorology in terms of synoptic systems for explaining the interannual variability of regional carbon fluxes.

Randazzo, Nina A.↗
DOE OSTI2022

Using an Explainable Machine Learning Approach to Characterize Earth System Model Errors: Application of SHAP Analysis to Modeling Lightning Flash Occurrence

Abstract Computational models of the Earth System are critical tools for modern scientific inquiry. Efforts toward evaluating and improving errors in representations of physical and chemical processes in these large computational systems are commonly stymied by highly nonlinear and complex error behavior. Recent work has shown that these errors can be effectively predicted using modern Artificial Intelligence (A.I.) techniques. In this work, we go beyond these previous studies to apply an explainable A.I. technique to not only predict model errors but also move toward understanding the underlying reasons for successful error prediction. We use XGBoost classification trees and SHapley Additive exPlanations analysis to explore the errors in the prediction of lightning occurrence in the NASA Goddard Earth Observing System model, a widely used Earth System Model. This explainable error prediction system can effectively predict the model error and indicates that the errors are strongly related to convective processes and the characteristics of the land surface.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Detection of Forced Change Within Combined Climate Fields Using Explainable Neural Networks

Abstract Assessing forced climate change requires the extraction of the forced signal from the background of climate noise. Traditionally, tools for extracting forced climate change signals have focused on one atmospheric variable at a time, however, using multiple variables can reduce noise and allow for easier detection of the forced response. Following previous work, we train artificial neural networks to predict the year of single‐ and multi‐variable maps from forced climate model simulations. To perform this task, the neural networks learn patterns that allow them to discriminate between maps from different years—that is, the neural networks learn the patterns of the forced signal amidst the shroud of internal variability and climate model disagreement. When presented with combined input fields (multiple seasons, variables, or both), the neural networks are able to detect the signal of forced change earlier than when given single fields alone by utilizing complex, nonlinear relationships between multiple variables and seasons. We use layer‐wise relevance propagation, a neural network explainability tool, to identify the multivariate patterns learned by the neural networks that serve as reliable indicators of the forced response. These “indicator patterns” vary in time and between climate models, providing a template for investigating inter‐model differences in the time evolution of the forced response. This work demonstrates how neural networks and their explainability tools can be harnessed to identify patterns of the forced signal within combined fields.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Climate variation explains a third of global crop yield variability

Many studies have examined the role of mean climate change in agriculture, but an understanding of the influence of inter-annual climate variations on crop yields in different regions remains elusive. We use detailed crop statistics time series for B13,500 political units to examine how recent climate variability led to variations in maize, rice, wheat and soybean crop yields worldwide. While some areas show no significant influence of climate variability, in substantial areas of the global breadbaskets, 460% of the yield variability can be explained by climate variability. Globally, climate variability accounts for roughly a third (B32–39%) of the observed yield variability. Our study uniquely illustrates spatial patterns in the relationship between climate variability and crop yield variability, highlighting where variations in temperature, precipitation or their interaction explain yield variability. We discuss key drivers for the observed variations to target further research and policy interventions geared towards buffering future crop production from climate variability

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Reliable and explainable machine-learning methods for accelerated material discovery

Abstract Despite ML’s impressive performance in commercial applications, several unique challenges exist when applying ML in materials science applications. In such a context, the contributions of this work are twofold. First, we identify common pitfalls of existing ML techniques when learning from underrepresented/imbalanced material data. Specifically, we show that with imbalanced data, standard methods for assessing quality of ML models break down and lead to misleading conclusions. Furthermore, we find that the model’s own confidence score cannot be trusted and model introspection methods (using simpler models) do not help as they result in loss of predictive performance (reliability-explainability trade-off). Second, to overcome these challenges, we propose a general-purpose explainable and reliable machine-learning framework. Specifically, we propose a generic pipeline that employs an ensemble of simpler models to reliably predict material properties. We also propose a transfer learning technique and show that the performance loss due to models’ simplicity can be overcome by exploiting correlations among different material properties. A new evaluation metric and a trust score to better quantify the confidence in the predictions are also proposed. To improve the interpretability, we add a rationale generator component to our framework which provides both model-level and decision-level explanations. Finally, we demonstrate the versatility of our technique on two applications: (1) predicting properties of crystalline compounds and (2) identifying potentially stable solar cell materials. We also point to some outstanding issues yet to be resolved for a successful application of ML in material science.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Training calibration-based counterfactual explainers for deep learning models in medical image analysis

The rapid adoption of artificial intelligence methods in healthcare is coupled with the critical need for techniques to rigorously introspect models and thereby ensure that they behave reliably. This has led to the design of explainable AI techniques that uncover the relationships between discernible data signatures and model predictions. In this context, counterfactual explanations that synthesize small, interpretable changes to a given query while producing desired changes in model predictions have become popular. This under-constrained, inverse problem is vulnerable to introducing irrelevant feature manipulations, particularly when the model’s predictions are not well-calibrated. Hence, in this paper, we propose the TraCE (training calibration-based explainers) technique, which utilizes a novel uncertainty-based interval calibration strategy for reliably synthesizing counterfactuals. Given the wide-spread adoption of machine-learned solutions in radiology, our study focuses on deep models used for identifying anomalies in chest X-ray images. Using rigorous empirical studies, we demonstrate the superiority of TraCE explanations over several state-of-the-art baseline approaches, in terms of several widely adopted evaluation metrics. Our findings show that TraCE can be used to obtain a holistic understanding of deep models by enabling progressive exploration of decision boundaries, to detect shortcuts, and to infer relationships between patient attributes and disease severity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2026

Explainable machine learning for incipient anomaly detection in compact molten salt heat exchanger with overlapping feature distributions

High-temperature molten salt-cooled reactors (MSCRs) are a promising next-generation nuclear technology option, offering efficient power conversion and inherent safety features. However, the reliability of these systems depends on the robust operation of heat exchangers (HXs), which are susceptible to failure due to temperature gradients and channel plugging caused by fluid freezing. Conventional monitoring methods, relying on inlet and outlet measurements, lack the spatial resolution needed to detect early-stage faults. We propose a novel design of a compact salt-to-salt matrix-type HX design consisting of interleaved arrays of parallel tubes, with integrated synthetic fiber optic distributed temperature sensing (DTS) to enable localized detection of incipient faults. To evaluate performance of this design, we generate high-fidelity synthetic data using heat transfer computational modeling to simulate channel plugging, and introduce sensor noise for realistic modeling of measurements. The dataset comprises of 97% normal operation and 3% anomaly cases, with each anomaly class representing 1% of the data. These early anomalies result in overlapping temperature profiles between normal and faulty channels, producing a non-separable dataset that challenges traditional classification techniques. We benchmark eight supervised machine learning (ML) models and demonstrate that XGBoost achieves the highest performance. To improve transparency, we develop an explainability framework combining Shapley values and partially ordered sets (POSETs) to quantify and structurally analyze feature importance. This approach identifies both dominant predictors and ambiguous feature relationships, enhancing trust and interpretability. Our results highlight the potential of combining DTS and explainable ML with intelligent feature selection to improve predictive maintenance and ensure operational resilience in advanced nuclear systems.

Prantikos, Konstantinos [Argonne National Laborato↗
DOE OSTI2026

Explainable tokamak-agnostic forecasting of fusion plasma instability via megahertz turbulent fluctuations

Scientific applications of artificial intelligence (AI) often remain limited by device-specific training and unexplained “black-box” approaches, creating fundamental barriers to cross-system generalization. This challenge is critical for nuclear fusion, where future reactors will have limited operational data for AI training. Here, we demonstrate that our neural network, trained solely on megahertz-scale turbulence measurements from one machine (DIII-D), forecasts Type-I edge localized mode (ELM) onsets in a different tokamak (KSTAR) through zero-shot weight transfer following physics-consistent preprocessing without device-specific retraining. Through an explainable AI framework combining gradient-weighted class activation mapping with physics validation, we reveal that our network can internalize physics relationships governing the ELM instabilities rather than memorizing device-specific patterns. The network perceives spatiotemporal features that correlate consistently with independently calculated instability growth rates, magnetohydrodynamic stability limits, and pedestal structure dynamics. Statistical analyses of dimensionally-reduced saliency features reveal the identical triangular features between the saliency representations, instability growth rates, and prediction probability across tokamaks, providing evidence that our forecasting system can show tokamak-agnostic generalization. This work contributes to a foundation for explainable scientific AI systems, where cross-system developments are essential for transcending traditional domain-specific constraints.

AI↗
DOE OSTI2015

Time delay and noise explaining the behaviour of the cell growth in fermentation process

This paper proposes to investigate the interplay between time delay and external noise in explaining the behaviour of the microbial growth in batch fermentation process. Time delay and noise are modelled jointly via stochastic delay differential equations (SDDEs). The typical behaviour of cell concentration in batch fermentation process under this model is investigated. Milstein scheme is applied for solving this model numerically. Simulation results illustrate the effects of time delay and external noise in explaining the lag and stationary phases, respectively for the cell growth of fermentation process.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗