Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Explainable machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

AI-Based Integrated Modeling and Observational Framework for Improving Seasonal to Decadal Prediction of Terrestrial Ecohydrological Extremes

Focal Areas: (1) Insight gleaned from complex data (both observed and simulated) using artificial intelligence(AI), big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI (2) Data acquisition and assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization, unsupervised learning (including deep learning), and hardware-related efforts involving AI (e.g., edge computing).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Elucidating and predicting the dynamic evolution of water and land systems due to natural and energy-related forcings

Focal Area(s): 3. Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI; & 1. Data acquisition and assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization, unsupervised learning (including deep learning), and hardware-related efforts involving AI (e.g., edge computing). Science Challenge: Interactions between water, land, and energy systems are complex and occur on a variety of scales, ranging from local to basinal to regional. Accurately predicting the behavior of ground water and surface water systems for 5-10 years and beyond requires an understanding of the current system and the ability to model both the natural system at scale and human-induced forcings related to energy and other activities. Artificial intelligence and machine learning (AI/ML) combined with modern compilation and integration efforts for U.S. groundwater and surface water systems present potential solutions to bolstering detailed physics-based models of these systems. Big data tied with ML and physics-based modeling can drive breakthroughs in understanding the earth system, but research is often impeded by data access (e.g., privacy issues), quality, formats, gaps, multi-source, multi-scale, integration, and spatiotemporal challenges. Effective integration of real data and simulated (synthetic) data that fill gaps is critical. Overcoming these complex data and model integration challenges will enable a transformational approach to acquiring enhanced understanding of environmental systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Charge-density based evaluation and prediction of stacking fault energies in Ni alloys from DFT and machine learning

A combination of high strength and high ductility has been observed in multi-principal element alloys due to twin formation attributed to low stacking fault energy (SFE). In the pursuit of low SFE alloys, a key bottleneck is the lack of understanding of the composition–SFE correlations that would guide tailoring SFE via alloy composition. Using density functional theory (DFT), we show that dopant radius, which have been postulated as a key descriptor for SFE in dilute alloys, does not fully explain SFE trends across different host metals. Instead, charge density is a much more central descriptor. It allows us to (1) explain contrasting SFE trends in Ni and Cu host metals due to various dopants in dilute concentrations, (2) explain the large SFE variations observed in the literature even within a given alloy composition due to the nearest neighbor environments in “model” concentrated alloys, and (3) develop a machine learning model that can be used to predict SFEs in multi-elemental alloys. Further, this model opens a possibility to use charge density as a descriptor for predicting SFE in alloys.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Investigating explainable transfer learning for battery lifetime prediction under state transitions

Battery lifetime prediction at early cycles is crucial for researchers and manufacturers to examine product quality and promote technology development. Machine learning has been widely utilized to construct data-driven solutions for high-accuracy predictions. However, the internal mechanisms of batteries are sensitive to many factors, such as charging/discharging protocols, manufacturing/storage conditions, and usage patterns. These factors will induce state transitions, thereby decreasing the prediction accuracy of data-driven approaches. Transfer learning is a promising technique that overcomes this difficulty and achieves accurate predictions by jointly utilizing information from various sources. Hence, we develop two transfer learning methods, Bayesian Model Fusion and Weighted Orthogonal Matching Pursuit, to strategically combine prior knowledge with limited information from the target dataset to achieve superior prediction performance. From our results, our transfer learning methods reduce root-mean-squared error by 41% through adapting to the target domain. Furthermore, the transfer learning strategies identify the variations of impactful features across different sets of batteries and therefore disentangle the battery degradation mechanisms and the root cause of state transitions from the perspective of data mining. These findings suggest that the transfer learning strategies proposed in our work are capable of acquiring knowledge across multiple data sources for solving specialized issues.

25 ENERGY STORAGE↗
DOE OSTI2025

Multi-scale, Multi-disciplinary, and Multi-agent Explainable AI with Koopman-Undergirded Learning, Prediction, and Analysis (M3EA KULPA) (Project Closeout Report)

The goal of this project was to develop and use domain-aware machine learning formulations, based on the Koopman Operator (KO), for modelling multi-scale, multi-disciplinary (e.g., multi-physics), and/or multi-agent systems. The project developed these formulations for the following cases: • Systems with dynamics at two separate time scales, • Systems with a bi-level hierarchical control structure, • Systems with bi-level hierarchical control and dynamics at two separate time scales (the lower level controls operating at the faster time scale), and • Systems with n separate but interacting agents/disciplines (with/without control, respectively); the controls for each agent could include bi-level hierarchical control and dynamics at two separate time scales as described above. The project then defined a set of dynamical systems consisting of different nonlinear oscillators that could be used to test these different formulations and then subsequently learned the KO models for those systems. With the KO models, we were able to do the following: • Quantify system stability, including both long-term and transient behavior, • Quantify the effects of feedbacks between the different time scales and agents/disciplines in terms of those feedbacks’ effects on system stability, • Replace a standard Proportional-Integral (PI) control in the hierarchical control structure with a KO-based Linear-Quadratic Regular (LQR), a form of optimal control, • Calculate optimal supervisory control policies a) with and without time scale separated dynamics at the lower level control levels and b) with both PI and KO-based LQR lower level control policies, and • Calculate dynamic Nash equilibria for multi-agent systems where each agent makes its own control decisions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Explainable AI for a No-Teardown Vehicle Component Cost Estimation: A Top-Down Approach

The broader ambition of this article is to popularize an approach for the fair distribution of the quantity of a system's output to its subsystems while allowing for underlying complex subsystem level interactions. Particularly, we present the use of this framework on a very specific (but generalizable) application, interesting for a more general AI audience. Here, we detail a data-driven approach to vehicle price modeling and its component price estimation by leveraging a combination of concepts from machine learning and game theory. We show an alternative to common teardown methodologies and surveying approaches for component and vehicle price estimation at the manufacturer's suggested retail price (MSRP) level that has the advantage of bypassing uncertainties involved in gathering teardown data, the need to perform expensive and biased surveying, and the need to perform retail price equivalent or indirect cost multiplier adjustments to mark up direct manufacturing costs to MSRP. This novel exercise not only provides accurate pricing of the technologies at the customer level, but also shows the, a priori known, large gaps in pricing strategies between manufacturers, vehicle classes, market segments, etc. There is also clear interaction between the price of technologies and other specifications present in vehicles. Those results are indication that old methods of manufacturer-level component costing, aggregation, and application of flat and rigid adjustment factors should be carefully examined. The findings are based on a database developed by Argonne, which includes over 64,000 vehicles covering MY1990 to MY2020 with hundreds of vehicle specs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Increasing the Scale of the Mass Spectrometry Query Language Compendium with Explainable AI

A significant bottleneck in metabolomics data interpretation is the effective use of domain knowledge to assign structural information based on fragmentation patterns. The mass spectrometry query language (MassQL) aims to make this process accessible and applicable across multiple analysis platforms. While advanced computational methods are capable of predicting compound structures from fragmentation data, AI/ML approaches often rely on complex, opaque criteria that are difficult to interpret or modify. As a result, their predictive patterns cannot be readily translated into human-readable rules, such as those used in MassQL. Here, in this study, we introduce ChemEcho, a machine learning embedding method that converts tandem mass spectrometry data into sparse feature vectors containing peak and neutral mass subformulae to enhance explainable AI/ML-based methods. An advantage of this approach is that decision trees trained using these feature vectors can be directly translated to MassQL. Using a battery of decision trees trained using ChemEcho embeddings to predict molecular attributes, we generated over 1500 MassQL queries for 765 molecular features and evaluated their precision and recall. From these queries, the 50 highest-performing queries were integrated into the MassQL compendium. This set of generated MassQL queries included environmentally and biologically relevant classes such as PFAS and molecules containing phosphate or sulfate substructures. To illustrate the impact these queries would have on a typical metabolomics experiment, these MassQL queries were applied to a public metabolomics data set─resulting in a marked increase in the structural information derived from tandem mass spectra. Access and reuse of these queries is expected to enhance structural annotation in untargeted experiments, leading to more specific claims and advancing many applications in metabolomics.

Harwood, Thomas V. [USDOE Joint Genome Institute (↗
DOE OSTI2022

Machine learning reveals key ion selectivity mechanisms in polymeric membranes with subnanometer pores

Designing single-species selective membranes for high-precision separations requires a fundamental understanding of the molecular interactions governing solute transport. Here, we comprehensively assess molecular-level features that influence the separation of 18 different anions by nanoporous cellulose acetate membranes. Our analysis identifies the limitations of bulk solvation characteristics to explain ion transport, highlighted by the poor correlation between hydration energy and the measured permselectivity (R 2 = 0.37). Entropy-enthalpy compensation, spanning 40 kilojoules per mole, leads to a free-energy barrier (ΔG‡) variation of only ~8 kilojoules per mole across all anions. We apply machine learning to elucidate descriptors for energetic barriers from a set of 126 collected features. Notably, electrostatic features account for 75% of the overall features used to describe ΔG‡, despite the relatively uncharged state of cellulose acetate. Our work presents an approach for studying ion transport across nanoporous membranes that could enable the design of ion-selective membranes.

36 MATERIALS SCIENCE↗
NASA NTRS2023

Ceramic Capacitor Grain Size Analysis Using Electron Backscatter Diffraction (EBSD)

The overall scope of this NESC study was to identify (or develop) a tool, methodology, or process that can inspect a ceramic capacitor and consistently return repeatable grain size distribution results. It is important to note that the development of a machine learning technique was considered as an option for this study, but only if an existing automated tool was not available. This report explains why the Electron Backscatter Diffraction analysis method for grain structure and size distribution was deemed a suitable candidate for this work.

Electron Backscatter Diffraction↗
DOE OSTI2024

Demystifying Cyberattacks: Potential for Securing Energy Systems With Explainable AI : Preprint

Modernization of energy systems has led to in- creased interactions among multiple critical infrastructures and diverse stakeholders making the challenge of operational decision making more complex and at times beyond cognitive capabilities of human operators. The state-of-the-art machine learning and deep learning approaches show promise of supporting users with complex decision-making challenges, such as those occurring in our rapidly transforming cyber-physical energy systems. However, successful adoption of data-driven decision support technology for critical infrastructure will be dependent on the ability of these technologies to be trustworthy and contextually interpretable. In this paper, we investigate the feasibility of implementing XAI for interpretable detection of cyberattacks in the energy system. Leveraging a proof-of-concept simulation use case of detection of a data falsification attack on a photovoltaic system using XGBoost algorithm, we demonstrate how Local Interpretable Model-Agnostic Explanations (LIME), a flavor XAI approach, can help provide contextual and actionable interpretation of cyberattack detection.

artificial intelligence↗
DOE OSTI2021

Event-scale predictions of water and nitrogen exports in coastal watersheds

Focal Area(s): The purpose of this white paper is to call for the improvement of the predictability and explainability of the magnitude and timing of water and nutrient exports in coastal watersheds. In this regard, hybrid machine learning approaches and process-based numerical models provide new opportunities to maximize predictability, emulate process-based model components, and explicitly address model uncertainty associated with event-scale predictions in coastal watersheds.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Structural and functional characterization of NEMO cleavage by SARS-CoV-2 3CLpro

Abstract In addition to its essential role in viral polyprotein processing, the SARS-CoV-2 3C-like protease (3CLpro) can cleave human immune signaling proteins, like NF-κB Essential Modulator (NEMO) and deregulate the host immune response. Here, in vitro assays show that SARS-CoV-2 3CLpro cleaves NEMO with fine-tuned efficiency. Analysis of the 2.50 Å resolution crystal structure of 3CLpro C145S bound to NEMO 226–234 reveals subsites that tolerate a range of viral and host substrates through main chain hydrogen bonds while also enforcing specificity using side chain hydrogen bonds and hydrophobic contacts. Machine learning- and physics-based computational methods predict that variation in key binding residues of 3CLpro-NEMO helps explain the high fitness of SARS-CoV-2 in humans. We posit that cleavage of NEMO is an important piece of information to be accounted for, in the pathology of COVID-19.

60 APPLIED LIFE SCIENCES↗
NASA NTRSDate not supplied

Linking OH Variability to Observable Variables, Meteorology and Transport

The hydroxyl radical (OH) plays a vital role in tropospheric chemistry, as it provides the dominant sink for a multitude of pollutants and climate-relevant gases such as methane. Observational constraints on the global distribution and temporal variability of OH are limited, and models simulate a wide range of OH distributions. While OH itself has a short atmospheric lifetime, OH is photochemically coupled to longer-lived species that undergo atmospheric transport. Here, we investigate how much of the OH variability within and between models can be explained by differences in observable species to develop diagnostics for OH differences. We find that NO 2 and water vapor together explain much of the spatial and temporal variability in simulated OH, and we use satellite observations to identify biases in these variables. The OH response to ENSO also differs between models, and we investigate potential causes of these differences such as differences in convection or lightning NOx. We also explore the potential of idealized tracers to represent the OH distribution. Within a single model, meteorological variables such as humidity and idealized tracers of transport can explain a significant portion of the OH spatial variability. We use a Gradient Boosted Regression Trees, a type of machine learning, to account for non-linear relationships between OH and the input variables.

Meteorology↗
DOE OSTI2021

Artificial Intelligence for Autonomous Molecular Design: A Perspective

Domain-aware artificial intelligence has been increasingly adopted in recent years to expedite molecular design in various applications, including drug design and discovery. Recent advances in areas such as physics-informed machine learning and reasoning, software engineering, high-end hardware development, and computing infrastructures are providing opportunities to build scalable and explainable AI molecular discovery systems. This could improve a design hypothesis through feedback analysis, data integration that can provide a basis for the introduction of end-to-end automation for compound discovery and optimization, and enable more intelligent searches of chemical space. Several state-of-the-art ML architectures are predominantly and independently used for predicting the properties of small molecules, their high throughput synthesis, and screening, iteratively identifying and optimizing lead therapeutic candidates. However, such deep learning and ML approaches also raise considerable conceptual, technical, scalability, and end-to-end error quantification challenges, as well as skepticism about the current AI hype to build automated tools. To this end, synergistically and intelligently using these individual components along with robust quantum physics-based molecular representation and data generation tools in a closed-loop holds enormous promise for accelerated therapeutic design to critically analyze the opportunities and challenges for their more widespread application. This article aims to identify the most recent technology and breakthrough achieved by each of the components and discusses how such autonomous AI and ML workflows can be integrated to radically accelerate the protein target or disease model-based probe design that can be iteratively validated experimentally. Taken together, this could significantly reduce the timeline for end-to-end therapeutic discovery and optimization upon the arrival of any novel zoonotic transmission event. Our article serves as a guide for medicinal, computational chemistry and biology, analytical chemistry, and the ML community to practice autonomous molecular design in precision medicine and drug discovery.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Linking repeat lidar with Landsat products for large scale quantification of fire-induced permafrost thaw settlement in interior Alaska

The permafrost–fire–climate system has been a hotspot in research for decades under a warming climate scenario. Surface vegetation plays a dominant role in protecting permafrost from summer warmth, thus, any alteration of vegetation structure, particularly following severe wildfires, can cause dramatic top–down thaw. A challenge in understanding this is to quantify fire-induced thaw settlement at large scales (>1000 km 2 ). In this study, we explored the potential of using Landsat products for a large-scale estimation of fire-induced thaw settlement across a well-studied area representative of ice-rich lowland permafrost in interior Alaska. Six large fires have affected ~1250 km 2 of the area since 2000. We first identified the linkage of fires, burn severity, and land cover response, and then developed an object-based machine learning ensemble approach to estimate fire-induced thaw settlement by relating airborne repeat lidar data to Landsat products. The model delineated thaw settlement patterns across the six fire scars and explained ~65% of the variance in lidar-detected elevation change. Our results indicate a combined application of airborne repeat lidar and Landsat products is a valuable tool for large scale quantification of fire-induced thaw settlement.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Training calibration-based counterfactual explainers for deep learning models in medical image analysis

The rapid adoption of artificial intelligence methods in healthcare is coupled with the critical need for techniques to rigorously introspect models and thereby ensure that they behave reliably. This has led to the design of explainable AI techniques that uncover the relationships between discernible data signatures and model predictions. In this context, counterfactual explanations that synthesize small, interpretable changes to a given query while producing desired changes in model predictions have become popular. This under-constrained, inverse problem is vulnerable to introducing irrelevant feature manipulations, particularly when the model’s predictions are not well-calibrated. Hence, in this paper, we propose the TraCE (training calibration-based explainers) technique, which utilizes a novel uncertainty-based interval calibration strategy for reliably synthesizing counterfactuals. Given the wide-spread adoption of machine-learned solutions in radiology, our study focuses on deep models used for identifying anomalies in chest X-ray images. Using rigorous empirical studies, we demonstrate the superiority of TraCE explanations over several state-of-the-art baseline approaches, in terms of several widely adopted evaluation metrics. Our findings show that TraCE can be used to obtain a holistic understanding of deep models by enabling progressive exploration of decision boundaries, to detect shortcuts, and to infer relationships between patient attributes and disease severity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2024

Vistransformers Explained

The Vistransformers Explained library is a collection of python notebooks that demonstrate the internal mechanics and uses of visual-transformer (ViT) machine learning models. The code implements, with mild modifications, ViT models that have been made publicly available through publication and GitHub code. The value added by this code is in-depth explanations of the mathematics behind the sub-modules of the ViT models, including original figures. Additionally, the library contains the code necessary to implement and train the ViT models. The library does not include example training data for the models; instead, it would rely on users generating their own datasets. The code is based on the PyTorch python library. It does not include any files other than python scripts, modules, or notebooks.

Callis, Skylar↗
NASA NTRSDate not supplied

Development of Machine Learning-Derived Microbiological and Immune Signatures: Applications in Adaptive Risk Assessment of Infectious Disease During Spaceflight

Infectious diseases represent an urgent risk for spaceflight with consequences ranging from loss in crew performance to crew incapacitation or loss of life should an outbreak occur. The resident environmental microbiome on the International Space Station has been monitored through routine surveillance over almost twenty years, beginning with culture-based microbial detection which has advanced to molecular methods in recent years. This has created a wealth of data that we have begun mining to define the microbial ecology of the ISS. Summarized here is our analysis of data from the historical microbial population defined by culture-based monitoring from the past two decades, organized by their likelihood to cause disease into clinical categories. As expected, many residents of the normal microflora in environments where people work and live were detected. However, some known pathogens were also detected. As the spaceflight environment can predispose humans to infection, crew health records were used to source additional data for the set to uncover clinical relevance. Data mining was performed on crew health records to capture adverse health events that may be related to infectious disease. Machine learning, specifically Random Forest analysis, was used to analyze the microbial and crew health datasets. The symptom categories were not explained by the ranked bacteria, due to lack of sufficient data for some categories and due to poor ranking of the pathogens for others. Poor ranking of the bacteria could be due to the clinical symptoms being linked to other disease-causing factors, such as allergy or viral infection. These findings suggest a lack of relationship between bacteria detected on surfaces in the ISS and historical health events experienced by astronauts.

Kristyn Hoffman↗