SEARCH · Engineering Papers

Results for “interpretable models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Revising the dynamic energy budget theory with a new reserve mobilization rule and three example applications to bacterial growth

Dynamic energy budget (DEB) theory has been applied to model a wide range of organisms, including microbes. In the standard DEB model, biomass is partitioned into reserve and structural compartments, where reserve biomass is mobilized in a pseudolinear manner (while the reserve biomass density, defined as the ratio between reserve and structural biomass, decays linearly) to drive maintenance and the growth of structural biomass (and extracellular enzyme production if it is considered). However, the linear dynamics of the reserve biomass density makes the standard DEB model incapable of explaining the slowdown of microbial growth at high reserve density that is caused by macromolecular crowding effect which reduces biochemical reaction rates (a typical situation occurs when microbes are experiencing severe moisture stress) and is inconsistent with the observation that intracellular enzymatic reactions generally follow non-linear kinetics. By partitioning biomass into reserve, kinetic, and structural compartments, we show here that the Equilibrium Chemistry Approximation (ECA) kinetics can be used to represent enzymatically catalyzed reserve biomass mobilization that can then drive the kinetic and structural biomass synthesis. This revised DEB model better represents the tradeoff in ribosome allocation for structural growth and internal enzyme production, is structurally compatible with metabolic models of cell individuals, and includes the standard DEB model and the popular compromise model as special cases for representing population growth. We then applied the revised DEB model to interpret components of bacterial respiration, their dependence on substrate availability, and emergent microbial carbon use efficiency dynamics for an exponentially growing population. We found that the revised DEB model enables a better understanding of bacterial substrates use (carbon in our examples) than that can be derived from a few other models in the literature. In particular, the revised DEB model explains why carbon use efficiency may first increase, then plateau, and finally decrease with growth rate (and substrate uptake rate), as a function of proteomics. Additionally, the revised DEB model explains why the kinetic biomass compartment needs to be divided to reasonably incorporate proteomic control of microbial growth.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Di-CNN: Domain-Knowledge-Informed Convolutional Neural Network for Manufacturing Quality Prediction

In manufacturing, convolutional neural networks (CNNs) are widely used on image sensor data for data-driven process monitoring and quality prediction. However, as purely data-driven models, CNNs do not integrate physical measures or practical considerations into the model structure or training procedure. Consequently, CNNs’ prediction accuracy can be limited, and model outputs may be hard to interpret practically. This study aims to leverage manufacturing domain knowledge to improve the accuracy and interpretability of CNNs in quality prediction. A novel CNN model, named Di-CNN, was developed that learns from both design-stage information (such as working condition and operational mode) and real-time sensor data, and adaptively weighs these data sources during model training. It exploits domain knowledge to guide model training, thus improving prediction accuracy and model interpretability. A case study on resistance spot welding, a popular lightweight metal-joining process for automotive manufacturing, compared the performance of (1) a Di-CNN with adaptive weights (the proposed model), (2) a Di-CNN without adaptive weights, and (3) a conventional CNN. The quality prediction results were measured with the mean squared error (MSE) over sixfold cross-validation. Model (1) achieved a mean MSE of 6.8866 and a median MSE of 6.1916, Model (2) achieved 13.6171 and 13.1343, and Model (3) achieved 27.2935 and 25.6117, demonstrating the superior performance of the proposed model.

47 OTHER INSTRUMENTATION↗

DOE OSTI2023

SULI Oral Presentation

Furthering our understanding of the prevalence and severity of issues that customers face when charging their electric vehicles (EVs) is crucial in order to improve the charging experience across the United States. This project utilizes web-scraping, machine leaning (ML), and natural language processing (NLP) techniques to analyze and categorize user-generated reviews. Selenium was used to build a data collection tool that can scrape vast amounts of user review data from the PlugShare website. Sentiment analysis was employed on this dataset in order to filter out negative reviews for further analysis. NLP techniques such as tokenization and word embedding were then used to convert user-written comments into a numerical format that a ML model can interpret. Multiple ML approaches are currently being explored in order to identify and categorize the charging issues being talked about in each review. Ultimately, the results from the ML model will be visualized and explained in a report on customer pain points to be delivered to the ChargeX Consortium, therefore revealing specific areas for improvement in the customer charging experience.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2023

SULI Oral Presentation

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2025

Data-driven high-dimensional statistical inference with generative models

Crucial to many measurements at the LHC is the use of correlated multi-dimensional information to distinguish rare processes from large backgrounds, which is complicated by the poor modeling of many of the crucial backgrounds in Monte Carlo simulations. In this work, we introduce HI-SIGMA, a method to perform unbinned high-dimensional statistical inference with data-driven background distributions. In contradistinction to many applications of Simulation Based Inference in High Energy Physics, HI-SIGMA relies on generative ML models, rather than classifiers, to learn the signal and background distributions in the high-dimensional space. These ML models allow for interpretable inference while also incorporating model errors and other sources of systematic uncertainties. We showcase this methodology on a simplified version of a di-Higgs measurement in the bbγγ final state, where the di-photon resonance allows for background interpolation from sidebands into the signal region. We demonstrate that HI-SIGMA provides improved sensitivity as compared to standard classifier-based methods, and that systematic uncertainties can be straightforwardly incorporated by extending methods which have been used for histogram based analyses.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2024

Search for supersymmetry using vector boson fusion signatures and missing transverse momentum in pp collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector

This paper presents a search for supersymmetric particles in models with highly compressed mass spectra, in events consistent with being produced through vector boson fusion. The search uses 140 fb −1 of proton-proton collision data at $\sqrt{s}$ = 13 TeV collected by the ATLAS experiment at the Large Hadron Collider. Events containing at least two jets with a large gap in pseudorapidity, large missing transverse momentum, and no reconstructed leptons are selected. A boosted decision tree is used to separate events consistent with the production of supersymmetric particles from those due to Standard Model backgrounds. The data are found to be consistent with Standard Model predictions. The results are interpreted using simplified models of R-parity-conserving supersymmetry in which the lightest supersymmetric partner is a bino-like neutralino with a mass similar to that of the lightest chargino and second-to-lightest neutralino, both of which are wino-like. Lower limits at 95% confidence level on the masses of next-to-lightest supersymmetric partners in this simplified model are established between 117 and 120 GeV when the lightest supersymmetric partners are within 1 GeV in mass.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2023

Time-dependent SOLPS-ITER simulations of the tokamak plasma boundary for model predictive control using SINDy *

Abstract Time-dependent SOLPS-ITER simulations have been used to identify reduced models with the sparse identification of nonlinear dynamics (SINDy) method and develop model-predictive control of the boundary plasma state using main ion gas puff actuation. A series of gas actuation sequences are input into SOLPS-ITER to produce a dynamic response in upstream and divertor plasma quantities. The SINDy method is applied to identify reduced linear and nonlinear models for the electron density at the outboard midplane n e , s e p O M P and the electron temperature at the outer divertor T e , s e p d i v . Note that T e , s e p d i v is not necessarily the peak value of T e along the divertor. The identified reduced models are interpretable by construction (i.e. not black box), and have the form of coupled ordinary differential equations. Despite significant noise in T e , s e p d i v , the reduced models can be used to predict the response over a range of actuation levels to a maximum deviation of 0.5% in n e , s e p O M P and 5%–10% in T e , s e p d i v for the cases considered. Model retraining using time history data triggered by a preset error threshold is also demonstrated. A model predictive control strategy for nonlinear models is developed and used to perform feedback control of a SOLPS-ITER simulation to produce a setpoint trajectory in n e , s e p O M P using the integrated plasma simulator framework. The developed techniques are general and can be applied to time-dependent data from other boundary simulations or experimental data. Ongoing work is extending the approach to model identification and control for divertor detachment, which will present transient nonlinear behavior from impurity seeding, including realistic latency and synthetic diagnostic signals derived from the full SOLPS-ITER output.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2022

Benchmark eA generator for leptoproduction in high-energy lepton-nucleus collisions

The upcoming electron-ion collider (EIC) will address several outstanding puzzles in modern nuclear physics. Topics such as the partonic structure of nucleons and nuclei, the origin of their mass and spin, among others, can be understood via the study of high-energy electron-proton (ep) and electron-nucleus (eA) collisions. Achieving the scientific goals of the EIC will require a novel electron-hadron collider and detectors capable to perform high-precision measurements but also dedicated tools to model and interpret the data. To aid in the latter, we present a general-purpose e A Monte Carlo generator—BeAGLE. In this paper, we provide a general description of the models integrated into BeAGLE, applications of BeAGLE in eA physics, implications for detector requirements at the EIC, and the tuning of the parameters in BeAGLE based on available experimental data. Specifically, we focus on a selection of model and data comparisons in particle production in both ep and eA collisions, where baseline particle distributions provide essential information to characterize the event. In addition, we investigate the collision geometry determination in eA collisions, which could be used as an experimental tool for varying the nuclear density.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

Search for top squarks in events with a Higgs or Z boson using 139 fb -1 of pp collision data at $\sqrt{s}=13$ TeV with the ATLAS detector

This paper presents a search for direct top squark pair production in events with missing transverse momentum plus either a pair of jets consistent with Standard Model Higgs boson decay into b-quarks or a same-flavour opposite-sign dilepton pair with an invariant mass consistent with a Z boson. The analysis is performed using the proton–proton collision data at √s=13 TeV collected with the ATLAS detector during the LHC Run-2, corresponding to an integrated luminosity of 139 fb -1 . No excess is observed in the data above the Standard Model predictions. The results are interpreted in simplified models featuring direct production of pairs of either the lighter top squark ($\tilde{t}_1$) or the heavier top squark ($\tilde{t}_2$), excluding at 95% confidence level $\tilde{t}_1$ and $\tilde{t}_2$ masses up to about 1220 and 875 GeV, respectively.

42 ENGINEERING↗

DOE OSTI2026

The Role of Nuclear Data Sensitivities in Prompt α-Eigenvalue Predictions of Delayed Critical Benchmarks

Alpha (α) eigenvalues, which describe the logarithmic time derivative of the neutron population in a multiplying system, are integral to time-dependent behavior and diagnostic applications. However, uncertainties in the evaluated nuclear data can significantly impact the accuracy of transport simulations for such quantities. This work explores the use of machine learning models to predict two key outputs, α-eigenvalues and keff bias, using input features derived from α-eigenvalue sensitivities to nuclear data. The criticality safety benchmark models used in this study come from the International Handbook of Evaluated Criticality Safety Benchmark Experiments. Three models, random forest, XGBoost, and NGBoost, are trained on both energy-resolved and energy-summed α sensitivities. For the α-eigenvalue bias prediction, NGBoost achieved the highest R 2 (0.9476) using energy-resolved features, while XGBoost performed best using summed sensitivities. In contrast, when predicting the keff bias, all the models showed moderate predictive capability (best R 2 ≈ 0.72), as the mapping from the static α-sensitivities to the static keff bias was less direct. SHAP (SHapley Additive exPlanations) analysis was used to interpret the model predictions. Across both prediction tasks, the features associated with neutron capture [H-1 (n, γ)], uranium scattering reactions (such as 235 U elastic/inelastic), and actinide capture/fission reactions (such as 239 Pu and 234 U) were consistently identified as the most impactful. This highlights the key role of specific nuclear reactions and energy ranges in shaping both time-dependent and steady-state criticality behavior. These results demonstrated that α-sensitivities, despite being computed for time-dependent metrics, can provide valuable insights for predicting both α-eigenvalues and the keff bias. Moreover, machine learning models offer a promising pathway for uncovering important nuclear data dependencies and guiding future data evaluation efforts.

Nuclear data↗

DOE OSTI2022

Modeling the partitioning of amphiphilic molecules and co-solvents in biomembranes

We report amphiphilic co-solvents can have a significant impact on the structure, organization and physical properties of lipid bilayers. Describing the mutual impact of partitioning and induced structure changes is therefore a crucial consideration for a range of topics such as anesthesia and other pharmacokinetic effects, as well as microbial solvent tolerance in the production of biofuels and other fermentation products, where molecules such as ethanol, butanol or acetic acid might be generated. Small-angle neutron scattering (SANS) is a key method for studying lipid and polymer bilayer structures, with many models for extracting bilayer structure (thickness, area per lipid etc.) from scattering data in use today. However, the molecular details of co-solvent partitioning are conflated with induced changes to bilayer structure, making interpretation and modeling of the scattering curves a challenge with the existing set of models. To address this, a model of a bilayer structure is presented which invokes a two-term partition constant accounting for the localization of the co-solvent within the bilayer. This model was validated using a series of SANS measurements of lipid vesicles in the presence of the co-solvent tetrahydrofuran (THF), showing several strategies of how to deploy the two-parameter partition constant model to describe scattering data and extract both structure and partitioning information from the data. Molecular dynamics simulations are then used to evaluate assumptions of the model, provide additional molecular scale details and illustrate its complementary nature to the data fitting procedure. This approach results in estimates of the partition coefficient for THF in 1,2-dimyristoyl-sn-glycero-3-phosphocholine at 35°C, along with an estimate of the fraction of THF residing in the hydrophobic core of the membrane. The authors envision that this model will be applicable to a wide range of other bilayer/amphiphile interactions and provide the associated code needed to implement this model as a fitting algorithm for scattering data in the SasView suite.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Moving beyond post hoc explainable artificial intelligence: a perspective paper on lessons learned from dynamical climate modeling

AI models are criticized as being black boxes, potentially subjecting climate science to greater uncertainty. Explainable artificial intelligence (XAI) has been proposed to probe AI models and increase trust. In this review and perspective paper, we suggest that, in addition to using XAI methods, AI researchers in climate science can learn from past successes in the development of physics-based dynamical climate models. Dynamical models are complex but have gained trust because their successes and failures can sometimes be attributed to specific components or sub-models, such as when model bias is explained by pointing to a particular parameterization. We propose three types of understanding as a basis to evaluate trust in dynamical and AI models alike: (1) instrumental understanding, which is obtained when a model has passed a functional test; (2) statistical understanding, obtained when researchers can make sense of the modeling results using statistical techniques to identify input–output relationships; and (3) component-level understanding, which refers to modelers' ability to point to specific model components or parts in the model architecture as the culprit for erratic model behaviors or as the crucial reason why the model functions well. We demonstrate how component-level understanding has been sought and achieved via climate model intercomparison projects over the past several decades. Such component-level understanding routinely leads to model improvements and may also serve as a template for thinking about AI-driven climate science. Currently, XAI methods can help explain the behaviors of AI models by focusing on the mapping between input and output, thereby increasing the statistical understanding of AI models. Yet, to further increase our understanding of AI models, we will have to build AI models that have interpretable components amenable to component-level understanding. We give recent examples from the AI climate science literature to highlight some recent, albeit limited, successes in achieving component-level understanding and thereby explaining model behavior. The merit of such interpretable AI models is that they serve as a stronger basis for trust in climate modeling and, by extension, downstream uses of climate model data.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Machine-learning enabled thermodynamic model for the design of new rare-earth compounds

We employ a descriptor based machine-learning approach to assess the effect of chemical alloying on formation-enthalpy of rare-earth intermetallics. Application of machine-learning approaches in rare-earth intermetallic design have been sparse due to limited availability of reliable datasets. In this work, we developed an ‘in-house’ rare-earth database with more than 600 + compounds, each entry was populated with formation enthalpy and related atomic features using high-throughput density-functional theory (DFT). The SISSO (sure independence screening and sparsifying operator) based machine-learning method with meaningful atomic features was used for training and testing the formation enthalpies of rare earth compounds. The complex lattice function coupled with the machine-learning model was used to explore the effect of transition metal alloying on the energy stability of Ce based cubic Laves phases (MgCu 2 type). The SISSO predictions show good agreement with high-fidelity DFT calculations and X-ray powder diffraction measurements. Our study provides quantitative guidance for compositional considerations within a machine-learning model and discovering new metastable materials. The electronic-structure of Ce-Fe-Cu based compound was also analyzed to get an in-depth understanding of the electronic origin of phase stability. The interpretable analytical models in combination with density-functional theory and experiments provide a fast and reliable design guide for discovering technologically useful materials.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Search for top-philic heavy resonances in pp collisions at $\sqrt{s}=13$ $\text {TeV}$ with the ATLAS detector

A search for the associated production of a heavy resonance with a top-quark or a top-antitop-quark pair, and decaying into a $\overline{tt}$ pair is presented. The search uses the data recorded by the ATLAS detector in pp collisions at $\sqrt{s}$ = 13 TeV at the Large Hadron Collider during the years 2015–2018, corresponding to an integrated luminosity of 139 fb -1 . Events containing exactly one electron or muon are selected. The two hadronically decaying top quarks from the resonance decay are reconstructed using jets clustered with a large radius parameter of R = 1. The invariant mass spectrum of the two top quark candidates is used to search for a resonance signal in the range of 1.0 TeV to 3.2 TeV. The presence of a signal is examined using an approach with minimal model dependence followed by a model-dependent interpretation. No significant excess is observed over the background expectation. Upper limits on the production cross section times branching ratio at 95% confidence level are provided for a heavy Z' boson based on a simplified model, for Z' mass between 1.0 TeV and 3.0 TeV. The observed (expected) limits range from 21 (14) fb to 119 (86) fb depending on the choice of model parameters

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2026

Z α 2 correction to superallowed beta decays in effective field theory and implications for | V u d |

Superallowed ( 0 + → 0 + ) beta decays currently provide the most precise extraction of quark mixing in the Standard Model. Their interpretation as a measurement of | V u d | relies on a reliable first-principles computation of QED radiative corrections expressed as a series in Z α and α . In this work, we provide the first model-independent result for two-loop, O ( Z α 2 ) , long-distance radiative corrections where the nuclei are treated as heavy pointlike particles. We use renormalization group analysis to obtain new results at O ( Z α 3 ) for the coefficient of double logarithms in the ratio of the maximal beta energy to the inverse nuclear size, E m / R - 1 . We use the Kinoshita-Lee-Nauenberg theorem to obtain new results at O ( Z 2 α 3 ) for the coefficient of logarithms in the ratio of maximal beta energy to the electron mass, log ( 2 E m / m ) . We identify a structure-dependent, and, therefore, short-distance, contribution to the traditional Z α 2 correction that should be revisited. We provide the first comprehensive update to the long-distance corrections in almost 40 years and comment on the impact of our findings for extractions of | V u d | . We find that shifts in the long-distance corrections are 2.5 × larger than past estimates of their uncertainty, 1.5 × larger than the statistical uncertainty from the combined fit of superallowed decays, and about 1 / 2 the size of estimated systematic error, which stems dominantly from nuclear structure effects.

Cao, Zehua [Kentucky U.] (ORCID:0009000354256423)↗

DOE OSTI2026

A Perspective on Traditional and Data Driven Electrochemical Modeling and Analysis

To understand the behavior of electrochemical systems, we need to reduce the dimensionality of the measured current-voltage-time (I-V-t) data by fitting models, thus enabling us to analyze and compare the governing physics. Traditionally, the process for this is an 'expert first' approach: defining the model and its explicit assumptions based on inductive reasoning or empirical observation, fitting small portions of the I-V-t data where assumptions are most valid or carefully designing experiments to enforce key assumptions, and then interpreting the model parameters. However, modern data-driven methods enable a new paradigm: a 'data first' approach, where the latent behaviors governing the system's measured response are identified directly using machine-learning models that optimize both model structure and parameters from the I-V-t data, guaranteeing that the learned model explains as much of the observed system response as possible. After model identification, the model can then be interrogated by an expert to connect observed behaviors with underlying physics. This talk will review several different types of electrochemical analysis (electrochemical impedance, differential voltage-capacity, electrochemical kinetics) and compare the traditional and data-driven methods for analyzing the data.

42 ENGINEERING↗

DOE OSTI2021

Machine Learned Hückel Theory: Interfacing Physics and Deep Neural Networks

The Hückel Hamiltonian is an incredibly simple tight-binding model known for its ability to capture qualitative physics phenomena arising from electron interactions in molecules and materials. Part of its simplicity arises from using only two types of empirically fit physics-motivated parameters: the first describes the orbital energies on each atom and the second describes electronic interactions and bonding between atoms. By replacing these empirical parameters with machine-learned dynamic values, we vastly increase the accuracy of the extended Hückel model. The dynamic values are generated with a deep neural network, which is trained to reproduce orbital energies and densities derived from density functional theory. The resulting model retains interpretability, while the deep neural network parameterization is smooth and accurate and reproduces insightful features of the original empirical parameterization. Altogether, this work shows the promise of utilizing machine learning to formulate simple, accurate, and dynamically parameterized physics models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Towards physics-informed explainable machine learning and causal models for materials research

From emergent material descriptions to estimation of properties stemming from structures to optimization of process parameters for achieving best performance – all key facets of materials science and related fields have experienced tremendous growth with the introduction of data-driven models. This gradual progression goes at par with developments of machine learning workflows, from purely data-driven shallow models to those that are well-capable in encoding more complex graphs, symbolic representations, invariances, and positional embeddings. Furthermore, this perspective aims at summarizing strategic aspects of such transitions while providing insights into the requirements of bringing in explainable, interpretable predictive models, and causal learning to aid in materials design and discovery. Although the focus remains on a variety of functional materials by providing a handful of case studies, the applications of such integrated methodologies are universal to facilitate fundamental understandings of materials physics while enabling autonomous experiments.

36 MATERIALS SCIENCE↗