SEARCH · Engineering Papers

Results for “model interpretability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Studies of new Higgs boson interactions through nonresonant $HH$ production in the $ b\overline{b}\gamma \gamma $ final state in $pp$ collisions at $ \sqrt{s} $ = 13 TeV with the ATLAS detector

A search for nonresonant Higgs boson pair production in the $ b\overline{b}\gamma \gamma $ final state is performed using 140 fb –1 of proton-proton collisions at a centre-of-mass energy of 13 TeV recorded by the ATLAS detector at the CERN Large Hadron Collider. This analysis supersedes and expands upon the previous nonresonant ATLAS results in this final state based on the same data sample. The analysis strategy is optimised to probe anomalous values not only of the Higgs (H) boson self-coupling modifier κλ but also of the quartic HHVV (V = W, Z) coupling modifier κ 2V . No significant excess above the expected background from Standard Model processes is observed. An observed upper limit μHH < 4.0 is set at 95% confidence level on the Higgs boson pair production cross-section normalised to its Standard Model prediction. The 95% confidence intervals for the coupling modifiers are –1.4 < κ λ < 6.9 and –0.5 < κ 2V < 2.7, assuming all other Higgs boson couplings except the one under study are fixed to the Standard Model predictions. The results are interpreted in the Standard Model effective field theory and Higgs effective field theory frameworks in terms of constraints on the couplings of anomalous Higgs boson (self-)interactions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2020

Search for a scalar partner of the top quark in the all-hadronic $t{\bar{t}}$ plus missing transverse momentum final state at $\sqrt{s}=13$ TeV with the ATLAS detector

A search for direct pair production of scalar partners of the top quark (top squarks or scalar third-generation up-type leptoquarks) in the all-hadronic $t{\bar{t}}$ plus missing transverse momentum final state is presented. The analysis of 139 $\hbox {fb}^{-1}$ of ${\sqrt{s}=13}$ TeV proton–proton collision data collected using the ATLAS detector at the LHC yields no significant excess over the Standard Model background expectation. To interpret the results, a supersymmetric model is used where the top squark decays via ${\tilde{t}} \rightarrow t^{(*)} {\tilde{\chi }}^0_1$ t ~ → t ( * ) χ ~ 1 0 , with $t^{(*)}$ t ( * ) denoting an on-shell (off-shell) top quark and ${\tilde{\chi }}^0_1$ χ ~ 1 0 the lightest neutralino. Three specific event selections are optimised for the following scenarios. In the scenario where $m_{{\tilde{t}}}> m_t+m_{{\tilde{\chi }}^0_1}$ m t ~ > m t + m χ ~ 1 0 , top squark masses are excluded in the range 400–1250 GeV for ${\tilde{\chi }}^0_1$ χ ~ 1 0 masses below 200 GeV at 95% confidence level. In the situation where $m_{{\tilde{t}}}\sim m_t+m_{{\tilde{\chi }}^0_1}$ m t ~ ~ m t + m χ ~ 1 0 , top squark masses in the range 300–630 GeV are excluded, while in the case where $m_{{\tilde{t}}}< m_W+m_b+m_{{\tilde{\chi }}^0_1}$ m t ~ < m W + m b + m χ ~ 1 0 (with $m_{{\tilde{t}}}-m_{{\tilde{\chi }}^0_1}\ge 5$ m t ~ - m χ ~ 1 0 ≥ 5 GeV), considered for the first time in an ATLAS all-hadronic search, top squark masses in the range 300–660 GeV are excluded. Limits are also set for scalar third-generation up-type leptoquarks, excluding leptoquarks with masses below 1240 GeV when considering only leptoquark decays into a top quark and a neutrino.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS1975

Local time variations of particle flux produced by an electrostatic field in the magnetosphere

The local time variations of particle distributions, which can be produced by the sudden enhancement of a cross-tail electric field, are examined by using adiabatic theory. The strong coupling between acceleration, inward motion, and east-west drift is emphasized. The model is used to interpret recent measurements of delay times of newly accelerated electrons at different local times at geostationary orbit. Observations of the asymmetric storm time 'ring current' are interpreted in terms of the model without invoking particle loss.

Kivelson, M. G.↗

NASA NTRS1997

Modeling and Data Analysis of SONEX Observations

Primary focus of the study is on the sources, photochemistry and transport of reactive nitrogen species, O3, as well as other O3 precursors such as NMHC and CO. Major objectives are: (1) Identify the major sources of NO(x) and quantify the contribution of each source to the NO(x) distribution in the free troposphere, particularly in the upper troposphere. (2) Understand the odd hydrogen photochemistry and the recycling of NO(x) in the free troposphere. (3) Evaluate the photochemical production and destruction of O3. A combination of modeling and data analysis/interpretation approach is used. We use a three-dimensional model and a box model to simulate, analyze, and interpret the observations. Both models are needed because they are complementary and each has its advantages and limitations. Proven analytical techniques, including correlation of NOx with various tracers and with different air masses, are applied to both observations and model results to deduce useful information toward accomplishing the objectives. In addition, the SONEX observations are compared and analyzed in a systematic way against other airborne experiments conducted over remote atmosphere, especially those from NASA GTE experiments, AASE 1 and 2, and SUCCESS.

Liu, Shaw C.↗

DOE OSTI2022

Genetic programming for interpretable, data-driven continuum damage models.

The damage mechanisms that lead to failure in engineering alloys have been studied extensively, but converting this knowledge into constitutive models that are suitable for engineering-scale analysis remains a challenge. Evolution laws for continuum damage have been developed in the past and have proven effective but suffer from many non-physical assumptions that inhibit the overall accuracy of the model. Further, the assumptions inherent in these existing models prevent them from being applicable to a broad class of materials. At the same time, computational models of fine-scale damage mechanisms continue to advance making it tractable to generate large training data sets through computer simulation. Data-driven machine learning approaches can leverage these data sets to avoid making limiting assumptions, and instead produce models directly from the results of microstructural simulations and/or experiments. Many of these machine learning approaches are rapid and accurate, but they offer little to no insight into the underlying relationships among state variables being discovered. Conversely, genetic programming symbolic regression (GPSR) is a machine learning method that produces analytic expressions relating the state variables, allowing maximal insight and interpretability. To that end, we propose using GPSR as a data-driven method of obtaining microstructurally informed continuum damage models. Data is generated using microstructural simulations of damage evolution, parameterized over microstructural statistics (i.e., pore shape) and nominally applied deformations. Analytic expressions for damage evolution are obtained from the data using GPSR, and these expressions are then utilized within a continuum constitutive model. Overall, this approach is a promising method of automatically obtaining analytic relations describing constitutive phenomena in a material.

Buche, Michael Robert↗

DOE OSTI2025

Enabling Strong Neutrino Self-Interaction with an Unparticle Mediator

Recent explorations of the cosmic microwave background and the large-scale structure of the universe have indicated a preference for sizable neutrino self-interactions, much stronger than what the standard model offers. When interpreted in the context of simple particle-physics models with a light, neutrinophilic scalar mediator, some of the hints are already in tension with the combination of terrestrial, astrophysical, and cosmological constraints. We take a novel approach by considering neutrino self-interactions through a mediator with a smooth, continuous spectral density function. We consider Georgi’s unparticle with a mass gap as a concrete example and point out two useful effects for mitigating two leading constraints. (i) The Unparticle is “broadband’—it occupies a wide range of masses which allows it to pass the early universe constraint on effective number of extra neutrinos ( Δ N eff ) even if the mass gap lies below the MeV scale. (ii) Scattering involving unparticles is less resonant, which lifts the constraint set by IceCube based on a recent measurement of ultra-high-energy cosmogenic neutrinos. Our analysis shows that an unparticle mediator can open up ample parameter space for strong neutrino self-interactions of interest to cosmology and serves a well-motivated target for upcoming experiments. Published by the American Physical Society 2025

Foroughi-Abari, Saeid (ORCID:0000000294061896)↗

DOE OSTI2021

Search for chargino–neutralino pair production in final states with three leptons and missing transverse momentum in $$\sqrt{s} = 13$$ TeV pp collisions with the ATLAS detector

A search for chargino–neutralino pair production in three-lepton final states with missing transverse momentum is presented. The study is based on a dataset of $\sqrt{s}$=13 TeV pp collisions recorded with the ATLAS detector at the LHC, corresponding to an integrated luminosity of 139 fb -1 . No significant excess relative to the Standard Model predictions is found in data. The results are interpreted in simplified models of supersymmetry, and statistically combined with results from a previous ATLAS search for compressed spectra in two-lepton final states. Various scenarios for the production and decay of charginos ($\tilde{χ}^±_1$) and neutralinos ($\tilde{χ}^0_2$) are considered. For pure higgsino $\tilde{χ}^±_1$$\tilde{χ}^0_2$ pair-production scenarios, exclusion limits at 95% confidence level are set on $\tilde{χ}^0_2$ masses up to 210 GeV. Limits are also set for pure wino $\tilde{χ}^±_1$$\tilde{χ}^0_2$ pair production, on $\tilde{χ}^0_2$ masses up to 640 GeV for decays via on-shell W and Z bosons, up to 300 GeV for decays via off-shell W and Z bosons, and up to 190 GeV for decays via W and Standard Model Higgs bosons.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2024

A Variable Eddington Factor Model for Thermal Radiative Transfer with Closure Based on Data-Driven Shape Function

Here, a new variable Eddington factor (VEF) model is presented for nonlinear problems of thermal radiative transfer (TRT). The VEF model is data-driven and acts on known (a-priori) radiation-diffusion solutions for material temperatures in the TRT problem. A linear auxiliary problem is constructed for the radiative transfer equation (RTE) whose emission source and opacities are evaluated at these known material temperatures. The solution to this RTE approximates the specific intensity distribution in phase-space and time. It is applied as a shape function to define the Eddington tensor for the presented VEF model. The shape function computed via the auxiliary RTE problem will capture some degree of transport effects within the TRT problem. The VEF moment equations closed with this approximate Eddington tensor will thus carry with them these captured transport effects. In this study, the temperature data comes from multigroup P 1 , P 1/3 , and flux-limited diffusion radiative transfer models. The proposed VEF model can be interpreted as a transport-corrected diffusion reduced-order model. Numerical results are presented on the Fleck-Cummings test problem which models a supersonic wavefront of radiation. The VEF model is shown to improve accuracy by 1–2 orders of magnitude compared to the considered radiation-diffusion model solutions to the TRT problem.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRS1990

AX-5 space suit reliability model

The AX-5 is an all metal Extra-vehicular (EVA) space suit currently under consideration for use on Space Station Freedom. A reliability model was developed based on the suit's unique design and on projected joint cycle requirements. Three AX-5 space suit component joints were cycled under simulated load conditions in accordance with NASA's advanced space suit evaluation plan. This paper will describe the reliability model developed, the results of the cycle testing, and an interpretation of the model and test results in terms of projected Mean Time Between Failure for the AX-5. A discussion of the maintenance implications and life cycle for the AX-5 based on this projection is also included.

Reinhardt, AL↗

DOE OSTI2022

Method to account for natural fracture induced elastic anisotropy in geomechanical characterization of shale gas reservoirs

Shale has been usually recognized as a transverse isotropic (TI) medium in conventional geomechanical log interpretation due to its laminated nature. However, when natural fractures exist in the shale rock, additional elastic anisotropy is introduced, converting laminated Shale to an orthorhombic (OB) medium. Previous studies illustrate that neglecting the natural fracture induced anisotropy in shale geomechanical log interpretation could lead to inaccurate evaluations of elastic moduli and in-situ stresses. In this paper, a new method is developed to account for the natural fracture induced anisotropy in geomechanical log interpretation based upon the TI acoustic model developed by the author and a characterization technique of elastic wave anisotropy (Sayers, 1991). The new OB model incorporates the four acoustic log data inputs and five modeling constraints in a nonlinear optimization algorithm to solve for the nine independent stiffness coefficients of an OB rock, and further to solve for the geomechanical properties and in-situ stress profiles in an OB formation. The new method was validated with a Marcellus Gas Shale field case. Both the new OB model and the conventional TI model were applied to interpret the minimum horizontal stress profile for the same formation. By comparing the results, the OB model is more robust than the TI from two aspects. First, the average stress magnitude predicted by the OB model is closer to the one measured by the Diagnostic Fracture Injection Test (DFIT). Second, the OB model predicts a more obvious stress barrier between the lower Marcellus and upper Onondaga Limestone than the TI model does. Finally, the predicted stress barrier is consistent with the observation of the microseismic events of a horizontal well drilled and completed nearby, which reveals that no hydraulic fracture propagates downward through the bottom boundary of Marcellus Shale into the underlying Onondaga Limestone.

03 NATURAL GAS↗

NASA NTRS2014

How to Develop and Interpret a Credibility Assessment of Numerical Models for Human Research: NASA-STD-7009 Demystified

In the wake of the Columbia accident, the NASA-STD-7009 [1] credibility assessment was developed as a unifying platform to describe model credibility and the uncertainties in its modeling predictions. This standard is now being adapted by NASAs Human Research Program to cover a wide range of numerical models for human research. When used properly, the standard can improve the process of code development by encouraging the use of best practices. It can also give management more insight in making informed decisions through a better understanding of the models capabilities and limitations.To a newcomer, the abstractions presented in NASA-STD-7009 and the sheer volume of information that must be absorbed can be overwhelming. This talk is aimed at describing the credibility assessment, which is the heart of the standard, in plain terms. It will outline how to develop a credibility assessment under the standard. It will also show how to quickly interpret the graphs and tables that result from the assessment and how to drill down from the top-level view to the foundation of the assessment. Finally, it will highlight some of the resources that are available for further study.

numerical analysis↗

DOE OSTI2023

Data, scripts, and figures associated with a manuscript studying impact of climate and topography on post-fire vegetation recovery.

This data package is associated with the publication “Impact of Topography and Climate on Post-fire Vegetation Recovery Across Different Burn Severity and Land Cover Types through Machine Learning” submitted to Remote Sensing of Environment (Zahura et al. 2023). In this research, a machine learning algorithm, random forest (RF), was utilized to examine the impact of climate and topography on post-fire vegetation recovery. We used enhanced vegetation index (EVI) to examine varying burn severity and land cover types. The data package includes the input files for RF model training, outputs from model predictions and analysis, and python scripts to run the model, analyze the results to understand model performance and interpretability, and plot manuscript figures. This data package contains three folders (Data, Scripts, and Figures), a file-level metadata (FLMD) csv, and a data dictionary (dd) csv. Please see Postfire_recovery_flmd.csv for a list of all files contained in this data package and descriptions for each. The data dictionary (Postfire_recovery_dd.csv) describes the csv column headers. The “Data” folder provides all the inputs and outputs to train the RF model, evaluate performance, and interpret predictions. The “Scripts” folder contains python scripts and jupyter notebooks for model training and result analysis. The “Figures” folder includes the figures used in the manuscript in “.png” and “.jpg” format.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1986

Interpretation of rapid rises in hard X-rays and microwaves with the thermal conduction front model

Impulsive hard X-ray and microwave bursts with rise times from 0.1 to 10 seconds are discussed. Source areas calculated by the method of Crannell et al. (1978) were compared with source areas determined from Hinotori and the Hard X-ray Imaging Spectrometer (HXIS) images. The agreement strongly suggests that the method is valid. If the thermal conduction front model for the hard X-ray and microwave source is adopted, then the method enables derivation of area, density, magnetic field, and rise time from hard X-ray and microwave spectral observations. This approach was used to derive these parameters for several rapid impulsive rises in the flares of July 1, 1980, and May 21, 1984. It is shown that the model provides a consistent interpretation of the observations of these impulsive increases. Indeed, the model provides a way to calculate rise times from spectra alone (to within a factor of about three) over more than two orders of magnitude.

Batchelor, D. A.↗

DOE OSTI2023

Using machine learning with optical profilometry for GaN wafer screening

Abstract To improve the manufacturing process of GaN wafers, inexpensive wafer screening techniques are required to both provide feedback to the manufacturing process and prevent fabrication on low quality or defective wafers, thus reducing costs resulting from wasted processing effort. Many of the wafer scale characterization techniques—including optical profilometry—produce difficult to interpret results, while models using classical programming techniques require laborious translation of the human-generated data interpretation methodology. Alternatively, machine learning techniques are effective at producing such models if sufficient data is available. For this research project, we fabricated over 6000 vertical PiN GaN diodes across 10 wafers. Using low resolution wafer scale optical profilometry data taken before fabrication, we successfully trained four different machine learning models. All models predict device pass and fail with 70–75% accuracy, and the wafer yield can be predicted within 15% error on the majority of wafers.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Global biomass supply modeling for long-run management of the climate system

Bioenergy is projected to have a prominent, valuable, and maybe essential, role in climate management. However, there is significant variation in projected bioenergy deployment results, as well as concerns about the potential environmental and social implications of supplying biomass. Bioenergy deployment projections are market equilibrium solutions from integrated modeling, yet little is known about the underlying modeling of the supply of biomass as a feedstock for energy use in these modeling frameworks. We undertake a novel diagnostic analysis with ten global models to elucidate, compare, and assess how biomass is supplied within the models used to inform long-run climate management. With experiments that isolate and reveal biomass supply modeling behavior and characteristics (costs, emissions, land use, market effects), we learn about biomass supply tendencies and differences. The insights provide a new level of modeling transparency and understanding of estimated global biomass supplies that informs evaluation of the potential for bioenergy in managing the climate and interpretation of integrated modeling. For each model, we characterize the potential distributions of global biomass supply across regions and feedstock types for increasing levels of quantity supplied, as well as some of the potential societal externalities of supplying biomass. We also evaluate the biomass supply implications of managing these externalities. Finally, we interpret biomass market results from integrated modeling in terms of our new understanding of biomass supply. Overall, we find little consensus between models on where biomass could be cost-effectively produced and the implications. We also reveal model specific biomass supply narratives, with results providing new insights into integrated modeling bioenergy outcomes and differences. The analysis finds that many integrated models are considering and managing emissions and land use externalities of supplying biomass and estimating that environmental and societal trade-offs in the form of land emissions, land conversion, and higher agricultural prices are cost-effective, and to some degree a reality of using biomass, to address climate change.

09 BIOMASS FUELS↗

DOE OSTI2023

A detailed study of interpretability of deep neural network based top taggers

Abstract Recent developments in the methods of explainable artificial intelligence (XAI) allow researchers to explore the inner workings of deep neural networks (DNNs), revealing crucial information about input–output relationships and realizing how data connects with machine learning models. In this paper we explore interpretability of DNN models designed to identify jets coming from top quark decay in high energy proton–proton collisions at the Large Hadron Collider. We review a subset of existing top tagger models and explore different quantitative methods to identify which features play the most important roles in identifying the top jets. We also investigate how and why feature importance varies across different XAI metrics, how correlations among features impact their explainability, and how latent space representations encode information as well as correlate with physically meaningful quantities. Our studies uncover some major pitfalls of existing XAI methods and illustrate how they can be overcome to obtain consistent and meaningful interpretation of these models. We additionally illustrate the activity of hidden layers as neural activation pattern diagrams and demonstrate how they can be used to understand how DNNs relay information across the layers and how this understanding can help to make such models significantly simpler by allowing effective model reoptimization and hyperparameter tuning. These studies not only facilitate a methodological approach to interpreting models but also unveil new insights about what these models learn. Incorporating these observations into augmented model design, we propose the particle flow interaction network model and demonstrate how interpretability-inspired model augmentation can improve top tagging performance.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Evidential Deep Learning: Enhancing Predictive Uncertainty Estimation for Earth System Science Applications

Abstract Robust quantification of predictive uncertainty is a critical addition needed for machine learning applied to weather and climate problems to improve the understanding of what is driving prediction sensitivity. Ensembles of machine learning models provide predictive uncertainty estimates in a conceptually simple way but require multiple models for training and prediction, increasing computational cost and latency. Parametric deep learning can estimate uncertainty with one model by predicting the parameters of a probability distribution but does not account for epistemic uncertainty. Evidential deep learning, a technique that extends parametric deep learning to higher-order distributions, can account for both aleatoric and epistemic uncertainties with one model. This study compares the uncertainty derived from evidential neural networks to that obtained from ensembles. Through applications of the classification of winter precipitation type and regression of surface-layer fluxes, we show evidential deep learning models attaining predictive accuracy rivaling standard methods while robustly quantifying both sources of uncertainty. We evaluate the uncertainty in terms of how well the predictions are calibrated and how well the uncertainty correlates with prediction error. Analyses of uncertainty in the context of the inputs reveal sensitivities to underlying meteorological processes, facilitating interpretation of the models. The conceptual simplicity, interpretability, and computational efficiency of evidential neural networks make them highly extensible, offering a promising approach for reliable and practical uncertainty quantification in Earth system science modeling. To encourage broader adoption of evidential deep learning, we have developed a new Python package, Machine Integration and Learning for Earth Systems (MILES) group Generalized Uncertainty for Earth System Science (GUESS) (MILES-GUESS) ( https://github.com/ai2es/miles-guess ), that enables users to train and evaluate both evidential and ensemble deep learning. Significance Statement This study demonstrates a new technique, evidential deep learning, for robust and computationally efficient uncertainty quantification in modeling the Earth system. The method integrates probabilistic principles into deep neural networks, enabling the estimation of both aleatoric uncertainty from noisy data and epistemic uncertainty from model limitations using a single model. Our analyses reveal how decomposing these uncertainties provides valuable insights into reliability, accuracy, and model shortcomings. We show that the approach can rival standard methods in classification and regression tasks within atmospheric science while offering practical advantages such as computational efficiency. With further advances, evidential networks have the potential to enhance risk assessment and decision-making across meteorology by improving uncertainty quantification, a longstanding challenge. This work establishes a strong foundation and motivation for the broader adoption of evidential learning, where properly quantifying uncertainties is critical yet lacking.

Schreck, John S.↗

DOE OSTI2026

Search for higgsinos in compressed mass spectra using low-momentum tracks in pp collisions at s=13 TeV with the ATLAS detector

This paper presents two searches for the electroweak production of higgsinos with compressed mass spectra using 140 fb−1 of s=13$$ \sqrt{s}=13 $$ TeV proton-proton collision data collected by the ATLAS experiment at the Large Hadron Collider. Events are required to feature an energetic jet, large missing transverse momentum, and at least one low-momentum charged particle that serves as a candidate higgsino decay product. In the first search, targeting higgsino mass splittings in the range of 0.3–1 GeV, the higgsinos are expected to predominantly decay into pions that are identified as low-momentum charged particles with large transverse impact parameters due to the long higgsino lifetime (cτ ≈ ?(0.1–10 mm)), and neural networks are used to discriminate between signal and background processes. The second search targets larger mass splittings in the range of 1–3 GeV, where the higgsinos are expected to decay promptly into low-momentum leptons, one of which is identified by dedicated low-momentum electron or muon taggers based on neural networks utilising tracking and calorimeter information. No significant excess above the Standard Model prediction is observed in either search and the results are interpreted within simplified models, to set lower limits on the masses of the higgsino-like charginos and neutralinos. Together, these searches exclude chargino masses below 126 GeV at 95% confidence level for mass splittings between the chargino and lightest neutralino in the range of 0.3–2 GeV. This represents the first ATLAS constraints in a portion of this parameter space and surpasses the limits previously set by other experiments.

Aad, G↗