Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model interpretability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Data-driven analysis of neutron diffraction line profiles: application to plastically deformed Ta

Abstract Non-destructive evaluation of plastically deformed metals, particularly diffraction line profile analysis (DLPA), is valuable both to estimate dislocation densities and arrangements and to validate microstructure-aware constitutive models. To date, the interpretation of whole line diffraction profiles relies on the use of semi-analytical models such as the extended convolutional multiple whole profile (eCMWP) method. This study introduces and validates two data-driven DLPA models to extract dislocation densities from experimentally gathered whole line diffraction profiles. Using two distinct virtual diffraction models accounting for both strain and instrument induced broadening, a database of virtual diffraction whole line profiles of Ta single crystals is generated using discrete dislocation dynamics. The databases are mined to create Gaussian process regression-based surrogate models, allowing dislocation densities to be extracted from experimental profiles. The method is validated against 11 experimentally gathered whole line diffraction profiles from plastically deformed Ta polycrystals. The newly proposed model predicts dislocation densities consistent with estimates from eCMWP. Advantageously, this data driven LPA model can distinguish broadening originating from the instrument and from the dislocation content even at low dislocation densities. Finally, the data-driven model is used to explore the effect of heterogeneous dislocation densities in microstructures containing grains, which may lead to more accurate data-driven predictions of dislocation density in plastically deformed polycrystals.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Comparison of equilibrium climate sensitivity estimates from slab ocean, 150-year, and longer simulations

We compare equilibrium climate sensitivity (ECS) estimates from pairs of long (= 800-year) control and abruptly quadrupled CO2 simulations with shorter (150, 300 year) coupled atmosphere-ocean simulations and Slab Ocean Models (SOM). Consistent with previous work, ECS estimates from shorter coupled simulations based on annual averages for years 1-150 underestimate those from SOM (-8% ± 13%) and long (-14% ± 8%) simulations. Analysis of only years 21-150 improved agreement with SOM (-2% ± 14%) and long (-8% ± 10%) estimates. Use of pentadal averages for years 51-150 results in improved agreement with long simulations (-4% ± 11%). While ECS estimates from current generation US models based on SOM and coupled annual averages of years 1-150 range from 2.6°C to 5.3°C, estimates based longer simulations of the same models range from 3.2°C to 7.0°C. Such variations between methods argues for caution in comparison and interpretation of ECS estimates across models.

Dunne, John P.↗
DOE OSTI2023

The Dynamics of Megafire Smoke Plumes in Climate Models: Why a Converged Solution Matters for Physical Interpretations

As the climate system warms, megafires have become more frequent with devastating effects. A byproduct of these events is the creation of smoke plumes that can rise into the stratosphere and spread across the globe where they reside for many months. To gain a deeper understanding of the plume dynamics, global climate simulations of a megafire were performed at a wide range of grid spacings from 2.0° down to 7 km, including a 7 km nonhydrostatic experiment. The analysis focuses on how the resolved dynamics affects the specification of the plume characteristics such as injection height and black carbon (BC) mass. Prior studies initialize the smoke plume at one or a few grid points and this is shown here to produce severely dissipative dynamics. In order to validate such simulations with observations, enhancements of the plume characteristics to offset the dissipation is necessary. Using a numerically converged simulation, sensitivity tests show that to approximate the observed stratospheric lifetime, a reduction in BC fraction by 50% is necessary for external mixtures. The vorticity dynamics of the plume is also analyzed with a Lagrangian budget to understand the mechanisms responsible for the evolution of a collocated anticyclonic vortex. The results can be distilled down into a simple conceptual model. As the plume rises, the air diverges at the top of the updraft where the largest concentrations of smoke are found. This divergence induces a dilution of the background cyclonic absolute vorticity producing an anticyclonic vortex. Vortex decay occurs from opposite arguments.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Improving the accuracy of freight mode choice models: A case study using the 2017 CFS PUF data set and ensemble learning techniques

Here, the US Census Bureau has collected two rounds of experimental data from the Commodity Flow Survey, providing shipment-level characteristics of nationwide commodity movements, published in 2012 (i.e., Public Use Microdata) and in 2017 (i.e., Public Use File). With this information, data-driven methods have become increasingly valuable for understanding detailed patterns in freight logistics. In this study, we used the 2017 Commodity Flow Survey Public Use File data set to explore building a high-performance freight mode choice model, considering three main improvements: (1) constructing local models for each separate commodity/industry category; (2) extracting useful geographical features, particularly the derived distance of each freight mode between origin/destination zones; and (3) applying additional ensemble learning methods such as stacking or voting to combine results from local and unified models for improved performance. The proposed method achieved over 92% accuracy without incorporating external information, an over 19% increase compared to directly fitting Random Forests models over 10,000 samples. Furthermore, SHAP (Shapely Additive Explanations) values were computed to explain the outputs and major patterns obtained from the proposed model. The model framework could enhance the performance and interpretability of existing freight mode choice models.

42 ENGINEERING↗
DOE OSTI2025

Airport Delay Prediction with Temporal Fusion Transformers

Since flight delay hurts passengers, airlines, and airports, its prediction becomes crucial for the decision-making of all stakeholders in the aviation industry and thus has been attempted by various previous research. However, previous delay predictions are often categorical and at a highly aggregated level. To improve that, this study proposes to apply the novel Temporal Fusion Transformer model and predict numerical airport arrival delays at quarter hour level for U.S. top 30 airports. Inputs to our model include airport demand and capacity forecasts, historic airport operation efficiency information, airport wind and visibility conditions, as well as en-route weather and traffic conditions. The results show that our model achieves satisfactory performance measured by small prediction errors on the test set. In addition, the interpretability analysis of the model outputs identifies the important input factors for delay prediction.

Liu, Ke [University of California Berkeley]↗
DOE OSTI2022

How to see hidden patterns in metamaterials with interpretable machine learning

Machine learning models can assist with metamaterials design by approximating computationally expensive simulators or solving inverse design problems. However, past work has usually relied on black box deep neural networks, whose reasoning processes are opaque and require enormous datasets that are expensive to obtain. Here, in this work, we develop two novel machine learning approaches to metamaterials discovery that have neither of these disadvantages. These approaches, called shape-frequency features and unit-cell templates, can discover 2D metamaterials with user-specified frequency band gaps. Our approaches provide logical rule-based conditions on metamaterial unit-cells that allow for interpretable reasoning processes, and generalize well across design spaces of different resolutions. The templates also provide design flexibility where users can almost freely design the fine resolution features of a unit-cell without affecting the user’s desired band gap.

36 MATERIALS SCIENCE↗
DOE OSTI2025

The Role of Water Volume Fraction on Water Adsorption in Anion Exchange Membranes

Water absorption plays a key role in the performance of polymeric anion exchange membranes. It influences important properties such as ionic conductivity and mechanical strength and alters their performance as solid electrolytes in hydrogen electrochemical devices for energy conversion. However, computational approaches that address the relationship between the polymer design and the absorption process are scarce. In this work, we introduce a simple thermodynamic model to predict the water absorption isotherms of polyelectrolyte membranes in contact with a water vapor reservoir that incorporates the specific chemical design of the polymers. The model accurately predicts the water content and macrostructural properties of polynorbornene membranes as a function of the water activity and successfully captures the effect of various polymer design parameters. The energy of pairwise attractive interactions predicted by our model provides a means to interpret the absorption process at the molecular level. The model also reveals the most significant favorable and unfavorable contributions to the free energy and indicates that their balance is solely governed by the water volume fraction, regardless of the polymer design. This universal behavior leads to important implications in the search for better ion exchange membranes.

Zaldivar, Gervasio [New York University, Brooklyn,↗
DOE OSTI2023

Sensitivities of subgrid-scale physics schemes, meteorological forcing, and topographic radiation in atmosphere-through-bedrock integrated process models: a case study in the Upper Colorado River basin

Abstract. Mountain hydrology is controlled by interacting processes extending from the atmosphere through the bedrock. Integrated process models (IPMs), one of the main tools needed to interpret observations and refine conceptual models of the mountainous water cycle, require meteorological forcing that simulates the atmospheric process to predict hydroclimate then subsequently impacts surface–subsurface hydrology. Complex terrain and extreme spatial heterogeneity in mountainous environments drive uncertainty in several key considerations in IPM configurations and require further quantification and sensitivity analyses. Here, we present an IPM using the Weather Research and Forecasting (WRF) model which forces an integrated hydrologic model, ParFlow-CLM, implemented over a domain centered over the East River watershed (ERW), located in the Upper Colorado River basin (UCRB). The ERW is a heavily instrumented 300 km2 region in the headwaters of the UCRB near Crested Butte, CO, with a growing atmosphere-through-bedrock observation network. Through a series of experiments in the water year 2019 (WY19), we use four meteorological forcings derived from commonly used reanalysis datasets, three subgrid-scale physics scheme configurations in WRF, and two terrain shading options within WRF to test the relative importance of these experimental design choices for key hydrometeorological metrics including precipitation and snowpack, as well as evapotranspiration, groundwater storage, and discharge simulated by the ParFlow-CLM. Our hypothesis is that uncertainty from synoptic-scale forcings produces a much larger spread in surface–subsurface hydrologic fields than subgrid-scale physics scheme choice. Results reveal that the WRF subgrid-scale physics configuration leads to larger spatiotemporal variance in simulated hydrometeorological conditions, whereas variance across meteorological forcing with common subgrid-scale physics configurations is more spatiotemporally constrained. Despite reasonably simulating precipitation, a delay in simulated discharge peak is due to a systematic cold bias across WRF simulations, suggesting the need for bias correction. Discharge shows greater variance in response to the WRF simulations across subgrid-scale physics schemes (26 %) rather than meteorological forcing (6 %). The topographic radiation option has minor effects on the watershed-average hydrometeorological processes but adds profound spatial heterogeneity to local energy budgets (±30 W m−2 in shortwave radiation and 1 K air temperature differences in late summer). This is the first presentation of sensitivity analyses that provide support to help guide the scientific community to develop observational constraints on atmosphere-through-bedrock processes and their interactions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Search for dark matter produced in association with a Higgs boson decaying to tau leptons at $\sqrt{s}$ = 13 TeV with the ATLAS detector

A search for dark matter produced in association with a Higgs boson in final states with two hadronically decaying τ-leptons and missing transverse momentum is presented. The analysis uses 139 fb -1 of proton-proton collision data at $\sqrt{s}$ = 13 TeV collected by the ATLAS experiment at the Large Hadron Collider between 2015 and 2018. No evidence of physics beyond the Standard Model is found. The results are interpreted in terms of a 2HDM+a model featuring two scalar Higgs doublets and a pseudoscalar singlet field. Exclusion limits on the parameters of the model in selected benchmark scenarios are derived at 95% confidence level. Model-independent limits are also set on the visible cross-section for processes beyond the Standard Model producing missing transverse momentum in association with a Higgs boson decaying into τ-leptons.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Magnetotelluric Investigations of the Kilauea Volcano, Hawaii

In 2002 and 2003 a collaborative effort was undertaken between Lawrence Berkeley National Laboratory, Sandia National Laboratories, the U.S. Geological Survey (USGS) Menlo Park, the USGS Hawaiian Volcano Observatory, and Electromagnetic Instruments Inc. to study the Kilauea volcano in Hawaii using the magnetotelluric (MT) technique. The work was motivated by a desire to improve understanding of the magma reservoirs and conduits within Kilauea and the East and Southwest Rift zones, which has implications for understanding Kilauea's plumbing system. An improved understanding of the rift zones has implications in understanding large-scale landslides that are generated in the Hilina Slump, which produce significant impacts on coastal communities. Up to eight stations operated simultaneously, with multiple remote reference sites, and data were processed using multi-station robust processing techniques. Data was acquired at 70 sites over the Southwest and East rift zones. Good to excellent quality data were obtained even in the harshest conditions, such as those encountered on the fresh lava flows of the East Rift Zone, where electrical contact resistances are on the order of 100 kΩ. A three-dimensional (3D) MT model study was done to guide interpretation of the observed MT measurements. Synthetic modeling demonstrates that conductive bodies in the upper 3 km can be spatially resolved where MT station sampling is good. Resistivity anomalies in the 3D inversions have a high degree of spatial correlation with previously published seismic velocity anomalies beneath Kilauea. Melt fractions between 0.096 and 0.117 are calculated for the Kilauea and Pu'u'ō'ō low resistivity anomalies, respectively.

58 GEOSCIENCES↗
DOE OSTI2024

A novel method may reveal bulk metallic glass compressive ductility trends in high data rate nanoindentation

Recent methods allow novel amorphous alloy compositions to be rapidly manufactured at small scale; however, obtaining materials properties such as compressive ductility from these smaller specimens has remained a challenge. Here, we suggest a potential high-throughput nanoindentation method that may be able to rapidly characterize the relative compressive ductility between these alloys based on their serration characteristics. The properties of emergent serrations, when interpreted in a simple micromechanical stress relaxation model, may order these materials by their compressive plastic strain to failure. These results are consistent with the ordering obtained from compressed specimens as well as with model simulations, suggesting that this model may be broadly useful for interpreting compressive ductility from nanoindentation serrations. After it is validated on more materials, this new method will match the rapid pace of amorphous alloy development, thus allowing metallic glass properties to be fine-tuned for each application prior to scale prototyping.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Model-independent search for pair production of new bosons decaying into muons in proton-proton collisions at $\sqrt{s}$ = 13 TeV

The results of a model-independent search for the pair production of new bosons within a mass range of 0.21 < m < 60 GeV, are presented. This study utilizes events with a four-muon final state. We use two data sets, comprising 41.5 fb −1 and 59.7 fb −1 of proton-proton collisions at $\sqrt{s}$ = 13 TeV, recorded in 2017 and 2018 by the CMS experiment at the CERN LHC. The study of the 2018 data set includes a search for displaced signatures of a new boson within the proper decay length range of 0 < cτ < 100 mm. Our results are combined with a previous CMS result, based on 35.9 fb −1 of proton-proton collisions at $\sqrt{s}$ = 13 TeV collected in 2016. No significant deviation from the expected background is observed. Results are presented in terms of a model-independent upper limit on the product of cross section, branching fraction, and acceptance. The findings are interpreted across various benchmark models, such as an axion-like particle model, a vector portal model, the next-to-minimal supersymmetric standard model, and a dark supersymmetric scenario, including those predicting a non-negligible proper decay length of the new boson. In all considered scenarios, substantial portions of the parameter space are excluded, expanding upon prior results.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Accelerating the design of lattice structures using machine learning

Lattices remain an attractive class of structures due to their design versatility; however, rapidly designing lattice structures with tailored or optimal mechanical properties remains a significant challenge. With each added design variable, the design space quickly becomes intractable. To address this challenge, research efforts have sought to combine computational approaches with machine learning (ML)-based approaches to reduce the computational cost of the design process and accelerate mechanical design. While these efforts have made substantial progress, significant challenges remain in (1) building and interpreting the ML-based surrogate models and (2) iteratively and efficiently curating training datasets for optimization tasks. Here, we address the first challenge by combining ML-based surrogate modeling and Shapley additive explanation (SHAP) analysis to interpret the impact of each design variable. We find that our ML-based surrogate models achieve excellent prediction capabilities (R 2 > 0.95) and SHAP values aid in uncovering design variables influencing performance. We address the second challenge by utilizing active learning-based methods, such as Bayesian optimization, to explore the design space and report a 5 × reduction in simulations relative to grid-based search. Collectively, these results underscore the value of building intelligent design systems that leverage ML-based methods for uncovering key design variables and accelerating design.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Unrolled Video Super-Resolution Network with Autoregressive Prior for the Case of Known Motion

Real-time detection and classification of distant objects is necessary for many national security applications. However, when objects are far from the sensor, they occupy only a small number of pixels in the captured video, limiting the amount of visual detail available for recognition. State-of-the-art classification methods typically rely on high-resolution (HR) video streams to capture characteristic object features, but obtaining such detail is challenging for distant objects that occupy only a few pixels. This motivates the development of video super-resolution (VSR) methods that enhance object classification by recovering fine details from low-pixel representations. Current VSR methods rely either on model-based optimization, which is interpretable but computationally expensive, or on learning-based approaches, which are efficient and high-performing but often lack flexibility and interpretability. In this report, we propose an end-to-end trainable unrolled VSR network, UVSRNet, which super-resolves each frame in a video by exploiting sub-pixel motion between neighboring low-resolution (LR) frames as well as incorporating high-frequency detail from previously super-resolved frames. In particular, by unrolling a plug-and-play (PnP) half-quadratic splitting (HQS) algorithm, we leverage a model-based data-fitting module alongside a learning-based autoregressive prior module. This combination yields a method that maintains the flexibility and interpretability of model-based methods while achieving the performance advantages of learning-based methods.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2024

Combined search for electroweak production of winos, binos, higgsinos, and sleptons in proton-proton collisions at s = 13 TeV

A combination of the results of several searches for the electroweak production of the supersymmetric partners of standard model bosons, and of charged leptons, is presented. All searches use proton-proton collision data at s = 13 TeV recorded with the CMS detector at the LHC in 2016–2018. The analyzed data correspond to an integrated luminosity of up to 137 fb − 1 . The results are interpreted in terms of simplified models of supersymmetry. Two new interpretations are added with this combination: a model spectrum with the bino as the lightest supersymmetric particle together with mass-degenerate Higgsinos decaying to the bino and a standard model boson, and the compressed-spectrum region of a previously studied model of slepton pair production. Improved analysis techniques are employed to optimize sensitivity for the compressed spectra in the wino and slepton pair production models. The results are consistent with expectations from the standard model. The combination provides a more comprehensive coverage of the model parameter space than the individual searches, extending the exclusion by up to 125 GeV, and also targets some of the intermediate gaps in the mass coverage. © 2024 CERN, for the CMS Collaboration 2024 CERN

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Screening Cu-Zeolites for Methane Activation Using Curriculum-Based Training

Machine learning (ML), when used synergistically with atomistic simulations, has recently emerged as a powerful tool for accelerated catalyst discovery. However, the application of these techniques has been limited by the lack of interpretable and transferable ML models. In this work, we propose a curriculum-based training (CBT) philosophy to systematically develop reactive machine learning potentials (rMLPs) for high-throughput screening of zeolite catalysts. Our CBT approach combines several different types of calculations to gradually teach the ML model about the relevant regions of the reactive potential energy surface. The resulting rMLPs are accurate, transferable, and interpretable. We further demonstrate the effectiveness of this approach by exhaustively screening thousands of [CuOCu] 2+ sites across hundreds of Cu-zeolites for the industrially relevant methane activation reaction. Specifically, this large-scale analysis of the entire International Zeolite Association (IZA) database identifies a set of previously unexplored zeolites (i.e., MEI, ATN, EWO, and CAS) that show the highest ensemble-averaged rates for [CuOCu] 2+ -catalyzed methane activation. We believe that this CBT philosophy can be generally applied to other zeolite-catalyzed reactions and, subsequently, to other types of heterogeneous catalysts. Thus, this represents an important step toward overcoming the long-standing barriers within the computational heterogeneous catalysis community.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Misinterpreting modified gravity as dark energy: a quantitative study

Standard cosmological data analyses typically constrain simple phenomenological dark-energy parameters, for example the present-day value of the equation of state parameter, w 0 , and its variation with scale factor, w a . However, results from such an analysis cannot easily indicate the presence of modified gravity. Even if general relativity does not hold, experimental data could still be fit sufficiently well by a phenomenological w 0 w a CDM, unmodified-gravity model. Hence, it would be very useful to know if there are generic signatures of modified gravity in standard analyses. Here we present, for the first time to our knowledge, a quantitative mapping showing how modified gravity models look when (mis)interpreted within the standard unmodified-gravity analysis. Scanning through a broad space of modified-gravity (Horndeski) models, and assuming a near-future survey consisting of CMB, BAO, and SNIa observations, we report values of the best-fit set of cosmological parameters including (w 0 , w a ) that would be inferred if modified gravity were at work. We find that modified gravity models that can masquerade as standard gravity lead to very specific biases in standard-parameter spaces. Here, we also comment on implications for measurements of the amplitude of mass fluctuations described by the parameter S 8 .

79 ASTRONOMY AND ASTROPHYSICS↗