Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model interpretation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Interpretable, Extensible Linear Regression Model for Electron Density Prediction

This code allows us to generate a model to predict ground state electron densities directly from atomic structure thereby bypassing the need to perform direct DFT calculations. It is based on many body correlation descriptors defined in https://arxiv.org/abs/2004.14442 (IM release numbers: LLNL-JRNL- 808791 and LLNL-JRNL-840698). The code reads in electron densities, in CHGCAR format used by the DFT code VASP, calculates many-body correlation descriptors based on atoms surrounding a grid point and then uses linear regression to obtain the fitting parameters.

Kumar, Shashikant↗

When ancient numerical demons meet physics-informed machine learning: adjoint-based gradients for implicit differentiable modeling

Recent advances in differentiable modeling, a genre of physics-informed machine learning that trains neural networks (NNs) together with process-based equations, have shown promise in enhancing hydrological models' accuracy, interpretability, and knowledge-discovery potential. Current differentiable models are efficient for NN-based parameter regionalization, but the simple explicit numerical schemes paired with sequential calculations (operator splitting) can incur numerical errors whose impacts on models' representation power and learned parameters are not clear. Implicit schemes, however, cannot rely on automatic differentiation to calculate gradients due to potential issues of gradient vanishing and memory demand. Here we propose a “discretize-then-optimize” adjoint method to enable differentiable implicit numerical schemes for the first time for large-scale hydrological modeling. The adjoint model demonstrates comprehensively improved performance, with Kling–Gupta efficiency coefficients, peak-flow and low-flow metrics, and evapotranspiration that moderately surpass the already-competitive explicit model. Therefore, the previous sequential-calculation approach had a detrimental impact on the model's ability to represent hydrological dynamics. Furthermore, with a structural update that describes capillary rise, the adjoint model can better describe baseflow in arid regions and also produce low flows that outperform even pure machine learning methods such as long short-term memory networks. The adjoint model rectified some parameter distortions but did not alter spatial parameter distributions, demonstrating the robustness of regionalized parameterization. Despite higher computational expenses and modest improvements, the adjoint model's success removes the barrier for complex implicit schemes to enrich differentiable modeling in hydrology.

58 GEOSCIENCES↗

Orthogonal Gaussian process models

Gaussian processes models are widely adopted for nonparameteric/semi-parametric modeling. Identifiability issues occur when the mean model contains polynomials with unknown coefficients. Though resulting prediction is unaffected, this leads to poor estimation of the coefficients in the mean model, and thus the estimated mean model loses interpretability. This paper introduces a new Gaussian process model whose stochastic part is orthogonal to the mean part to address this issue. As a result, this paper also discusses applications to multi-fidelity simulations using data examples.

97 MATHEMATICS AND COMPUTING↗

Revisiting Fenton Hill Phase I reservoir creation and stimulation mechanisms through the GTO code comparison effort

A series of experiments performed at the Fenton Hill hot dry rock site after stage 2 drilling of Phase I reservoir provided intriguing field observations on the reservoir’s responses to injection and venting under various conditions. Two teams participating in the US DOE Geothermal Technologies Office (GTO)’s Code Comparison Study (CCS) used different numerical codes to model these five experiments with the objective of inferring the hydraulic stimulation mechanism involved. The codes used by the two teams are based on different numerical principles, and the assumptions made were also different, due to intrinsic limitations in the codes and the modelers’ personal interpretations of the field observations. Both sets of models were able to produce the most important field observations and both found that it was the combination of the vertical gradient of the fracture opening pressure, injection volume, and the use/absence of proppant that yielded the different outcomes of the five experiments.

Fu, Pengcheng↗

A Data-Driven Method for Modeling Creep-Fatigue Stress- Strain Behavior Using Neural ODEs

In this paper, we introduce a data-driven machine learning approach for modeling one-dimensional stress–strain behavior under cyclic loading, utilizing experimental data from the nickel-based Alloy 617. The study employs uniaxial creep–fatigue test data acquired under various loading histories and compares two distinct neural network-based ODE models. The first model, known as the black-box model, comprehensively describes the strain–stress relationship using a Neural ODE equation. To interpret this black-box model, we apply the Sparse Identification of Nonlinear Dynamical Systems (SINDy) technique, transforming the black-box model into an equation-based model using symbolic regression. The second model, the Neural flow rule model, incorporates Hooke’s Law for the linear elastic component, with the nonlinear part characterized by a Neural ODE. Both models are trained with experimental data to accurately reflect the observed stress–strain behavior. We conduct a detailed comparison with the standard Chaboche model, which includes three back stresses. Our results demonstrate that the neural network-based ODE models precisely capture the experimental creep–fatigue mechanical behavior, exceeding the standard Chaboche model’s accuracy. Furthermore, an interpretable model derived from the black-box neural ODE model through symbolic regression achieves accuracy comparable to the Chaboche model, enhancing its interpretability. The results highlight the potential of neural network-based ODE models to depict complex creep–fatigue behavior, eliminating the necessity for experts to define a specific, material-focused model form.

creep-fatigue↗

The interpretation of temperature and salinity variables in numerical ocean model output and the calculation of heat fluxes and heat content

Abstract. The international Thermodynamic Equation of Seawater 2010 (TEOS-10) defined the enthalpy and entropy of seawater, thus enabling the global ocean heat content to be calculated as the volume integral of the product of in situ density, ρ, and potential enthalpy, h0 (with reference sea pressure of 0 dbar). In terms of Conservative Temperature, Θ, ocean heat content is the volume integral of ρcp0Θ, where cp0 is a constant “isobaric heat capacity”. However, many ocean models in the Coupled Model Intercomparison Project Phase 6 (CMIP6) as well as all models that contributed to earlier phases, such as CMIP5, CMIP3, CMIP2, and CMIP1, used EOS-80 (Equation of State – 1980) rather than the updated TEOS-10, so the question arises of how the salinity and temperature variables in these models should be physically interpreted, with a particular focus on comparison to TEOS-10-compliant observations. In this article we address how heat content, surface heat fluxes, and the meridional heat transport are best calculated using output from these models and how these quantities should be compared with those calculated from corresponding observations. We conclude that even though a model uses the EOS-80, which expects potential temperature as its input temperature, the most appropriate interpretation of the model's temperature variable is actually Conservative Temperature. This perhaps unexpected interpretation is needed to ensure that the air–sea heat flux that leaves and arrives in atmosphere and sea ice models is the same as that which arrives in and leaves the ocean model. We also show that the salinity variable carried by present TEOS-10-based models is Preformed Salinity, while the salinity variable of EOS-80-based models is also proportional to Preformed Salinity. These interpretations of the salinity and temperature variables in ocean models are an update on the comprehensive Griffies et al. (2016) paper that discusses the interpretation of many aspects of coupled Earth system models.

54 ENVIRONMENTAL SCIENCES↗

PORFLOW Simulations Supporting Saltstone Disposal Unit Design Optimization

SRNL was requested by SRR to perform PORFLOW simulations to support potential cost-saving design modifications to future Saltstone Disposal Units in Z-Area (SRR-CWDA-2015-00120). The design sensitivity cases are defined in a modeling input specification document SRR-CWDA-2015-00133 Rev. 1. A high-level description of PORFLOW modeling and interpretation of results are provided in SRR-CWDA-2015-00169. The present report focuses on underlying technical issues and details of PORFLOW modeling not addressed by the input specification and results interpretation documents. Design checking of PORFLOW modeling is documented in SRNL-L3200-2015-00146.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Simulations of stable compact proton beam acceleration from a two-ion-species ultrathin foil

We report stable laser-driven proton beam acceleration from ultrathin foils consisting of two ion species: heavier carbon ions and lighter protons. Multidimensional particle-in-cell simulations show that the radiation pressure leads to very fast and complete spatial separation of the species. The laser pulse does not penetrate the carbon ion layer, avoiding the proton Rayleigh-Taylor (RT)-like instability. Ultimately, the carbon ions are heated and spread extensively in space. In contrast, protons always ride on the front of the carbon ion cloud, forming a compact high quality bunch. We introduce a simple three-interface model to interpret the instability suppression in the proton layer. The model is backed by simulations of various compound foils such as carbon-deuterium and carbon-tritium foils. The effects of the carbon ions' charge state on proton acceleration are also investigated. It is shown that with the decrease of the carbon ion charge state, both the RT-like instability and the Coulomb explosion degrade the energy spectrum of the protons. Finally, full 3D simulations are performed to demonstrate the robustness of the stable two-ion-species regime.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Simulation of the 2003 Foss Barge - Point Wells Oil Spill: A Comparison between BLOSOM and GNOME Oil Spill Models

The Department of Energy’s (DOE’s) National Energy Technology Laboratory’s (NETL’s) Blowout and Spill Occurrence Model (BLOSOM), and the National Oceanic and Atmospheric Administration’s (NOAA’s) General NOAA Operational Modeling Environment (GNOME) are compared. Increasingly complex simulations are used to assess similarities and differences between the two models’ components. The simulations presented here are forced by ocean currents from a Finite Volume Community Ocean Model (FVCOM) implementation that has excellent skill in representing tidal motion, and with observed wind data that compensates for a coarse vertical ocean model resolution. The comprehensive comparison between GNOME and BLOSOM presented here, should aid modelers in interpreting their results. Beyond many similarities, aspects where both models are distinct are highlighted. Some suggestions for improvement are included, e.g., the inclusion of temporal interpolation of the forcing fields (BLOSOM) or the inclusion of a deflection angle option when parameterizing wind-driven processes (GNOME). Overall, GNOME and BLOSOM perform similarly, and are found to be complementary oil spill models. This paper also sheds light on what drove the historical Point Wells spill, and serves the additional purpose of being a learning resource for those interested in oil spill modeling. The increasingly complex approach used for the comparison is also used, in parallel, to illustrate the approach an oil spill modeler would typically follow when trying to hindcast or forecast an oil spill, including detailed technical information on basic aspects, like choosing a computational time step. We discuss our successful hindcast of the 2003 Point Wells oil spill that, to our knowledge, had remained unexplained. The oil spill models’ solutions are compared to the historical Point Wells’ oil trajectory, in time and space, as determined from overflight information. Our hindcast broadly replicates the correct locations at the correct times, using accurate tide and wind forcing. While the choice of wind coefficient we use is unconventional, a simplified analytic model supported by observations, suggests that it is justified under this study’s circumstances. We highlight some of the key oceanographic findings as they may relate to other oil spills, and to the regional oceanography of the Salish Sea, including recommendations for future studies.

42 ENGINEERING↗

A review of computing-based automated fault detection and diagnosis of heating, ventilation and air conditioning systems

We report faults in Heating, Ventilation, and Air Conditioning (HVAC) systems of buildings result in significant energy waste in building operation. With fast-growing sensing data availability and advancement in computing, computational modeling has demonstrated strong capability to detect and diagnose HVAC system faults, hence, ensuring efficient building operation. This paper comprehensively reviews the state-of-the-art computing-based fault detection and diagnosis (FDD) for HVAC systems. Overall, the reviewed computing-based FDD methods are classified as two major approaches: knowledge-based and data-driven approaches. We then identify multiple important topics, including data availability, training data size, data quality, approach generality, capability, interpretability, and required modeling efforts, along with corresponding metrics to summarize the most updated FDD development. Generally, the knowledge-based approaches are further divided as physics-based modeling, Diagnostic Bayesian Network, and performance indicator-based methods while data-driven approaches include supervised learning, unsupervised learning, and regression and statistics-based methods. State-of-the-art FDD development, remaining challenges, and future research directions are further discussed to push forward FDD in practice. Availability of fault data, capability of existing methods to deal with complex fault situations (such as simultaneous faults), modeling interpretability for data-driven methods, and required engineering efforts for physics-based methods are identified as remaining challenges in FDD development. Improving modeling fidelity and reducing modeling efforts are essential for applying physics-based methods in real buildings. Meanwhile, addressing fault data availability, increasing algorithm adaptability, and handling multiple faults are essential to further enhance the applicability of data-driven FDD approaches.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Experimental Soil Warming Impacts Soil Moisture and Plant Water Stress and Thereby Ecosystem Carbon Dynamics

Experimental soil heating experiments have found a consistent increase in soil-surface CO 2 emissions ( F s ), but inconsistent soil organic carbon (SOC) responses. Interpretation of heating effects is complicated by spatial heterogeneity and soil moisture, nitrogen availability, and microbial and plant responses. Here we applied a mechanistic ecosystem model to interpret heating impacts on a California forest subjected to 1 m deep, 4°C heating. The model accurately simulated control-plot CO 2 fluxes, SOC stocks, fine root biomass, soil moisture, and soil temperature, and the observed increases in F s and decreases in fine root biomass. We show that a complex suite of interactions can lead to a consistent increase in F s (~17%) over the 5-year study period, with very small changes in SOC stocks (<1%). Modeled increases in leaf water stress from soil drying reduced GPP and NPP. The resulting reduction in leaf and fine root allocation increased fine root litter inputs to the soil and reduced root exudation. Soil heating led to about a 50% larger increase in root autotrophic respiration than in heterotrophic respiration, with the heating effect on both these fluxes decreasing over the simulation period. Increased heterotrophic respiration led to increased soil N availability and plant N uptake. These heating responses are mechanistically linked, of magnitudes that can affect ecosystem dynamics, and long-term observations of them are rarely made. Therefore, we conclude that a coupled observational and mechanistic modeling framework is needed to interpret manipulation experiments, and to improve projections of climate change impacts on terrestrial ecosystem carbon dynamics.

54 ENVIRONMENTAL SCIENCES↗

A local structure model for network analysis

The statistical analysis of networks is a popular research topic with ever widening applications. Exponential random graph models (ERGMs), which specify a model through interpretable, global network features, are common for this purpose. In this study we introduce a new class of models for network analysis, called local structure graph models (LSGMs). In contrast to an ERGM, a LSGM specifies a network model through local features and allows for an interpretable and controllable local dependence structure. In particular, LSGMs are formulated by a set of full conditional distributions for each network edge, e.g., the probability of edge presence/absence, depending on neighborhoods of other edges. Additional model features are introduced to aid in specification and to help alleviate a common issue (occurring also with ERGMs) of model degeneracy. Finally, the proposed models are demonstrated on a network of tornadoes in Arkansas where a LSGM is shown to perform significantly better than a model without local dependence.

97 MATHEMATICS AND COMPUTING↗

Characterizing magnetized plasmas with dynamic mode decomposition

Accurate and efficient plasma models are essential to understand and control experimental devices. Existing magnetohydrodynamic or kinetic models are nonlinear and computationally intensive and can be difficult to interpret, while often only approximating the true dynamics. In this work, data-driven techniques recently developed in the field of fluid dynamics are leveraged to develop interpretable reduced-order models of plasmas that strike a balance between accuracy and efficiency. In particular, dynamic mode decomposition (DMD) is used to extract spatio-temporal magnetic coherent structures from the experimental and simulation datasets of the helicity injected torus with steady inductive (HIT-SI) experiment. Three-dimensional magnetic surface probes from the HIT-SI experiment are analyzed, along with companion simulations with synthetic internal magnetic probes. A number of leading variants of the DMD algorithm are compared, including the sparsity-promoting and optimized DMD. Optimized DMD results in the highest overall prediction accuracy, while sparsity-promoting DMD yields physically interpretable models that avoid overfitting. These DMD algorithms uncover several coherent magnetic modes that provide new physical insights into the inner plasma structure. These modes were subsequently used to discover a previously unobserved three-dimensional structure in the simulation, rotating at the second injector harmonic. Finally, using data from probes at experimentally accessible locations, DMD identifies a resistive kink mode, a ubiquitous instability seen in magnetized plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Improving Precipitation Estimation Using Convolutional Neural Network

Precipitation process is generally considered to be poorly represented in numerical weather/climate models. Statistical downscaling (SD) methods, which relate precipitation with model resolved dynamics, often provide more accurate precipitation estimates compared to model's raw precipitation products. Herein we introduce the convolutional neural network model to foster this aspect of SD for daily precipitation prediction. Specifically, we restrict the predictors to the variables that are directly resolved by discretizing the atmospheric dynamics equations. In this sense, our model works as an alternative to the existing precipitation-related parameterization schemes for numerical precipitation estimation. We train the model to learn precipitation-related dynamical features from the surrounding dynamical fields by optimizing a hierarchical set of spatial convolution kernels. We test the model at 14 geogrid points across the contiguous United States. Results show that provided with enough data, precipitation estimates from the convolutional neural network model outperform the reanalysis precipitation products, as well as SD products using linear regression, nearest neighbor, random forest, or fully connected deep neural network. Evaluation for the test set suggests that the improvements can be seamlessly transferred to numerical weather modeling for improving precipitation prediction. Based on the default network, we examine the impact of the network architectures on model performance. Also, we offer simple visualization and analyzing approaches to interpret the models and their results. Our study contributes to the following two aspects: First, we offer a novel approach to enhance numerical precipitation estimation; second, the proposed model provides important implications for improving precipitation-related parameterization schemes using a data-driven approach.

54 ENVIRONMENTAL SCIENCES↗

Role of Neutrals Versus Transport in Determining the Pedestal Density Structure: Final Technical Report

In fusion devices the plasma density plays a crucial role in determining the fusion reaction rate and has a direct impact on the fusion gain of a given device. This density is in general regulated by the particle sources and transport near the plasma edge, which give rise to an edge density pedestal. When predicting the performance of future devices, this density pedestal is often prescribed, rather than predicted, due to a lack of models which allow confident extrapolation. This project aims to advance these models through the focused validation of theoretical models related to the transport of fueling neutral particles, and through interpretive transport modeling in present day fusion plasmas, in which the penetration of neutrals is altered to better simulate future reactor-like conditions. Achievements in theory and model validation under this project have advanced our understanding of how much of the edge density profile is set by transport versus direct ionization, enabling interesting projections to future burning plasma devices.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Understanding the Drivers of Atlantic Multidecadal Variability using a Stochastic Model Hierarchy

The relative importance of ocean and atmospheric dynamics in generating Atlantic Multidecadal Variability (AMV) remains an open question. Comparisons between climate models with SLAB and fully-dynamic (FULL) ocean components are often used to explore this question, but cannot reveal how individual ocean processes generate these differences. We build a hierarchy of physically interpretable stochastic models to investigate the contribution of two upper-ocean processes to AMV: the role of seasonal variation and mixed-layer entrainment. This interpretability arises from the stochastic model’s simplified representation of sea surface temperature (SST), considering only the local upper ocean response to white-noise atmospheric forcing and its impact on surface heat exchange. We focus on understanding differences between SLAB and FULL non-eddy resolving pre-industrial control simulations of the Community Earth System Model 1 (CESM), and estimate the stochastic model parameters from each respective simulation. Despite its simplicity, the stochastic model reproduces temporal characteristics of SST variability in the SPG, including reemergence, seasonal-to-interannual persistence and power spectra. Furthermore, unrealistically persistent SST of the CESM-SLAB ocean simulation is reproduced in the equivalent stochastic model configuration where the mixed-layer depth (MLD) is constant. The stochastic model also reveals that vertical entrainment primarily damps SST variability, thus explaining why SLAB exhibits larger SST variance than FULL. Here, the stochastic model driven by temporally stochastic, spatially coherent forcing patterns reproduces the canonical AMV pattern. However, the amplitude of low-frequency variability remains underestimated, suggesting a role for ocean dynamics beyond entrainment.

54 ENVIRONMENTAL SCIENCES↗