Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model interpretation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

DYNAMICS OF TURBULENT CONVECTION AND CONVECTIVE OVERSHOOT IN A MODERATE-MASS STAR

We present results of realistic three-dimensional (3D) radiative hydrodynamic simulations of the outer layers of a moderate-mass star (1.47 M {sub ⊙}), including the full convection zone, the overshoot region, and the top layers of the radiative zone. The simulation results show that the surface granulation has a broad range of scales, from 2 to 12 Mm, and that large granules are organized in well-defined clusters, consisting of several granules. Comparison of the mean structure profiles from 3D simulations with the corresponding one-dimensional (1D) standard stellar model shows an increase of the stellar radius by ∼800 km, as well as significant changes in the thermodynamic structure and turbulent properties of the ionization zones. Convective downdrafts in the intergranular lanes between granulation clusters reach speeds of more than 20 km s{sup −1}, penetrate through the whole convection zone, hit the radiative zone, and form an 8 Mm thick overshoot layer. Contrary to semi-empirical overshooting models, our results show that the 3D dynamic overshoot region consists of two layers: a nearly adiabatic extension of the convection zone and a deeper layer of enhanced subadiabatic stratification. This layer is formed because of heating caused by the braking of the overshooting convective plumes. This effect has to be taken into account in stellar modeling and the interpretation of asteroseismology data. In particular, we demonstrate that the deviations of the mean structure of the 3D model from the 1D standard model of the same mass and composition are qualitatively similar to the deviations for the Sun found by helioseismology.

79 ASTRONOMY AND ASTROPHYSICS↗

Probing eddy size and its effective mixing length in stably stratified roughness sublayer flows

Stably stratified roughness sublayer flows are ubiquitous yet remain difficult to represent in models and to interpret using field experiments. Here, continuous high-frequency potential temperature profiles from the forest floor up to 6.5 times the canopy height observed with distributed temperature sensing (DTS) are used to link eddy topology to roughness sublayer stability correction functions and coupling between air layers within and above the canopy. The experiments are conducted at two forest stands classified as hydrodynamically sparse and dense. Near-continuous profiles of eddy sizes (length scales) and effective mixing lengths for heat are derived from the observed profiles using a novel conditional sampling approach. The approach utilizes potential temperature isoline fluctuations from a statically stable background state. The transport of potential temperature by an observed eddy is assumed to be conserved (adiabatic movement) and we assume that irreversible heat exchange between the eddy and the surrounding background occurs along the (vertical) periphery of the eddy. This assumption is analogous to Prandtl's mixing-length concept, where momentum is transported rapidly vertically and then equilibrated with the local mean velocity gradient. A distinct dependence of the derived length scales on background stratification, height above ground, and canopy characteristics emerges from the observed profiles. Implications of these findings for (1) the failure of Monin–Obukhov similarity in the roughness sublayer and (2) above-canopy flow coupling to the forest floor are examined. The findings have practical applications in terms of analysing similar DTS data sets with the proposed approach, modelling roughness sublayer flows, and interpreting nocturnal eddy covariance measurements above tall forested canopies.

54 ENVIRONMENTAL SCIENCES↗

Identifying stochastic dynamics via finite expression methods

Modeling stochastic differential equations (SDEs) is crucial for understanding complex dynamical systems in various scientific fields. Recent methods often employ neural network-based models, which typically represent SDEs through a combination of deterministic and stochastic terms. However, these models usually lack interpretability and have difficulty in generalizing beyond their training domain. Here, this paper introduces the Finite Expression Method (FEX), a symbolic learning approach designed to derive interpretable mathematical representations of the deterministic component of SDEs. For the stochastic component, we integrate FEX with advanced generative modeling techniques to provide a comprehensive representation of SDEs. The numerical experiments on linear, nonlinear, and multidimensional SDEs demonstrate that FEX generalizes well beyond the training domain and delivers more accurate long-term predictions compared to neural network-based methods. The symbolic expressions identified by FEX not only improve prediction accuracy but also offer valuable scientific insights into the underlying dynamics of the systems.

Complex dynamical systems↗

Generalized vs. fractional: a comparative analysis of Maxwell models applied to entangled polymer solutions

Fractional viscoelastic models provide an excellent description of rheological data for polymer systems with power-law behaviour. However, the physical interpretation of their model parameters, which carry fractional units of time, often remains elusive. We show that for poly(ethylene oxide) (PEO) solutions, the fractional Maxwell model (FMM) requires much fewer model parameters than the classical generalized Maxwell model for a good description of the data and that it can be applied consistently to solutions with varying degrees of viscoelasticity. Despite their fractional units, the parameters exhibit scaling laws similar to classical parameters as a function of polymer concentration.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Recent Progress on Surface Water Quality Models Utilizing Machine Learning Techniques

Surface waterbodies are heavily exposed to pollutants caused by natural disasters and human activities. Empowering sensor technologies in water quality monitoring, sufficient measurements have become available to develop machine learning (ML) models. Numerous ML models have quickly been adopted to predict water quality indicators in various surface waterbodies. This paper reviews 78 recent articles from 2022 to October 2024, categorizing water quality models utilizing ML into three groups: Point-to-Point (P2P), which estimates the current target value based on other measurements at the same time point; Sequence-to-Point (S2P), which utilizes previous time series data to predict the target value at one time point ahead; and Sequence-to-Sequence (S2S), which uses previous time series data to forecast sequential target values in the future. The ML models used in each group are classified and compared according to water quality indicators, data availability, and model performance. Widely used strategies for improving performance, including feature engineering, hyperparameter tuning, and transfer learning, are recognized and described to enhance model effectiveness. The interpretability limitations of ML applications are discussed. This review provides a perspective on emerging ML for surface water quality models.

machine learning (ML)↗

An approach to develop chemical intuition for atomistic electron transport calculations using basis set rotations

Single molecule conductance measurements are often interpreted through computational modeling, but the complexity of these calculations makes it difficult to directly link them to simpler concepts and models. Previous work has attempted to make this connection using maximally localized Wannier functions and symmetry adapted basis sets, but their use can be ambiguous and non-trivial. Starting from a Hamiltonian and overlap matrix written in a hydrogen-like basis set, we demonstrate a simple approach to obtain a new basis set that is chemically more intuitive and allows interpretation in terms of simple concepts and models. By diagonalizing the Hamiltonians corresponding to each atom in the molecule, we obtain a basis set that can be partitioned into pseudo-σ and −π and allows partitioning of the Landuaer-Büttiker transmission as well as create simple Hückel models that reproduce the key features of the full calculation. This method provides a link between complex calculations and simple concepts and models to provide intuition or extract parameters for more complex model systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Diagnostic-free onboard battery health assessment

Diverse usage patterns induce complex and variable aging behaviors in lithiumion batteries, complicating accurate health diagnosis and prognosis. Separate diagnostic cycles are often used to untangle the battery’s current state of health from prior complex aging patterns. However, these same diagnostic cycles alter the battery’s degradation trajectory, are time-intensive, and cannot be practically performed in onboard applications. Here, in this work, we leverage portions of operational measurements in combination with an interpretable machine learning model to enable rapid, onboard battery health diagnostics and prognostics without offline diagnostic testing and the requirement of historical data. We integrate mechanistic constraints within an encoder-decoder architecture to extract electrode states in a physically interpretable latent space and enable improved reconstruction of the degradation path. The health diagnosis model framework can be flexibly applied across diverse application interests with slight fine-tuning.

battery aging reconstruction↗

Inclusive search for supersymmetry in pp collisions at $ \sqrt{s}=13 $ TeV using razor variables and boosted object identification in zero and one lepton final states

An inclusive search for supersymmetry (SUSY) using the razor variables is performed using a data sample of proton-proton collisions corresponding to an integrated luminosity of 35.9 fb$^{-1}$, collected with the CMS experiment in 2016 at a center-of-mass energy of $\sqrt{s} =$ 13 TeV. The search looks for an excess of events with large transverse energy, large jet multiplicity, and large missing transverse momentum. The razor kinematic variables are sensitive to large mass differences between the parent particle and the invisible particles of a decay chain and help to identify the presence of SUSY particles. The search covers final states with zero or one charged lepton and features event categories divided according to the presence of a high transverse momentum hadronically decaying W boson or top quark, the number of jets, the number of b-tagged jets, and the values of the razor kinematic variables, in order to separate signal from background for a broad range of SUSY signatures. The addition of the boosted W boson and top quark categories within the analysis further increases the sensitivity of the search, particularly to signal models with large mass splitting between the produced gluino or squark and the lightest SUSY particle. Furthermore, the analysis is interpreted using simplified models of $R$-parity conserving SUSY, focusing on gluino pair production and top squark pair production. Limits on the gluino mass extend to 2.0 TeV, while limits on top squark mass reach 1.14 TeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Soil incubation methods lead to large differences in inferred methane production temperature sensitivity

Abstract Quantifying the temperature sensitivity of methane (CH 4 ) production is crucial for predicting how wetland ecosystems will respond to climate warming. Typically, the temperature sensitivity (often quantified as a Q 10 value) is derived from laboratory incubation studies and then used in biogeochemical models. However, studies report wide variation in incubation-inferred Q 10 values, with a large portion of this variation remaining unexplained. Here we applied observations in a thawing permafrost peatland (Stordalen Mire) and a well-tested process-rich model ( ecosys ) to interpret incubation observations and investigate controls on inferred CH 4 production temperature sensitivity. We developed a field-storage-incubation modeling approach to mimic the full incubation sequence, including field sampling at a particular time in the growing season, refrigerated storage, and laboratory incubation, followed by model evaluation. We found that CH 4 production rates during incubation are regulated by substrate availability and active microbial biomass of key microbial functional groups, which are affected by soil storage duration and temperature. Seasonal variation in substrate availability and active microbial biomass of key microbial functional groups led to strong time-of-sampling impacts on CH 4 production. CH 4 production is higher with less perturbation post-sampling, i.e. shorter storage duration and lower storage temperature. We found a wide range of inferred Q 10 values (1.2–3.5), which we attribute to incubation temperatures, incubation duration, storage duration, and sampling time. We also show that Q 10 values of CH 4 production are controlled by interacting biological, biochemical, and physical processes, which cause the inferred Q 10 values to differ substantially from those of the component processes. Terrestrial ecosystem models that use a constant Q 10 value to represent temperature responses may therefore predict biased soil carbon cycling under future climate scenarios.

54 ENVIRONMENTAL SCIENCES↗

Search for the Higgs boson in the $\gamma \gamma$ final state at the Tevatron

We present searches for Higgs bosons decaying to the di-photon final state using up to 5.4 fb{sup -1} of data at a center-of-mass energy of {radical}s = 1.96 TeV at the Fermilab Tevatron collider. Whilst the branching ratio to the di-photon final state is small in the Standard Model, this channel contributes appreciably to the overall Higgs sensitivity at the Tevatron. In parallel, the limit is re-interpreted in fermiophobic models where the di-photon branching ratio is considerably larger. This decay channel will be of major importance in the light mass Standard Model Higgs search at the LHC.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Machine learning and deep learning for mineralogy interpretation and CO 2 saturation estimation in geological carbon Storage: A case study in the Illinois Basin

Carbon capture and storage (CCS) is a promising approach to simultaneously maintaining energy security and reducing carbon dioxide (CO 2 ) emissions under the current energy portfolio that is dominated by fossil fuel energy. Pre-injection formation characterization and post-injection CO 2 monitoring are two critical tasks to guarantee storage efficiency in CCS. The CCS projects in the Illinois Basin, the first large-scale CO 2 injection into saline aquifers in the United States, employed conventional and the latest pulsed neutron logging (PNL) tools for mineralogy interpretation and CO 2 saturation estimation, which provide valuable references for future CCS projects. Because of the inherent fuzziness of petrophysical measurements and complex subsurface heterogeneity, interpreting well-logging data is time-consuming, and its accuracy can be user-biased. In recent years, data-driven methods have been widely used to capture the non-linear patterns between input features and interpretation results. This work applied and evaluated four commonly used machine learning (ML) models, including ridge regression (RR), random forest (RF), gradient boosting regression (GBR), support vector regression (SVR), and one deep learning (DL) model, the artificial neural network (ANN). We optimized the hyperparameters of the four ML models and the DL model using the simulated annealing algorithm and the grid search strategy, respectively. The input features of the mineralogy interpretation models were eleven conventional well-logging parameters, and the label data (i.e., ground truth) were the porosity and volumetric fractions of six minerals, including quartz, feldspar, dolomite, calcite, clay, and iron minerals. The results demonstrated that the GBR and RF models were superior in predicting volumetric fractions of minerals and porosity; label data with low coefficient of variation (CV) values tended to yield better performance. For CO 2 saturation estimation, the RF was the best-performing model, followed by SVR, ANN, GBR, and RR. Furthermore, we conducted feature importance ranking using the permutation importance algorithm and found that the formation sigma and well pressure were the most important features in this study. In conclusion, the study of CCS projects in the Illinois Basin bridges the gap between the limited knowledge and understanding of geological carbon storage and the increasing demand for reliable, cost-effective, and sustainable energy solutions.

58 GEOSCIENCES↗

Systematic study of the validity of the eikonal model including uncertainties

Nuclear reactions at intermediate beam energies are often interpreted using the eikonal model. In the analysis of complex reaction probes, where few-body reaction methods are needed, the eikonal method may be used as an efficient way for describing the fragment-target reaction process. In this work, we perform a systematic study to test the validity of the eikonal approximation for nucleon-nucleus reactions. We also quantify uncertainties due to the nucleon optical potential on reaction observables. We inspect the validity of the eikonal model and its semiclassical correction by comparing it to exact solutions (obtained from solving the optical-model equation with a finite-differences method) for a wide range of reactions. We also study the effect of relativistic corrections, both kinematic and dynamic, by effectively incorporating the relativistic effects at intermediate energies. The uncertainties from a Bayesian global optical potential (KDUQ) are propagated to the observables of interest. Our study includes neutron and proton reactions on 27 Al , 40 Ca , 90 Zr , and 208 Pb , for a wide range of energies 𝐸 lab = 0–400 MeV. We calculate neutron-total cross sections (elastic and reactions) as well as proton-absorption cross sections as a function of beam energy, using the eikonal model, the eikonal model with a semiclassical correction, and the exact solution. Here, we also compute angular distributions for the methods above. Our results show that for the proton-absorption cross section, the eikonal model can be used down to around 60 MeV and the semiclassical correction extends its use to 30 MeV. However, the validity of the eikonal model for the neutron-total cross section only goes down to ≈120 MeV, a range extended to ≈ 50 MeV when using the semiclassical correction. We find the semiclassical correction to the eikonal model to be less effective in describing the angular distributions. The 1⁢𝜎 uncertainty intervals on the observables we studied is less than 5% for most of the energies considered, but increases rapidly for higher energies, namely energies outside the range of KDUQ (𝐸 lab > 200MeV).

Cluster models↗

Unsupervised machine learning based on non-negative tensor factorization for analyzing reactive-mixing

Analysis of reactive-diffusion simulations representing complex mixing processes requires a large number of independent model runs. For each high-fidelity model simulation, the model inputs are varied and the predicted mixing behavior is represented by temporal and spatial changes in species concentration. It is then required to discern how the model inputs (such as diffusivity, dispersion, anisotropy, and velocity field properties) impact the mixing process. This task is challenging and typically involves interpretation of large model outputs representing temporal and spatial changes of species concentration within the model domain. Yet, the task can be automated and substantially simplified by applying Machine Learning (ML) methods. Here, we present an application of an unsupervised ML method (called NTF k ) using Non-negative Tensor Factorization (NTF) coupled with a custom clustering procedure based on k-means to reveal the temporal and spatial features in product concentrations. An attractive and unique aspect of the proposed ML method is that it ensures the extracted features are non-negative, which is important to obtain a meaningful deconstruction of the mixing processes. The ML methodology is applied to a large set of high-resolution finite-element model simulations representing anisotropic reaction-diffusion processes in perturbed vortex-based velocity fields. The applied finite-element method ensures that spatial and temporal species concentration are always non-negative, even in the case of high anisotropic contrasts. The simulated reaction is a fast irreversible bimolecular reaction A+B→C , where species A and B react to form species C. The reactive-diffusion model input parameters that control mixing include properties of the velocity field (such as vortex structures), anisotropic dispersion, and molecular diffusion. We demonstrate the applicability of the ML feature extraction method to produce a meaningful deconstruction of model outputs to discriminate between different physical processes impacting the reactants, their mixing, and the spatial distribution of the product C. The introduced ML analysis allowed us to identify additive temporal and spatial features that characterize mixing behavior. The application of the proposed NTF k approach is not limited to reactive-mixing. NTFk can be readily applied to any observed or simulated datasets that can be represented as tensors (multi-dimensional arrays) and have separable latent signatures or features.

97 MATHEMATICS AND COMPUTING↗

New model of axion monodromy inflation and its cosmological implications

We propose a new realization of axion monodromy inflation in which axion monodromy arises from torsional cycles in a type IIB compactification. A class of monomial potentials is obtained with specific values for the power index. Moreover, the inflaton mass changes profile due to the couplings between various fields after compactification. Consequently, the potential obtains a step-like profile at some critical scale. We study the cosmological implications of one concrete realization of this model. At the background level, it realizes a sufficiently long inflationary stage, which allows for the violation of the slow-roll conditions for a short period of time when the inflaton is close to the critical scale. Accordingly, the Hubble horizon is perturbed and affects the dynamics of primordial cosmological perturbations. In particular, we analyze the angular power spectrum of B-mode polarization and find a boost on very large scales. We also find that the amplitude of scalar perturbations is suppressed near the critical scale. Thus our model provides an interpretation for the low-ℓ suppression of temperature anisotropies in the CMB power spectrum. We examine these effects and confront the model to observations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Differentiable physics-enabled closure modeling for Burgers’ turbulence

Abstract Data-driven turbulence modeling is experiencing a surge in interest following algorithmic and hardware developments in the data sciences. We discuss an approach using the differentiable physics paradigm that combines known physics with machine learning to develop closure models for Burgers’ turbulence. We consider the one-dimensional Burgers system as a prototypical test problem for modeling the unresolved terms in advection-dominated turbulence problems. We train a series of models that incorporate varying degrees of physical assumptions on an a posteriori loss function to test the efficacy of models across a range of system parameters, including viscosity, time, and grid resolution. We find that constraining models with inductive biases in the form of partial differential equations that contain known physics or existing closure approaches produces highly data-efficient, accurate, and generalizable models, outperforming state-of-the-art baselines. Addition of structure in the form of physics information also brings a level of interpretability to the models, potentially offering a stepping stone to the future of closure modeling.

97 MATHEMATICS AND COMPUTING↗

Code for the manuscript titled "Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces"

We would like to disclose two scripts, written in Jupyter notebook, in which we implement the "Blackout Diffusion Process" described in the manuscript "Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces" (LA-UR-23-20509), to be submitted to the International Conference of Machine Learning (ICML). The abstract of the manuscript is append below. == Typical generative diffusion models rely on a Gaussian diffusion process for training the backward transformations, which can then be used generate samples from Gaussian noise. However, real world data often takes place in discrete-state spaces, which occur in many scientific applications. Here, we develop a theoretical formulation for arbitrary discrete-state Markov processes in the forward diffusion process. We relate the theory to the existing continuous-state Gaussian diffusion and identify the corresponding reverse-time stochastic process and score function in the continuous-time setting, and the reverse-time mapping in the discrete-time setting. As an example of this framework, we introduce "Blackout Diffusion", which learns to produce samples from an empty image instead of from noise. Numerical experiments on the CIFAR-10 dataset confirm the feasibility of generative diffusion modeling in a discrete space. Generalizing from specific (Gaussian) forward processes to a more general framework also sheds light on how to interpret generative diffusion models and their mathematical structure, which we comment on.

Lin, Yen Ting↗

VALIDATION OF THE CORONAL THICK TARGET SOURCE MODEL

We present detailed 3D modeling of a dense, coronal thick-target X-ray flare using the GX Simulator tool, photospheric magnetic measurements, and microwave imaging and spectroscopy data. The developed model offers a remarkable agreement between the synthesized and observed spectra and images in both X-ray and microwave domains, which validates the entire model. The flaring loop parameters are chosen to reproduce the emission measure, temperature, and the nonthermal electron distribution at low energies derived from the X-ray spectral fit, while the remaining parameters, unconstrained by the X-ray data, are selected such as to match the microwave images and total power spectra. The modeling suggests that the accelerated electrons are trapped in the coronal part of the flaring loop, but away from where the magnetic field is minimal, and, thus, demonstrates that the data are clearly inconsistent with electron magnetic trapping in the weak diffusion regime mediated by the Coulomb collisions. Thus, the modeling supports the interpretation of the coronal thick-target sources as sites of electron acceleration in flares and supplies us with a realistic 3D model with physical parameters of the acceleration region and flaring loop.

79 ASTRONOMY AND ASTROPHYSICS↗

Genetic programming for understanding cognitive biases that generate polarization in social networks

Recent studies have applied agent-based models to infer human-interpretable explanations of individual-scale behaviors that generate macro-scale patterns in complex social systems. Genetic programming has proven to be an ideal explainable AI tool for this purpose, where primitives may be expressed in an interpretable fashion and assembled into agent rules. Evolutionary model discovery (EMD) is a tool that combines genetic programming and random forest feature importance analysis, to infer individual-scale, human-interpretable explanations from agent-based models. We deploy EMD to investigate the cognitive biases behind the emergence of ideological polarization within a population. An agent-based model is developed to simulate a social network, where agents are able to create or sever links with one another, and update an internal ideological stance based on their neighbors' stances. Agent rules govern these actions and constitute of cognitive biases. A set of 7 cognitive biases are included as genetic program primitives in the search for rules that generate hyper-polarization among the population of agents. We find that heterogeneity in cognitive biases is more likely to generate polarized social networks. Highly polarized social networks are likely to emerge when individuals with confirmation bias are exposed to those with either attentional bias, egocentric bias, or cognitive dissonance.

Gunaratne, Chathika↗