Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Physics-based statistical learning approach to mesoscopic model selection

In materials science and many other research areas, models are frequently inferred without considering their generalization to unseen data. Here, we apply statistical learning using cross-validation to obtain an optimally predictive coarse-grained description of a two-dimensional kinetic nearest-neighbor Ising model with Glauber dynamics (GD) based on the stochastic Ginzburg-Landau equation (sGLE). The latter is learned from GD “training” data using a log-likelihood analysis, and its predictive ability for various complexities of the model is tested on GD “test” data independent of the data used to train the model on. Using two different error metrics, we perform a detailed analysis of the error between magnetization time trajectories simulated using the learned sGLE coarse-grained description and those obtained using the GD model. We show that both for equilibrium and out-of-equilibrium GD training trajectories, the standard phenomenological description using a quartic free energy does not always yield the most predictive coarse-grained model. Moreover, increasing the amount of training data can shift the optimal model complexity to higher values. Our results are promising in that they pave the way for the use of statistical learning as a general tool for materials modeling and discovery.

36 MATERIALS SCIENCE↗

A new method for inferring city emissions and lifetimes of nitrogen oxides from high-resolution nitrogen dioxide observations: a model study

We present a new method to infer emissions and lifetimes of nitrogen oxides (NO x ) based on tropospheric nitrogen dioxide (NO 2 ) observations together with reanalysis wind fields for cities located in polluted backgrounds. Since the accuracy of the method is difficult to assess due to lack of “true values” that can be used as a benchmark, we apply the method to synthetic NO 2 observations derived from the NASA-Unified Weather Research and Forecasting (NU-WRF) model at a high horizontal spatial resolution of 4 km × 4 km for cities over the continental United States. We compare the inferred emissions and lifetimes with the values given by the NU-WRF model to evaluate the method. The method is applicable to 26 US cities. The derived results are generally in good agreement with the values given by the model, with the relative differences of 2 % ± 17 % (mean ± standard deviation) and 15 % ± 25 % for lifetimes and emissions, respectively. Our investigation suggests that the use of wind data prior to the satellite overpass time improves the performance of the method. The correlation coefficients between inferred and NU-WRF lifetimes increase from 0.56 to 0.79 and for emissions increase from 0.88 to 0.96 when comparing results based on wind fields sampled simultaneously with satellite observations and averaged over 9 h data prior to satellite observations, respectively. We estimate that uncertainties in NO x lifetime and emissions arising from the method are approximately 15 % and 20 %, respectively, for typical (US) cities. The total uncertainties reach up to 43% (lifetimes) and 45% (emissions) by considering the additional uncertainties associated with satellite NO 2 observations and wind data. We expect this new method to be applicable to NO 2 observations from the TROPOspheric Monitoring Instrument (TROPOMI) and geostationary satellites, such as Geostationary Environment Monitoring Spectrometer (GEMS) or the Tropospheric Emissions: Monitoring Pollution (TEMPO) instrument, to estimate urban NO x emissions and lifetimes globally.

54 ENVIRONMENTAL SCIENCES↗

Inference of Experimental Radial Impurity Transport on Alcator C-Mod: Bayesian Parameter Estimation and Model Selection.

We present a fully Bayesian approach for the inference of radial profiles of impurity transport coefficients and compare its results to neoclassical, gyrofluid and gyrokinetic modeling. Using nested sampling, the Bayesian Impurity Transport InferencE (BITE) framework can handle complex parameter spaces with multiple possible solutions, offering great advantages in interpretative power and reliability with respect to previously demonstrated methods. BITE employs a forward model based on the pySTRAHL package, built on the success of the well-known STRAHL code [Dux, IPP Report, 2004], to simulate impurity transport in magnetically-confined plasmas. In this paper, we focus on calcium (Ca, Z=20) Laser Blow-Off injections into Alcator C-Mod plasmas. Multiple Ca atomic lines are diagnosed via high-resolution X-ray Imaging Crystal Spectroscopy and Vacuum Ultra-Violet measurements. We analyze a sawtoothing I-mode discharge for which neoclassical and turbulent (quasilinear and nonlinear) predictions are also obtained. We find good agreement in diffusion across the entire radial extent, while turbulent convection and density profile peaking are estimated to be larger in experiment than suggested by theory. Efforts and challenges associated with the inference of experimental pedestal impurity transport are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Inference of experimental radial impurity transport on Alcator C-Mod: Bayesian parameter estimation and model selection

We present a fully Bayesian approach for the inference of radial profiles of impurity transport coefficients and compare its results to neoclassical, gyrofluid and gyrokinetic modeling. Using nested sampling, the Bayesian Impurity Transport InferencE (BITE) framework can handle complex parameter spaces with multiple possible solutions, offering great advantages in interpretative power and reliability with respect to previously demonstrated methods. BITE employs a forward model based on the pySTRAHL package, built on the success of the well-known STRAHL code [Dux, IPP Report, 2004], to simulate impurity transport in magnetically-confined plasmas. In this paper, we focus on calcium (Ca, Z=20) Laser Blow-Off injections into Alcator C-Mod plasmas. Multiple Ca atomic lines are diagnosed via high-resolution X-ray Imaging Crystal Spectroscopy and Vacuum Ultra-Violet measurements. We analyze a sawtoothing I-mode discharge for which neoclassical and turbulent (quasilinear and nonlinear) predictions are also obtained. Here, we find good agreement in diffusion across the entire radial extent, while turbulent convection and density profile peaking are estimated to be larger in experiment than suggested by theory. Efforts and challenges associated with the inference of experimental pedestal impurity transport are discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Improving deep learning model performance under parametric constraints for materials informatics applications

Abstract Modern machine learning (ML) and deep learning (DL) techniques using high-dimensional data representations have helped accelerate the materials discovery process by efficiently detecting hidden patterns in existing datasets and linking input representations to output properties for a better understanding of the scientific phenomenon. While a deep neural network comprised of fully connected layers has been widely used for materials property prediction, simply creating a deeper model with a large number of layers often faces with vanishing gradient problem, causing a degradation in the performance, thereby limiting usage. In this paper, we study and propose architectural principles to address the question of improving the performance of model training and inference under fixed parametric constraints. Here, we present a general deep-learning framework based on branched residual learning (BRNet) with fully connected layers that can work with any numerical vector-based representation as input to build accurate models to predict materials properties. We perform model training for materials properties using numerical vectors representing different composition-based attributes of the respective materials and compare the performance of the proposed models against traditional ML and existing DL architectures. We find that the proposed models are significantly more accurate than the ML/DL models for all data sizes by using different composition-based attributes as input. Further, branched learning requires fewer parameters and results in faster model training due to better convergence during the training phase than existing neural networks, thereby efficiently building accurate models for predicting materials properties.

36 MATERIALS SCIENCE↗

An Applied Strategy for Using Empirical and Hybrid Models in Online Monitoring

The monitoring of plant equipment for failure prediction is one of the key contributors to operation and maintenance (O&M) costs for a nuclear power plant (NPP) because O&M monitoring depends on labor-intensive activities that are required to meet high equipment reliability standards. These activities rely primarily on humans for information gathering, condition diagnosis, and predictive analysis. Online monitoring aims to automate these activities by relying on sensors to replace human information gathering and machine learning to replace human analysis and decision making. To facilitate automated monitoring, a systematic strategy for anomaly detection is needed to optimally use the available sensor data, empirical models, and physics-supported models. This strategy is essential to provide credible reasoning on why and when an empirical (i.e., purely data-driven) versus hybrid (i.e., physics-supported) approach should be used and to determine the ideal mix of these two approaches for a defined anomaly detection scope. The extant methods usually adopt an ad hoc trial-and-error approach that, in addition to being time-consuming and costly, is also highly subjective; it is impacted by the background and the skill set of the personnel making the decisions. Thus, such an approach cannot guarantee an optimum outcome. This represents the motivation of the current research effort, which is focused on devising a scientifically supported strategy for the optimum selection of anomaly detection methods. This report presents a detailed assessment of the main anomaly detection techniques within the empirical or hybrid method streams. Empirical methods include pattern, statistical, and causal inference. Hybrid methods include the use of physics models to train and test data methods, reduce data dimensionality, reduce data-model complexity, augment data, and reduce empirical uncertainty; hybrid methods also include the use of data to tune physics models. The listed techniques within these two streams represent the vast majority of techniques performed for anomaly detection. Using the techniques as outcomes, a strategy was developed to enable a systematic decision-making process to lead to one of these techniques. The strategy is driven by key decision points related to data relevance, simple modeling feasibility, data inference, physics-modeling value, data dimensionality, physics knowledge, method of validation, performance, data availability and suitability for training and testing, cause-effect, entropy inference, and model fitting. Each of these decision points in the strategy is explained in detail in this report with examples, along with the scientific basis behind the decisions and outcomes in common and simplified terminology. The strategy is developed for use by any NPP staff with basic engineering or science knowledge. A user-friendly graphical state flow diagram was also developed as a visual presentation of the strategy. The strategy was tested and demonstrated through two pilot projects for the application of anomaly detection at an NPP. Each pilot had two use cases: an initial case in which certain decisions were made that resulted in one or more empirical techniques and a revised use case where one or more key decisions were modified resulting in using a set of hybrid methods.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Embedding a critical point in a hadron to quark-gluon crossover equation of state

Lattice QCD simulations have shown unequivocally that the transition from hadrons to quarks and gluons is a crossover when the baryon chemical potential is zero or small. Many model calculations predict the existence of a critical point at a value of the chemical potential where current lattice simulations are unreliable. We show how to embed a critical point in a smooth background equation of state so as to yield the critical exponents and critical amplitude ratios expected of a transition in the same universality class as the liquid-gas phase transition and the three-dimensional Ising model. There are only two independent critical exponents; the relations α + 2β + γ = 2 and β(δ-1) = γ arise automatically, as does a relation between the two critical amplitudes. The resulting equation of state has parameters that may be inferred by hydrodynamic modeling of heavy-ion collisions in the Beam Energy Scan II at the BNL Relativistic Heavy Ion Collider or in experiments at other accelerators.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Constitutive model fingerprints in medium-amplitude oscillatory shear

Rheologists have expectations for signatures of linear viscoelastic properties, such as shapes of G'(ω) and G"(ω). Medium amplitude (or asymptotically-nonlinear) oscillatory shear (MAOS) provides additional nonlinear rheological information with low dimensional, well-defined material functions. Here, we develop expectations of signatures (or fingerprints) for the four asymptotically-nonlinear material functions associated with MAOS, [e 1 ](ω), [e 3 ](ω), [v 1 ](ω), [v 3 ](ω). Although the linear fingerprints may be identical for different models, the asymptotically-nonlinear fingerprints may be different in magnitude, frequency-scaling, curve shapes, and sign changes. To perform the analysis, we collect/translate a library of available analytical strain-controlled MAOS fingerprints for seven different constitutive models. Using this library, we identify general trends and highlight key differences of asymptotic-nonlinear viscoelasticity. Asymptotic nonlinearities for all models considered here obey the terminal regime inter-relations and frequency scaling predicted by Bharadwaj and Ewoldt. Unlike the positive linear viscoelastic measures, at least one of the four asymptotic nonlinearities changes signs with Deborah number (De). Following sign interpretations of Ewoldt and Bharadwaj, we show that nonlinearities tend to be driven by strain-rates at small De, and by strains at large De, a trend observed for nearly all the constitutive models studied here, the exception being the model for dilute rigid dumbbell suspensions. Some constitutive models exhibit multiple sign changes at intermediate De and there may be no universal behavior of asymptotically-nonlinear fingerprints in this regime. Therefore, frequency-dependent signatures can be material-specific. Furthermore, this will allow inverse problems to infer structure, select models, and fit model parameters using asymptotically-nonlinear signatures. To illustrate this aspect, we demonstrate a fingerprint matching exercise with experimental measurements on a transiently cross-linked hydrogel system. We find that currently available model fingerprints can match the qualitative magnitudes and frequency dependence, but not the signs of the experimental transient network response.

42 ENGINEERING↗

Bayesian calibration of a hybrid nuclear collision model using $\textit{p}$₋Pb and Pb-Pb data at energies available at the CERN Large Hadron Collider

Here, we posit a unified hydrodynamic and microscopic description of the quark-gluon plasma (QGP) produced in ultrarelativistic p₋Pb and Pb-Pb collisions at $\sqrt{s}_\text{NN}$ = 5.02 TeV and evaluate our assertion using Bayesian inference. Specifically, we model the dynamics of both collision systems using initial conditions with parametric nucleon substructure, a preequilibrium free streaming stage, event-by-event viscous hydrodynamics, and a microscopic hadronic afterburner. Free parameters of the model, which describe the initial state and QGP medium are then simultaneously calibrated to fit charged-particle yields, mean $p_T$, and flow cumulants. We argue that the global agreement of the calibrated model with the experimental data strongly supports the existence of hydrodynamic flow in small collision systems at ultrarelativistic energies, and that the flow produced develops at length scales smaller than a single proton. Posterior estimates for the model's input parameters are obtained, and new insights into the temperature dependence of the QGP transport coefficients and event-by-event structure of the proton are discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Validity of a finite temperature expansion for dense nuclear matter

In this work we provide a new, well-controlled expansion of the equation of state of dense matter from zero to finite temperatures (𝑇) while covering a wide range of charge fractions (𝑌 𝑄 ), from pure neutron to isospin symmetric nuclear matter. Our expansion can be used to describe neutron star mergers using the equation of state inferred from neutron star observations. We discuss how knowledge from low-energy nuclear experiments and heavy-ion collisions can be directly incorporated into the expansion. We also suggest new thermodynamic quantities of interest that can be calculated from theoretical models or directly inferred by experimental data that can be used to infer the finite temperature equation of state. With our new method, we can quantify the uncertainty in our finite 𝑇 and 𝑌 𝑄 expansions without making assumptions about the underlying degrees of freedom. We can reproduce results from a microscopic equation of state up to 𝑇 = 100 MeV for baryon chemical potential 𝜇 𝐵 ≳ 1100 MeV [≈(1–2)⁢𝑛 sat ] within 5% error, with even better results for larger 𝜇 𝐵 and/or lower 𝑇. We investigate the sources of numerical and theoretical uncertainty and discuss future directions of study.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Embedding a Critical Point in a Hadron to Quark–Gluon Crossover Equation of State

It is shown how to embed a critical point in a smooth background equation of state so as to yield the critical exponents and critical amplitude ratios expected of a transition in the same universality class as the liquid–gas phase transition and the 3D Ising model. There are only two independent critical exponents; the relations α + 2β + $\gamma$ = 2 and β(δ - 1) = $\gamma$ arise automatically, as does a new relation between the two critical amplitudes. The resulting equation of state has parameters which may be inferred by hydrodynamic modeling of heavy-ion collisions in the Beam Energy Scan II at the Relativistic Heavy Ion Collider.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Dealing with Measurement Uncertainties as Nuisance Parameters in Bayesian Model Calibration

In the presence of model discrepancy, the calibration of physics-based models for physical parameter inference is a challenging problem. Lack of identifiability between calibration parameters and model discrepancy requires additional identifiability constraints to be placed on the model discrepancy to obtain unique physical parameter estimates. If these assumptions are violated, the inference for the calibration parameters can be systematically biased. In many applications, such as in dynamic material property experiments, many of the calibration inputs refer to measurement uncertainties. Here, we develop a metric for identifying overfitting of these measurement uncertainties, propose a prior capable of reducing this overfitting, and show how this leads to a diagnostic tool for validation of physical parameter inference. The approach is demonstrated for a benchmark example and applied for a material property application to perform inference on the equation of state parameters of tantalum.

97 MATHEMATICS AND COMPUTING↗

Structural changes and variability of the ITCZ induced by radiation–cloud–convection–circulation interactions: inferences from the Goddard Multi-scale Modeling Framework (GMMF) experiments

In this paper, we have investigated the impact of radiation–cloud–convection–circulation interaction (RC3I) on structural changes and variability of the Inter-tropical Convergence Zone (ITCZ) using the Goddard Multi-scale Modeling Framework, where cloud processes are super-parameterized, i.e., explicitly resolved with 2-D cloud resolving models embedded in each coarse grid of the host Goddard Earth Observing System-Version 5 global climate model. Experiments have been conducted under prescribed sea surface temperature conditions for 10 years (2007–2016), with and without cloud radiation feedback in the atmosphere, respectively. Diagnostic analyses separately for January and July show that RC3I leads to an enhanced and expanded Hadley Circulation characterized by (1) a quasi-uniform warming and moistening of the tropical atmosphere and a sharpening of the ITCZ with enhanced deep convection, more intense precipitation and higher clouds, (2) extended drying of the tropical marginal convective zones, and extratropical mid- to lower troposphere, and (3) a cooling of the polar regions, with increased baroclinicity and midlatitude storm track activities. Computations based on the zonal mean thermodynamic energy balance equation show that the radiative warming and cooling are strongly balanced by local adiabatic processes associated with changes in large-scale vertical motions, as well as horizontal atmospheric heat transport. In the tropics, enhanced short-wave absorption and longwave water vapor greenhouse effects by high clouds play key roles in providing strong positive feedback to the tropospheric warming. In the extratropics, increased atmospheric heat transport associated with changes in the Hadley circulation is balanced by strong longwave cooling above, and warming below due to increased high clouds. We also find a strong positive correlation between daily and pentad heavy rain in the ITCZ core, and expansion of the drier zones coupled to a contraction of the highly convective zones in the ITCZ, indicating a strong tendency RC3I-induced convective aggregation in tropical clouds i.e., wet-regions-get-wetter and contracted, and dry-areas-get-drier and expanded.

54 ENVIRONMENTAL SCIENCES↗