Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “PROBABILITY DENSITY FUNCTIONS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Conditional Pseudo-Reversible Normalizing Flow for Surrogate Modeling in Quantifying Uncertainty Propagation

We introduce a conditional pseudo-reversible normalizing flow (PR-NF) that directly learns conditional probability distributions from noisy physical models to efficiently quantify both forward and inverse uncertainty propagation. Traditional surrogate modeling approaches approximate only the deterministic component of physical models, requiring separate noise characterization and computationally expensive sampling methods for inverse problems. Here, in this work, we develop the conditional PR-NF model to directly learn and efficiently generate samples from the conditional probability density functions (PDFs). The training process utilizes dataset consisting of input-output pairs without requiring prior knowledge about the noise and the function. Once trained, our model efficiently generates samples from conditional PDFs for any input within the training domain. Moreover, the pseudo-reversibility feature allows for the use of fully connected neural network architectures, which simplifies the implementation and enables theoretical analysis. We provide a rigorous convergence analysis of the conditional PR-NF model, showing its ability to converge to the target conditional PDF using the Kullback−Leibler divergence. To demonstrate the effectiveness of our method, we apply it to several benchmark tests and a real-world geologic carbon storage problem.

97 MATHEMATICS AND COMPUTING↗

A priori analysis on deep learning of subgrid-scale parameterizations for Kraichnan turbulence

In the present study, we investigate different data-driven parameterizations for large eddy simulation of two-dimensional turbulence in the a priori settings. These models utilize resolved flow field variables on the coarser grid to estimate the subgrid-scale stresses. We use data-driven closure models based on localized learning that employs a multilayer feedforward artificial neural network with point-to-point mapping and neighboring stencil data mapping, and convolutional neural network fed by data snapshots of the whole domain. The performance of these data-driven closure models is measured through a probability density function and is compared with the dynamic Smagorinksy model (DSM). The quantitative performance is evaluated using the cross-correlation coefficient between the true and predicted stresses. We analyze different frameworks in terms of the amount of training data, selection of input and output features, their characteristics in modeling with accuracy, and training and deployment computational time. We also demonstrate computational gain that can be achieved using the intelligent eddy viscosity model that learns eddy viscosity computed by the DSM instead of subgrid-scale stresses. Here, we detail the hyperparameters optimization of these models using the grid search algorithm.

42 ENGINEERING↗

A new spatially distributed added value index for regional climate models: the EURO-CORDEX and the CORDEX-CORE highest resolution ensembles

The added value of using regional climate models (RCMs) to downscale data from general circulation models (GCMs) has often been questioned and researched. Although several studies have used different methods to identify (and in some cases quantify) the added value, there is still a need to find a general metric that quantifies the added value of any variable. This paper builds on past studies to propose a new metric of added value in the simulation of present-day climate which measures the difference in the probability density functions (PDFs) at each grid-cell between a model and an observation source, and then compares the results of the RCM and GCM in order to spatially compute the added value index. The same method is also adapted to quantify the climate change downscaling signal in a way that is consistent with the present-day metric. These new metrics are tested on the daily precipitation output from the EURO-CORDEX and CORDEX-CORE projection ensembles and reveal an overall positive added value of RCMs, especially at the tail-end of the distribution. Higher added value is obtained in areas of complex topography and coast-lines, as well as in tropical regions. Areas with large added value in present-day climate are consistent with areas of significant climate change downscaling signal in the RCP 8.5 far future simulations, and when the analysis is repeated at a low-resolution. The use of different resolution observations shows that the added value tends to decrease when models are compared to low-resolution observation datasets.

54 ENVIRONMENTAL SCIENCES↗

Region and cloud regime dependence of parametric sensitivity in E3SM atmosphere model

Abstract The Department of Energy (DOE)’s Energy Exascale Earth System Model (E3SM), including its atmosphere model (EAM), has many relatively new features. In a previous study we conducted a systematic parametric sensitivity analysis for EAM based on short, perturbed parameter ensemble (PPE) simulations, mainly focusing on global mean climate features and metrics. While parameter values in global climate models are generally invariant in space and time, model response to parameters perturbation may vary by regions and climate regimes, which motivates the need to better understand the EAM model behaviors and physics at regional scale and process level. In this study, using the same set of PPE simulations and a similar sensitivity analysis framework, we identify parameters that cause largest sensitivities over different regions and compare model responses in fast atmospheric processes to the parameters across different cloud regimes for several important cloud-related fidelity metrics. We find that cloud forcing has opposite response to some parameters over mid-latitude vs. tropical land. We also analyze how the parametric sensitivity varies as stratocumulus transitions to shallow convection and to deep convection over ocean. Low cloud forcing and shortwave cloud forcing in the subtropical eastern Pacific are most sensitive to the parameters controlling the width of the probability density function (PDF) of the subgrid vertical velocity ( w’ ) ( gamma ) and the damping of the w’ skewness ( c8 ) near the coast but become more sensitive to the parameter affecting the damping of the w’ variance ( c1 ) further offshore. Detailed interpretation of the spatial dependence of parametric sensitivity is provided. We also investigate how the parametric sensitivity evolves with prediction duration. This study improves our process-level understanding of cloud physics and parameterization and provides insights for developing more advanced regime-aware parameterization schemes in global climate model.

54 ENVIRONMENTAL SCIENCES↗

Numerical analysis of a time discretized method for nonlinear filtering problem with Lévy process observations

Abstract In this paper, we consider a nonlinear filtering model with observations driven by correlated Wiener processes and point processes. We first derive a Zakai equation whose solution is an unnormalized probability density function of the filter solution. Then, we apply a splitting-up technique to decompose the Zakai equation into three stochastic differential equations, based on which we construct a splitting-up approximate solution and prove its half-order convergence. Furthermore, we apply a finite difference method to construct a time semi-discrete approximate solution to the splitting-up system and prove its half-order convergence to the exact solution of the Zakai equation. Finally, we present some numerical experiments to demonstrate the theoretical analysis.

Mathematics↗

Using ultrasonic attenuation in cortical bone to infer distributions on pore size

Here, in this work we infer the underlying distribution on pore radius in human cortical bone samples using ultrasonic attenuation data. We first discuss how to formulate polydisperse attenuation models using a probabilistic approach and the Waterman Truell model for scattering attenuation. We then compare the Independent Scattering Approximation and the higher-order Waterman Truell models’ forward predictions for total attenuation in polydisperse samples. Following this, we formulate an inverse problem under the Prohorov Metric Framework coupled with variational regularization to stabilize this inverse problem. We then use experimental attenuation data taken from human cadaver samples and solve inverse problems resulting in nonparametric estimates of the probability density function on pore radius. We compare these estimates to the “true” microstructure of the bone samples determined via microCT imaging. We find that our methodology allows us to reliably estimate the underlying microstructure of the bone from attenuation data.

97 MATHEMATICS AND COMPUTING↗

Improving air leakage prediction of buildings using the fan pressurization method with the Weighted Line of Organic Correlation

In many countries, the fan pressurization method is the most frequently chosen approach for measuring the air leakage of houses. The measurements are usually performed at pressures that far exceed pressures to which buildings are exposed to under normal conditions. A fit of these tests to the power-law formulation allows an extrapolation to data points outside the measured pressure range. With the Ordinary Least Square (OLS) fitting method, the pressure exponent and flow coefficient can be determined. However, the measurement results are highly sensitive to uncertainties induced by external factors like changing wind conditions during the tests, which is neglected by OLS. This may lead to errors in the prediction of flows at lower pressures. The Weighted Line of Organic Correlation (WLOC) is an alternative approach and takes measurement uncertainty into account. In this paper, a statistical analysis of an extensive data set of pressurization measurements has been performed. Both regression techniques have been compared for almost 7500 fan pressurization measurements of six houses in 109 different house leak configurations. The variability in predicting pressure exponent and flow coefficient for both WLOC and OLS regression was analyzed using probability density functions. It was found that the Weighted Line of Organic Correlation significantly decreases the uncertainty in predicting pressure exponent, flow coefficient, and other low-pressure air leakage metrics compared to the Ordinary Least Square fitting. Here, the authors highly recommend the implementation of WLOC in current measurement standards and test equipment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

PYSIMFRAC: A Python library for synthetic fracture generation and analysis

In this paper, we introduce PYSIMFRAC, an open-source python library for generating 3-D synthetic fracture realizations, integrating with fluid simulators, and performing analysis. PYSIMFRAC allows the user to specify one of three fracture generation techniques (Box, Gaussian, or Spectral) and perform statistical analysis including the autocorrelation, moments, and probability density functions of the fracture surfaces and aperture. This analysis and accessibility of a python library allows the user to create realistic fracture realizations and vary properties of interest. In addition, PYSIMFRAC includes integration examples to two different pore-scale simulators and the discrete fracture network simulator, dfnWorks. The capabilities developed in this work provides opportunity for quick and smooth adoption and implementation by the wider scientific community for accurate characterization of fluid transport in geologic media. We present PYSIMFRAC along with integration examples and discuss the ability to extend PYSIMFRAC from a single complex fracture to complex fracture networks.

58 GEOSCIENCES↗

Tracer particle transport dynamics in the diffusive sandpile cellular automaton

The confinement properties of the diffusive running sandpile are characterized by tracking the motion of a population of marked grains of sand. It is found that, as the relative strength of the avalanching to the diffusive transport channel is varied, a point is reached at which the particle global confinement time and the probability density functions of the jump-sizes and waiting-times of the tracked grains experience a sudden change, thus revealing a dynamical transition, that is consistent with previous studies (Newman DE et al., Phys Rev Lett 2002;88(20):204304). Across this transition, the sandpile moves from a regime characterized by self-similarity and memory, where avalanches of all possible sizes dominate transport across the system, to another regime where transport is taken over by near system-size, quasi-periodic avalanches. Values for the fractional transport exponents that quantify effective transport across the sandpile prior to the transition are also obtained.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Machine learning assisted modeling of mixing timescale for LES/PDF of high-Karlovitz turbulent premixed combustion

Accurate modeling of mixing in the transported probability density function (PDF) method remains a great challenge, especially for turbulent premixed combustion under extreme conditions such as high Karlovitz number Ka. Recently, a power-law based mixing timescale model was developed for the large-eddy simulations (LES)/PDF modeling of high-Ka number turbulent premixed flames. It is found in this work that the power-law mixing timescale model is highly sensitive to the model parameters. It is thus critically needed to develop accurate calibration of these model parameters. The empirical specification of the model parameters developed in Zhang et. al. is found to be inadequate for accurate modeling of the mixing timescale. Here, machine learning is introduced as an attractive alternative in this work for the specification of the model parameters. A high-Ka number DNS jet flame is used as the training and validation of the machine learning models. The choices of the input parameters are discussed and compared for the machine learning models. The effect of differential molecular diffusion on mixing is examined by including the effect of the Lewis number in the training of the machine learning models. The performance of different machine learning algorithms is compared for the specification of the mixing model parameters. Overall, excellent performance of the machine learning models is observed for assisting the mixing modeling. The feasibility, interpretability, applicability, generality, and portability of using machine learning are discussed in general to provide a perspective on applying data-driven machine learning for turbulent combustion modeling studies.

42 ENGINEERING↗

Preliminary results in using Deep Learning to emulate BLOB, a nuclear interaction model

Purpose: A reliable model to simulate nuclear interactions is fundamental for Ion-therapy. We already showed how BLOB (“Boltzmann-Langevin One Body”), a model developed to simulate heavy ion interactions up to few hundreds of MeV/u, could simulate also 12 C reactions in the same energy domain. However, its computation time is too long for any medical application. For this reason we present the possibility of emulating it with a Deep Learning algorithm. Methods: The BLOB final state is a Probability Density Function (PDF) of finding a nucleon in a position of the phase space. We discretised this PDF and trained a Variational Auto-Encoder (VAE) to reproduce such a discrete PDF. As a proof of concept, we developed and trained a VAE to emulate BLOB in simulating the interactions of 12 C with 12 C at 62 MeV/u. To have more control on the generation, we forced the VAE latent space to be organised with respect to the impact parameter (b) training a classifier of b jointly with the VAE. Results: In this work, the distributions obtained from the VAE are similar to the input ones and the computation time needed to use the VAE as a generator is negligible. Conclusions: We show that it is possible to use a Deep Learning approach to emulate a model developed to simulate nuclear reactions in the energy range of interest for Ion-therapy. We foresee the implementation of the generation part in C++ and to interface it with the most used Monte Carlo toolkit: Geant4.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

An indirect approach to optimize the reaction rates of thermal NO formation for diesel engines

With stringent emission regulations, it has become more important for modern diesel engine manufacturers to accurately predict engine-out nitrogen oxide (NO x ) emissions across a wide range of operating conditions. Thermal NO is the major source of engine-out NO x in modern diesel engines. For thermal NO formation, several earlier studies have recommended the forward and reverse reaction rate coefficients of the rate-limiting reaction (O + N 2 ⇌ NO + N). However, due to deficiencies in sub-models and inadequacies of reduced chemical mechanisms to represent diesel combustion, these recommended values more often than not need to be adjusted in reduced order combustion models to accurately predict engine-out NO x . Hence, in this work a systematic and computationally efficient approach has been proposed to streamline the process of determining the optimum reaction rate coefficients. Here, to develop the optimization approach, four different production diesel engines with different operating conditions in terms of speed, load, and exhaust-gas recirculation have been considered. Numerical simulations have been performed using a detailed zero-dimensional velocity-composition-frequency transported probability density function (0D-VCF-tPDF) model that uses hundreds of notional particles to capture in-cylinder stratification. Four different combinations of hydrocarbon and NO x chemical mechanisms were used to represent chemistry. It was found that for the rate-limiting reaction, the pre-exponent factors (A f1 , A r1 ) and activation energies (E A,f1 , E A,r1 ) of the forward and reverse reaction rates follow a linear band in A f1 - E A,f1 and A r1 - E A,r1 space where predicted engine-out NO x match the measured values closely. By encompassing such bands from different engines and considering constraints on activation energies, a reduced search domain of pre-exponent factors and activation energies was constructed that is expected to be applicable to any diesel engine. Eventually, computationally efficient three-line and one-line search approaches were proposed to determine the optimum values of the pre-exponent factors and activation energies that led to a minimum error between measured and predicted engine-out NO x . Finally, these three-line and one-line NO x optimization approaches were applied to a fifth production diesel engine for which the 0D-VCF-tPDF model showed a very good predictive performance in terms of predicting peak pressure, 50% burn rate, and engine-out NO x when compared to measured and 3D-CFD values.

33 ADVANCED PROPULSION SYSTEMS↗

A Eulerian three-fluid flow framework for the study of fuel dispersal behavior under loss-of-coolant accident conditions

As the nuclear industry explores new fuel designs to accommodate increased burnup, studying fuel behavior during loss-of-coolant accidents is essential for ensuring the safe operation of light-water reactors. Here, this study presents a computational model to simulate the intricate three-phase flow dynamics of fuel dispersal following cladding breach, where solid fuel particles and carrier fission gases interact with the surrounding liquid or gas medium. The model utilizes a Eulerian three-fluid framework to depict the phase interaction within interpenetrating continua, treating fragmented fuel as granular material. Closure relationships for bulk-flow properties of the solid phase and detailed interfacial exchange terms in high-temperature, high-speed gas-solid-liquid flow scenarios are proposed. The model was validated using adiabatic experimental results in the literature, focusing on characterizing fuel dispersal behavior during loss-of-coolant accidents conditions. Settlement characteristics of the solids, quantified by the probability distribution of equivalent particles, closely matched probability density functions reported in experimental studies. Key highlights of this study include the theoretical description of a coupled three-phase flow with phase change, interpretation of the high-pressure boundary conditions and insights into the transient behavior of gas-solid-liquid phase dynamics during a simulated high-speed dispersal event.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Transported PDF Modeling of Compressible Turbulent Reactive Flows by using the Eulerian Monte Carlo Fields Method

Although the transported probability density function (PDF) method has been developed for decades, its application has been mainly focused on the low-Mach number flow problems. This work extends the transported PDF method to compressible flow problems. The Eulerian Monte Carlo fields (EMCF) solution method is employed to solve the transported PDF equation for compressible flow problems. A pseudo stagnation enthalpy is introduced and its stochastic partial differential equation is derived to ensure total energy conservation numerically. A new mixing model called interaction by partial exchange with mean (IPEM) is introduced to expand the available choices of mixing models for the EMCF method. The consistency of the EMCF method is examined for solving the transported PDF equation. Numerical implementation details are discussed, such as the density coupling between the compressible flow solver and the EMCF solver, discretization schemes for the mixing terms and the stochastic terms. The implemented compressible flow solver coupled with the EMCF solver is verified and validated in a series of test cases with increasing level of complexity, ranging from a statistically one-dimensional turbulent mixing layer to a self-excited resonance model rocket combustor. It is observed that in general with the increase of compressibility, there is an increase in the sensitivity of the modeling results to the different models and algorithms. This makes it necessary to develop a thorough understanding of the model sensitivity in order to develop a robust and accurate simulation solver for highly compressible turbulent reactive flows. The thermo-acoustic instability inside the model rocket combustor case is captured reasonably, which demonstrates the overall capability of the developed compressible turbulent combustion solver based on the transported PDF method.

42 ENGINEERING↗

Adversarial sampling of unknown and high-dimensional conditional distributions

Many engineering problems require the prediction of realization-to-realization variability or a refined description of modeled quantities. In that case, it is necessary to sample elements from unknown high-dimensional spaces with possibly millions of degrees of freedom. While there exist methods able to sample elements from probability density functions (PDF) with known shapes, several approximations need to be made when the distribution is unknown. In this paper the sampling method, as well as the inference of the underlying distribution, are both handled with a data-driven method known as generative adversarial networks (GAN), which trains two competing neural networks to produce a network that can effectively generate samples from the training set distribution. In practice, it is often necessary to draw samples from conditional distributions. When the conditional variables are continuous, only one (if any) data point corresponding to a particular value of a conditioning variable may be available, which is not sufficient to estimate the conditional distribution. This work handles this problem using an a priori estimation of the conditional moments of a PDF. Herein, two approaches, stochastic estimation, and an external neural network are compared for computing these moments; however, any preferred method can be used. The algorithm is demonstrated in the case of the deconvolution of a filtered turbulent flow field. It is shown that all the versions of the proposed algorithm effectively sample the target conditional distribution with minimal impact on the quality of the samples compared to state-of-the-art methods. Additionally, the procedure can be used as a metric for the diversity of samples generated by a conditional GAN (cGAN) conditioned with continuous variables.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Kernel learning backward SDE filter for data assimilation

In this paper, we develop a kernel learning backward SDE filter method to estimate the state of a stochastic dynamical system based on its partial noisy observations. A system of forward backward stochastic differential equations is used to propagate the state of the target dynamical model, and Bayesian inference is applied to incorporate the observational information. Further, to characterize the dynamical model in the entire state space, we introduce a kernel learning method to learn a continuous global approximation for the conditional probability density function of the target state by using discrete approximated density values as training data. Numerical experiments demonstrate that the kernel learning backward SDE is highly effective.

97 MATHEMATICS AND COMPUTING↗

Load-Displacement Relation and Gap Distribution Between Rough Surfaces: Partial Differential Equations Approach

We develop a theoretical model to predict the load-displacement relation and probability density function for gaps between contacting rough surfaces. We derive partial differential equations from the previous model (Joe et al., 2018), and extend them to the non-adhesive contact problem. The predictions of the present theory are compared with numerical results using the Green's function molecular dynamics algorithm, and a good agreement is obtained.

adhesion↗

Determining reference standard strength for neutron-irradiated reduced activation ferritic/martensitic steel F82H by Bayesian method

The deterministic approach widely adopted in the design of structural components relies on systematically defined design limits using empirically determined safety factors. However, this approach is not always appropriate because structures are subjected to a variety of loads in the practical environment, which may result in excessively conservative design limits. In recent years, a more rigorous probabilistic approach that incorporates material strength distributions has become an important solution. In the probabilistic approach, the probability density functions of material strength properties underpin the design criteria. Here, the objective of this study is to identify the density distribution functions that best describe tensile properties of irradiated F82H to define a reference strength for DEMO design. Due to the limited number of existing data, this study specifically employs a Bayesian prediction method based on Monte Carlo simulations to determine a material reference value with statistical reliability and to investigate its effectiveness. For example, the dependence of tensile properties of 300 °C irradiated materials on irradiation damage and the range predicted by 95% Bayesian estimation was evaluated. As a statistical model for the dose dependence of statistical parameters, the normal distribution exhibited a better fit for 0.2% proof strength and tensile strength, whereas the distribution of total elongation data gave comparable reference values for both the normal and Weibull distribution models. Both models gave comparable criteria for the distribution of total elongation data. The Weibull model also gave better results for uniform elongation. The function best describing the model was a logarithmic law for both 0.2% proof strength and tensile strength, while a power law for both total and uniform elongation, which allowed for more comprehensive data prediction of irradiation data with statistical accuracy for DEMO reactor design.

36 MATERIALS SCIENCE↗