Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Stochastic Trust-Region Algorithm in Random Subspaces with Convergence and Expected Complexity Analyses

Here, this work proposes a framework for large-scale stochastic derivative-free optimization (DFO) by introducing STARS, a trust-region method based on iterative minimization in random subspaces. This framework is both an algorithmic and theoretical extension of a random subspace derivative-free optimization (RSDFO) framework, and an algorithm for stochastic optimization with random models (STORM). Moreover, like RSDFO, STARS achieves scalability by minimizing interpolation models that approximate the objective in low-dimensional affine subspaces, thus significantly reducing per-iteration costs in terms of function evaluations and yielding strong performance on largescale stochastic DFO problems. The user-determined dimension of these subspaces, when the latter are defined, for example, by the columns of so-called Johnson-Lindenstrauss transforms, turns out to be independent of the dimension of the problem. For convergence purposes, inspired by the analyses of RSDFO and STORM, both a particular quality of the subspace and the accuracies of random function estimates and models are required to hold with sufficiently high, but fixed, probabilities. Using martingale theory under the latter assumptions, an almost sure global convergence of STARS to a first-order stationary point is shown, and the expected number of iterations required to reach a desired first-order accuracy is proved to be similar to that of STORM and other stochastic DFO algorithms, up to constants.

97 MATHEMATICS AND COMPUTING↗

A Stochastic Diffusion Process for the Dirichlet Distribution

The method of potential solutions of Fokker-Planck equations is used to develop a transport equation for the joint probability of N coupled stochastic variables with the Dirichlet distribution as its asymptotic solution. To ensure a bounded sample space, a coupled nonlinear diffusion process is required: the Wiener processes in the equivalent system of stochastic differential equations are multiplicative with coefficients dependent on all the stochastic variables. Individual samples of a discrete ensemble, obtained from the stochastic process, satisfy a unit-sum constraint at all times. The process may be used to represent realizations of a fluctuating ensemble of N variables subject to a conservation principle. Similar to the multivariate Wright-Fisher process, whose invariant is also Dirichlet, the univariate case yields a process whose invariant is the beta distribution. As a test of the results, Monte Carlo simulations are used to evolve numerical ensembles toward the invariant Dirichlet distribution.

97 MATHEMATICS AND COMPUTING↗

Improving Solution Accuracy and Convergence for Stochastic Physics Parameterizations with Colored Noise

Stochastic parameterizations are used in numerical weather prediction and climate modeling to help capture the uncertainty in the simulations and improve their statistical properties. Convergence issues can arise when time integration methods originally developed for deterministic differential equations are applied naively to stochastic problems. In previous studies, it has been demonstrated that a correction term, known in stochastic analysis as the Itô correction, can help improve solution accuracy for various deterministic numerical schemes and ensure convergence to the physically relevant solution without substantial computational overhead. The usual formulation of the Itô correction is valid only when the stochasticity is represented by white noise. In this study, a generalized formulation of the Itô correction is derived for noises of any color. The formulation is applied to a test problem described by an advection–diffusion equation forced with a spectrum of fast processes. We present numerical results for cases with both constant and spatially varying advection velocities to show that, for the same time step sizes, the introduction of the generalized Itô correction helps to substantially reduce time integration error and significantly improve the convergence rate of the numerical solutions when the forcing term in the governing equation is rough (fast varying); alternatively, for the same target accuracy, the generalized Itô correction allows for the use of significantly longer time steps and, hence, helps to reduce the computational cost of the numerical simulation.

54 ENVIRONMENTAL SCIENCES↗

The Impact of Stochastic Perturbations in Physics Variables for Predicting Surface Solar Irradiance

We present a probabilistic framework tailored for solar energy applications referred to as the Weather Research and Forecasting-Solar ensemble prediction system (WRF-Solar EPS). WRF-Solar EPS has been developed by introducing stochastic perturbations into the most relevant physical variables for solar irradiance predictions. In this study, we comprehensively discuss the impact of the stochastic perturbations of WRF-Solar EPS on solar irradiance forecasting compared to a deterministic WRF-Solar prediction (WRF-Solar DET), a stochastic ensemble using the stochastic kinetic energy backscatter scheme (SKEBS), and a WRF-Solar multi-physics ensemble (WRF-Solar PHYS). The performances of the four forecasts are evaluated using irradiance retrievals from the National Solar Radiation Database (NSRDB) over the contiguous United States. We focus on the predictability of the day-ahead solar irradiance forecasts during the year of 2018. The results show that the ensemble forecasts improve the quality of the forecasts, compared to the deterministic prediction system, by accounting for the uncertainty derived by the ensemble members. However, the three ensemble systems are under-dispersive, producing unreliable and overconfident forecasts due to a lack of calibration. In particular, WRF-Solar EPS produces less optically thick clouds than the other forecasts, which explains the larger positive bias in WRF-Solar EPS (31.7 W/m 2 ) than in the other models (22.7–23.6 W/m 2 ). This study confirms that the WRF-Solar EPS reduced the forecast error by 7.5% in terms of the mean absolute error (MAE) compared to WRF-Solar DET, and provides in-depth comparisons of forecast abilities with the conventional scientific probabilistic approaches (i.e., SKEBS and a multi-physics ensemble). Guidelines for improving the performance of WRF-Solar EPS in the future are provided.

14 SOLAR ENERGY↗

CSI 2264: CHARACTERIZING YOUNG STARS IN NGC 2264 WITH STOCHASTICALLY VARYING LIGHT CURVES

We provide CoRoT and Spitzer light curves and other supporting data for 17 classical T Tauri stars in NGC 2264 whose CoRoT light curves exemplify the “stochastic” light curve class as defined in 2014 by Cody et al. The most probable physical mechanism to explain the optical variability within this light curve class is time-dependent mass accretion onto the stellar photosphere, producing transient hot spots. Where we have appropriate spectral data, we show that the veiling variability in these stars is consistent in both amplitude and timescale with the optical light curve morphology. The veiling variability is also well-correlated with the strength of the He i 6678 Å emission line, predicted by models to arise in accretion shocks on or near the stellar photosphere. Stars with accretion burst light curve morphology also have variable mass accretion. The stochastic and accretion burst light curves can both be explained by a simple model of randomly occurring flux bursts, with the stochastic light curve class having a higher frequency of lower amplitude events. Members of the stochastic light curve class have only moderate mass accretion rates. Their Hα profiles usually have blueshifted absorption features, probably originating in a disk wind. The lack of periodic signatures in the light curves suggests that little of the variability is due to long-lived hot spots rotating into or out of our line of sight; instead, the primary driver of the observed photometric variability is likely to be instabilities in the inner disk that lead to variable mass accretion.

79 ASTRONOMY AND ASTROPHYSICS↗

BOOSTING LY α AND He ii λ 1640 LINE FLUXES FROM POPULATION III GALAXIES: STOCHASTIC IMF SAMPLING AND DEPARTURES FROM CASE-B

We revisit calculations of nebular hydrogen Ly α and He ii λ 1640 line strengths for Population III (Pop III) galaxies, undergoing continuous, and bursts of, star formation. We focus on initial mass functions (IMFs) motivated by recent theoretical studies, which generally span a lower range of stellar masses than earlier works. We also account for case-B departures and the stochastic sampling of the IMF. In agreement with previous work, we find that departures from case-B can enhance the Ly α flux by a factor of a few, but we argue that this enhancement is driven mainly by collisional excitation and ionization, and not due to photoionization from the n = 2 state of atomic hydrogen. The increased sensitivity of the Ly α flux to the high-energy end of the galaxy spectrum makes it more subject to stochastic sampling of the IMF. The latter introduces a dispersion in the predicted nebular line fluxes around the deterministic value by as much as a factor of ∼4. In contrast, the stochastic sampling of the IMF has less impact on the emerging Lyman Werner photon flux. When case-B departures and stochasticity effects are combined, nebular line emission from Pop III galaxies can be up to one order of magnitude brighter than predicted by “standard” calculations that do not include these effects. This enhances the prospects for detection with future facilities such as the James Webb Space Telescope and large, ground-based telescopes.

79 ASTRONOMY AND ASTROPHYSICS↗

STOCHASTIC OPTICS: A SCATTERING MITIGATION FRAMEWORK FOR RADIO INTERFEROMETRIC IMAGING

Just as turbulence in the Earth’s atmosphere can severely limit the angular resolution of optical telescopes, turbulence in the ionized interstellar medium fundamentally limits the resolution of radio telescopes. We present a scattering mitigation framework for radio imaging with very long baseline interferometry (VLBI) that partially overcomes this limitation. Our framework, “stochastic optics,” derives from a simplification of strong interstellar scattering to separate small-scale (“diffractive”) effects from large-scale (“refractive”) effects, thereby separating deterministic and random contributions to the scattering. Stochastic optics extends traditional synthesis imaging by simultaneously reconstructing an unscattered image and its refractive perturbations. Its advantages over direct imaging come from utilizing the many deterministic properties of the scattering—such as the time-averaged “blurring,” polarization independence, and the deterministic evolution in frequency and time—while still accounting for the stochastic image distortions on large scales. These distortions are identified in the image reconstructions through regularization by their time-averaged power spectrum. Using synthetic data, we show that this framework effectively removes the blurring from diffractive scattering while reducing the spurious image features from refractive scattering. Stochastic optics can provide significant improvements over existing scattering mitigation strategies and is especially promising for imaging the Galactic Center supermassive black hole, Sagittarius A*, with the Global mm-VLBI Array and with the Event Horizon Telescope.

79 ASTRONOMY AND ASTROPHYSICS↗

A dynamically adaptive wavelet approach to stochastic computations based on polynomial chaos - capturing all scales of random modes on independent grids

Highlights: {yields} New approach for stochastic computations based on polynomial chaos. {yields} Development of dynamically adaptive wavelet multiscale solver using space refinement. {yields} Accurate capture of steep gradients and multiscale features in stochastic problems. {yields} All scales of each random mode are captured on independent grids. {yields} Numerical examples demonstrate the need for different space resolutions per mode. - Abstract: In stochastic computations, or uncertainty quantification methods, the spectral approach based on the polynomial chaos expansion in random space leads to a coupled system of deterministic equations for the coefficients of the expansion. The size of this system increases drastically when the number of independent random variables and/or order of polynomial chaos expansions increases. This is invariably the case for large scale simulations and/or problems involving steep gradients and other multiscale features; such features are variously reflected on each solution component or random/uncertainty mode requiring the development of adaptive methods for their accurate resolution. In this paper we propose a new approach for treating such problems based on a dynamically adaptive wavelet methodology involving space-refinement on physical space that allows all scales of each solution component to be refined independently of the rest. We exemplify this using the convection-diffusion model with random input data and present three numerical examples demonstrating the salient features of the proposed method. Thus we establish a new, elegant and flexible approach for stochastic problems with steep gradients and multiscale features based on polynomial chaos expansions.

97 MATHEMATICS AND COMPUTING↗

Monte Carlo solution for uncertainty propagation in particle transport with a stochastic Galerkin method

The stochastic Galerkin method (SGM) is an intrusive technique for propagating data uncertainty in physical models. The method reduces the random model to a system of coupled deterministic equations for the moments of stochastic spectral expansions of result quantities. We investigate solving these equations using the Monte Carlo technique. We compare the efficiency with brute-force Monte Carlo evaluation of uncertainty, the non-intrusive stochastic collocation method (SCM), and an intrusive Monte Carlo implementation of the stochastic collocation method. We also describe the stability limitations of our SGM implementation. (authors)

97 MATHEMATICS AND COMPUTING↗

Data-driven Minimum Entropy Control for Stochastic Nonlinear Systems using the Cumulant-Generating Function

Here, we present a novel minimum entropy control algorithm for a class of stochastic nonlinear systems subjected to non-Gaussian noises. The entropy control can be considered as an optimization problem for the system randomness attenuation, but the mean value has to be considered separately. To overcome this disadvantage, a new representation of the system stochastic properties was given using the cumulant-generating function based on the moment-generating function, in which the mean value and the entropy was reflected by the shape of the cumulant-generating function. Based on the samples of the system output and control input, a time-variant linear model was identified, and the minimum entropy optimization was transformed to system stabilization. Then, an optimal control strategy was developed to achieve the randomness attenuation, and the boundedness of the controlled system output was analyzed. The effectiveness of the presented control algorithm was demonstrated by a numerical example. In this paper, a data-driven minimum entropy design is presented without pre-knowledge of the system model; entropy optimization is achieved by the system stabilization approach in which the stochastic distribution control and minimum entropy are unified using the same identified structure; and a potential framework is obtained since all the existing system stabilization methods can be adopted to achieve the minimum entropy objective.

42 ENGINEERING↗

Survey on stochastic distribution systems: A full probability density function control theory with potential applications

Complex systems seen either in general engineering practice or economics are subjected to ever increased uncertainties that are mostly represented as random variables or parameters, and the characteristics of random variables are represented by their probability density functions (PDFs). Controlling their PDFs means to shape their stochastic distributions and in general it would provide a full treatment for system analysis and operational control and optimization. This leads to the development of stochastic distribution control (SDC) systems theory in the past decades, where the original aim of the controller design is to realize a shape control of the distributions of certain random variables in their PDFs sense for some engineering processes. Indeed, once the PDFs of these random variables or parameters are used to describe their distribution characters, the control task is to obtain control signals so that the output PDFs of stochastic systems are made to follow their target PDFs. The subject of SDC was initially originated for non-Gaussian stochastic control systems design but has found a wide spectrum of applications in general systems in terms of data-driven modeling, analysis, signal processing (filtering), data mining via multivariable statistics, decision-making (optimization) for systems subjected to uncertainties and even in economics. In this context, SDC constitutes an effective primer tool for complex system analysis, control and operational optimizations. In this review paper, a detailed survey of the developments on the research of SDC systems will be made together with their wide spectrum applications and future perspectives.

42 ENGINEERING↗

Stochastic Inflation at NNLO

Stochastic Inflation is an important framework for understanding the physics of de Sitter space and the phenomenology of inflation. In the leading approximation, this approach results in a Fokker-Planck equation that calculates the probability distribution for a light scalar field as a function of time. Despite its successes, the quantum field theoretic origins and the range of validity for this equation have remained elusive, and establishing a formalism to systematically incorporate higher order effects has been an area of active study. In this paper, we calculate the next-to-next-to-leading order (NNLO) corrections to Stochastic Inflation using Soft de Sitter Effective Theory (SdSET). In this effective description, Stochastic Inflation manifests as the renormalization group evolution of composite operators. The leading impact of non-Gaussian quantum fluctuations appears at NNLO, which is presented here for the first time; we derive the coefficient of this term from a two-loop anomalous dimension calculation within SdSET. We solve the resulting equation to determine the NNLO equilibrium distribution and the low-lying relaxation eigenvalues. In the process, we must match the UV theory onto SdSET at one-loop order, which provides a non-trivial confirmation that the separation into Wilson-coefficient corrections and contributions to initial conditions persists beyond tree level. Furthermore, these results illustrate how the naive factorization of time and momentum integrals in SdSET no longer holds in the presence of logarithmic divergences. It is these effects that ultimately give rise to the renormalization group flow that yields Stochastic Inflation.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Multistart algorithm for identifying all optima of nonconvex stochastic functions

Here, we propose a multistart algorithm to identify all local minima of a constrained, nonconvex stochastic optimization problem. The algorithm uniformly samples points in the domain and then starts a local stochastic optimization run from any point that is the "probabilistically best" point in its neighborhood. Under certain conditions, our algorithm is shown to asymptotically identify all local optima with high probability; this holds even though our algorithm is shown to almost surely start only finitely many local stochastic optimization runs. We demonstrate the performance of an implementation of our algorithm on nonconvex stochastic optimization problems, including identifying optimal variational parameters for the quantum approximate optimization algorithm.

97 MATHEMATICS AND COMPUTING↗

Stochastic fracture generation and thermo-hydro-mechanical modeling in an equivalent continuum framework for enhanced geothermal systems

Enhanced geothermal systems (EGS) involve fracturing low permeability material to establish well connectivity and then injecting and circulating fluid into the fractured subsurface for geothermal power production. Changes in fracture aperture from contraction of the cooling matrix rock may alter network connectivity and risk thermal short-circuiting. Thermo-hydro-mechanical (THM) models are a useful tool to study these processes. However, as fracture networks are complex, and data may be limited, fracture networks in THM models are often stochastically generated. Given reliance on stochastic fracture networks and THM modeling to represent the subsurface and assess productivity of EGS, increased understanding of the influence of such statistically derived fracture networks on flow and heat transport in THM models is needed. Here, a new fracture process model is developed in the reactive transport code PFLOTRAN to stochastically generate fracture families and simulate changes in fracture aperture over time due to temperature changes of the rock matrix. Sixty-four different fracture networks ranging from well to poorly-connected, are modeled in PFLOTRAN with and without mechanical processes (THM vs TH). Results indicate that for well-connected fracture networks, thermal short-circuiting is less of a concern due to the abundance of available alternative flowpaths. For poorly-connected fracture networks, inclusion of mechanical processes showed steep thermal drawdown coincident with increase in fracture aperture along developing colder flowpaths, demonstrating the risk of thermal short-circuiting. Simulations with additional, larger fractures engineered to establish connectivity in a poorly-fractured subsurface, indicate that while stochastic variation of fracture orientation of the background network had limited influence, such variation in the engineered fractures significantly affected flow and heat transport.

Discrete fracture networks (DFN)↗

Stochastic Optimization and Uncertainty Quantification of Natrium-based Nuclear-Renewable Energy Systems for Flexible Power Applications in Deregulated Markets

Rapid integration of variable renewable energy sources (VRES) has made modeling and stochastic optimization of hybrid energy systems crucial for studying their long-term performance and viability. However, most studies have focused on just historical data, which may be unreliable for capturing short-term fluctuations, rare events, and long-term patterns of energy demand, price, and the variability of renewable energy sources. For this study, optimal synthetic time series models were developed using Wasserstein distance. The models were validated by comparing the key statistical measures against those of the historical data. They were then used to optimize the integrated Natrium-style advanced energy systems and their long-term (30 years) economics. The stochastic model performs bi-level optimization to find the optimal sizes for the balance of plant and thermal energy storage, while also optimizing energy dispatch to achieve the maximum net present value. In studies of two deregulated markets (California ISO and the Electric Reliability Council of Texas), the integrated Natrium-style system performed better in CAISO than in ERCOT, given higher and more consistent electricity prices during peak-demand periods. The potentially enlarged cost associated with the variable operation and maintenance of the TES system also plays a significant role in driving the system sizing, thus its impacts on the system are investigated in detail through comparison against a baseline case. The study also finds that the bi-level optimization results based on stochastic gradient descent closely match the grid search results. The uncertainty quantification of the stochastic signals provides further NPV-related insights and probability distributions for the case studies. The normal standard error of the mean of NPV for the case with and without TES VOM for CAISO were found to be 7.73M (plus-minus sign) 1.09M USD and 104.99M (plus-minus sign) 1.25M USD, respectively based on a 95% confidence. Given the relatively small NPV variance based on 150 samples, the analysis affords the most robust possible prediction of the techno-economic performance of the integrated Natrium-style energy systems.

25 ENERGY STORAGE↗

Stochastic nature of magnetic processes studied by full-field soft X-ray microscopy

In nanomagnetism, one of the crucial scientific questions is whether magnetic behaviors are deterministic or stochastic on a nanoscale. Apart from the exciting physical issue, this question is also of paramount highest relevance for using magnetic materials in a wealth of technological applications such as magnetic storage and sensor devices. In the past, the research on the stochasticity of a magnetic process has been mainly done by macroscopic measurements, which only offer ensemble-averaged information. To give more accurate answer for the question and to fully understand related underlying physics, the direct observation of statistical behaviors in magnetic structures and magnetic phenomena utilizing advanced characterization techniques is highly required. One of the ideal tools for such study is a full-field soft X-ray microscope since it enables imaging of magnetic structures on the large field of view within a few seconds. Here in this paper, we review the stochastic behaviors of various magnetic processes including magnetization reversal process in thin films, magnetic domain wall motions in nanowires, and magnetic vortex formations in nanodisks studied by full-field soft X-ray microscopy. The origin triggering the stochastic nature witnessed in each magnetic process and the way to control the intrinsic nature are also discussed.

36 MATERIALS SCIENCE↗

Probability Density Function Control for Stochastic Nonlinear Systems using Monte Carlo Simulation

This paper presents a fast implementation framework of output probability density function (PDF) control for a class of stochastic nonlinear systems which are subjected to non-Gaussian noises. The statistical properties of the system outputs can be adjusted by shaping the dynamic output probability density function to track the reference stochastic distribution. However, the dynamic probability density function evolution is very difficult to obtain analytically even if the system model and the stochastic distributions of the noises are known. Motivated by Monte Carlo simulation, the dynamic probability density function can be estimated by sampling data which forms the contribution of this paper. In particular, the sampling points are generated following the stochastic distribution of the noise for each instant. These points go through the system would generate the histogram for system outputs, then the dynamic model can be established based on the dynamic histogram which reflects the randomness and the nonlinear dynamics of the investigated system. Based on the established model, the output probability density function tracking can be achieved and the simulation results and discussions show the effectiveness and benefits of the presented framework.

Zhang, Qichun↗

Robust verification of stochastic simulation codes

We introduce a robust verification tool for computational codes, which we call Stochastic Robust Extrapolation based Error Quantification (StREEQ). Unlike the prevalent Grid Convergence Index (GCI) [1] method, our approach is suitable for both stochastic and deterministic computational codes and is generalizable to any number of discretization variables. Building on ideas introduced in the Robust Verification [2] approach, we estimate the converged solution and orders of convergence with uncertainty using multiple fits of a discretization error model. In contrast to Robust Verification, we perform these fits to many bootstrap samples yielding a larger set of predictions with smoother statistics. Here, bootstrap resampling is performed on the lack-of-fit errors for deterministic code responses, and directly on the noisy data set for stochastic responses. This approach lends a degree of robustness to the overall results, capable of yielding precise verification results for sufficiently resolved data sets, and appropriately expanding the uncertainty when the data set does not support a precise result. For stochastic responses, a credibility assessment is also performed to give the analyst an indication of the trustworthiness of the results. Furthermore, this approach is suitable for both code and solution verification, and is particularly useful for solution verification of high-consequence simulations..

97 MATHEMATICS AND COMPUTING↗