Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Research into the effects of astronaut motion on the spacecraft: a review

The paper reviews the research that has been undertaken to understand and quantify the disturbance effects of the astronaut's motion inside and outside the spacecraft on the vehicle's attitude and acceleratory environment. In early investigations, the dynamic interaction of astronauts, modeled as point masses, and the spacecraft, modelled as a rigid body, was analyzed. Through ground-based experiments and the modeling of astronaut-induced forces and moments as stochastic processes, it became possible to estimate the magnitude and energy content of the loads produced by the astronaut. The first experiment in space to measure the astronaut-induced disturbances was conducted on the Skylab orbital station. Loads generated while performing routine operations were measured on board the Space Shuttle in 1994 and on the space station Mir in 1996-1997. c 2001 Elsevier Science Ltd. All rights reserved.

Skylab Project↗

Stochastic contribution to the growth factor in the {lambda}CDM model

We study the effect of noise on the evolution of the growth factor of density perturbations in the context of the {lambda}CDM model. Stochasticity is introduced as a Wiener process amplified by an intensity parameter {alpha}. By comparing the evolution of deterministic and stochastic cases for different values of {alpha} we estimate the intensity level necessary to make noise relevant for cosmological tests based on large-scale structure data. Our results indicate that the presence of random forces underlying the fluid description can lead to significant deviations from the nonstochastic solution at late times for {alpha}{>=}10{sup -3}.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Sequential filter design for precision orbit determination and physical constant refinement

Earth-based spacecraft tracking data have historically been processed with classical least squares filtering techniques both for navigation purposes and for physical constant determination. The small, stochastic nongravitational forces acting on the spacecraft are described to motivate the use of sequential estimation as an alternative to the least squares fitting procedures. The stochastic forces are investigated both in terms of their effect on the tracking data and their influence on estimation accuracy. A flexible sequential filter design which leaves the existing trajectory, variational equations, data observable and partial computations undisturbed is described. A detailed filter design is presented that meets the precision demands and flexibility requirements of deep space navigation and of scientific problems.

Curkendall, D. W.↗

Chaotic ion motion in magnetosonic plasma waves

The motion of test ions in a magnetosonic plasma wave is considered, and the 'stochasticity threshold' of the wave's amplitude for the onset of chaotic motion is estimated. It is shown that for wave amplitudes above the stochasticity threshold, the evolution of an ion distribution can be described by a diffusion equation with a diffusion coefficient D approximately equal to 1/v. Possible applications of this process to ion acceleration in flares and ion beam thermalization are discussed.

Varvoglis, H.↗

Goal-oriented sensitivity analysis for lattice kinetic Monte Carlo simulations

In this paper we propose a new class of coupling methods for the sensitivity analysis of high dimensional stochastic systems and in particular for lattice Kinetic Monte Carlo (KMC). Sensitivity analysis for stochastic systems is typically based on approximating continuous derivatives with respect to model parameters by the mean value of samples from a finite difference scheme. Instead of using independent samples the proposed algorithm reduces the variance of the estimator by developing a strongly correlated-“coupled”- stochastic process for both the perturbed and unperturbed stochastic processes, defined in a common state space. The novelty of our construction is that the new coupled process depends on the targeted observables, e.g., coverage, Hamiltonian, spatial correlations, surface roughness, etc., hence we refer to the proposed method as goal-oriented sensitivity analysis. In particular, the rates of the coupled Continuous Time Markov Chain are obtained as solutions to a goal-oriented optimization problem, depending on the observable of interest, by considering the minimization functional of the corresponding variance. We show that this functional can be used as a diagnostic tool for the design and evaluation of different classes of couplings. Furthermore, the resulting KMC sensitivity algorithm has an easy implementation that is based on the Bortz–Kalos–Lebowitz algorithm's philosophy, where events are divided in classes depending on level sets of the observable of interest. Finally, we demonstrate in several examples including adsorption, desorption, and diffusion Kinetic Monte Carlo that for the same confidence interval and observable, the proposed goal-oriented algorithm can be two orders of magnitude faster than existing coupling algorithms for spatial KMC such as the Common Random Number approach. We also provide a complete implementation of the proposed sensitivity analysis algorithms, including various spatial KMC examples, in a supplementary MATLAB source code.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Systematic parameter inference in stochastic mesoscopic modeling

We propose a method to efficiently determine the optimal coarse-grained force field in mesoscopic stochastic simulations of Newtonian fluid and polymer melt systems modeled by dissipative particle dynamics (DPD) and energy conserving dissipative particle dynamics (eDPD). The response surfaces of various target properties (viscosity, diffusivity, pressure, etc.) with respect to model parameters are constructed based on the generalized polynomial chaos (gPC) expansion using simulation results on sampling points (e.g., individual parameter sets). To alleviate the computational cost to evaluate the target properties, we employ the compressive sensing method to compute the coefficients of the dominant gPC terms given the prior knowledge that the coefficients are “sparse”. The proposed method shows comparable accuracy with the standard probabilistic collocation method (PCM) while it imposes a much weaker restriction on the number of the simulation samples especially for systems with high dimensional parametric space. Fully access to the response surfaces within the confidence range enables us to infer the optimal force parameters given the desirable values of target properties at the macroscopic scale. Moreover, it enables us to investigate the intrinsic relationship between the model parameters, identify possible degeneracies in the parameter space, and optimize the model by eliminating model redundancies. The proposed method provides an efficient alternative approach for constructing mesoscopic models by inferring model parameters to recover target properties of the physics systems (e.g., from experimental measurements), where those force field parameters and formulation cannot be derived from the microscopic level in a straight forward way.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Variance-Reduced Accelerated First-Order Methods: Central Limit Theorems and Confidence Statements

In this paper, we consider a strongly convex stochastic optimization problem and propose three classes of variable sample-size stochastic first-order methods: (i) the standard stochastic gradient descent method, (ii) its accelerated variant, and (iii) the stochastic heavy-ball method. In each scheme, the exact gradients are approximated by averaging across an increasing batch size of sampled gradients. We prove that when the sample size increases at a geometric rate, the generated estimates converge in mean to the optimal solution at an analogous geometric rate for schemes (i)–(iii). Based on this result, we provide central limit statements, whereby it is shown that the rescaled estimation errors converge in distribution to a normal distribution with the associated covariance matrix dependent on the Hessian matrix, the covariance of the gradient noise, and the step length. If the sample size increases at a polynomial rate, we show that the estimation errors decay at a corresponding polynomial rate and establish the associated central limit theorems (CLTs). Under certain conditions, we discuss how both the algorithms and the associated limit theorems may be extended to constrained and nonsmooth regimes. As a result, we provide an avenue to construct confidence regions for the optimal solution based on the established CLTs and test the theoretical findings on a stochastic parameter estimation problem.

Lei, Jinlong↗

Scalable Preconditioning of Block-Structured Linear Algebra Systems using ADMM

In this paper, we study the solution of block-structured linear algebra systems arising in optimization by using iterative solution techniques. These systems are the core computational bottleneck of many problems of interest such as parameter estimation, optimal control, network optimization, and stochastic programming. Our approach uses a Krylov solver (GMRES) that is preconditioned with an alternating method of multipliers (ADMM). We show that this ADMM-GMRES approach overcomes well-known scalability issues of Schur complement decomposition in problems that exhibit a high degree of coupling. The effectiveness of the approach is demonstrated using linear systems that arise in stochastic optimal power flow problems and that contain up to 2 million total variables and 4,000 coupling variables. We find that ADMM-GMRES is nearly an order of magnitude faster than Schur complement decomposition. Moreover, we demonstrate that the approach is robust to the selection of the augmented Lagrangian penalty parameter, which is a key advantage over the direct use of ADMM.

97 MATHEMATICS AND COMPUTING↗

Diagonal state designs with reconfigurable real-time circuits

Unitary designs are widely used in quantum computation, but in many practical settings it suffices to construct a diagonal state design generated with unitary gates diagonal in the computational basis. In this work, we introduce a simple and efficient diagonal state 3-design based on real-time evolutions under 2-local Hamiltonians. Our construction is inspired by the classical Girard-Hutchinson trace estimator in that it involves the stochastic preparation of many random-phase states. Though the exact Girard-Hutchinson states are not tractably implementable on a quantum computer, we can construct states that match the statistical moments of the Girard-Hutchinson states with real-time evolution. Importantly, our random states are all generated using the same Hamiltonians for real-time evolution, with the randomness arising solely from stochastic variations in the durations of the evolutions. In this sense, the circuit is fully reconfigurable and thus suited for near-term realizations on both digital and analog platforms. Moreover, we show how to extend our construction to achieve diagonal state designs of arbitrarily high order.

Shen, Yizhi [LBL, Berkeley] (ORCID:000000024160548↗

AlignOT: An Optimal Transport Based Algorithm for Fast 3D Alignment With Applications to Cryogenic Electron Microscopy Density Maps

Aligning electron density maps from Cryogenic electron microscopy (cryo-EM) is a first key step for studying multiple conformations of a biomolecule. As this step remains costly and challenging, with standard alignment tools being potentially stuck in local minima, we propose here a new procedure, called AlignOT, which relies on the use of computational optimal transport (OT) to align EM maps in 3D space. By embedding a fast estimation of OT maps within a stochastic gradient descent algorithm, our method searches for a rotation that minimizes the Wasserstein distance between two maps, represented as point clouds. Here, we quantify the impact of various parameters on the precision and accuracy of the alignment, and show that AlignOT can outperform the standard local alignment methods, with an increased range of rotation angles leading to proper alignment. We further benchmark AlignOT on various pairs of experimental maps, which account for different types of conformational heterogeneities and geometric properties. As our experiments show good performance, we anticipate that our method can be broadly applied to align 3D EM maps.

3D alignment↗

DAKOTA Design Analysis Kit for Optimization and Terascale

The DAKOTA (Design Analysis Kit for Optimization and Terascale Applications) toolkit provides a flexible and extensible interface between simulation codes (computational models) and iterative analysis methods. By employing object-oriented design to implement abstractions of the key components required for iterative systems analyses, the DAKOTA toolkit provides a flexible and extensible problem-solving environment for design and analysis of computational models on high performance computers.A user provides a set of DAKOTA commands in an input file and launches DAKOTA. DAKOTA invokes instances of the computational models, collects their results, and performs systems analyses. DAKOTA contains algorithms for optimization with gradient and nongradient-based methods; uncertainty quantification with sampling, reliability, polynomial chaos, stochastic collocation, and epistemic methods; parameter estimation with nonlinear least squares methods; and sensitivity/variance analysis with design of experiments and parameter study methods. These capabilities may be used on their own or as components within advanced strategies such as hybrid optimization, surrogate-based optimization, mixed integer nonlinear programming, or optimization under uncertainty. Services for parallel computing, simulation interfacing, approximation modeling, fault tolerance, restart, and graphics are also included.

SciDAC↗

Quinoa, Version 0.2

Quinoa is a set of computational tools that enables research and numerical analysis in fluid dynamics. At this time it remains a test-bed to experiment with various algorithms using fully asynchronous runtime systems. Currently, Quinoa consists of the following tools: (1) Walker, a numerical integrator for systems of stochastic differential equations in time. It is a mathematical tool to analyze and design the behavior of stochastic differential equations. It allows the estimation of arbitrary coupled statistics and probability density functions and is currently used for the design of statistical moment approximations for multiple mixing materials in variable-density turbulence. (2) Inciter, an overdecomposition-aware finite element field solver for partial differential equations using 3D unstructured grids. Inciter is used to research asynchronous mesh-based algorithms and to experiment with coupling asynchronous to bulk-synchronous parallel code. Two planned new features of Inciter, compared to the previous release (LA-CC-16-015), to be implemented in 2017, are (a) a simple Navier-Stokes solver for ideal single-material compressible gases, and (b) solution-adaptive mesh refinement (AMR), which enables dynamically concentrating compute resources to regions with interesting physics. Using the NS-AMR problem we plan to explore how to scale such high-load-imbalance simulations, representative of large production multiphysics codes, to very large problems on very large computers using an asynchronous runtime system. (3) RNGTest, a test harness to subject random number generators to stringent statistical tests enabling quantitative ranking with respect to their quality and computational cost. (4) UnitTest, a unit test harness, running hundreds of tests per second, capable of testing serial, synchronous, and asynchronous functions. (5) MeshConv, a mesh file converter that can be used to convert 3D tetrahedron meshes from and to either of the following formats: Gmsh, http://www.geuz.org/gmsh, Netgen, http://sourceforge.net/apps/mediawiki/netgen-mesher, ExodusII, http://sourceforge.net/projects/exodusii, HyperMesh, http://www.altairhyperworks.com/product/HyperMesh.

Bakosi, Jozsef↗

Deep Direct-Use Feasibility Study Reservoir Productivity Uncertainty Analysis for the Tuscarora Sandstone, Morgantown, WV

This dataset contains figures that summarize the Tuscarora Sandstone core permeability data collected from the Preston 119 well in Preston County, WV, and summary results of a stochastic analysis that was used to estimate reservoir productivity for the currently unexplored Tuscarora Sandstone below Morgantown, West Virginia. Uncertainties in reservoir productivity considered the thickness of the reservoir, rock permeability, and fluid viscosity. A Monte Carlo analysis of these uncertain properties was used to predict reservoir flow productivity for the case of a matrix-dominated reservoir, and a fracture-dominated reservoir. These results are summarized in figures, spreadsheets, and maps.

15 GEOTHERMAL ENERGY↗

Final Report, DOE Early Career Award: Predictive modeling of complex physical systems: new tools for statistical inference, uncertainty quantification, and experimental design

Predictive simulation of complex physical systems increasingly rests on the interplay of experimental observations with computational models. Key inputs, parameters, or structural aspects of models may be incomplete or unknown, and must be developed from indirect and limited observations. At the same time, quantified uncertainties are needed to qualify computational predictions in the support of design and decision-making. In this context, Bayesian statistics provides a foundation for inference from noisy and limited data, but at prohibitive computional expense. This project intends to make rigorous predictive modeling *feasible* in complex physical systems, via accelerated and scalable tools for uncertainty quantification, Bayesian inference, and experimental design. Specific objectives are as follows: 1. Develop adaptive posterior approximations and dimensionality reduction approaches for Bayesian inference in high-dimensional nonlinear systems. 2. Extend accelerated Bayesian methodologies to large-scale {\em sequential} data assimilation, fully treating nonlinear models and non-Gaussian state and parameter distributions. 3. Devise efficient surrogate-based methods for Bayesian model selection and the learning of model structure. 4. Develop scalable simulation/optimization approaches to nonlinear Bayesian experimental design, for both parameter inference and model selection. 5. Demonstrate these inferential tools on chemical kinetic models in reacting flow, constructing and refining thermochemical and electrochemical models from limited data. Demonstrate Bayesian filtering on canonical stochastic PDEs and in the dynamic estimation of inhomogeneous subsurface properties and flow fields.

97 MATHEMATICS AND COMPUTING↗

Uncertainties in Local Intense Precipitation Flood Modeling

In the Task 1 report for the U.S. Nuclear Regulatory Commission (NRC) funded Local Intense Precipitation (LIP) Probabilistic Flood Hazard Assessment (PFHA) Pilot Study, the Pacific Northwest National Laboratory (PNNL) reviewed hydrologic and hydraulic modeling approaches for estimation of LIP flooding and their implementation in readily available simulation software packages (Prasad and Yuan 2020). NRC’s interest is in developing guidance for performing LIP PFHA at nuclear power plant (NPP) sites. This report describes the work done under Task 2 of the study that focused on describing uncertainties associated with LIP flood modeling. Two main types of uncertainties exist in LIP flood modeling: (1) aleatory uncertainties that arise from the inherent natural variability of the hydrometeorological system and (2) epistemic uncertainties that arise from the analysts’ incomplete knowledge of the hydrometeorological and site configuration. Principal sources for aleatory variability in LIP flood simulations at NPP sites include precipitation (i.e., magnitude, duration, and temporal distribution of LIP events), initial conditions (e.g., soil moisture content, stormwater drainage discharge, surface storage), boundary conditions (e.g., upstream discharge, downstream water surface elevations), and long-term temporal trends (e.g., climate change). This report describes approaches used for estimating the aleatory variability in precipitation including precipitation-frequency analysis, numerical weather prediction, and stochastic weather generation. Data sources that can be used to estimate aleatory variability in initial and boundary conditions are also described. Approaches to include effects of long-term trends like those from climate change into estimation of aleatory variability are summarized. Sources of epistemic uncertainty in LIP flood simulations at NPP sites include process representation (e.g., multiple approaches to represent runoff generation, stormwater drainage, and hydraulic routing), site configurations (e.g., site layout, flow features, status of temporary flood protection, blockage of drains), model resolution, and long-term temporal trends (e.g., known/planned site alterations, land-use changes at and in the vicinity of the site). The report describes alternative process representations (methods and models), particularly those implemented in the LIP flood simulation software packages reviewed in Task 1 report, and lists the associated model parameters. Approaches for estimating model parameters when surface and subsurface water exchanges occur are also described.

42 ENGINEERING↗

UV stars and the interstellar medium - A statistical time-dependent model

A statistical time-dependent model for the effects on the interstellar gas of the ionizing radiation from UV stars is presented. The radiation from the stars is assumed to be emitted as monochromatic bursts at random times and locations. The thermal and ionization history of the gas is followed in a Monte Carlo simulation. Probability densities as well as mean values for the ionization fraction, temperature, and other observable quantities are derived. The fluctuations in observed quantities due to the stochastic nature of the model are estimated. Models of the interstellar medium perpendicular to the galactic plane are developed and compared with observations. The action of the UV stars can explain the bulk properties of the interstellar gas toward the galactic poles and is consistent with the Copernicus satellite observations toward lambda Scorpii.

Lyon, J.↗

Effects of structural error on the estimates of parameters of dynamical systems

In this paper, the notion of 'near-equivalence in probability' is introduced for identifying a system in the presence of several error sources. Following some basic definitions, necessary and sufficient conditions for the identifiability of parameters are given. The effects of structural error on the parameter estimates for both the deterministic and stochastic cases are considered.

Hadaegh, F. Y.↗