Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Using Dense Array Waveform Correlations to Build a Velocity Model with Stochastic Variability

In an ongoing effort to improve 3D seismic-wave propagation modeling for frequencies up to 10 Hz, we used cross correlations between vertical-component waveforms from an underground chemical explosion to estimate the statistical properties of small-scale velocity heterogeneities. The waveforms were recorded by a dense 2D seismic array deployed during the Source Physics Experiments for event number 5 (SPE-5) in a series of six underground chemical explosions, conducted at the Nevada National Security Site. The array consisted of 996 geophones with a 50–100 m grid spacing, deployed at the SPE site at the north end of the Yucca Flat basin. The SPE were conducted to investigate the generation and propagation of seismic and acoustic waves from underground explosions. Comparisons of decay rates of waveform cross correlations as function of interstation distance, computed for observed and synthetic seismograms from the SPE-5 chemical explosion, were used to constrain statistical properties of correlated stochastic velocity perturbations representing small-scale heterogeneities added to a geology-based velocity model of the Yucca Flat basin. Using comparisons between recorded and simulated waveform cross correlations, we were able to recover sets of statistical properties of small-scale velocity perturbations in the velocity model that produce the best-fit between the recorded and simulated ground motion. The stochastic velocity fluctuations in the velocity model that produced the smallest misfits have a horizontal correlation distance of between 400 and 800 m, a vertical correlation distance between 100 and 200 m, and a standard deviation of 10% from the nominal model velocity in the alluvium basin layers. They also have a horizontal correlation distance of 1000 m, a vertical correlation distance of 250 m, and a standard deviation of 6% in the underlying and consolidated sedimentary layers, up to a depth of 4 km. Comparisons between observed and simulated wavefields were used to assess the proposed small-scale heterogeneity enhancements to the Yucca Flat basin model. We found that adding a depth-resolved stochastic variability to the geology-based velocity model improves the overall performance of ground-motion simulations of an SPE-5 explosion in the modeled frequency range up to 10 Hz. The results may be applicable to other similar basins.

58 GEOSCIENCES↗

Preliminary study of auto-differentiation algorithm in beam dynamics with stochastic process

Modern particle accelerator optimization requires sophisticated computational methods to address the inherently stochastic nature of beam dynamics. This research develops a framework applying AD to SDEs that specifically addresses beam dynamics challenges in particle accelerators, focusing on accurately modeling and optimizing beam behavior in regimes dominated by stochastic processes. By incorporating key physical phenomena such as synchrotron radiation, wakefield effects, and quantum excitation, the framework aims to provide auto differentiation on the figure of merit of the phase space evolution and beam dynamics. The methodology will enable effective optimization method in a dynamic system with stochastic process.

Accelerator Physics↗

Determining Reduced Order Models for Optimal Stochastic Reduced Order Models

The use of parameterized reduced order models(PROMs) within the stochastic reduced order model (SROM) framework is a logical progression for both methods. In this report, five different parameterized reduced order models are selected and critiqued against the other models along with truth model for the example of the Brake-Reuss beam. The models are: a Taylor series using finite difference, a proper orthogonal decomposition of the the output, a Craig-Bampton representation of the model, a method that uses Hyper-Dual numbers to determine the sensitivities, and a Meta-Model method that uses the Hyper-Dual results and constructs a polynomial curve to better represent the output data. The methods are compared against a parameter sweep and a distribution propagation where the first four statistical moments are used as a comparison. Each method produces very accurate results with the Craig-Bampton reduction having the least accurate results. The models are also compared based on time requirements for the evaluation of each model where the Meta- Model requires the least amount of time for computation by a significant amount. Each of the five models provided accurate results in a reasonable time frame. The determination of which model to use is dependent on the availability of the high-fidelity model and how many evaluations can be performed. Analysis of the output distribution is examined by using a large Monte-Carlo simulation along with a reduced simulation using Latin Hypercube and the stochastic reduced order model sampling technique. Both techniques produced accurate results. The stochastic reduced order modeling technique produced less error when compared to an exhaustive sampling for the majority of methods.

97 MATHEMATICS AND COMPUTING↗

Systematic Evaluation of Stochastic Methods in Power System Scheduling and Dispatch with Renewable Energy

As more wind power and other renewable resources are being integrated into the electric power grid, the forecast uncertainty brings operational challenges for the power system operators. In this report, different operational strategies for uncertainty management are presented and evaluated. A comprehensive and consistent simulation framework is developed to analyze the performance of different reserve policies and scheduling techniques under uncertainty in wind power. Numerical simulations are conducted on a modified version of the IEEE 118-bus system with a 20% wind penetration level, comparing deterministic, interval, and stochastic unit commitment strategies. The results show that stochastic unit commitment provides a reliable schedule without large increases in operational costs. Moreover, decomposition techniques, such as load shift factor and Benders decomposition, can help in overcoming the computational obstacles to stochastic unit commitment and enable the use of a larger scenario set to represent forecast uncertainty. In contrast, deterministic and interval unit commitment tend to give higher system costs as more reserves are being scheduled to address forecast uncertainty. However, these approaches require a much lower computational effort Choosing a proper lower bound for the forecast uncertainty is important for balancing reliability and system operational cost in deterministic and interval unit commitment. Finally, we find that the introduction of zonal reserve requirements improves reliability, but at the expense of higher operational costs.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The Effects of Stochastic Velocity Variations on Estimating Time Dependent Seismic Moment Tensors: Applications to the Blue Mountain Well Perforation Data

Resolving the time dependent terms in the seismic moment tensor provides important information that can be used to interpret the source process of an explosion, including the separation of isotropic explosion terms from shear forces and potentially isolated force couples. In this report, we detail our method of inverting three component seismic data for the seismic moment tensor. We review possible seismic source models from the simplest isotropic explosion type source to those incorporating the six independent moment tensor terms. The inversion we describe is formulated in the frequency domain, and results in estimates of time dependent moment tensor components. The inversion relies on an accurate estimate of the Green's functions of the Earth. However, given the complexity of the Earth, we explore the effects of inaccuracies in the presumed Earth model used to estimate the Green's functions needed for the inversion. Specifically, we explore the effects of stochastic variations in the Earth models on the inversion results. These tests are synthetic throughout, and show that adding stochastic density/velocity heterogeneity in the presumed Earth model results in reduced amplitude seismic moment tensor estimates, as well as degrading the data misfit. We suggest two mitigation strategies. First, produce a suite of Green's functions using different realizations of the stochastic field within the Earth Model. Secondly, perform the in- version in the power spectral domain, eliminating all phase information. Finally, we analyze actual seismic data collected in winter 2017/2018. The seismic data was collected at in active geothermal well site outside of Winnimucca, NV, and was produced during well stimulation operations. In general, the inversion results were poor, with a high degree of data misfit. We hypothesize that the poor results are a function of a poorly constrained Earth model as well as noisy, high-frequency data being used in the inversion.

58 GEOSCIENCES↗

Stochastic Richardson Extrapolation Based Numerical Error Estimation for Kinetic Plasma Simulations

We present a numerical error estimation technique specifically formulated to deal with stochastic code output with multiple discretization parameters. This method is based on multiple fits to an error model with arbitrary convergence rates and cross-coupling terms, performed using nonlinear optimization. The fitting approach varies by the type of residual norm which influences the importance of outliers, and weights which influences the relative importance of data points in the coarse and refined regions of discretization parameter space. To account for the influence of stochastic noise, these fits are performed on multiple bootstrap values based on the underlying response data set. Using an automated discretization domain selection scheme, the fits are performed on a series of reduced sets of discretization levels in order to find an optimal fully-converged result estimate in the minimum variance sense; this automated approach enables straightforward analysis of multiple quantities of interest and/or time and spatially-dependent response data. The overall numerical error analysis method is useful for verification and validation problems for stochastic simulation methods and forms a key component in the overall uncertainty quantification process. The method was demonstrated for steady and unsteady electron diode problems simulated using a particle-in-cell kinetic plasma code, demonstrating excellent results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Stochastic Approaches for Calculating and Aggregating Detection Probabilities for Nuclear Material Diversion

The authors built and tested a stochastic simulation to estimate achieved detection probabilities (DPs) on a stratum basis, over a tailorable range of diverted amounts from 0 to 2 significant quantities (SQ), using typical International Atomic Energy Agency (IAEA) inspection data: i.e., SQ in stratum, number of items, number of gross/partial/bias defect measurements conducted, and realistic relative standard deviation (RSD) values for typical IAEA verification measurements. For bulk strata, the model calculates achieved DP at 0.01 SQ diversion increments; for item strata, the model calculates DP using the smallest realistic diversion increment (e.g., a plate, pin, or coupon). After successfully benchmarking against IAEA deterministic models, the simulation was used to test the sensitivity of DP to certain standard assumptions and selected input parameters. First, the equal defect assumption was tested; the results suggest significant complexity in the effectiveness of partial defect measurements. Next, the authors explored the sensitivity of DP to the assumed RSD of attribute tests. Then, the authors compared non-normal models for instrument performance (e.g., logistic, step, or arbitrary functions) to the typical results from a normal distribution (characterized by RSD). This last comparison was supplemented with experimentally derived performance data for an HM-5 gamma spectrometer. The HM-5 was used to make enrichment measurements on both LEU and HEU MTR fuel elements as plates were removed, and the results fit with logistic and step curves and applied in the simulation. These stochastic DP results were compared to DP estimates from a deterministic model assuming a normal curve and typical RSD, yielding insights that could improve effectiveness in the field. These early results illustrate the potential of stochastic models to better understand achieved DP and to improve safeguards effectiveness.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Scalable Techniques for Stochastic Power Flow Problems (Final Report)

The proposed research focuses on developing scalable algorithms for two-stage security-constrained OPF problems with AC power flow constraints, a class of problems complicated by (i) scale arising from a scenario representation; and (ii) the presence of nonlinearity, nonconvexity, and possibly second-stage discreteness or complementarity. Unfortunately, most existing solvers cannot contend with both challenges simultaneously; accordingly, the proposed research focuses on developing solution techniques that can both scale with the number of scenarios and contend with nonconvexity and second-stage complementarity. We consider three avenues for addressing such problems: (i) Variable sample-size SQP (VS-SQP) methods that combine sparse Quasi-Newton updates with a scalable variance-reduced stochastic gradient scheme for stochastic QP subproblems, allowing for contending with second-stage complementarity via regularization; (ii) Variable sample-size stochastic Interior-point (VS-sIP) schemes that propose a sampling-based regularized (to allow for contending with complementarity) interior-point schemes in which a Schur-complement technique is employed for decomposing the Newton direction computation step; (iii) Variable sample-size tractable ADMM (VS-tADMM) schemes combine variable sample-sizes with carefully designed techniques for resolving each of the nonconvex updates (by leveraging the QCQP structures). We intend to compare the three schemes using performance profiles in terms of solution quality, scalability, etc. and then select one scheme which will then be developed and further refined in Python for purposes of the GO competition.

42 ENGINEERING↗

STOCHASTIC OPTIMAL POWER FLOW FOR REAL-TIME MANAGEMENT OF DISTRIBUTED RENEWABLE GENERATION AND DEMAND RESPONSE (Final Report)

To meet the grand challenge of a sustainable energy future, there has been a surge of interest in renewable energy. Today, the uncertainty associated with renewable resources is handled by using operating reserves. The high penetration of renewable resources, however, introduces difficult-to-control dynamics and challenges for power system operation. Decision support tools are necessary at the bulk system operational level to recognize and efficiently utilize renewable resources and distributed demand response products in concert with traditional grid resources. It is envisaged that responsive load can potentially have very significant cost advantages over either spinning or non-spinning ramping reserve. Critical decisions are made during hour(s)-ahead and real-time power system operation regarding the commitment and dispatch of generators to ensure power delivery is both reliable and economic. These decisions are typically made by a security constrained optimal flow, which determines future generator commitments, dispatches, and ensures adequate reserves are available in the event of a contingency (unexpected outage) or if future system conditions deviate from forecasts. However, security has been always based on a pre-specified subset of contingency constraints whose enforcement does not guarantee security under all possible future possibilities while also giving little or no weight to the likelihood of each contingent event or the severity of its consequences. Existing tools, which are based exclusively on deterministic optimization models, do not yield optimal operational decisions to address these new challenges, in terms of both reliability and cost-effectiveness. This project has focused on developing a stochastic optimal power flow (SOPF) framework, which integrates renewable resource uncertainty, load uncertainty, distributed storage (DS), demand response (DR) products, in a holistic manner to address the uncertainty associated with ever-increasing renewable resources, along with the inclusion of distributed demand response products in future power systems. A proof-of-concept problem was created using the Pennsylvania-Jersey-Maryland (PJM) power system network. Synthetic wind generation was added to the system to simulate 50% wind penetration. A 1-hour test of SOPF operation indicated more than 6% operational cost savings. The project continued by adding the Midwestern Independent System Operator (MISO) as a partner, with focus shifting from SOPF to Stochastic Look-Ahead Unit Commitment (SLAC). Unlike PJM, MISO is faced with significant renewable energy resources within its footprint and is challenged with substantial uncertainty in its operations. The SLAC distinguishes itself from existing tools that operators use. At best, today’s tools solve two to three cases independently, where one or two system parameters, such as forecasted load level (e.g., a low, base, and high forecast), are varied and the resulting scenarios are analyzed independently. The stochastic-based optimization of SLAC leverages statistical information from an ensemble of potential operational scenarios and their respective likelihood. The SLAC output can be translated into valuable information to the operator such as suggested commitments, optimal scheduling and dispatch of resources, reserve requirements at both locational and zonal resolutions, ramping availability and requirements, availability of demand response including operational guidance concerning the near-term and real-time coordination between distributed energy resources, and utilization of distributed storage resources. The developed SOPF/SLAC tool, a stand-alone tool compatible with existing EMSs, will provide system operators with unprecedented visibility, flexibility and predictability to these resources and operational guidance concerning the real-time coordination between DERs and DR/DS products. The game changing and practical impact of this disruptive technology will be dramatic and will usher in a new era in the electric power industry, wherein green energy concepts are fully embraced, and electric power costs are lowered throughout the nation.

42 ENGINEERING↗

Exploring Interferometry Diagnostics for Optical Stochastic Cooling at FAST/IOTA

Optical Stochastic Cooling (OSC) is an advanced beam-cooling technique that will precede the traditional stochastic cooling. This method leverages optical radiation and high-precision feedback to cool the particles more efficiently than traditional stochastic methods by more than three orders of magnitude. As such, it is an enabler for the development of next generation discovery science machines at the frontiers of energy and intensity. This paper focuses on the development of the second phase of OSC and improving extreme beam cooling technique in accelerators. Along with the assembly and use of an interferometer to provide diagnostics and optimization to OSC systems. The interferometer can allow for the observation and analysis of fringe patterns from a recreated simpler version in the laser room. By leveraging interferometric techniques, OSC can achieve higher efficiency, verification, stability and performance.

Teriba, Folashade↗

Stochastic Acceleration of ~0.1–5 keV Pickup Ions in the Heliotail

We seek to understand the quantitative role of the dominant physical processes (charge-exchange, adiabatic heating, stochastic acceleration) governing the proton distribution in the heliotail using observations of hydrogen energetic neutral atoms (ENAs) from the Interstellar Boundary Explorer ( IBEX ). We solve the Parker transport equation for solar wind protons and pickup ions (PUIs) as they propagate from the termination shock (TS) down the heliotail, including charge-exchange between protons and neutral hydrogen atoms as source terms derived from an MHD-fluid and kinetic-neutral simulation of the heliosphere. We compute ENA fluxes at 1 au from the results of the proton transport model and compare them with IBEX observations. We find that, under the assumptions of our model, a stochastic acceleration process is needed to counteract the energy-dependent losses of ~0.1–5 keV PUIs from charge-exchange to reproduce IBEX data. The power-law velocity dependence of the diffusion coefficient (spectral index γ ) is limited to the range 0.67 < γ < 2, and the best fit to IBEX data appears close to γ ~ 1.25. The diffusion rate ~1.1 &#x00d7; 10 -8 km 2 s -3 ( v / v 0 ) 1.25 nearly balances the loss of ~0.1–5 keV PUIs by charge-exchange. Our analysis suggests that cyclotron resonance with two widely known incompressible MHD turbulence: namely, isotropic Kolmogorov and anisotropic Goldreich–Sridhar turbulence, as well as stochastic particle interactions with compressive waves are not by themselves the dominant diffusion mechanisms. However, some intermediate processes may be occurring due to the presence of PUIs.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Latent Stochastic Differential Equations for Modeling Quasar Variability and Inferring Black Hole Properties

Quasars are bright and unobscured active galactic nuclei (AGN) thought to be powered by the accretion of matter around supermassive black holes at the centers of galaxies. The temporal variability of a quasar’s brightness contains valuable information about its physical properties. The UV/optical variability is thought to be a stochastic process, often represented as a damped random walk described by a stochastic differential equation (SDE). Upcoming wide-field telescopes such as the Rubin Observatory Legacy Survey of Space and Time (LSST) are expected to observe tens of millions of AGN in multiple filters over a ten year period, so there is a need for efficient and automated modeling techniques that can handle the large volume of data. Latent SDEs are machine learning models well suited for modeling quasar variability, as they can explicitly capture the underlying stochastic dynamics. In this work, we adapt latent SDEs to jointly reconstruct multivariate quasar light curves and infer their physical properties such as the black hole mass, inclination angle, and temperature slope. Our model is trained on realistic simulations of LSST ten year quasar light curves, and we demonstrate its ability to reconstruct quasar light curves even in the presence of long seasonal gaps and irregular sampling across different bands, outperforming a multioutput Gaussian process regression baseline. Our method has the potential to provide a deeper understanding of the physical properties of quasars and is applicable to a wide range of other multivariate time series with missing data and irregular sampling.

79 ASTRONOMY AND ASTROPHYSICS↗

Joint Modeling of Quasar Variability and Accretion Disk Reprocessing Using Latent Stochastic Differential Equations

Quasars are bright active galactic nuclei powered by the accretion of matter around supermassive black holes at the center of galaxies. Their stochastic brightness variability depends on the physical properties of the accretion disk and black hole. The upcoming Rubin Observatory Legacy Survey of Space and Time (LSST) is expected to observe tens of millions of quasars, so there is a need for efficient techniques like machine learning that can handle the large volume of data. Quasar variability is believed to be driven by an X-ray corona, which is reprocessed by the accretion disk and emitted as UV/optical variability. We are the first to introduce an auto-differentiable simulation of the accretion disk and reprocessing. We use the simulation as a direct component of our neural network to jointly model the driving variability and reprocessing, trained with supervised learning on simulated LSST-like 10 yr quasar light curves. We encode the light curves using a transformer encoder, and the driving variability is reconstructed using latent stochastic differential equations, a physically motivated generative deep learning method that can model continuous-time stochastic dynamics. By embedding the physical processes of the driving signal and reprocessing into our network, we achieve a model that is more robust and interpretable. We demonstrate that our model outperforms a Gaussian process regression baseline and can infer accretion disk parameters and time delays between wave bands, even for out-of-distribution driving signals. Our approach provides a powerful framework that can be adapted to solve other inverse problems in multivariate time series.

Fagin, Joshua [City Univ. of New York (CUNY), NY (↗

Fast Ion Heating in Transient Collisionless Magnetic Reconnection via an Intrinsic Stochastic Mechanism

Stochastic heating has typically been known to be a powerful ion heating mechanism in the solar wind, atmosphere, and flares. Here, we show that stochastic ion heating is inherent to transient collisionless magnetic reconnection. The explanation exploits the connected nature of electron canonical vorticity to show analytically that the in-plane electric and magnetic fields in a typical reconnection geometry satisfy the condition for stochastic heating of ions. Electron fluid simulations, test ion simulations, and comparisons to experiments all support the existence of this mechanism.

79 ASTRONOMY AND ASTROPHYSICS↗

On stochastic control and optimal measurement strategies

The control of stochastic dynamic systems is studied with particular emphasis on those which influence the quality or nature of the measurements which are made to effect control. Four main areas are discussed: (1) the meaning of stochastic optimality and the means by which dynamic programming may be applied to solve a combined control/measurement problem; (2) a technique by which it is possible to apply deterministic methods, specifically the minimum principle, to the study of stochastic problems; (3) the methods described are applied to linear systems with Gaussian disturbances to study the structure of the resulting control system; and (4) several applications are considered.

Kramer, L. C.↗

Stochastic stability

The field of stochastic stability is surveyed, with emphasis on the invariance theorems and their potential application to systems with randomly varying coefficients. Some of the basic ideas are reviewed, which underlie the stochastic Liapunov function approach to stochastic stability. The invariance theorems are discussed in detail.

Kushner, H. J.↗

The role and use of the stochastic linear-quadratic-Gaussian problem in control system design.

The role of the linear-quadratic stochastic control problem in engineering design is reviewed in tutorial fashion. The design approach is motivated by considering the control of a nonlinear uncertain plant about a desired input-output response. It is demonstrated how a design philosophy based on (1) deterministic perturbation control, (2) stochastic state estimation, and (3) linearized stochastic control leads to an overall closed-loop control system. The emphasis of the paper is on the philosophy of the design process, the modeling issue, and the formulation of the problem; the results are given for the sake of completeness, but no proofs are included. The systematic off-line nature of the design process is stressed throughout.

Athans, M.↗

Application of a stochastic inverse to the geophysical inverse problem

The inverse problem for gross earth data can be reduced to an undertermined linear system of integral equations of the first kind. A theory is discussed for computing particular solutions to this linear system based on the stochastic inverse theory presented by Franklin. The stochastic inverse is derived and related to the generalized inverse of Penrose and Moore. A Backus-Gilbert type tradeoff curve is constructed for the problem of estimating the solution to the linear system in the presence of noise. It is shown that the stochastic inverse represents an optimal point on this tradeoff curve. A useful form of the solution autocorrelation operator as a member of a one-parameter family of smoothing operators is derived.

Jordan, T. H.↗