Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Neutrino masses and sparticle spectra from stochastic superspace

Based on the stochastic superspace mechanism for softly breaking supersymmetry, we present improved sparticle spectra computations for the minimal model and examine extensions through R-parity violation and the type-I seesaw mechanism that incorporate nonzero neutrino masses for more realistic models. Performing the calculations to two-loop accuracy, we observe a global decrease in predicted sparticle masses. However this does not affect the generic features of the minimal model outlined in our earlier work, including the characteristic light stop mass. We find stop decay channels accessible at the LHC which can be used in combination with our predicted range for the stop mixing angle to falsify the minimal model with stochastic supersymmetry. We then introduce neutrino masses and mixings consistent with experiment by including purely trilinear R-parity violating superpotential terms, resulting in a viable stochastic superspace model absent a dark matter candidate. An alternative method for generating neutrino masses, namely, the type-I seesaw mechanism, is found only to be viable when the neutrino Yukawa coupling is small relative to the top Yukawa and the cutoff scale is large.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Discriminating between a stochastic gravitational wave background and instrument noise

The detection of a stochastic background of gravitational waves could significantly impact our understanding of the physical processes that shaped the early Universe. The challenge lies in separating the cosmological signal from other stochastic processes such as instrument noise and astrophysical foregrounds. One approach is to build two or more detectors and cross correlate their output, thereby enhancing the common gravitational wave signal relative to the uncorrelated instrument noise. When only one detector is available, as will likely be the case with the Laser Interferometer Space Antenna (LISA), alternative analysis techniques must be developed. Here we show that models of the noise and signal transfer functions can be used to tease apart the gravitational and instrument noise contributions. We discuss the role of gravitational wave insensitive ''null channels'' formed from particular combinations of the time delay interferometry, and derive a new combination that maintains this insensitivity for unequal arm-length detectors. We show that, in the absence of astrophysical foregrounds, LISA could detect signals with energy densities as low as {Omega}{sub gw}=6x10{sup -13} with just one month of data. We describe an end-to-end Bayesian analysis pipeline that is able to search for, characterize and assign confidence levels for the detection of a stochastic gravitational wave background, and demonstrate the effectiveness of this approach using simulated data from the third round of Mock LISA Data Challenges.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Three-point statistics of cosmological stochastic gravitational waves

We consider the three-point function (i.e. the bispectrum or non-Gaussianity) for stochastic backgrounds of gravitational waves. We estimate the amplitude of this signal for the primordial inflationary background, gravitational waves generated during preheating, and for gravitational waves produced by self-ordering scalar fields following a global phase transition. To assess detectability, we describe how to extract the three-point signal from an idealized interferometric experiment and compute the signal to noise ratio as a function of integration time. The three-point signal for the stochastic gravitational wave background generated by inflation is unsurprisingly tiny. For gravitational radiation generated by purely causal, classical mechanisms we find that, no matter how nonlinear the process is, the three-point correlations produced vanish in direct detection experiments. On the other hand, we show that in scenarios where the B-mode of the cosmic microwave background is sourced by gravitational waves generated by a global phase transition, a strong three-point signal among the polarization modes is also produced. This may provide another method of distinguishing inflationary B-modes. To carry out this computation, we have developed a diagrammatic approach to the calculation of stochastic gravitational waves sourced by scalar fluids, which has applications beyond the present scenario.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Astrometric effects of a stochastic gravitational wave background

A stochastic gravitational wave background causes the apparent positions of distant sources to fluctuate, with angular deflections of order the characteristic strain amplitude of the gravitational waves. These fluctuations may be detectable with high precision astrometry, as first suggested by Braginsky et al. in 1990. Several researchers have made order of magnitude estimates of the upper limits obtainable on the gravitational wave spectrum {Omega}{sub gw}(f), at frequencies of order f{approx}1 yr{sup -1}, both for the future space-based optical interferometry missions GAIA and SIM, and for very long baseline interferometry in radio wavelengths with the SKA. For GAIA, tracking N{approx}10{sup 6} quasars over a time of T{approx}1 yr with an angular accuracy of {Delta}{theta}{approx}10{mu} as would yield a sensitivity level of {Omega}{sub gw{approx}}({Delta}{theta}){sup 2}/(NT{sup 2}H{sub 0}{sup 2}){approx}10{sup -6}, which would be comparable with pulsar timing. In this paper we take a first step toward firming up these estimates by computing in detail the statistical properties of the angular deflections caused by a stochastic background. We compute analytically the two-point correlation function of the deflections on the sphere, and the spectrum as a function of frequency and angular scale. The fluctuations are concentrated at low frequencies (for a scale invariant stochastic background), and at large angular scales, starting with the quadrupole. The magnetic-type and electric-type pieces of the fluctuations have equal amounts of power.

79 ASTRONOMY AND ASTROPHYSICS↗

Demand Response Under Stochastic, Price-Dependent User Behavior

This letter focuses on price-based demand response (DR) implemented through dynamic adjustments of electricity prices. It extends existing DR models to a stochastic framework in which customer response is represented by price-dependent random variables, leveraging models and tools from the theory of stochastic optimization with decision-dependent distributions. The inherent epistemic uncertainty in the customers' responses renders open-loop, model-based DR strategies impractical. We propose a stochastic, feedback-based pricing strategy to compensate for estimation errors and uncertainty in customer response, establish theoretical results demonstrating the stability and near-optimality of the proposed approach, and validate its effectiveness through numerical simulations.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Will Stochastic Devices Play Nice With Others in Neuromorphic Hardware?: There’s More to a Probabilistic System Than Noisy Devices

Achieving brain-like efficiency in computing requires a co-design between the development of neural algorithms, brain-inspired circuit design, and careful consideration of how to use emerging devices. The recognition that leveraging device-level noise as a source of controlled stochasticity represents an exciting prospect of achieving brain-like capabilities in probabilistic neural algorithms, but the reality of integrating stochastic devices with deterministic devices in an already-challenging neuromorphic circuit design process is formidable. Here, we explore how the brain combines different signaling modalities into its neural circuits as well as consider the implications of more tightly integrated stochastic, analog, and digital circuits. Further, by acknowledging that a fully CMOS implementation is the appropriate baseline, we conclude that if mixing modalities is going to be successful for neuromorphic computing, it will be critical that device choices consider strengths and limitations at the overall circuit level.

42 ENGINEERING↗

Scenario Creation and Power-Conditioning Strategies for Operating Power Grids with Two-Stage Stochastic Economic Dispatch

A significant difficulty associated with the use of stochastic programming to solve optimal power flow problems on a 5-minute timescale is the quality of renewable energy scenarios input by the user. This is especially true when considering power systems with high penetrations of renewable energy, e.g. wind power. This paper introduces the use of stochastic programming to solve the DC optimal power flow problem with scenarios drawn directly from high-fidelity data sets. Hence, the proposed method avoids the problem of lost physics by finding high-fidelity analogs that can describe future states of the system. Furthermore, this method can be simply extended to output multi-period scenarios to the stochastic program. We demonstrate the effectiveness of this technique by simulating dispatch operations on a synthetic test system over the course of a week.

94 GMLC - Grid Modernization Laboratory Consortium↗

Stochastic Model Predictive Control With Gaussian Wind Direction Preview for Wake Steering

This article addresses the problem of wake steering control for wind farms that explicitly consider the tradeoff between farm-level power generation and yaw duty cycle under variable and uncertain wind conditions. A novel stochastic model predictive control (MPC) algorithm is presented, which utilizes a stochastic model of the freestream wind field components in a receding horizon framework to compute optimal yaw set points that maximize the expected value of the farm power while constraining the yaw actuation. Different configurations of the algorithm are evaluated using a steady-state wind farm simulator. The proposed stochastic MPC algorithm can plan control actions over a future prediction horizon based on probabilistic estimates of the incoming wind magnitude and direction.

17 WIND ENERGY↗

Scalable FPGA Accelerator for Deep Convolutional Neural Networks with Stochastic Streaming

Here, FPGA-based heterogeneous computing platform, due to its extreme logic reconfigurability, emerges to be a strong contender as computing fabric in modern AI. As a result, various FPGA-based accelerators for deep CNN—the key driver of modern AI—have been proposed due to their advantages of high performance, reconfigurability, and fast development round, etc. In general, the consensus among researchers is that, although FPGA-based accelerator can achieve much higher energy efficiency, its raw computing performance lags behind when compared with GPUs with similar logic density. In this paper, we develop an alternative methodology to efficiently implement CNNs with FPGAs that outperform GPUs in terms of both power consumption and performance. Our key idea is to design a scalable hardware architecture and circuit design for large-scale CNNs that leverages a stochastic-based computing principle. Specifically, there are three major performance advantages. First, all key components of our deep learning CNN are designed and implemented to compute stochastically, thus achieving excellent computing performance and energy efficiency. Second, because our proposed CNN architecture enables a stream-mode computing, all of its stages can process even the partial results from preceding stages, therefore not incurring unnecessary latency due to data dependency. Finally, our FPGA-based deep CNN also provides a superior hardware scalability when compared with conventional FPGA implementations by reducing the bandwidth requirement between layers. The results show that our proposed CNN architecture significantly outperforms all previous FPGA-based deep CNN implementation approaches. It achieves 1.58x more GOPS, 6.42x more GOPS/Slice, and 10.92x more GOPS/W when compared with state-of-the-art CNN architecture. The top-5 accuracy of stochastic VGG-16 CNN is 86.77 percent with 18.91 fps frame rate.

97 MATHEMATICS AND COMPUTING↗

An Improved Stochastic Unit Commitment Formulation to Accommodate Wind Uncertainty

The United States targets to supply 20% of its electricity generation using wind energy by 2030. The expansion of renewable resources, especially weather-based resources such as wind, creates more uncertainty and variability in the operation of the power grid. New methods and approaches in electricity market operations are needed to efficiently manage the continuing increase in variability and uncertainty caused by expanding intermittent wind. This paper proposes an improved stochastic programming approach for incorporating wind uncertainty into energy markets. The proposed formulation improves the two-stage stochastic unit commitment problem by introducing a dynamic decision making approach similar to a multi-stage formulation in the presence of wind power scenarios which are not well represented by a scenario tree. The numerical results present up to 1%-2% decrease in operational costs compared to the two-stage stochastic unit commitment formulation.

Electricity markets↗

Efficient Uncertainty Quantification in Stochastic Economic Dispatch

Stochastic economic dispatch models usually address uncertainties in forecasts of renewable generation output by considering a finite number of realizations drawn from a stochastic process model, typically via Monte Carlo sampling. Accurate evaluations of expectations or higher order moments for quantities of interest, e.g., generating cost, can require a prohibitively large number of samples. We propose an alternative to Monte Carlo sampling based on polynomial chaos expansions. These representations enable efficient and accurate propagation of uncertainties in model parameters, using sparse quadrature methods. Furthermore, we use Karhunen-Loève expansions for efficient representation of uncertain renewable energy generation that follows geographical and temporal correlations derived from historical data at each wind farm. Considering expected production cost, we show that the proposed approach can yield several orders of magnitude reduction in computational cost for solving stochastic economic dispatch relative to Monte Carlo sampling, for a given target error threshold.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Stochastic Dynamic Analysis for Power Systems Under Uncertain Variability

This paper proposes a novel method to analyze impacts of uncertain variability on power system dynamics. There is considerable interest in integrating intermittent renewable energy and plug-in electric vehicles into power systems. Therefore, power systems are in an environment with increasing uncertain variability. In this paper, the uncertain variability is described as a continuous-time stochastic process, and thus, the power system under uncertain variability is modeled by stochastic differential equations. To quantify impacts of uncertain variability on power system dynamics, an intra-region probability index is presented. Based on the stochastic averaging method, an analytical method is proposed to calculate the intra-region probability. Compared to Monte Carlo simulation, the proposed method is many orders of magnitude faster without sacrificing the result accuracy. As a result, several insights are given to improve the power system dynamics under uncertain variability.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Observability Analysis of a Power System Stochastic Dynamic Model Using a Derivative-Free Approach

Serving as a prerequisite to power system dynamic state estimation, the observability analysis of a power system dynamic model has recently attracted the attention of many power engineers. However, because this model is typically nonlinear and large-scale, the analysis of its observability is a challenge to the traditional derivative-based methods. Indeed, the linear-approximation-based approach may provide unreliable results while the nonlinear-technique-based approach inevitably faces extremely complicated derivations. Furthermore, because power systems are intrinsically stochastic, the traditional deterministic approaches may lead to inaccurate observability analyses. In this work, facing these challenges, we propose a novel polynomial-chaos-based derivative-free observability analysis approach that not only is free of any linear approximations, but also accounts for the stochasticity of the dynamic model while bringing a low implementation complexity. Furthermore, this approach enables us to quantify the degree of observability of a stochastic model, what conventional deterministic methods cannot do. The excellent performance of the proposed method has been demonstrated by performing extensive simulations using a synchronous generator model with IEEE-DC1A exciter and the TGOV1 turbine governor.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Stochastic noise characteristics in matrix inversion tomosynthesis (MITS)

Matrix inversion tomosynthesis (MITS) uses known imaging geometry and linear systems theory to deterministically separate in-plane detail from residual tomographic blur in a set of conventional tomosynthesis (''shift-and-add'') planes. A previous investigation explored the effect of scan angle (ANG), number of projections (N), and number of reconstructed planes (NP) on the MITS impulse response and modulation transfer function characteristics, and concluded that ANG=20 deg., N=71, and NP=69 is the optimal MITS imaging technique for chest imaging on our prototype tomosynthesis system. This article examines the effect of ANG, N, and NP on the MITS exposure-normalized noise power spectra (ENNPS) and seeks to confirm that the imaging parameters selected previously by an analysis of the MITS impulse response also yield reasonable stochastic properties in MITS reconstructed planes. ENNPS curves were generated for experimentally acquired mean-subtracted projection images, conventional tomosynthesis planes, and MITS planes with varying combinations of the parameters ANG, N, and NP. Image data were collected using a prototype tomosynthesis system, with 11.4 cm acrylic placed near the image receptor to produce lung-equivalent beam hardening and scattered radiation. Ten identically acquired tomosynthesis data sets (realizations) were collected for each selected technique and used to generate ensemble mean images that were subtracted from individual image realizations prior to noise power spectra (NPS) estimation. NPS curves were normalized to account for differences in entrance exposure (as measured with an ion chamber), yielding estimates of the ENNPS for each technique. Results suggest that mid- and high-frequency noise in MITS planes is fairly equivalent in magnitude to noise in conventional tomosynthesis planes, but low-frequency noise is amplified in the most anterior and posterior reconstruction planes. Selecting the largest available number of projections (N=71) does not incur any appreciable additive electronic noise penalty compared to using fewer projections for roughly equivalent cumulative exposure. Stochastic noise is minimized by maximizing N and NP but increases with increasing ANG. The noise trend results for NP and ANG are contrary to what would be predicted by simply considering the MITS matrix conditioning and likely result from the interplay between noise correlation and the polarity of the MITS filters. From this study, the authors conclude that the previously determined optimal MITS imaging strategy based on impulse response considerations produces somewhat suboptimal stochastic noise characteristics, but is probably still the best technique for MITS imaging of the chest.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

MOLNs: A Cloud Platform for Interactive, Reproducible, and Scalable Spatial Stochastic Computational Experiments in Systems Biology Using PyURDME

Computational experiments using spatial stochastic simulations have led to important new biological insights, but they require specialized tools and a complex software stack, as well as large and scalable compute and data analysis resources due to the large computational cost associated with Monte Carlo computational workflows. The complexity of setting up and managing a large-scale distributed computation environment to support productive and reproducible modeling can be prohibitive for practitioners in systems biology. This results in a barrier to the adoption of spatial stochastic simulation tools, effectively limiting the type of biological questions addressed by quantitative modeling. In this paper, we present PyURDME, a new, user-friendly spatial modeling and simulation package, and MOLNs, a cloud computing appliance for distributed simulation of stochastic reaction-diffusion models. In conclusion, MOLNs is based on IPython and provides an interactive programming platform for development of sharable and reproducible distributed parallel computational experiments.

97 MATHEMATICS AND COMPUTING↗

Stochastic Learning Approach for Binary Optimization: Application to Bayesian Optimal Design of Experiments

Here, we present a novel stochastic approach to binary optimization suited for optimal experimental design (OED) for Bayesian inverse problems governed by mathematical models such as partial differential equations. The OED utility function, namely, the regularized optimality criterion, is cast into a stochastic objective function in the form of an expectation over a multivariate Bernoulli distribution. The probabilistic objective is then solved by using a stochastic optimization routine to find an optimal observational policy. This formulation (a) is generally applicable to binary optimization problems with soft constraints and is ideal for OED and sensor placement problems; (b) does not require differentiability of the original objective function (e.g., a utility function in OED applications) with respect to the design variable, and thus it enables direct employment of sparsity-enforcing penalty functions such as $\ell_0$, without needing to utilize a continuation procedure or apply a rounding technique; (c) exhibits much lower computational cost than traditional gradient-based relaxation approaches; and (d) can be applied to both linear and nonlinear OED problems with proper choice of the utility function. The proposed approach is analyzed from an optimization perspective with detailed convergence analysis of the optimization approach and is also analyzed from a machine learning perspective with correspondence to policy gradient reinforcement learning. The approach is demonstrated numerically by using an idealized two-dimensional Bayesian linear inverse problem and validated by extensive numerical experiments carried out for sensor placement in a parameter identification setup.

97 MATHEMATICS AND COMPUTING↗

A stochastic method for computing hadronic matrix elements

In this study, we present a stochastic method for the calculation of baryon 3-point functions which is an alternative to the typically used sequential method offering more versatility. We analyze the scaling of the error of the stochastically evaluated 3-point function with the lattice volume and find a favorable signal to noise ratio suggesting that the stochastic method can be extended to large volumes providing an efficient approach to compute hadronic matrix elements and form factors.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Collaborative Research: Using ARM Observations to Evaluate GCM Cloud Statistics for Development of Stochastic Cloud-Radiation Parameterizations

The long-range goal of several past and current projects in our DOE-supported research has been the development of new and improved parameterizations of cloud-radiation effects and related processes, using ARM data, and the implementation and testing of these parameterizations in global models. The main objective of the present project being reported on here has been to develop and apply advanced statistical techniques, including Bayesian posterior estimates, to diagnose and evaluate features of both observed and simulated clouds. The research carried out under this project has been novel in two important ways. The first is that it is a key step in the development of practical stochastic cloud-radiation parameterizations, a new category of parameterizations that offers great promise for overcoming many shortcomings of conventional schemes. The second is that this work has brought powerful new tools to bear on the problem, because it has been an interdisciplinary collaboration between a meteorologist with long experience in ARM research (Somerville) and a mathematician who is an expert on a class of advanced statistical techniques that are well-suited for diagnosing model cloud simulations using ARM observations (Shen). The motivation and long-term goal underlying this work is the utilization of stochastic radiative transfer theory (Lane-Veron and Somerville, 2004; Lane et al., 2002) to develop a new class of parametric representations of cloud-radiation interactions and closely related processes for atmospheric models. The theoretical advantage of the stochastic approach is that it can accurately calculate the radiative heating rates through a broken cloud layer without requiring an exact description of the cloud geometry.

58 GEOSCIENCES↗