Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
NASA NTRS2005

What Does Reflection from Cloud Sides Tell Us About Vertical Distribution of Cloud Droplet Sizes?

Cloud development, the onset of precipitation and the effect of aerosol on clouds depend on the structure of the cloud profiles of droplet size and phase. Aircraft measurements of cloud profiles are limited in their temporal and spatial extent. Satellites were used to observe cloud tops not cloud profiles with vertical profiles of precipitation-sized droplets anticipated from Cloudsat. The recently proposed CLAIM-3D satellite mission (cloud aerosol interaction mission in 3D) suggests to measure profiles of cloud microphysical properties by retrieving them from the solar and infrared radiation reflected or emitted from cloud sides. Inversion of measurements from the cloud sides requires rigorous understanding of the 3-dimensional (3D) properties of clouds. Here we discuss the reflected sunlight from the cloud sides and top at two wavelengths: one nonabsorbing to solar radiation (0.67 micrometers) and one with liquid water efficient absorption of solar radiation (2.1 micrometers). In contrast to the plane-parallel approximation, a conventional approach to all current operational retrievals, 3D radiative transfer is used for interpreting the observed reflectances. General properties of the radiation reflected from the sides of an isolated cloud are discussed. As a proof of concept, the paper shows a few examples of radiation reflected from cloud fields generated by a simple stochastic cloud model with the prescribed vertically resolved microphysics. To retrieve the information about droplet sizes, we propose to use the probability density function of the droplet size distribution and its first two moments instead of the assumption about fixed values of the droplet effective radius. The retrieval algorithm is based on the Bayesian theorem that combines prior information about cloud structure and microphysics with radiative transfer calculations.

Marshak, Alexander↗
NASA NTRS1985

Stochastic particle acceleration in solar flares

It is proposed that particles during the second phase of solar flares are accelerated by stochastic resonant scattering off hydromagnetic waves and first order Fermi acceleration in shock waves generated in the impulsive phase of the flare. Solutions allow arbitrary power law momentum dependences of the momentum diffusion coefficient as well as the momentum diffusion coefficient as well as the momentum loss time. The acceleration time scale to a characteristic energy approximately 100 keV for protons can be as short as 5s. The resulting electron spectra show a characteristic double power law with a transition around 200 keV and are correlated to the proton spectra evaluated under equal boundary conditions, indicating that electrons and protons are accelerated by the same mechanism. The correlation between the different spectral indices in the electron double power law and between electron and proton spectra are governed by the ratio of first to second order acceleration and therefore allow a determination of the Alfven Mach number of the shock wave.

Droege, W.↗
NASA NTRS1985

Fuel-injector/air-swirl characterization

The objectives of this program are to establish an experimental data base documenting the behavior of gas turbine engine fuel injector sprays as the spray interacts with the swirling gas flow existing in the combustor dome, and to conduct an assessment of the validity of current analytical techniques for predicting fuel spray behavior. Emphasis is placed on the acquisition of data using injector/swirler components which closely resemble components currently in use in advanced aircraft gas turbine engines, conducting tests under conditions that closely simulate or closely approximate those developed in actual combustors, and conducting a well-controlled experimental effort which will comprise using a combination of low-risk experiments and experiments requiring the use of state-of-the-art diagnostic instrumentation. Analysis of the data is to be conducted using an existing, TEACH-type code which employs a stochastic analysis of the motion of the dispersed phase in the turbulent continuum flow field.

Mcvey, J. B.↗
NASA NTRS2003

Evaluation of Improved Pushback Forecasts Derived from Airline Ground Operations Data

Accurate and timely predictions of airline pushbacks can potentially lead to improved performance of automated decision-support tools for airport surface traffic, thus reducing the variability and average duration of costly airline delays. One factor which affects the realization of these benefits is the level of uncertainty inherent in the turn processes. To characterize this inherent uncertainty, three techniques are developed for predicting time-to-go until pushback as a function of available ground-time; elapsed ground-time; and the status (not-started/in-progress/completed) of individual turn processes (cleaning, fueling, etc.). These techniques are tested against a large and detailed dataset covering approximately l0(exp 4) real-world turn operations obtained through collaboration with Deutsche Lufthansa AG. Even after the dataset is filtered to obtain a sample of turn operations with minimal uncertainty, the standard deviation of forecast error for all three techniques is lower-bounded away from zero, indicating that turn operations have a significant stochastic component. This lower-bound result shows that decision-support tools must be designed to incorporate robust mechanisms for coping with pushback demand stochasticity, rather than treating the pushback demand process as a known deterministic input.

Carr, Francis↗
NASA NTRS2003

Stochastic Optimal Control via Bellman's Principle

This paper presents a method for finding optimal controls of nonlinear systems subject to random excitations. The method is capable to generate global control solutions when state and control constraints are present. The solution is global in the sense that controls for all initial conditions in a region of the state space are obtained. The approach is based on Bellman's Principle of optimality, the Gaussian closure and the Short-time Gaussian approximation. Examples include a system with a state-dependent diffusion term, a system in which the infinite hierarchy of moment equations cannot be analytically closed, and an impact system with a elastic boundary. The uncontrolled and controlled dynamics are studied by creating a Markov chain with a control dependent transition probability matrix via the Generalized Cell Mapping method. In this fashion, both the transient and stationary controlled responses are evaluated. The results show excellent control performances.

Crespo, Luis G.↗
NASA NTRS2006

What does Reflection from Cloud Sides tell us about Vertical Distribution of Cloud Droplet Sizes?

Cloud development, the onset of precipitation and the effect of aerosol on clouds depend on the structure of the cloud profiles of droplet size and phase. Aircraft measurements of cloud profiles are limited in their temporal and spatial extent. Satellites were used to observe cloud tops not cloud profiles with vertical profiles of precipitation-sized droplets anticipated from CloudSat. The recently proposed CLAIM-3D satellite mission (cloud aerosol interaction mission in 3-D) suggests to measure profiles of cloud microphysical properties by retrieving them from the solar and infrared radiation reflected or emitted from cloud sides. Inversion of measurements from the cloud sides requires rigorous understanding of the 3-dimentional(3-D) properties of clouds. Here we discuss the reflected sunlight from the cloud sides and top at two wavelengths: one nonabsorbing to solar radiation (0.67 microns) and one with liquid water efficient absorption of solar radiation (2.1 microns). In contrast to the plane-parallel approximation, a conventional approach to all current operational retrievals, 3-D radiative transfer is used for interpreting the observed reflectances. General properties of the radiation reflected from the sides of an isolated cloud are discussed. As a proof of concept, the paper shows a few examples of radiation reflected from cloud fields generated by a simple stochastic cloud model with the prescribed vertically resolved microphysics. To retrieve the information about droplet sizes, we propose to use the probability density function of the droplet size distribution and its first two moments instead of the assumption about fixed values of the droplet effective radius. The retrieval algorithm is based on the Bayesian theorem that combines prior information about cloud structure and microphysics with radiative transfer calculations.

Marshak, A.↗
NASA NTRS1977

Stochastic models for software project management

A method for determining the number and characteristics of milestones to be achieved during a development project is presented in order that effective monitors of progress can be provided. Projections of progress data lead to estimates of the completion with determinable accuracy, but accuracy imposes a requirement that the number of milestones be inversely proportional to the estimate-error variance, and that the milestones themselves be defined in such a way that each represents approximately the same level of effort to complete.

Tausworthe, R. C.↗
DOE OSTI2021

Proactive Operations and Investment Planning via Stochastic Optimization to Enhance Power Systems’ Extreme Weather Resilience

We present scalable stochastic optimization approaches for improving power systems’ resilience to extreme weather events. We consider both proactive redispatch and transmission line hardening as alternatives for mitigating expected load shed due to extreme weather, resulting in large-scale stochastic linear programs (LPs) and mixed-integer linear programs (MILPs). We solve these stochastic optimization problems with progressive hedging (PH), a parallel, scenario-based decomposition algorithm. Our computational experiments indicate that our proposed method for enhancing power system resilience can provide high-quality solutions efficiently. With up to 128 scenarios on a 2,000-bus network, the operations (redispatch) and investment (hardening) resilience problems can be solved in approximately 6 min and 2 h of wall-clock time, respectively. Additionally, we solve the investment problems with up to 512 scenarios, demonstrating that the approach scales very well with the number of scenarios. Moreover, the method produces high quality solutions that result in statistically significant reductions in expected load shed. Our proposed approach can be augmented to incorporate a variety of other operational and investment resilience strategies, or a combination of such strategies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Projective Integral Updates for High-Dimensional Variational Inference

Variational inference is an approximation framework for Bayesian inference that seeks to improve quantified uncertainty in predictions by optimizing a simplified distribution over parameters to stand in for the full posterior. Capturing model variations that remain consistent with training data enables more robust predictions by reducing parameter sensitivity. This work introduces a fixed-point optimization for variational inference that is applicable when every feasible log density can be expressed as a linear combination of functions from a given basis. In such cases, the optimizer becomes a fixed-point of projective integral updates. When the basis spans univariate quadratics in each parameter, the feasible distributions are Gaussian mean-fields and the projective integral updates yield quasi-Newton variational Bayes (QNVB). Other bases and updates are also possible. Since these updates require high-dimensional integration, this work begins by proposing an efficient quasirandom sequence of quadratures for mean-field distributions. Each iterate of the sequence contains two evaluation points that combine to correctly integrate all univariate quadratic functions and, if the mean-field factors are symmetric, all univariate cubics. More importantly, averaging results over short subsequences achieves periodic exactness on a much larger space of multivariate polynomials of quadratic total degree. The corresponding variational updates require four loss evaluations with standard (not second-order) backpropagation to eliminate error terms from over half of all multivariate quadratic basis functions. Furthermore, this integration technique is motivated by first proposing stochastic blocked mean-field quadratures, which may be useful in other contexts. A PyTorch implementation of QNVB allows for better control over model uncertainty during training than competing methods. Experiments demonstrate superior generalizability for multiple learning problems and architectures.

Gaussian mean-field↗
DOE OSTI2025

Emulation of radiation transport in 3D stochastic media using 1D planar Monte Carlo stochastic media radiation transport algorithms

A subset of stochastic media radiation transport problems involves those in which radiation is incident on a thin slab of stochastic material. Particle tracking in 3D for such problems is expensive, and 1D planar models lack accuracy because they only allow the material to change in one dimension. Therefore, we propose dimensional emulation, which through a slight modification allows existing 1D planar geometry stochastic media radiation transport models to reproduce results from the equivalent 3D models by allowing the material to change in all three dimensions, reproducing the fidelity of the 3D model for the low computational cost of the 1D planar model. In this work, we apply dimensional emulation to three Monte Carlo stochastic media radiation transport models: Chord Length Sampling (CLS), the Local Realization Preserving method (LRP), and a variant of Conditional Point Sampling (CoPS). For a common Markovian benchmark set, the 3D emulation variants of these algorithms are numerically verified to reproduce the results of the 3D variants within statistics while running 1.3 to 2 times faster in the implementation within Sandia National Laboratories open-source research code PlaybookMC. The 3D emulation variants are also shown to yield a 72%–92% reduction in error for the thin slab problems in comparison to the 1D benchmark. As a result, the 3D emulation variant of CLS and CoPS-1 are shown to reproduce 3D CLS results that were used to approximate results for a 3D spherical inclusion geometry benchmark set.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Wavefront shaping with a Hadamard basis for scattering soil imaging

Here, soil is a scattering medium that inhibits imaging of plant-microbial-mineral interactions that are essential to plant health and soil carbon sequestration. However, optical imaging in the complex medium of soil has been stymied by the seemingly intractable problems of scattering and contrast. Here, we develop a wavefront shaping method based on adaptive stochastic parallel gradient descent optimization with a Hadamard basis to focus light through soil mineral samples. Our approach allows a sparse representation of the wavefront with reduced dimensionality for the optimization. We further divide the used Hadamard basis set into subsets and optimize a certain subset at once. Simulation and experimental optimization results demonstrate our method has an approximately seven times higher convergence rate and overall better performance compared to that with optimizing all pixels at once. The proposed method can benefit other high-dimensional optimization problems in adaptive optics and wavefront shaping.

47 OTHER INSTRUMENTATION↗
NASA NTRS1985

Single particle momentum and angular distributions in hadron-hadron collisions at ultrahigh energies

The forward-backward charged multiplicity distribution (P n sub F, n sub B) of events in the 540 GeV antiproton-proton collider has been extensively studied by the UA5 Collaboration. It was pointed out that the distribution with respect to n = n sub F + n sub B satisfies approximate KNO scaling and that with respect to Z = n sub F - n sub B is binomial. The geometrical model of hadron-hadron collision interprets the large multiplicity fluctuation as due to the widely different nature of collisions at different impact parameters b. For a single impact parameter b, the collision in the geometrical model should exhibit stochastic behavior. This separation of the stochastic and nonstochastic (KNO) aspects of multiparticle production processes gives conceptually a lucid and attractive picture of such collisions, leading to the concept of partition temperature T sub p and the single particle momentum spectrum to be discussed in detail.

Chou, T. T.↗
NASA NTRS1977

Set-point control of nonlinear systems

A method of nonlinear stochastic control is applied to the problem of providing set-point control. The procedure is illustrated for a nonlinear second-order plant. The controller design uses a variation of the 'multiple-model adaptive control' approach. Specific problems related to the design are investigated, including learning time and set-point accuracy dependence on the number of approximating models, chord versus tangent approximations, and the a priori Markov switching parameter values. Simulations are provided for different situations under various levels of measurement noise.

Vanlandingham, H. F.↗
NASA NTRSDate not supplied

Uncertainty Quantification using Deep Ensembles for Decision Making in Cyber-Physical-Human Systems

In this paper and its companion, Differential Equation Approximation Using Gradient-Boosted Quantile Regression, Robison et al., we examine an approach to quantifying model uncertainty with the aim of increasing the trustworthiness of computational models in human-machine interactions. In Differential Equation Approximation Using Gradient-Boosted Quantile Regression, we focus on gradient-boosted decision trees, while in this one, we give more details about deep ensembles. Uncertainty quantification is crucial for building trustworthy autonomous decision-making agents in human-machine teams. There are two types of uncertainties: aleatoric and epistemic. The former is related to the inherent stochasticity (noise) of the process, whereas the latter is associated with the lack of knowledge or representation capability of models, such as neural networks. By lack of knowledge, we mean the model’s inability to accurately predict outputs for all possible inputs. The aleatory uncertainty can be estimated fairly easily with, for example, filters, whereas epistemic uncertainty is challenging to compute. This paper uses deep ensembles to quantify both aleatory and epistemic uncertainty. It can act as an uncertainty-aware surrogate transition model for decision-making frameworks. "Uncertainty-aware" means that the surrogate transition model should make predictions along with confidence in those predictions. In the context of decision-making, the transition models are ordinary differential equations (ODEs). Since ODEs can be simulated to make one-step or multi-step predictions, a good surrogate model for them should perform reasonably well in both modes. In a multi-step approach, the trajectory sampling method TS∞ was used to propagate uncertainty over multiple steps. The cartpole dynamical system was selected to demonstrate the ability of deep ensembles as good surrogate transition models for decision-making frameworks. The deep ensembles modeled the dynamics of cartpole ODEs and made uncertainty-aware predictions in single-step and multi-step transition modes.

CPH systems↗
DOE OSTI2023

Sensitivity Analysis, Reduced-order Modeling, and Optimization of a Gas-Cooled Pebble Bed Reactor using Equilibrium-Core and DLOFC Performance

This work presents and applies a workflow for performing design optimization on gas-cooled pebble-bed reactors. Based on previous research, a representative equilibrium core of a pebble-bed reactor and a depressurized loss-of-forced-cooling model are created. These applications are built using the Multiphysics Object-Oriented Simulation Environment (MOOSE), specifically utilizing Griffin, Pronghorn, and Bison. After defining design-related parameters and quantities of interest regarding reactor safety and efficiency, this multiphysics model is sampled using the MOOSE stochastic tools module. The result is a comprehensive dataset of configurations, enabling sensitivity analysis and the generation of reduced-order models. Subsequently, the dataset and reduced-order models are employed in an optimization study aimed at maximizing fuel utilization while adhering to safety and operational constraints. The optimization process leads to an improvement of fuel utilization by approximately 10\%, compared to engineering-judgment-based nominal conditions.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A Multistage Stochastic Transmission Expansion Algorithm for Wide-Area Planning under Uncertainty

The overall objective for this project was to develop and demonstrate a set of methods for solving the transmission investment problem for a large network considering many possible scenarios of future conditions and multiple decision points when investments can be made. Project sub-objectives achieved this goal through a succession of extending the methods to apply to problems with increasing complexity or additional features, including the number of decision points, whether generation and transmission are co-optimized, and whether AC or DC power flow is used. A transmission model was developed for the Western Electric Coordinating Council (WECC) region, the high-voltage transmission system that serves the western third of the continental U.S. Using a dataset provided by WECC and by researchers from John Hopkins University, we have validated and demonstrated the model and used it to compare the new method for solving multi-stage stochastic transmission planning to several state-of-the-art techniques. The project has resulted in several key outcomes and achievements: The covariance-based method for choosing a small set of hours to represent short-term variability has superior performance in terms of accuracy to existing methods, including K-means clustering and Importance Sampling; The combined partitioning method for long-term uncertainty with the nested clustering approach for choosing representative hours for each long-term group has superior accuracy for equivalent computational effort compared with existing methods; Using the partitioning/clustering method combined with Sample Average Approximation provides both statistical bounds on the quality of the solution and at the same time, a complete investment plan for all contingencies in the full uncertainty set; no existing methods can provide both at the same time; The method is demonstrated to work well for choosing both transmission and generation investments; A variant on the method allows for both scenario selection and simultaneous correction for the error from the DC power flow approximation to provide a tractable method for AC power flow-based transmission planning under uncertainty; The method applied to the WECC case study demonstrates the additional value to the system operator and the consumer of identifying flexible investment options in the near-term decisions. In particular, the case study exhibits significant option value in postponing some transmission additions that appear useful but in some long-term system states create new congestion problems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Nonlocal suppression of Biermann battery magnetic-field generation for arbitrary atomic numbers and magnetization

The Biermann battery term of magnetohydrodynamics (MHD) generates a magnetic field where electron density gradients and electron temperature gradients are perpendicular to one another. Kinetic simulations and experiments have shown that the rate of magnetic-field generation is lower than Biermann when the electron mean free path becomes comparable to or greater than the temperature gradient scale length, known as the nonlocal regime. We investigate the nonlocal suppression of the Biermann term using simplified Fokker–Planck simulations covering a wide range of parameters. We provide the first fit for nonlocal Biermann suppression that has physically accurate behavior for small and large values of a suitable nonlocality parameter, valid for an arbitrary atomic number, and that includes the effect of magnetization on nonlocality. Lastly, the fit is intended to provide an approximate method to account for reduced magnetic-field generation in MHD codes and theory.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1991

Lower hybrid waves excited through linear mode coupling and the heating of ions in the auroral and subauroral magnetosphere

Two related aspects of the linear mode conversion mechanism are considered: (1) the controlled heating of suprathermal ions in the ionosphere and magnetosphere over a powerful VLF/ELF transmitter using lower hybrid (LH) waves excited by the electromagnetic (EM) transmitter signals through linear mode conversion; (2) the excitation of intense LH waves in the auroral regions through the linear conversion of VLF/ELF EM auroral hiss, and the subsequent heating of ions by the excited LH waves. Experimental results are used to demonstrate that strong LH waves can be excited by EM waves down to frequencies as low as 2 kHz in the subauroral low-altitude magnetosphere. It is also shown that an approximately 250 kW VLF/ELF transmitter operating in the subauroral region at 2 kHz could excite sufficiently intense LH waves to heat suprathermal 1 eV H(+) ions and 16 eV O(+) ions to roughly 50 eV in a region extending in altitude from 1000 to 5000 km above the transmitter with a horizontal scale of about 500 km. If coherent wave stochastic heating occurs, the O(+) energy gain could be as large as 200 eV.

Bell, T. F.↗