Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Effect of internal noise on the oscillation of N{sub 2}O decomposition over Cu-ZSM-5 zeolites using a stochastic description

When considering stochastic oscillations of heterogeneous catalyst systems, most researches have focused on the surface of a metal or its oxide catalysts, but there have been few studies on porous catalysts. In this work, the effects of internal noise on oscillations of N{sub 2}O decomposition over Cu-ZSM-5 zeolites are investigated, using the chemical Langevin equation and a mesoscopic stochastic model. Considering that Cu-ZSM-5 particles are finely divided particles, the number of Cu ions (N{sub s}) is proportional to the particle size at a certain Cu/Al, and the internal noise is inversely proportional to N{sub s}. Stochastic oscillations can be observed outside the deterministic oscillatory region. Furthermore, the performance of the oscillation characterized by the signal-to-noise ratio has a maximum within the optimal size range of 4–8 nm. This suggests that a nanometer-sized zeolite may be best for oscillations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Modeling Framework for Bulk Electric Grid Impacts from HEMP E1 and E3 Effects (Tasks 3.1 Final Report)

This report presents a framework to evaluate the impact of a high-altitude electromagnetic pulse (HEMP) event on a bulk electric power grid. This report limits itself to modeling the impact of EMP E1 and E3 components. The co-simulation of E1 and E3 is presented in detail, and the focus of the paper is on the framework rather than actual results. This approach is highly conservative as E1 and E3 are not maximized with the same event characteristics and may only slightly overlap. The actual results shown in this report are based on a synthetic grid with synthetic data and a limited exemplary EMP model. The framework presented can be leveraged and used to analyze the impact of other threat scenarios, both manmade and natural disasters. This report d escribes a Monte-Carlo based methodology to probabilistically quantify the transient response of the power grid to a HEMP event. The approach uses multiple fundamental steps to characterize the system response to HEMP events, focused on the E1 and E3 components of the event. 1) Obtain component failure data related to HEMP events testing of components and creating component failure models. Use the component failure model to create component failure conditional probability density function (PDF) that is a function of the HEMP induced terminal voltage. 2) Model HEMP scenarios and calculate the E1 coupled voltage profiles seen by all system components. Model the same HEMP scenarios and calculate the transformer reactive power consumption profiles due to E3. 3) Sample each component failure PDF to determine which grid components will fail, due to the E1 voltage spike, for each scenario. 4) Perform dynamic simulations that incorporate the predicted component failures from E1 and reactive power consumption at each transformer affected by E3. These simulations allow for secondary transients to affect the relays/protection remaining in service which can lead to cascading outages. 5) Identify the locations and amount of load lost for each scenario through grid dynamic simulation. This can be an indication of the immediate grid impacts from a HEMP event. In addition, perform more detailed analysis to determine critical nodes and system trends. 6) To help realize the longer-term impacts, a security constrained alternating current optimal power flow (ACOPF) is run to maximize critical load served. This report describes a modeling framework to assess the systemic grid impacts due to a HEMP event. This stochastic simulation framework generates a large amount of data for each Monte Carlo replication, including HEMP location and characteristics, relay and component failures, E3 GIC profiles, cascading dynamics including voltage and frequency over time, and final system state. This data can then be analyzed to identify trends, e.g., unique system behavior modes or critical components whose failure is more likely to cause serious systemic effects. The proposed analysis process is demonstrated on a representative system. In order to draw realistic conclusions of the impact of a HEMP event on the grid, a significant amount of work remains with respect to modeling the impact on various grid components.

24 POWER TRANSMISSION AND DISTRIBUTION↗

"Hybrid fracture/matrix modeling for well completion options evaluation"

Orientation and completion for well pairs that have been subjected to multi-zonal stimulation play a critical role in the long-term performance of an Enhanced Geothermal Reservoir. Here we present the development of a methodology to rapidly and efficiently numerically simulate mixed fracture-matrix flow systems for evaluation of well design and completion options. The methodology is based on a loose coupling framework, allowing the fracture and matrix systems to be meshed separately. The fracture system includes the integration of fracture growth and aperture data from well stimulation simulations of stochastically generated fracture networks. Automatic mesh refinement is used in the matrix simulation to resolve heat transfer near the fracture network. This simulation framework is used to efficiently determine optimal production and injection well placement using adaptive sampling.

15 GEOTHERMAL ENERGY↗

Gaussian processes with built-in dimensionality reduction: Applications to high-dimensional uncertainty propagation

Uncertainty quantification (UQ) tasks, such as model calibration, uncertainty propagation, and optimization under uncertainty, typically require several thousand evaluations of the underlying computer codes. To cope with the cost of simulations, one replaces the real response surface with a cheap surrogate based, e.g., on polynomial chaos expansions, neural networks, support vector machines, or Gaussian processes (GP). However, the number of simulations required to learn a generic multivariate response grows exponentially as the input dimension increases. This curse of dimensionality can only be addressed, if the response exhibits some special structure that can be discovered and exploited. A wide range of physical responses exhibit a special structure known as an active subspace (AS). An AS is a linear manifold of the stochastic space characterized by maximal response variation. The idea is that one should first identify this low dimensional manifold, project the high-dimensional input onto it, and then link the projection to the output. If the dimensionality of the AS is low enough, then learning the link function is a much easier problem than the original problem of learning a high-dimensional function. The classic approach to discovering the AS requires gradient information, a fact that severely limits its applicability. Furthermore, and partly because of its reliance to gradients, it is not able to handle noisy observations. The latter is an essential trait if one wants to be able to propagate uncertainty through stochastic simulators, e.g., through molecular dynamics codes. In this work, we develop a probabilistic version of AS which is gradient-free and robust to observational noise. Our approach relies on a novel Gaussian process regression with built-in dimensionality reduction. In particular, the AS is represented as an orthogonal projection matrix that serves as yet another covariance function hyper-parameter to be estimated from the data. To train the model, we design a two-step maximum likelihood optimization procedure that ensures the orthogonality of the projection matrix by exploiting recent results on the Stiefel manifold, i.e., the manifold of matrices with orthogonal columns. The additional benefit of our probabilistic formulation, is that it allows us to select the dimensionality of the AS via the Bayesian information criterion. We validate our approach by showing that it can discover the right AS in synthetic examples without gradient information using both noiseless and noisy observations. We demonstrate that our method is able to discover the same AS as the classical approach in a challenging one-hundred-dimensional problem involving an elliptic stochastic partial differential equation with random conductivity. Finally, we use our approach to study the effect of geometric and material uncertainties in the propagation of solitary waves in a one dimensional granular system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Methods of Reverberation Mapping. I. Time-lag Determination by Measures of Randomness

A class of methods for measuring time delays between astronomical time series is introduced in the context of quasar reverberation mapping, which is based on measures of randomness or complexity of the data. Several distinct statistical estimators are considered that do not rely on polynomial interpolations of the light curves nor on their stochastic modeling, and do not require binning in correlation space. Methods based on von Neumann’s mean-square successive-difference estimator are found to be superior to those using other estimators. An optimized von Neumann scheme is formulated, which better handles sparsely sampled data and outperforms current implementations of discrete correlation function methods. This scheme is applied to existing reverberation data of varying quality, and consistency with previously reported time delays is found. In particular, the size–luminosity relation of the broad-line region in quasars is recovered with a scatter comparable to that obtained by other works, yet with fewer assumptions made concerning the process underlying the variability. The proposed method for time-lag determination is particularly relevant for irregularly sampled time series, and in cases where the process underlying the variability cannot be adequately modeled.

79 ASTRONOMY AND ASTROPHYSICS↗

Modelling the internal structure of nascent soot particles

In this paper we present studies of clusters assembled from polycyclic aromatic hydrocarbon (PAH) molecules similar in size to small soot particles. The clusters studied were comprised of coronene (C{sub 24}H{sub 12}) or pyrene (C{sub 16}H{sub 10}) molecules and represent the types of soot precursor molecule typically found in flame environments. A stochastic 'basin-hopping' global optimisation scheme was used to locate low-lying local minima on the potential energy surface of the molecular clusters. TEM-style projections of the resulting geometries show similarities with those observed experimentally in TEM images of soot particles. The mass densities of these clusters have also been calculated and are lower than bulk values of the pure crystalline PAH structures. They are also significantly lower than the standard value of 1.8 g/cm{sup 3} used in our soot models. Consequently we have varied the mass density between 1.0 g/cm{sup 3} and 1.8 g/cm{sup 3} to examine the effects of varying soot density on our soot model and observed how the shape of the particle size distribution changes. Based on similarities between nascent soot particles and PAH clusters a more accurate soot density is likely to be significantly lower than 1.8 g/cm{sup 3}. As such, for modelling purposes, we recommend that the density of nascent soot should be taken to be the value obtained for our coronene cluster of 1.12 g/cm{sup 3}. (author)

02 PETROLEUM↗

Modeling Time-Dependent Surrogates of Additive-Manufactured Nuclear Fuels Processes

Additive manufacturing (AM) technology is being increasingly adopted in a wide variety of application areas for its ability to rapidly produce, prototype, and customize designs. Recently, a hybrid AM technique was successfully developed at Idaho National Laboratory (INL) to manufacture nuclear fuels [1]. Despite the advantages, this AM technique needs optimization due to defects from a highly complex melting and sintering process. The complex metallurgical phenomena during AM processes are strongly related to parameters such as applied laser power, traveling speed, and scan style, which could lead to differences in density, residual stress, crystallographic texture, and mechanical properties. In addition, stochastic variations in laser energy interaction and associated multiscale/multiphysics phenomena cause variations in microstructure evolution and mechanical properties. Currently, researchers at INL are focusing on developing a comprehensive modeling framework, leveraging INL’s simulation tools MOOSE/MARMOT/BISON/RAVEN [2-4] to describe all steps of this AM process across multiple length scales. Although this advanced framework plays a critical role in enabling enhancements to traditional trial and error approaches for design and optimization of nuclear fuel materials, it remains computationally intense, limiting its use in sensitivity and optimization analysis. In this case, an accurate and inexpensive surrogate becomes an effective tool for providing a tractable approximation of the underlying underline physics. Surrogate models generally not based on the physics of a system are purely mathematical models used to capture the relationships between specific system inputs and outputs. Popular approaches, including neural networks [5], response surfaces [6], and subspace-based reduced order models [7], have been applied to a wide range of disciplines, such as nuclear reactor design, aerospace design and automotive design. In this summary, we employ advanced time-dependent surrogate models such as high-dimensional model representation (HDMR) [8] and physics-informed deep neural network (PINNs) [9] to accelerate the design and optimization of AM process.

42 ENGINEERING↗

Solving Stochastic Dynamic Programming Problems: A Mixed Complementarity Approach

We detail a mixed complementarity problem (MCP) formulation of continuous state dynamic programming problems (DP-MCP). We write the solution to projection methods in value function iteration (VFI) as a joint set of optimality conditions that characterize maximization of the Bellman equation; and approximation of the value function. The MCP approach replaces the iterative component of projection based VFI with a one-shot solution to a square system of complementary conditions. We provide three numerical examples to illustrate our approach.

97 MATHEMATICS AND COMPUTING↗

Data-driven optimal charging decision making for connected and automated electric vehicles: A personal usage scenario

This study introduces an optimal charging decision making framework for connected and automated electric vehicles under a personal usage scenario. This framework aims to provide charging strategies, i.e. the choice of charging station and the amount of charged energy, by considering constraints from personal daily itineraries and existing charging infrastructure. A data-driven method is introduced to establish a stochastic energy consumption prediction model with consideration of realistic uncertainties. This is performed by analyzing a large scale electric vehicle data set. A real-time updating method is designed to construct this prediction model from new consecutive data points in an adaptive way for real-world applications. Based on this energy cost prediction framework from real electric vehicle data, multistage optimal charging decision making models are introduced, including a deterministic model for average outcome decision making and a robust model for safest charging strategies. A dynamic programming algorithm is proposed to find the optimal charging strategies. Detailed simulations and case studies demonstrate the performance of the proposed algorithms to find optimal charging strategies. They also show the potential capability of connected and automated electric vehicles to reduce the range anxiety and charging infrastructure dependency.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Designing Monte Carlo Simulation and an Optimal Machine Learning to Optimize and Model Space Missions

This paper investigates applying artificial intelligence (AI) algorithms to attitude control system of satellites to optimally tune the controller using high performance computing. This methodology is applied to the Virtual Telescope for X-ray Observation mission, which is a precise formation of two separate spacecraft observing multiple objects in the space in the X-ray domain. The mission is divided into phases based on the instrumentation and the mission goal. To reach an stable precise formation robust to stochastic slew and slew rate (i.e., Euler angles and angular velocities) in a minimal constrained time T , consumed energy of the attitude control system, denoted as E, and root-mean-square state error of attitude control system, denoted as e, are minimized. Monte-Carlo simulation is used for the sensitivity analysis of optimization and designing a controller. Deep neural networks (DNN), Gaussian processes (GP), and support vector regression (SVR) learn this optimization as a surrogate model, while their hyperparameters are optimized in a novel approach. THETA supercomputer at Argonne Leadership Computing Facility (ALCF) is used for optimizing the hyperparameters of DNN. The surrogate model meets the requirements of the mission, and it shows a better performance over the optimization and Monte-Carlo. The optimal DNN can satisfy the mission requirements e and T while reducing E for 90% compared to the other given methods.

42 ENGINEERING↗

Low-rank separated representation surrogates of high-dimensional stochastic functions: Application in Bayesian inference

This study introduces a non-intrusive approach in the context of low-rank separated representation to construct a surrogate of high-dimensional stochastic functions, e.g., PDEs/ODEs, in order to decrease the computational cost of Markov Chain Monte Carlo simulations in Bayesian inference. The surrogate model is constructed via a regularized alternative least-square regression with Tikhonov regularization using a roughening matrix computing the gradient of the solution, in conjunction with a perturbation-based error indicator to detect optimal model complexities. The model approximates a vector of a continuous solution at discrete values of a physical variable. The required number of random realizations to achieve a successful approximation linearly depends on the function dimensionality. The computational cost of the model construction is quadratic in the number of random inputs, which potentially tackles the curse of dimensionality in high-dimensional stochastic functions. Furthermore, this vector-valued separated representation-based model, in comparison to the available scalar-valued case, leads to a significant reduction in the cost of approximation by an order of magnitude equal to the vector size. The performance of the method is studied through its application to three numerical examples including a 41-dimensional elliptic PDE and a 21-dimensional cavity flow.

97 MATHEMATICS AND COMPUTING↗

Rejoinder

We are grateful for the many insightful comments provided by the discussants. One team politely pointed out oversights in our literature review and the subsequent omission of a formidable comparator. Another made an important clarification about when a more aggressive variation (the so-called NoMax) would perform poorly. A third team offered enhancements to the framework, including a derivation of closed-form expressions and a more aggressive updating scheme; these enhancements were supported by an empirical study comparing new alternatives with old. The last team suggested hybridizing the statistical augmented Lagrangian (AL) method with modern stochastic search. Here we present our responses to these contributions and detail some improvements made to our own implementations in light of them. We conclude with some thoughts on statistical optimization using surrogate modeling and open-source software.

97 MATHEMATICS AND COMPUTING↗

Stochastic Least-Squares Petrov--Galerkin Method for Parameterized Linear Systems

We consider the numerical solution of parameterized linear systems where the system matrix, the solution, and the right-hand side are parameterized by a set of uncertain input parameters. We explore spectral methods in which the solutions are approximated in a chosen finite-dimensional subspace. It has been shown that the stochastic Galerkin projection technique fails to minimize any measure of the solution error [A. Mugler and H.-J. Starkloff, ESAIM Math. Model. Numer. Anal., 47 (2013), pp. 1237--1263]. As a remedy for this, we propose a novel stochatic least-squares Petrov--Galerkin (LSPG) method. The proposed method is optimal in the sense that it produces the solution that minimizes a weighted $\ell^2$-norm of the residual over all solutions in a given finite-dimensional subspace. Moreover, the method can be adapted to minimize the solution error in different weighted $\ell^2$-norms by simply applying a weighting function within the least-squares formulation. In addition, a goal-oriented seminorm induced by an output quantity of interest can be minimized by defining a weighting function as a linear functional of the solution. We establish optimality and error bounds for the proposed method, and extensive numerical experiments show that the weighted LSPG method outperforms other spectral methods in minimizing corresponding target weighted norms.

97 MATHEMATICS AND COMPUTING↗

Design and simulation of the nuSTORM facility

This thesis provides a full design and simulation of the nuSTORM beam line facility including the pion beam line , the pion and muon orbit combination section, and the muon decay ring. The study also includes the development of numerical optimization methods and their application to the design. At nuSTORM, one proton batch from the Main Injector (MI) is extracted and transported to the target station to bombard a solid target. A magnetic horn is used as the collection device for the secondary particles such as pions and kaons. A pion beam line is designed to transport the secondary particles downstream to the muon decay ring. In order to avoid the use of a fast kicker with a large aperture for the injection, an Orbit Combination Section (OCS) was designed to combine the reference pion orbit with the circulating muon orbit. This ful lls the stochastic injection scheme proposed in the 1980s. It is shown through the simulation that the pion beam line is able to deliver 0.011 muons per proton on target within the acceptance of the ring. In order to improve the circulating muon ux, an optimization of the magnetic collection horn was studied. A Multi-Objective Genetic Algorithm (MOGA), that was modi ed to integrate Message Passing Interface (MPI) in the process, is applied to the optimization. The number of muons within the ring acceptance from the pion decay is estimated by the pions after the collection horn. This new method was proposed to lower the requirement on the computing resources for the optimization. The study gives a new and better target and horn con guration after a full investigation of the system. The nuSTORM ring is examined with two optics designs. With di erent features, the two designs are optimized via correcting the nonlinearities with sextupolar eld distribution in the ring. A modi ed MPI-based Simulated Annealing (SA) algorithm was applied to obtain the optimal ring acceptance. The comparison with the GA shows good agreements on the achieved optimal ring acceptance. The pion and muon beams at nuSTORM were simulated and yield avor-pure and precisely measurable neutrino beams, which can be used to provide a de nite statement about the existence of a sterile neutrino.

97 MATHEMATICS AND COMPUTING↗

Formation of correlated states and optimization of nuclear reactions for low-energy particles at nonresonant low-frequency modulation of a potential well

A method for the formation of correlated coherent states of low-energy particles in a parabolic potential well owing to the full-scale low-frequency modulation ω(t) = ω{sub 0}sinΩt of the parameters of this well has been considered. It has been shown that such a modulation in the absence of a stochastic force acting on a particle results in the fast formation of correlated coherent states and in an increase in the correlation coefficient and transparency of the potential barrier to the limiting values vertical bar r(t) vertical bar {sub max} → 1 and D → 1. The presence of the stochastic force significantly affects the evolution of correlated coherent states, decreasing the rate of an increase in the correlation coefficient vertical bar r(t) vertical bar {sub max} (at Ω ≤ 10{sup −4}ω{sub 0}) and limiting it at the level vertical bar r(∞) vertical bar {sub max} < 1 (at Ω = (0.001–0.1)ω{sub 0}); vertical bar r(∞) vertical bar {sub max} increases with a decrease in the frequency of modulation and decreases with an increase in the intensity of the stochastic force. It has been shown that, at a realistic relation between the parameters, low-frequency modulation can ensure such vertical bar r vertical bar {sub max} value that the transparency of the potential barrier for low-energy particles increases by a factor of 10{sup 50}–10{sup 100} or larger. The mechanism of the formation of correlated coherent states for charged particles in a gas or a low-pressure plasma placed in a low-frequency magnetic field has been considered. We have determined the relation between the magnetic field strength and modulation frequency, as well as the relation between the temperature and density of the gas (plasma), at which the method under consideration can be used to optimize nuclear reactions at low energies.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Noise analysis of grating-based x-ray differential phase contrast imaging

The sensitivity of x-ray radiographic images, meaning the minimal detectable change in the thickness or in the index of refraction of a sample, is directly related to the uncertainty of the measurement method. In the following work, we report on the recent development of quantitative descriptions for the stochastic error of grating-based differential phase contrast imaging (DPCi). Our model includes the noise transfer characteristics of the x-ray detector and the jitter of the phase steps. We find that the noise in DPCi depends strongly on the phase stepping visibility and the sample properties. The results are supported by experimental evidence acquired with our new instrument with a field of view of 50x70 mm{sup 2}. Our conclusions provide general guidelines to optimize grating interferometers for specific applications and problems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Stochastic assessment of distributed generation hosting capacity and energy efficiency in active distribution networks

Active network management (ANM) aims to increase the capacity of variable distributed generation (DG), which can be connected to existing distribution networks. In this study, it is proposed to simultaneously consider the efficient use of energy resources when high shares of DG are procured through the ANM approach. To that end, a multi-period and multiobjective optimisation algorithm, based on the linearised optimal power flow, is formulated. The algorithm seeks to maximise the installed capacity of DG while minimising the energy losses and consumption of voltage-dependent loads. The objectives are optimised considering the coordinated operation of voltage regulators and on-load tap changers, and the management of DG generation curtailment and reactive power compensation from DG. Additionally, the effects of load and generation uncertainties are addressed through a two-stage stochastic programming formulation of the multiobjective problem. The result is a set of non-inferior solutions, which allows exploring the degree of conflict among the objectives. The proposed approach was tested on two IEEE test feeders and the solutions show a significant improvement in the system's energy efficiency with a low impact on the amount of connected DG.

Quijano, Darwin Alexis↗

Π4U: A high performance computing framework for Bayesian uncertainty quantification of complex models

We present Π4U,{sup 1} an extensible framework, for non-intrusive Bayesian Uncertainty Quantification and Propagation (UQ+P) of complex and computationally demanding physical models, that can exploit massively parallel computer architectures. The framework incorporates Laplace asymptotic approximations as well as stochastic algorithms, along with distributed numerical differentiation and task-based parallelism for heterogeneous clusters. Sampling is based on the Transitional Markov Chain Monte Carlo (TMCMC) algorithm and its variants. The optimization tasks associated with the asymptotic approximations are treated via the Covariance Matrix Adaptation Evolution Strategy (CMA-ES). A modified subset simulation method is used for posterior reliability measurements of rare events. The framework accommodates scheduling of multiple physical model evaluations based on an adaptive load balancing library and shows excellent scalability. In addition to the software framework, we also provide guidelines as to the applicability and efficiency of Bayesian tools when applied to computationally demanding physical models. Theoretical and computational developments are demonstrated with applications drawn from molecular dynamics, structural dynamics and granular flow.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗