Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic optimizations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60

Resilient Observer Design for Cyber-Physical Systems with Data-Driven Measurement Pruning

Resilient observer design for Cyber-Physical Systems (CPS) in the presence of adversarial false data injection attacks (FDIA) is an active area of research. The existing state-of-the-art algorithms tend to break down as more and more knowledge of the system is built into the attack model; also as the percentage of attacked nodes increases. From the view of optimization theory, the problem is often cast as a classical error correction problem for which a theoretical limit of has been established as the maximum percentage attacked nodes for which state recovery is guaranteed. Beyond this limit, the performance of -minimization based schemes, for instance, deteriorates rapidly. Similar performance degradation occurs for other types of resilient observers beyond certain percentages of attacked nodes. In order to increase the corresponding percentage of attacked nodes for which state recoveries can be guaranteed, researchers have begun to incorporate prior information into the underlying resilient observer design framework. For the most pragmatic cases, this prior information is often obtained through a data-driven machine learning process. Existing results have shown a strong positive correlation between the maximum attacked percentages that can be tolerated and the accuracy of the data-driven model. Motivated by these results, this chapter examines the case for pruning algorithms designed to improve the Positive Prediction Value (PPV) of the resulting prior information, given stochastic uncertainty characteristics of the underlying machine learning model. Theoretical quantification of the achievable improvement is given. Simulation results show that the pruning algorithm significantly increases the maximum correctable percentage of attacked nodes, even for machine learning model whose prediction power is comparable to the random flip of a coin.

Resilient Observer, Cyber-physical Systems, Data-D↗

An Online Dynamic Amplitude-Correcting Gradient Estimation Technique to Align X-ray Focusing Optics

High-brightness X-ray pulses, as generated at synchrotrons and X-ray free electron lasers (XFELs), are used in a variety of scientific experiments. At these facilities, measurements often require optical equipment, e.g Compound Refractive Lenses (CRLs) to be precisely aligned and focused. The lateral alignment of CRLs to a beamline requires precise positioning along four axes: two translational, and the two rotational. At a synchrotron, alignment is often accomplished manually. However, XFEL beamlines present a beam brightness that fluctuates stochastically, making manual alignment a time-consuming endeavor. Automation using simplex or classic stochastic descent often fails, given the errant gradient estimates. Herein we present a dynamic-amplitude correction to the usual gradient based on the combination of a generalized finite difference stencil and a time-dependent sampling pattern. Intensity is recorded periodically, then used to normalize numerical derivatives against fluctuations. Error expectation is analyzed, and efficacy is demonstrated on classic benchmarks. We provide a proof of concept by laterally aligning optics on a simulated XFEL beamline using data recorded at both synchrotron and XFEL facilities.

97 MATHEMATICS AND COMPUTING↗

Autonomous frequency domain identification: Theory and experiment

The analysis, design, and on-orbit tuning of robust controllers require more information about the plant than simply a nominal estimate of the plant transfer function. Information is also required concerning the uncertainty in the nominal estimate, or more generally, the identification of a model set within which the true plant is known to lie. The identification methodology that was developed and experimentally demonstrated makes use of a simple but useful characterization of the model uncertainty based on the output error. This is a characterization of the additive uncertainty in the plant model, which has found considerable use in many robust control analysis and synthesis techniques. The identification process is initiated by a stochastic input u which is applied to the plant p giving rise to the output. Spectral estimation (h = P sub uy/P sub uu) is used as an estimate of p and the model order is estimated using the produce moment matrix (PMM) method. A parametric model unit direction vector p is then determined by curve fitting the spectral estimate to a rational transfer function. The additive uncertainty delta sub m = p - unit direction vector p is then estimated by the cross spectral estimate delta = P sub ue/P sub uu where e = y - unit direction vectory y is the output error, and unit direction vector y = unit direction vector pu is the computed output of the parametric model subjected to the actual input u. The experimental results demonstrate the curve fitting algorithm produces the reduced-order plant model which minimizes the additive uncertainty. The nominal transfer function estimate unit direction vector p and the estimate delta of the additive uncertainty delta sub m are subsequently available to be used for optimization of robust controller performance and stability.

Yam, Yeung↗

Effect of pattern transfer process on roughness of block copolymer patterns from directed self-assembly

Block copolymer-directed self-assembly (DSA) remains promising for improving pattern quality and reducing the stochastic variations that challenge high numerical aperture extreme ultraviolet lithography. Equally critical is refining pattern transfer methods for accurately transferring the rectified DSA features to the underlying substrate. We compare two atomic layer deposition (ALD)-based techniques: sequential infiltration synthesis (SIS) and dry liftoff, applied to polystyrene-block-poly(methyl methacrylate) (PS-b-PMMA) DSA patterns. Both methods utilize aluminum oxide hard masks, with one synthesized through infiltration into the PMMA domains and the other through conformal ALD coating. High-resolution scanning electron micrographs were analyzed to measure line edge, width, and placement roughness for both the line (PMMA) and space (PS) features. Although both methods yielded similar overall 3σ rms roughness, they differed significantly in the frequency-dependent power spectral density (PSD) profiles. SIS reduced line placement roughness at length scales associated with the polymer pitch, but increased space width roughness at low frequencies, whereas dry liftoff mimicked the frequency content of the original guiding pattern. This study underscores the importance of PSD evaluation in selecting optimal pattern transfer strategies for specific applications.

Block copolymers↗

Scalable Techniques for Stochastic Power Flow Problems (Final Report)

The proposed research focuses on developing scalable algorithms for two-stage security-constrained OPF problems with AC power flow constraints, a class of problems complicated by (i) scale arising from a scenario representation; and (ii) the presence of nonlinearity, nonconvexity, and possibly second-stage discreteness or complementarity. Unfortunately, most existing solvers cannot contend with both challenges simultaneously; accordingly, the proposed research focuses on developing solution techniques that can both scale with the number of scenarios and contend with nonconvexity and second-stage complementarity. We consider three avenues for addressing such problems: (i) Variable sample-size SQP (VS-SQP) methods that combine sparse Quasi-Newton updates with a scalable variance-reduced stochastic gradient scheme for stochastic QP subproblems, allowing for contending with second-stage complementarity via regularization; (ii) Variable sample-size stochastic Interior-point (VS-sIP) schemes that propose a sampling-based regularized (to allow for contending with complementarity) interior-point schemes in which a Schur-complement technique is employed for decomposing the Newton direction computation step; (iii) Variable sample-size tractable ADMM (VS-tADMM) schemes combine variable sample-sizes with carefully designed techniques for resolving each of the nonconvex updates (by leveraging the QCQP structures). We intend to compare the three schemes using performance profiles in terms of solution quality, scalability, etc. and then select one scheme which will then be developed and further refined in Python for purposes of the GO competition.

42 ENGINEERING↗

Generalized Bayesian Framework for Evaluation of Integral Benchmark Experiments

A recently published generalized Bayesian optimization framework has provided a way to retract any or all of the three common assumptions underlying the conventional Generalized Linear Least Squares (GLLS) optimization method based on the concepts introduced in Ref. [2]. These assumptions are: 1. Perfection: The model used for data evaluation and the prior probability distribution function (PDF) of generalized data are perfect. 2. Normality: The prior and posterior PDF are normal. 3. Linearity: The model is linear. In this work we outline how the framework in [1] could be directly adopted for improved evaluation of nuclear criticality integral benchmark experiments (IBEs) by: 1. Removing the first assumption alone by utilizing the concept of imperfections introduced in [1] to enable evaluation in the presence of discrepancies between the data and model or of missing covariance information by a GLLS method that will be seen as a generalization of the conventional GLLS method employed by the TSURFER code, and by 2. Removing the remaining two assumptions by implementing a Markov Chain Monte Carlo method for computation of the posterior PDF in the SAMPLER code, where TSURFER and SAMPLER are the uncertainty quantification (UQ) codes for IBEs in the SCALE code system based on the GLLS and the stochastic method, respectively. The graphic in Figure 1 categorizes the methods discussed in terms of the assumptions that they employ to determine posterior PDFs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Generalized Bayesian Framework for Evaluation of Integral Benchmark Experiments

A recently published generalized Bayesian optimization framework has provided a way to retract any or all of the three common assumptions underlying the conventional Generalized Linear Least Squares (GLLS) optimization method based on the concepts introduced in reference two. These assumptions are: 1. Perfection: The model used for data evaluation and the prior probability distribution function (PDF) of generalized* data are perfect; 2. Normality: The prior and posterior PDF are normal; and 3. Linearity: The model is linear. In this work we outline how the framework in 1 could be directly adopted for improved evaluation of nuclear criticality integral benchmark experiments (IBEs) by: 1. Removing the first assumption alone by utilizing the concept of imperfections introduced in 1 to enable evaluation in the presence of discrepancies between the data and model or of missing covariance information by a GLLS method that will be seen as a generalization of the conventional GLLS method employed by the TSURFER code, and by 2. Removing the remaining two assumptions by implement- ing a Markov Chain Monte Carlo method for computation of the posterior PDF in the SAMPLER code, where TSURFER and SAMPLER are the uncertainty quantification (UQ) codes for IBEs in the SCALE code system based on the GLLS, and the stochastic method, respectively.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Development of a three-dimensional APOLLO3 neutrons deterministic scheme for the CABRI reactor

CABRI is an experimental reactor to study the fuel behavior during reactivity injection transients. These transients being highly multiphysics, the development of suitable modeling and simulation tools to simulate them is important for the optimization of the tests and the control of the experimental conditions. This paper focuses on the development of an APOLLO3 deterministic core calculation tool dedicated to the CABRI transient analysis. It represents the first stage of the incremental process for the implementation of a multiphysics time-dependent modeling of the CABRI transient. The neutron calculation scheme is based on a classical two-step approach. The first step consists of a 281-energy group calculation flux with the TDT-MOC (Method Of Characteristics) solver for cross-section space and energy (23 groups) collapsing for the CABRI different assembly clusters. The bias on a 2D core neutron calculation due to the self-shielding calculation and collapsing on a restricted pattern are investigated thanks to a comparison with a direct full 2D calculation on a quarter of core. The second step relies on a pin-resolved transport 3D transport core calculation with the SN solver MINARET. A progressive numerical validation process is followed to quantify the calculation biases on reactivity and reaction rates at each step using reference calculations with the stochastic code TRIPOLI4. The next development stage toward a multiphysics scheme will be the implementation of the 3D-kinetics equation resolution and the coupling with a core thermal-hydraulics model. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Simulating Impacts of Extreme Events on Grids with High Penetrations of Wind Power Resources

As extreme weather events become more frequent and intense, the demand for connecting grid operation and infrastructure planning with extreme event models will increase as well. We present a methodology for creating damage contingencies and scenarios for electric transmission grids during a hurricane strike. Using WIND Toolkit meteorological data in conjunction with fragility curves for various electric grid elements, we generate stochastic damage scenarios that can be used for short- and long-term planning problems, e.g., emergency asset management. Included is an example case study: Hurricane Dolly damaging a synthetic 2000-bus test system during its landing in Southern Texas. We perform statistical analysis of damages and discuss topological effects on the example synthetic grid. Also, we include a cursory evaluation of impacts using simplified operational models. Finally, we discuss how our method can be extended to use even higher-fidelity meteorological data sets and suggest directions for future work.

contingencies↗

On the formation of swelling and related flaws in laser powder bed fusion

Process monitoring in laser powder bed fusion additive manufacturing can provide insights into stochastic anomalies, melt pool and plume dynamics, and part quality. Swelling, a build anomaly where overbuilt material protrudes through the powder layer after recoating, is readily detectable in post-recoat visible light images of the powder bed. Here, this work identifies several of the underlying mechanisms driving swelling formation by analyzing the influence of processing parameters, laser scan paths, and build plate locations on the presence of swelling detected in situ. Swelling near the edge of the part and swelling in the internal region of the part are shown to correlate with different process conditions. Edge and internal swelling may be driven by different phenomena, with edge swelling predominately occurring on the edge of a part facing the laser module and correlated to clusters of near-surface voids (detected with X-ray computed tomography). A larger spot size, higher laser power, and lower scan velocity also increased the presence of edge swelling. Laser spot size and scan path influenced internal swelling, which occurred preferentially with a larger spot size and in regions with large melt pools, caused by localized heat accumulation due to non-optimal processing parameters or scan path strategies. For coupons processed with a slicer-defined maximum scan vector length, swelling seldom occurred at internal vector-stripe boundaries. These results provide a mechanistic understanding of how swelling can be linked to material flaws, insight into how some instances of swelling can be avoided, and evidence supporting the use of swelling as an in situ indicator for quality assurance and part qualification.

Anomaly↗

Gas-rich dwarf galaxies in dense and sparse environments

Dwarf irregular galaxies (generically labelled Im for the present purposes) pose an enigma to students of galaxy evolution. In nearby groups and the Virgo cluster, Im galaxies are at least as abundant as spiral galaxies, and their low surface brightnesses and high gas-to-stars ratios suggest that (at least in the stochastic self-propagating star formation scenario) there should be significant numbers of HI clouds with masses approaching 10(exp 8) solar mass which have undergone very little or no star formation. To date, however, no clouds with so little star formation that they would not be recognized as Im galaxies on high-quality photographic plates have been identified. There have been suggestions that such dwarfs may be tidally disrupted in regions of high galactic density, but may be prevalent in low density regions. We offer data from three parallel programs relevant to this issue. (1) A large number of Im galaxies throughout the Local Supercluster have been mapped in the HI spectral line using the Arecibo Radiotelescope, and we can establish the frequency with which HI disks much more extended than their optically visible portions are found. (2) Our extensive mapping of spiral and dwarf galaxies in the Virgo cluster allows us to set stringent limits on the density of star-free Hi clouds in that cluster. (3) We have conducted a sampling of the void in the distribution of galaxies toward the super galactic pole, optimized for finding low-mass HI clouds at redshifts out to approximately 2000 km/s.

Hoffman, G. Lyle↗

Image Mapping and Visual Attention on the Sensory Ego-Sphere

The Sensory Ego-Sphere (SES) is a short-term memory for a robot in the form of an egocentric, tessellated, spherical, sensory-motor map of the robot s locale. Visual attention enables fast alignment of overlapping images without warping or position optimization, since an attentional point (AP) on the composite typically corresponds to one on each of the collocated regions in the images. Such alignment speeds analysis of the multiple images of the area. Compositing and attention were performed two ways and compared: (1) APs were computed directly on the composite and not on the full-resolution images until the time of retrieval; and (2) the attentional operator was applied to all incoming imagery. It was found that although the second method was slower, it produced consistent and, thereby, more useful APs. The SES is an integral part of a control system that will enable a robot to learn new behaviors based on its previous experiences, and that will enable it to recombine its known behaviors in such a way as to solve related, but novel, task problems with apparent creativity. The approach is to combine sensory-motor data association and dimensionality reduction to learn navigation and manipulation tasks as sequences of basic behaviors that can be implemented with a small set of closed-loop controllers. Over time, the aggregate of behaviors and their transition probabilities form a stochastic network. Then given a task, the robot finds a path in the network that leads from its current state to the goal. The SES provides a short-term memory for the cognitive functions of the robot, association of sensory and motor data via spatio-temporal coincidence, direction of the attention of the robot, navigation through spatial localization with respect to known or discovered landmarks, and structured data sharing between the robot and human team members, the individuals in multi-robot teams, or with a C3 center.

Fleming, Katherine Achim↗

Recommended DSMC Collision Model Parameters for Planetary Entry

Hybrid simulation frameworks combining Computational Fluid Dynamics (CFD) and Direct Simulation Monte Carlo (DSMC) are frequently employed to efficiently perform high-fidelity simulations of environments consisting of both continuum and rarified flow. DSMC is a stochastic, particle-based method which solves the fundamental Boltzmann equation and is therefore necessary for high-Knudsen flow where continuum-based assumptions governing CFD break down. However, the DSMC methodology is generally computationally inefficient to model the continuum regime. In a CFD/DSMC hybrid approach, obtaining an accurate, high-fidelity solution hinges on the consistent treatment of transport properties and the thermo-chemical models employed within the two solvers. In principle, in regions where CFD and DSMC are both employed, the same gas mixture under the same conditions should have the same properties, regardless of simulation type. Observed differences should be due to non-equilibrium processes, rather than differences in physical models. The goal of this work is to provide a comprehensive DSMC transport database encompassing the vast majority of known gas species encountered during Earth or other planetary atmospheric entry. This goal is largely possible due to recently performed ab initio quantum chemistry calculations. Combined with other high-fidelity data, the planned database will consist of collision integral data for over 200 neutral and ionized species and over 20000 binary collisions. From these collision integrals, Nelder-Mead optimization is used to compute collision-specific Variable Soft Sphere (VSS) collision model parameters, fitted from 300 K to 20000 K. Initial comparisons of transport properties of relevant equilibrium gas mixtures show great agreement between CFD and DSMC-derived results. The completed database can be readily applied to model binary collisions of any gas mixture containing the included species over the specified temperature range, making it a valuable tool for future planetary probe modeling efforts. An example is shown below in Fig. 1. Equilibrium mixture transport properties for a 35-species mixture composed originally of 10% air and 90% pyrolysis species of a carbon-phenolic ablator material [4] are computed using both fitted VSS Parameters and the original CFD collision integral values. Deviations in computed properties between the two approaches are less than 5% for the entire temperature range.

M. R. Gosma↗

A Holistic DSMC Transport Database for Re-Entry and Ablation Modeling

Hybrid simulation frameworks combining Computational Fluid Dynamics (CFD) and Direct Simulation Monte Carlo (DSMC) are frequently employed to efficiently perform high-fidelity solutions of environments containing combined continuum/rarified flow. The use of DSMC, a stochastic, particle-based method, is necessary for high-Knudsen flow where continuum-based assumptions governing CFD break down. However, the DSMC methodology is generally very computationally inefficient to model the continuum regime. In a CFD/DSMC hybrid approach, obtaining an accurate, high-fidelity solution hinges on the consistent treatment of transport properties and the used thermo-chemical models employed within the two solvers. In principle, in regions where CFD and DSMC are both employed, the same gas mixture under the same conditions should have the same properties, regardless of simulation type. Observed differences should be due to non-equilibrium processes, rather than differences in physical models. While the transport models governing CFD and DSMC simulations are starkly different, they can effectively be linked via their use of reduced Chapman-Enskog collision integrals. In CFD, these integrals are typically stored as fitted polynomial expressions and used to directly compute gas transport properties via mixing rules or the full Chapman-Enskog formulation. In DSMC, they can be used to derive the collision parameters needed for the phenomenological collision cross-section models that govern particle interactions, via a Nelder-Mead optimization scheme. The goal of this work is to provide a unified DSMC transport database encompassing the vast majority of known gas species encountered during atmospheric entry, on Earth or any other Solar body. This goal is largely possible due to recently performed ab-initio quantum chemistry calculations. Combined with other high-fidelity literature sources, the planned database will consist of collision integral data for over 200 neutral and ionized species and over 17000 binary collisions. From these collision integrals, Nelder-Mead optimization is used to compute Variable Soft Sphere (VSS) collision model parameters for DSMC, fitted from 300 K to 20000 K. Initial comparisons of transport properties of relevant equilibrium gas mixtures show great agreement between CFD and DSMC-derived results. The completed database will be able to be readily applied to model binary collisions of any gas mixture containing the included species over the specified temperature range, making it a valuable tool for future planetary probe modeling efforts. An example is shown below. Equilibrium mixture transport properties for a 19-species Titan atmospheric model [4] are computed using both fitted VSS parameters and the original CFD collision integral values. Deviations in computed properties between the two approaches is less than 5% for the entire temperature range.

M R Gosma↗

Accelerated basis adaptation in homogeneous chaos spaces

Polynomial chaos expansions (PCE) provide an efficient approach to uncertainty quantification (UQ) and have been adapted to diverse applications across the spectrum of science and engineering. For situations involving large stochastic parameterizations, the curse of dimensionality renders PCE-based methods computationally prohibitive. A basis adaptation approach for PCE was proposed by Tipireddy and Ghanem (2014) which transforms the input random variables through an isometry such that sufficient probabilistic characterization of specific quantities of interest (QoI) is concentrated in an algebraic manifold embedded in the linear span of the dominant transformed variables. While quite versatile, that original version of the PCE basis adaptation exhibited slow convergence for a number of problems of practical significance. In the present paper, we propose two novel methods to accelerate the convergence of the original basis adaptation approach, thus expanding its reach while also providing insight into its performance. In the first method, information gained from a pilot PCE representation is used to correct the mean and Gaussian coefficients in the adapted space. By taking advantages of probabilistic information in higher dimensional adaptation gleaned from an initial adaptation, the second method updates the rotation matrix used to identify the dominant transformed variables. In this manner, the new rotation matrix concentrates even more probabilistic information in its first few dimensions. These two method can be combined to achieve even better performance, the combined method is referred to as sequentially optimized adaptation method. Here, the methods are demonstrated on an analytical test function and a model of a space structure with several sub-components and a non-smooth quantity of interest representing the maximum acceleration over time. Both methods achieve accelerated convergence of the basis adaptation approach with negligible additional costs.

Accelerated convergence↗

Raptor

Raptor is an efficient Python-based tool for predicting the formation and morphology of stochastic lack of fusion defects in metal AM processes. A major obstacle for the qualification and certification of additively manufactured parts in critical applications continues to be performance variability caused in part by porosity-related defects. High-fidelity process models that could predict these defect features are currently too computationally expensive for component-level analysis. To address this, Raptor employs a high-performance geometric method to model the dynamic melt pool rather than relying on computationally intensive thermal fluid dynamics. This allows Raptor to rapidly identify regions of unmelted material that correspond to lack of fusion pores. The efficiency of this approach significantly reduces the time and resources needed for generating 3D defect predictions, which enables users to conduct large-scale parameter studies and evaluate how process variations affect part quality. The framework offers operational flexibility; users can execute simulations through a simple command line interface or integrate core functions as a library within larger computational workflows. Simulation outputs include 3D porosity maps for visualization and tools for quantitative morphological analysis. These results are suitable for direct comparison with experimental characterization data from methods such as X-ray computed tomography and can be used for statistical process optimization.

Subraveti, Vamsi [Vanderbilt Univ., Nashville, TN ↗

Emergency Asset Positioning for Resilient Transmission Grid Operation

In this paper we study a problem of hurricane emergency preparedness via placement of emergency storage assets prior to its strike. We present a two-stage stochastic model for choosing locations and quantities of emergency storage to help support the power grid through a hurricane event. The expectation of losses in our two-stage model is estimated using the sample average approximation. We construct damage scenarios for sample average approximation using WIND Toolkit meteorological data and fragility curves of various electric grid components. We demonstrate the efficacy of our two-stage planning model by simulating operations during Hurricane Dolly on the 2000-bus transmission test system. Our model, coupled with our scenario selection strategy, is effective at mitigating loss of load when compared to a model without emergency storage assets placed prior to an extreme event.

emergency preparedness↗

Emergency Generation Asset Positioning for Resilient Transmission Grid Operation: Preprint

In this paper we study a problem of hurricane emergency preparedness via placement of emergency generation assets prior to its strike. We present a two-stage stochastic model for choosing locations and quantities of emergency storage to help support the power grid through a hurricane event. The expectation of losses in our two-stage model is estimated using the sample average approximation. We construct damage scenarios for sample average approximation using WIND Toolkit meteorological data and fragility curves of various electric grid components. We demonstrate the efficacy of our two-stage planning model by simulating operations during Hurricane Dolly on the 2000-bus transmission test system. Our model, coupled with our scenario selection strategy, is effective at mitigating loss of load when compared to a model without emergency generation assets placed prior to an extreme event.

emergency preparedness↗