Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

On the Stochastic Stability of Deep Markov Models

Deep Markov models (DMM) are generative models which are scalable and expressive generalization of Markov models for representation, learning, and inference problems. DMMs using deep neural networks to parametrize the transition of Markov probability distributions have recently been shown to provide more expressiveness in modeling sequential data and dynamical system responses. However, the fundamental stochastic stability guarantees of such models have not been thoroughly investigated. In this paper, we present a rigorous analytical method to prove the necessary and sufficient conditions of DMM's stochastic stability. This task is achieved by spectral analysis of the efficiently computed Jacobians of probabilistic maps modeled by deep neural networks. We make theoretical connections between the eigenvalues of neural network's weights and the different activation function types used on the stability and overall dynamic behavior of DMMs with Gaussian distributions. We empirically substantiate our theoretical results on stochastic stability and eigenvalue spectra via several numerical experiments. Formal stability guarantees of DMMs can substantially improve their robustness and trustworthiness, necessary for reliable use in safety-critical real-world applications.

Drgona, Jan↗

Fast Computational Algorithms for Partial Differential Equations and Uncertainty Quantifications

This project concerned the construction, testing and analysis of computational algorithms for solving parameterized and stochastic partial differential equations. The study and understanding of equations of this type is of fundamental importance in numerous engineering and scientific applications. Examples include simulation of plasma dynamics in models of electric propulsion and nuclear fusion, simulation of multiphase flows, such as the flow of water, gas and oil in reservoirs, and structural analysis of the dependence of structures on materials. Parametrization is used in such settings when properties of the models such as viscosity of fluids or electric resistivity of materials are not precisely understood and instead are treated as random variables. The resulting solutions are themselves random, and having such solutions will enable engineers to use probabilistic methods to assess the likelihood of events, for example, whether a pollutant in a liquid will exceed a limit, and to use such analyses to develop ways to ensure positive outcomes. Construction of accurate (high resolution) computational solutions is expensive, requiring significant computer time and computational resources, and there is need to reduce computational cost to make simulation useful and effective. The aim of the project was to construct algorithms to efficiently compute surrogate solutions to parameterized problems to allow for efficient and accurate simulation. The technical approach used focused on two related strategies, based on rank-reduction methods and reduced-order models. These methods construct surrogate solutions of parameter-dependent models by projection or interpolation into low-dimensional approximation spaces. Cost savings are achieved if the low-dimensional spaces can be identified and constructed efficiently and if the resulting low-dimensional algebraic systems can be solved cheaply. Accomplishments include: Theoretical and empirical demonstration of the effectiveness of fast multigrid solution strategies for computing low-rank representations of parameter-dependent solutions to discrete partial differential equations, including the first proof establishing so-called textbook convergence properties for low-rank methods. Development of efficient solution algorithms for solving nonlinear parameter-dependent partial differential equations used in models of fluid dynamics. Developent of efficient algorithms for low-rank representation of solutions of time-dependent simulations of fluid dynamics using multi-dimensional tensor representations of solutions.

97 MATHEMATICS AND COMPUTING↗

Revisiting the ODE Method for Recursive Algorithms: Fast Convergence Using Quasi Stochastic Approximation

Several decades ago, Profs. Sean Meyn and Lei Guo were postdoctoral fellows at ANU, where they shared interest in recursive algorithms. It seems fitting to celebrate Lei Guo's 60th birthday with a review of the ODE Method and its recent evolution. The method has been regarded as a technique for algorithm analysis. It is argued that this viewpoint is backwards: The original stochastic approximation method was surely motivated by an ODE, and tools for analysis came much later (based on establishing robustness of Euler approximations). The paper presents a brief survey of recent research in machine learning that shows the power of algorithm design in continuous time, following by careful approximation to obtain a practical recursive algorithm. While these methods are usually presented in a stochastic setting, this is not a prerequisite. In fact, recent theory shows that rates of convergence can be dramatically accelerated by applying techniques inspired by quasi Monte-Carlo. Subject to conditions, the optimal rate of convergence can be obtained by applying the averaging technique of Polyak and Ruppert. The conditions are not universal, but theory suggests alternatives to achieve acceleration. The theory is illustrated with applications to gradient-free optimization, and policy gradient algorithms for reinforcement learning.

learning and adaptive systems in artificial intell↗

QCD Predictions for Physical Multimeson Scattering Amplitudes

We use lattice QCD calculations of the finite-volume spectra of systems of two and three mesons to determine, for the first time, three-particle scattering amplitudes with physical quark masses. Our results are for combinations of 𝜋 + and 𝐾 + , at a lattice spacing 𝑎 = 0.063 fm, and in the isospin-symmetric limit. We also obtain accurate results for maximal-isospin two-meson amplitudes, with those for 𝜋 + ⁢𝐾 + and 2⁢𝐾 + being the first determinations at the physical point. Dense lattice spectra are obtained using the stochastic Laplacian-Heaviside method, and the analysis leading to scattering amplitudes is done using the relativistic finite-volume formalism. Results are compared to chiral perturbation theory and to phenomenological fits to experimental data, finding good agreement.

hadron-hadron interactions↗

Improving statistical precision in Monte Carlo samples with negative weights via reweighting and uncertainty quantification

High statistical precision is critical for Monte Carlo (MC) samples in high energy physics and is degraded by negatively weighted events. This paper investigates a procedure to learn the relationship between the negative and positive weight distributions of any sample, allowing the reduction of statistical uncertainty by reweighting kinematically equivalent events with the same sign. A robust uncertainty quantification method is required for the practical application of such method. Two methods for the estimation of the reweighting uncertainty are developed: one at the event and another one at the final observable level. The latter method is strongly favored. The gains in statistical precision are then quantified. The method is demonstrated on Sherpa vector boson plus jets samples when using all generated events and when restricted to the signal region of a mock analysis. It is demonstrated to significantly reduce stochastic behavior in sparse MC samples while decreasing the overall uncertainty with a sufficiently well-known reweighting function.

Monte Carlo methods↗

Technical notes and correspondence: Stochastic robustness of linear time-invariant control systems

A simple numerical procedure for estimating the stochastic robustness of a linear time-invariant system is described. Monte Carlo evaluations of the system's eigenvalues allows the probability of instability and the related stochastic root locus to be estimated. This analysis approach treats not only Gaussian parameter uncertainties but non-Gaussian cases, including uncertain-but-bounded variation. Confidence intervals for the scalar probability of instability address computational issues inherent in Monte Carlo simulation. Trivial extensions of the procedure admit consideration of alternate discriminants; thus, the probabilities that stipulated degrees of instability will be exceeded or that closed-loop roots will leave desirable regions can also be estimated. Results are particularly amenable to graphical presentation.

Stengel, Robert F.↗

Probabilistic structural analysis algorithm development for computational efficiency

The PSAM (Probabilistic Structural Analysis Methods) program is developing a probabilistic structural risk assessment capability for the SSME components. An advanced probabilistic structural analysis software system, NESSUS (Numerical Evaluation of Stochastic Structures Under Stress), is being developed as part of the PSAM effort to accurately simulate stochastic structures operating under severe random loading conditions. One of the challenges in developing the NESSUS system is the development of the probabilistic algorithms that provide both efficiency and accuracy. The main probability algorithms developed and implemented in the NESSUS system are efficient, but approximate in nature. In the last six years, the algorithms have improved very significantly.

Wu, Y.-T.↗

Modeling Uncertainty in Large Natural Resource Allocation Problems

The productivity of the world's natural resources is critically dependent on a variety of highly uncertain factors, which obscure individual investors and governments that seek to make long-term, sometimes irreversible investments in their exploration and utilization. These dynamic considerations are poorly represented in disaggregated resource models, as incorporating uncertainty into large-dimensional problems presents a challenging computational task. This study introduces a novel numerical method to solve large-scale dynamic stochastic natural resource allocation problems that cannot be addressed by conventional methods. The method is illustrated with an application focusing on the allocation of global land resource use under stochastic crop yields due to adverse climate impacts and limits on further technological progress. For the same model parameters, the range of land conversion is considerably smaller for the dynamic stochastic model as compared to deterministic scenario analysis. The scenario analysis can thus significantly overstate the magnitude of expected land conversion under uncertain crop yields.

Cai, Yongyang↗

Probabilistic analysis of structures involving random stress-strain behavior

The present methodology for analysis of structures with random stress strain behavior characterizes the uniaxial stress-strain curve in terms of (1) elastic modulus, (2) engineering stress at initial yield, (3) initial plastic-hardening slope, (4) engineering stress at point of ultimate load, and (5) engineering strain at point of ultimate load. The methodology is incorporated into the Numerical Evaluation of Stochastic Structures Under Stress code for probabilistic structural analysis. The illustrative problem of a thick cylinder under internal pressure, where both the internal pressure and the stress-strain curve are random, is addressed by means of the code. The response value is the cumulative distribution function of the equivalent plastic strain at the inner radius.

Millwater, H. R.↗

Stochastic stability and instability of model ecosystems

In this work, we initiate a stability study of multispecies communities in stochastic environment by using Ito's differential equations as community models. By applying the direct method of Liapunov, we obtain sufficient conditions for stability and instability in the mean of the equilibrium populations. The conditions are expressed in terms of the dominant diagonal property of community matrices, which is a suitable mechanism for resolving the central problem of 'complexity vs stability' in model ecosystems. As a by-product of this analysis we exhibit important structural properties of the stochastic density-dependent models, and establish tolerance of community stability to a broad class of nonlinear time-varying perturbations.

Ladde, G. S.↗

FORCE-DISPATCHES Integration - Initial Demonstration

Integrated energy systems (IES) combine, in mutually beneficial ways, power from variable renewable energy sources and nuclear power plants (NPP) to improve economic viability under uncertain market and weather conditions. The open-source Framework for Optimization of Resources and Economics (FORCE) tool suite, developed at Idaho National Laboratory (INL), has enabled comprehensive modeling and simulation of IES. The capabilities within FORCE include grid portfolio optimization through the Holistic Energy Resource Optimization Network (HERON) and the transient process model analysis library HYBRID, among others. Continuous efforts and investments from the IES programs have been made to expand and improve the versatility of the FORCE toolset in fiscal year 2022. Code-coupling and cross-tool communication have been important methods for improving this versatility. This report focuses on an additional workflow in the HERON tool for capacity and dispatch stochastic optimization through integration with the external tool Design Integration and Synthesis Platform to Advance Tightly Coupled Hybrid Energy Systems (DISPATCHES). DISPATCHES was primarily developed by the National Energy Technology Laboratory, in collaboration with other national laboratories, which included INL, universities, and industry partners. It is coupled to a library of algebraic models for specific plant components, and to a framework for stochastic optimization different from that provided in the current Risk Analysis Virtual Environment (RAVEN)-running-RAVEN algorithm in HERON. HERON currently conducts stochastic optimization via an outer-inner loop: it optimizes over variable capacity on the outer loop, and at each step within the capacity parameter space, conducts an inner optimization over scenarios (of market signals, demand, and/or weather patterns) and hourly dispatch throughout a user-specified number of years. On the other hand, DISPATCHES conducts stochastic optimization via an “all-at-once” strategy in which capacity variables are optimized at the same level as dispatch variables, as all scenarios are considered at once. The latter method works especially well for projects of limited size and project length, as the necessary computational power and memory increases with the number of variables and scenarios. The new capability to use the DISPATCHES workflow in HERON enhances standalone simulations by leveraging FORCE tools—namely, the economic metrics from the Tool for Economic Analysis (TEAL) and reduced-order model (ROM) sampling from RAVEN. The initial demonstration of the DISPATCHES workflow simulates an existing nuclear-case flowsheet within the DISPATCHES repository—this models a NPP with a secondary revenue stream for hydrogen production. Electrical output from the plant is converted to hydrogen via a proton-exchange membrane (PEM) electrolyzer, hydrogen tanks are used for storage, and an additional turbine is added for hydrogen combustion. Continued work regarding this FORCE-DISPATCHES integration will include automatic generation of DISPATCHES models from HERON inputs, offering analysts the option of using either the RAVEN-runsRAVEN or DISPATCHES workflow to solve technoeconomic optimization problems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Computers boost structural technology

Derived from matrix methods of structural analysis and finite element methods developed over the last three decades, computational structures technology (CST) blends computer science, numerical analysis, and approximation theory into structural analysis and synthesis. Recent significant advances in CST include stochastic-based modeling, strategies for performing large-scale structural calculations on new computing systems, and the integration of CST with other disciplinary modules for multidisciplinary analysis and design. New methodologies have been developed at NASA for integrated fluid-thermal structural analysis and integrated aerodynamic-structure-control design. The need for multiple views of data for different modules also led to the development of a number of sophisticated data-base management systems. For CST to play a role in the future development of structures technology and in the multidisciplinary design of future flight vehicles, major advances and computational tools are needed in a number of key areas.

Noor, Ahmed K.↗

SGD-Net: Efficient Model-Based Deep Learning with Theoretical Guarantees

Deep unfolding networks have recently gained popularity for solving imaging inverse problems. However, the computational and memory complexity of data-consistency layers within traditional deep unfolding networks scales with the number of measurements, limiting their applicability to large-scale imaging inverse problems. We propose SGD-Net as a new methodology for improving the efficiency of deep unfolding through stochastic approximations of the data-consistency layers. Our theoretical analysis shows that SGD-Net can be trained to approximate batch deep unfolding networks to an arbitrary precision. Our simulations on intensity diffraction tomography and sparse-view computed tomography show that SGD-Net can match the performance of the traditional batch network at a fraction of training and testing complexity.Deep unfolding networks have recently gained popularity for solving imaging inverse problems. However, the computational and memory complexity of data-consistency layers within traditional deep unfolding networks scales with the number of measurements, limiting their applicability to large-scale imaging inverse problems. We propose SGD-Net as a new methodology for improving the efficiency of deep unfolding through stochastic approximations of the data-consistency layers. Our theoretical analysis shows that SGD-Net can be trained to approximate batch deep unfolding networks to an arbitrary precision. Our simulations on intensity diffraction tomography and sparse-view computed tomography show that SGD-Net can match the performance of the traditional batch network at a fraction of training and testing complexity.

97 MATHEMATICS AND COMPUTING↗

Probabilistic structural analysis verification studies

The basic objective of this verification effort is to apply probabilistic structural analysis methods developed and implemented in the Numerical Evaluation of Stochastic Structures Under Stress (NESSUS) code to typical space propulsion components. The chosen typical components are turbine blade, high pressure duct, Lox post, and transfer tube liners. Since analysis options of increasing levels of sophistication are implemented in NESSUS incrementally, the verification efforts are also tailored to have increasing levels of sophistication during the progression of the contract. The current released version of the code is limited to linear structural analysis.

Rajagopal, K. R.↗

Time domain probabilistic seismic risk analysis using ground motion prediction equations of Fourier amplitude spectra

Modeling of Fourier amplitude spectra (FAS) of seismic motions has gained much attention in engineering seismology. In the past few years, several ground motion prediction equations (GMPEs) and inter-frequency correlation structure of FAS have been established. Due to many preferable characteristics of FAS, probabilistic seismic hazard/risk analysis is rapidly changing from ergodic, spectrum acceleration Sa(T 0 )-based approach to non-ergodic, site-specific, FAS-based approach. This paper presents time domain intrusive framework for probabilistic seismic risk analysis using GMPE of FAS. Herein, methodology for time domain stochastic ground motion modeling based on GMPEs of FAS is presented in some detail. The simulated uncertain motions are modeled as a random process and represented by polynomial chaos Karhunen-Loève expansion. The random process excitations are further propagated into the uncertain structural system using Galerkin stochastic finite element method (SFEM). Probabilistic evolution of structural response is solved, and such solution is used to develop seismic risk for any damage state. The presented framework is illustrated through seismic risk analysis of a four-story building subjected to possible earthquakes from two strike slip faults. The influences of the epistemic uncertainties in source stress drop Δσ and site attenuation κ0 on seismic risk are investigated. The need for non-ergodic seismic risk analysis with source-specific and site specific characterizations is emphasized.

58 GEOSCIENCES↗

Scatter in Carbon/Silicon Carbide (C/SiC) Composites Quantified

Carbon-fiber-reinforced silicon carbide matrix (C/SiC) composites processed by chemical vapor infiltration are candidate materials for aerospace thermal structures. Carbon fibers can retain properties at very high temperatures, but they are known to have poor oxidation resistance in adverse, high-temperature environments. Nevertheless, the combination of CVI-SiC matrix with higher stiffness and oxidation resistance, the interfacial coating, and additional surface-seal coating provides the necessary protection to the carbon fibers, and makes the material viable for high-temperature space applications operating under harsh environments. Furthermore, C/SiC composites, like other ceramic matrix composites (CMCs), exhibit graceful non-catastrophic failure because of various inherent energy dissipating mechanisms. The material exhibits nonlinearity in deformation even at very low stress levels. This is the result of the severe matrix microcracking present in the as processed composite because of large differences between the coefficients of thermal expansion of the fiber and the matrix. Utilization of these advanced composites in next generation space vehicles will require innovative structural configurations, updated materials, and refined analyses. Structural safety issues for these vehicles are in direct competition with performance and cost. One would have to quantify the uncertainties associated with the design using formal probabilistic methods. Specifically four fundamental aspects on which analyses are based-- (1) loading conditions, (2) material behavior, (3) geometrical configurations, and (4) structural connections between the composite components and baseline structure--are stochastic in nature. A direct way to formally account for uncertainties is to develop probabilistic structural analysis methods where all participating variables are described by appropriate probability density functions. The present work, however, focuses on analyzing the stochastic material behavior of these advanced composites using formal probabilistic analysis methods. Often, some of the desirable property characteristics that allow composites to offer advantages over conventional structural materials (like tailoring of composite properties) and the complexity are in fact responsible for their greater statistical variability and the requirements for more characterization tests. Composite properties are anisotropic as well, having different properties in different directions. This means that characterization of a property such as stiffness--which will vary greatly depending on the orientation of the fiber relative to the direction of the testing--must be repeated for several different directions and loading conditions. The fabrication process for composites also introduces statistical variations in properties and geometry. A composite part is produced in a number of steps, each of which introduces statistical variability. The matrix is usually produced from a combination of raw materials; and the fiber, which has its own set of properties, is often coated or surface treated, introducing yet another source of variability.

Murthy, Pappu L. N.↗

The kinetic response of a stochastic plasma to low frequency perturbations

Following suggestion that substorm breakup might be caused by an interchange or ballooning instability, several magnetohydrodynamic (MHD) and gyro-kinetic stability analysis have been performed for plasma sheet magnetic field geometries. However, the stochastic ion dynamics in the highly stressed, thin high-beta near earth plasma sheet violate the locality requirements of MHD and the invarience of the magnetic moment, mu, required by gyro-kinetic theories. In this paper we develop a new linear Vlasov kinetic theory (for low frequency modes omega less than omega(sub b), omega(sub b) being the bounce frequency) which includes the dynamics of stochastic ions.

Hurricane, Omar A.↗