Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic tools”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Uncontrolled Learning: Codesign of Neuromorphic Hardware Topology for Neuromorphic Algorithms

Neuromorphic computing has the potential to revolutionize future technologies and our understanding of intelligence, yet it remains challenging to realize in practice. The learning-from-mistakes algorithm, inspired by the brain's simple learning rules of inhibition and pruning, is one of the few brain-like training methods. This algorithm is implemented in neuromorphic memristive hardware through a codesign process that evaluates essential hardware trade-offs. While the algorithm effectively trains small networks as binary classifiers and perceptrons, performance declines significantly with increasing network size unless the hardware is tailored to the algorithm. This work investigates the trade-offs between depth, controllability, and capacity—the number of learnable patterns—in neuromorphic hardware. This highlights the importance of topology and governing equations, providing theoretical tools to evaluate a device's computational capacity based on its measurements and circuit structure. The findings show that breaking neural network symmetry enhances both controllability and capacity. Additionally, by pruning the circuit, neuromorphic algorithms in all-memristive circuits can utilize stochastic resources to create local contrasts in network weights. Through combined experimental and simulation efforts, the parameters are identified that enable networks to exhibit emergent intelligence from simple rules, advancing the potential of neuromorphic computing.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

AlignOT: An Optimal Transport Based Algorithm for Fast 3D Alignment With Applications to Cryogenic Electron Microscopy Density Maps

Aligning electron density maps from Cryogenic electron microscopy (cryo-EM) is a first key step for studying multiple conformations of a biomolecule. As this step remains costly and challenging, with standard alignment tools being potentially stuck in local minima, we propose here a new procedure, called AlignOT, which relies on the use of computational optimal transport (OT) to align EM maps in 3D space. By embedding a fast estimation of OT maps within a stochastic gradient descent algorithm, our method searches for a rotation that minimizes the Wasserstein distance between two maps, represented as point clouds. Here, we quantify the impact of various parameters on the precision and accuracy of the alignment, and show that AlignOT can outperform the standard local alignment methods, with an increased range of rotation angles leading to proper alignment. We further benchmark AlignOT on various pairs of experimental maps, which account for different types of conformational heterogeneities and geometric properties. As our experiments show good performance, we anticipate that our method can be broadly applied to align 3D EM maps.

3D alignment↗

An improved Method for Determining Transient Fuel Dilution of Oil in an Internal-Combustion Engine Using Laser-Induced Florescence and Multivariate Least Square Calibration

An optical diagnostic, based on laser-induced fluorescence (LIF), has been developed for on-engine measurements of real-time fuel dilution of engine oil or fuel in oil (FIO). Fuel dilution of oil is broadly relevant to advancing engine technology including durability, calibration, and catalyst-system management, and believed to promote destructive stochastic pre-ignition (SPI) during high-load engine operations. While standard (e.g., ASTM D3524-90) methods are not capable of real-time transient measurements, the LIF technique resolves transient dilution on the minutes time scale. We have expanded on our original FIO instrument development by introducing an improved analysis based on multivariate least square chemometrics analysis. The measurement uses a fuel dye (180–1300 parts per million, by mass) and monitors for its presence in the oil using 532 nm excitation and LIF. While the original FIO instrument utilized a two-color ratio method for analysis, the improved chemometric analysis uses the fully resolved LIF dye spectra to provide better predictive FIO accuracy (>92%) over a wide FIO range (1.5–14%) typical of engine application. We also investigate the effect of oil temperature on the LIF signal. Limited engine applications for demonstrating and validating the improved FIO instrument are shown, and the related data used to quantify practical detection limit and sensitivity. The improved analysis is insensitive to laser power fluctuation and change in detector integration time, providing an excellent FIO sensitivity (1–2%) and detection limit (0.01 %FIO) over a wide range of loads and injection timings, illustrating this updated approach to be a promising tool for advancing engine technology.

42 ENGINEERING↗

Solar flux forecasting using mutual information with an optimal delay

Solar flux F(sub 10.7) directly affects the atmospheric density, thereby changing the lifetime and prediction of satellite orbits. For this reason, accurate forecasting of F(sub 10.7) is crucial for orbit determination of spacecraft. Our attempts to model and forecast F(sub 10.7) uncovered highly entangled dynamics. We concluded that the general lack of predictability in solar activity arises from its nonlinear nature. Nonlinear dynamics allow us to predict F(sub 10.7) more accurately than is possible using stochastic methods for time scales shorter than a characteristic horizon, and with about the same accuracy as using stochastic techniques when the forecasted data exceed this horizon. The forecast horizon is a function of two dynamical invariants: the attractor dimension and the Lyapunov exponent. In recent years, estimation of the attractor dimension reconstructed from a time series has become an important tool in data analysis. In calculating the invariants of the system, the first necessary step is the reconstruction of the attractor for the system from the time-delayed values of the time series. The choice of the time delay is critical for this reconstruction. For an infinite amount of noise-free data, the time delay can, in principle, be chosen almost arbitrarily. However, the quality of the phase portraits produced using the time-delay technique is determined by the value chosen for the delay time. Fraser and Swinney have shown that a good choice for this time delay is the one suggested by Shaw, which uses the first local minimum of the mutual information rather than the autocorrelation function to determine the time delay. This paper presents a refinement of this criterion and applies the refined technique to solar flux data to produce a forecast of the solar activity.

Ashrafi, S.↗

NASA Tech Briefs, March 2014

Topics include: Data Fusion for Global Estimation of Forest Characteristics From Sparse Lidar Data; Debris and Ice Mapping Analysis Tool - Database; Data Acquisition and Processing Software - DAPS; Metal-Assisted Fabrication of Biodegradable Porous Silicon Nanostructures; Post-Growth, In Situ Adhesion of Carbon Nanotubes to a Substrate for Robust CNT Cathodes; Integrated PEMFC Flow Field Design for Gravity-Independent Passive Water Removal; Thermal Mechanical Preparation of Glass Spheres; Mechanistic-Based Multiaxial-Stochastic-Strength Model for Transversely-Isotropic Brittle Materials; Methods for Mitigating Space Radiation Effects, Fault Detection and Correction, and Processing Sensor Data; Compact Ka-Band Antenna Feed with Double Circularly Polarized Capability; Dual-Leadframe Transient Liquid Phase Bonded Power Semiconductor Module Assembly and Bonding Process; Quad First Stage Processor: A Four-Channel Digitizer and Digital Beam-Forming Processor; Protective Sleeve for a Pyrotechnic Reefing Line Cutter; Metabolic Heat Regenerated Temperature Swing Adsorption; CubeSat Deployable Log Periodic Dipole Array; Re-entry Vehicle Shape for Enhanced Performance; NanoRacks-Scale MEMS Gas Chromatograph System; Variable Camber Aerodynamic Control Surfaces and Active Wing Shaping Control; Spacecraft Line-of-Sight Stabilization Using LWIR Earth Signature; Technique for Finding Retro-Reflectors in Flash LIDAR Imagery; Novel Hemispherical Dynamic Camera for EVAs; 360 deg Visual Detection and Object Tracking on an Autonomous Surface Vehicle; Simulation of Charge Carrier Mobility in Conducting Polymers; Observational Data Formatter Using CMOR for CMIP5; Propellant Loading Physics Model for Fault Detection Isolation and Recovery; Probabilistic Guidance for Swarms of Autonomous Agents; Reducing Drift in Stereo Visual Odometry; Future Air-Traffic Management Concepts Evaluation Tool; Examination and A Priori Analysis of a Direct Numerical Simulation Database for High-Pressure Turbulent Flows; and Resource-Constrained Application of Support Vector Machines to Imagery.

Source record↗

On analysis and stochastic modeling of the particle kinetic energy equation in particle-laden isotropic turbulent flows

In this study, we analyze three-dimensional particle-laden, isotropic turbulence to develop an understanding of inertial particle dynamics from a kinetic energy perspective. Data trends implying inhomogeneous sampling of the flow by particles are identified and used to support a proposed particle behavior: particles appear to accumulate in regions of low flow kinetic energy over time because they lose kinetic energy and slow down in such regions, ultimately causing them to spend more time there. To elucidate this behavior, we derive a particle kinetic energy equation from the particle momentum equation, which incorporates inertial effects through the Schiller–Naumann drag correlation. Upon extracting fundamental physics from this equation, hypotheses regarding the role of the Stokes number in the temporal change of particle kinetic energy and the previously proposed particle behavior are evaluated using simulation data considering three Stokes numbers. Finally, a Fokker–Planck equation is used to derive the steady-state probability density function of the particle kinetic energy. The model fits the simulation data well and provides a tool for further investigation into understanding preferential concentration, as well as a reduced order model for predicting particle kinetic energy in turbulent flows.

42 ENGINEERING↗

Visualization of Multi-Fidelity Approximations of Stochastic Economic Dispatch

As renewable energy generation deployment increases, the operation of electrical grids becomes more complex. Economic dispatch is part of a grid operator's regular decision process where the amount of energy to generate is determined based on the number of available generators and the actual level of energy demand. Renewable generators are inherently stochastic due to the chaotic nature of weather patterns, and thus, real-time decisions of economic dispatch become increasingly complex. Modeling efforts to assist in these decisions in the highest fidelity typically take hours to days to solve on leadership-class computers; too long for the 5-minute operational time-frame demanded of operators. Alternatively, multi-fidelity approximations can be used to predict generation levels quickly and with sufficient accuracy to be used for real-time operations. We have developed a visualization tool to demonstrate the utility of multi-fidelity approximations by displaying contextual results of economic dispatch approximations, comparisons across fidelity levels of generation levels and possible failures to meet demand, and meta-data on the modeling setup.

interactive visualization↗

SoDa: An Irradiance-Based Synthetic Solar Data Generation Tool (SoDa) v0.1

SoDa is an irradiance-based synthetic Solar Data generation tool to generate realistic sub-minute solar photovoltaic (PV) power time series, that emulate the weather pattern for a certain geographical location. Our tool relies on the National Solar Radiation Database (NSRDB) to obtain irradiance and weather data patterns for the site. Irradiance is mapped onto a PV model estimate of a solar plant's 30-min power output, based on the configuration of the panel. We use a stochastic model with a switching behavior due to different weather regimes as provided by the cloud type label in the NSRDB, with parameters for the cloudy states trained on the high-resolution solar power measurements from a Phasor Measurement Unit (PMU).

Carreno, IgnacioLosada↗

GentenMPI: Distributed Memory Sparse Tensor Decomposition

GentenMPl is a toolkit of sparse canonical polyadic (CP) tensor decomposition algorithms that is designed to run effectively on distributed-memory high-performance computers. Its use of distributed-memory parallelism enables it to efficiently decompose tensors that are too large for a single compute node's memory. GentenMPl leverages Sandia's decades-long investment in the Trilinos solver framework for much of its parallel-computation capability. Trilinos contains numerical algorithms and linear algebra classes that have been optimized for parallel simulation of complex physical phenomena. This work applies these tools to the data science problem of sparse tensor decomposition. In this report, we describe the use of Trilinos in GentenMPl, extensions needed for sparse tensor decomposition, and implementations of the CP-ALS (CP via alternating least squares) and GCP-SGD (generalized CP via stochastic gradient descent) sparse tensor decomposition algorithms. We show that GentenMPl can decompose sparse tensors of extreme size, e.g., a 12.6-terabyte tensor on 8192 computer cores. We demonstrate that the Trilinos backbone provides good strong and weak scaling of the tensor decomposition algorithms.

97 MATHEMATICS AND COMPUTING↗

Stochastic reconstruction of fracture network pattern using spatial point processes

Fracture spatial patterns can strongly affect fluid flow in the subsurface. Proximity and distribution of fractures control reservoir flow behavior over various length scales. In many studies, however, simplified geometrical patterns are generated for fractures which may lead to unrealistic subsurface models. Here we introduce a new method for characterization and modeling of fracture spatial patterns based on outcrop observations. We use Ripley's K-function to characterize the arrangement of fracture barycenters and intersection points over various length scales. In addition, we use semivariograms to quantify spatial correlation in fracture intensity maps. Using this information, we develop a stochastic algorithm that generates two-dimensional fracture network realizations with spatial properties similar to those of a real fracture network measured in the field. Numerical simulation models indicate that the generated fracture realizations exhibit similar flow behaviors as that of the original fracture network. Furthermore, such modeling tools expand and improve our capability in building representative fracture models and in quantification of uncertainty in naturally and hydraulically fractured reservoirs.

58 GEOSCIENCES↗

Decentralized stochastic control

Decentralized stochastic control is characterized by being decentralized in that the information to one controller is not the same as information to another controller. The system including the information has a stochastic or uncertain component. This complicates the development of decision rules which one determines under the assumption that the system is deterministic. The system is dynamic which means the present decisions affect future system responses and the information in the system. This circumstance presents a complex problem where tools like dynamic programming are no longer applicable. These difficulties are discussed from an intuitive viewpoint. Particular assumptions are introduced which allow a limited theory which produces mechanizable affine decision rules.

Speyer, J. L.↗

Stochastic nonlinear analysis of unidirectional fiber composites using image-based microstructural uncertainty quantification

Here, we present a data-driven nonlinear uncertainty quantification and propagation framework to study the microstructure-induced stochastic performance of unidirectional (UD) carbon fiber reinforced polymer (CFRP) composites. The proposed approach integrates (1) microscopic image characterization, (2) stochastic microstructure reconstruction, and (3) efficient multiscale finite element simulations enabled by self-consistent clustering (SCA) analysis. To model the complex microstructural variability, the proposed UQ methods take the non-Gaussian uncertainty sources into account through a distribution-free sampling approach leveraging nonparametric and asymptotic statistical tools. A hierarchical conditional sampling strategy enables the simultaneous sampling of multiple sources of uncertainties. Our approach provides insights into the impact of microstructural variabilities, which are shown to have an increasing impact on the nonlinear responses of UD CFRP parts under progressive compression loading and ultimately on the failure rate over time. We discover that before CFRP parts start to fail, a characteristic time period emerges with distinctive uncertainty distributions specific to the microstructure variability and the probability of failure. Identifying the failure time period is crucial to the reliability prediction, which is an essential component of CFRP design.

36 MATERIALS SCIENCE↗

Modeling the Variability of the BL Lacertae Object PKS 2155-304

The bright X-ray-selected BL Lacertae object PKS 2155-304 has been the target of two intense multi-wavelength campaigns in 1991 November and in 1994 May. Although the spectral energy distributions at both epochs were quite similar, the source exhibited two very distinct variability patterns that cannot be easily reconciled with homogeneous one-zone C7 jet models. During the first epoch the variability was almost achromatic in amplitude, with a time lag between X-rays and ultraviolet radiation (UV) of approximately three hours, while during the second epoch the variability amplitude increased as a function of wavelength with the EUV flare peaking approximately one day after the X-ray flare. We model the source using a time-dependent inhomogeneous accelerating jet model. We reproduce the general characteristics of the different variability signatures by assuming that plasma disturbances with different physical properties propagate downstream in an underlying jet characterized by the same set of physical parameters at both epochs. A time delay of approximately one day between the hardening of the UV spectral index and the UV flux present at both epochs is modeled with stochastic fluctuations in the particle acceleration manifested through small variations of the maximum energy of the injected electrons. We predict that similar time delays will be present in future observations even in the absence of strong variability event. We stress the importance of observations at neighboring frequencies as a diagnostic tool for the structure of the quiescent jet in blazars especially in the seemingly dull case in which strong variability is absent.

Georganopuolos, Markos↗

The Integrated Medical Model: A Risk Assessment and Decision Support Tool for Space Flight Medical Systems

The Integrated Medical Model (IMM) is a decision support tool that is useful to mission planners and medical system designers in assessing risks and designing medical systems for space flight missions. The IMM provides an evidence based approach for optimizing medical resources and minimizing risks within space flight operational constraints. The mathematical relationships among mission and crew profiles, medical condition incidence data, in-flight medical resources, potential crew functional impairments, and clinical end-states are established to determine probable mission outcomes. Stochastic computational methods are used to forecast probability distributions of crew health and medical resource utilization, as well as estimates of medical evacuation and loss of crew life. The IMM has been used in support of the International Space Station (ISS) medical kit redesign, the medical component of the ISS Probabilistic Risk Assessment, and the development of the Constellation Medical Conditions List. The IMM also will be used to refine medical requirements for the Constellation program. The IMM outputs for ISS and Constellation design reference missions will be presented to demonstrate the potential of the IMM in assessing risks, planning missions, and designing medical systems. The implementation of the IMM verification and validation plan will be reviewed. Additional planned capabilities of the IMM, including optimization techniques and the inclusion of a mission timeline, will be discussed. Given the space flight constraints of mass, volume, and crew medical training, the IMM is a valuable risk assessment and decision support tool for medical system design and mission planning.

Kerstman, Eric↗

Machine Learning Assisted HPC Workload Trace Generation for Leadership Scale Storage Systems

Monitoring and analyzing a wide range of I/O activities in an HPC cluster is important in maintaining mission-critical performance in a large-scale, multi-user, parallel storage system. Center-wide I/O traces can provide high-level information and fine-grained activities per application or per user running in the system. Studying such large-scale traces can provide helpful insights into the system. It can be used to develop predictive methods for making predictive decisions, adjusting scheduling policies, or providing decisions for the design of next-generation systems. However, sharing real-world I/O traces to expedite such research efforts leaves a few concerns; i) the cost of sharing the large traces is expensive due to this large size, and ii) privacy concern is an issue.We address such issues by building an end-to-end machine learn- ing (ML) workflow that can generate I/O traces for large-scale HPC applications. We leverage ML based feature selection and gener- ative models for I/O trace generation. The generative models are trained on I/O traces collected by the darshan I/O characterization tool over a period of one year. We present a two-step generation process consisting of two deep-learning models, called the feature generator and the trace generator. The combination of two-step generative models provides robustness by reducing the bias of the model and accounting for the stochastic nature of the I/O traces across different runs of an application. We evaluate the performance of the generative models and show that the two-step model can generate time-series I/O traces with less than 20% root mean square error.

Paul, Arnab↗

AEOLUS: Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems

Sustained advances in the mathematics of modeling and simulation have resulted in the capability today for routine simulation of a number of large scale complex DOE-relevant systems. As remarkable as this capability for solving the so-called forward problem is, it is typically only the first step-an inner loop within an outer loop that explores the simulation model's parameter space and decision space to characterize uncertainty in the model's predictions, learn unknown model parameters from data, design the most informative experiments, determine optimal control strategies, and create optimal designs. Broadly, what unifies all of these outer loop problems is that they are, in one form or another, optimization problems over parameter/control/design space that are constrained by complex uncertain models. To fully realize the power of scientific simulation as a basis for scientific discovery, technological innovation, and rational decision-making, it is imperative to move beyond simulation to tackle the outer loop of optimization for learning from data, experimental design, and control with complex uncertain models. When the models under consideration are large-scale and complex, and when the optimization variable and uncertain parameter spaces are high (or infinite) dimensional, this constitutes a grand challenge of the highest order, and is intractable with conventional methods. To overcome these challenges, the AEOLUS Center was established to develop a unified mathematical, computational, and statistical framework for (1) Learning predictive models from complex data via Bayesian inference and optimization, and (2) Optimizing experiments, processes, and designs using the resulting uncertain models. These problems are intractable with conventional methods, for several reasons: (1) The simulation problems that govern the inner loops of the optimization problems are expensive to execute (due to severe nonlinearity, heterogeneity, multiphysics/multiscale coupling); (2) The optimization variable and uncertain parameter spaces are high dimensional, often stemming from discretizations of infinite dimensional fields such as initial conditions, sources, or material properties. We argue that the key to overcoming these challenges is to develop new mathematical, computational, and statistical methods that exploit the structure of the Bayesian inference and optimization problems mediated by their underlying complex uncertain models. This structure includes the regularity, sparsity, geometry, low intrinsic dimensionality, and multifidelity nature of the maps from uncertain parameter/optimization variable spaces to the specific objectives targeted: Bayesian inference, optimal experimental design, and optimal control design. Black box methods developed as generic tools are incapable of exploiting this structure. To be successful, we must create, integrate, and cross-fertilize ideas across multiple areas of applied math--including approximation theory, Bayesian inference, data science, experimental design, information theory, machine learning, model reduction, optimal control theory, parallel algorithms, PDE-constrained optimization, randomized algorithms, stochastic optimization, and uncertainty quantification--all while exploiting the structure of the problems at hand. With this goal in mind, we have marshaled a team of leading authorities in these areas. While the methods we develop will be broadly applicable across a wide spectrum of DOE problems in which experiments inform models and the systems those models describe must be optimized under uncertainty, we have chosen a specific area, advanced manufacturing and materials, to drive our work. AMM is characterized by complex models across multiple scales, and is a rich source of challenging problems in inference, experimental design, and optimal control, requiring multifaceted and integrated advances in applied mathematics. As such, AMM serves as an excellent vehicle to motivate and demonstrate the advances in applied mathematics developed by our center.

97 MATHEMATICS AND COMPUTING↗

Survey on stochastic distribution systems: A full probability density function control theory with potential applications

Complex systems seen either in general engineering practice or economics are subjected to ever increased uncertainties that are mostly represented as random variables or parameters, and the characteristics of random variables are represented by their probability density functions (PDFs). Controlling their PDFs means to shape their stochastic distributions and in general it would provide a full treatment for system analysis and operational control and optimization. This leads to the development of stochastic distribution control (SDC) systems theory in the past decades, where the original aim of the controller design is to realize a shape control of the distributions of certain random variables in their PDFs sense for some engineering processes. Indeed, once the PDFs of these random variables or parameters are used to describe their distribution characters, the control task is to obtain control signals so that the output PDFs of stochastic systems are made to follow their target PDFs. The subject of SDC was initially originated for non-Gaussian stochastic control systems design but has found a wide spectrum of applications in general systems in terms of data-driven modeling, analysis, signal processing (filtering), data mining via multivariable statistics, decision-making (optimization) for systems subjected to uncertainties and even in economics. In this context, SDC constitutes an effective primer tool for complex system analysis, control and operational optimizations. In this review paper, a detailed survey of the developments on the research of SDC systems will be made together with their wide spectrum applications and future perspectives.

42 ENGINEERING↗

Investigating Sources of Ozone over California Using AJAX Airborne Measurements and Models: Assessing the Contribution from Long Range Transport

High ozone (O3) concentrations at low altitudes (1.5e4 km) were detected from airborne Alpha Jet Atmospheric eXperiment (AJAX) measurements on 30 May 2012 off the coast of California (CA). We investigate the causes of those elevated O3 concentrations using airborne measurements and various models. GEOS-Chem simulation shows that the contribution from local sources is likely small. A back trajectory model was used to determine the air mass origins and how much they contributed to the O3 over CA. Low-level potential vorticity (PV) from Modern Era Retrospective analysis for Research and Applications 2 (MERRA-2) reanalysis data appears to be a result of the diabatic heating and mixing of airs in the lower altitudes, rather than be a result of direct transport from stratospheric intrusion. The Q diagnostic, which is a measure of the mixing of the air masses, indicates that there is sufficient mixing along the trajectory to indicate that O3 from the different origins is mixed and transported to the western U.S.The back-trajectory model simulation demonstrates the air masses of interest came mostly from the mid troposphere (MT, 76), but the contribution of the lower troposphere (LT, 19) is also significant compared to those from the upper troposphere/lower stratosphere (UTLS, 5). Air coming from the LT appears to be mostly originating over Asia. The possible surface impact of the high O3 transported aloft on the surface O3 concentration through vertical and horizontal transport within a few days is substantiated by the influence maps determined from the Weather Research and Forecasting Stochastic Time Inverted Lagrangian Transport (WRF-STILT) model and the observed increases in surface ozone mixing ratios. Contrasting this complex case with a stratospheric-dominant event emphasizes the contribution of each source to the high O3 concentration in the lower altitudes over CA. Integrated analyses using models, reanalysis, and diagnostic tools, allows high ozone values detected by in-situ measurements to be attributed to multiple source processes.

Ryoo, Ju-Mee↗