Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Integration of multiple coinflip devices for high-quality random sampling

Artificial intelligence, scientific computing, and probabilistic computing use random sampling to approximate solutions to various problems, with larger models requiring a substantial quantity of random numbers. To generate the required vast quantity of random numbers at high rates, we explore so-called “coinflip” devices, which are stochastic microelectronic devices ideally capable of independently generating random bits with a tunable weight at a high rate. However, coinflip devices are inherently analog and demonstrate nonidealities, like temperature dependence and drift, that can introduce determinism into the outputs. We present important considerations for building systems of multiple coinflip devices to produce high-quality bitstreams with low error and little dependency on previous bits. Using tunnel diodes as coinflip devices, we implement a control loop to adapt to temperature dependence and generate fair bitstreams with each device. While this can lead to dependencies between bits in a single bitstream, we demonstrate that combining results generated in parallel with individual tunnel diodes can produce fair and unpredictable bitstreams. The suitability of these bitstreams for use in probabilistic computing is then demonstrated through a Monte Carlo approximation of π.

Taylor, Brady Garland [Sandia National Laboratorie↗

On-lattice kinetic Monte Carlo approaches for modeling molecular anisotropy in resveratrol crystallization

Stilbenes are a class of organic compounds with broad-ranging pharmaceutical and agricultural applications, which are typically isolated and purified through recrystallization. We are motivated by reducing experimental waste and optimizing yield via developing predictive simulations for processing-dependent crystal morphologies. Using resveratrol as a model stilbene system, we have developed an approach for simulating crystallization with molecular resolution using on-lattice kinetic Monte Carlo. In this work, we highlight modifications to the Stochastic Parallel PARticle Kinetic Simulator (SPPARKS) software package, which were essential to this application. Key enhancements include the incorporation of non-orthogonal cell shapes and monomer anisotropy approximations using bound hard spheres. This new SPPARKS application has been applied to resveratrol with attachment energy libraries obtained from density functional theory, resulting in excellent agreement with experimental morphology prediction.

crystallization↗

Dynamic microbial assembly processes correspond to soil fertility in sustainable paddy agroecosystems

1. Microorganisms underpin the sustainability of agroecosystems, but we have a poor understanding of how the assembly processes that govern microbial community structure interact through time to maintain soil fertility. 2. Ancient rice paddies have a history of cultivation spanning hundreds or thousands of years and provide an ideal opportunity to explore relationships between community assembly processes and long-term agroecosystem sustainability. We used statistical null models to evaluate temporal patterns of bacterial community assembly processes across rice cultivation years and their associations with increases in soil fertility in paddy agroecosystems. 3. We found that stochasticity was a persistent force structuring paddy soil microbial communities, putatively due to frequent flooding that facilities dispersal. However, determinism gradually increased over centuries of agriculture and corresponded to increases in soil fertility. Accordingly, multifunctionality, calculated using enzymes catalyzing key soil functions in carbon, nitrogen, phosphorous and sulfur cycling significantly increased along rice cultivation years. We therefore propose that balanced assembly processes preserve a diverse array of traits that can dominate under various circumstances (stochasticity) while allowing for traits relevant to soil fertility to be selected for by soil fertility (determinism), thus supporting multifunctionality that underlies sustainable agroecosystems. 4. In total, our results highlight that knowledge on temporal microbial assembly processes, community composition, and ecological function in context of soil fertility is key to understanding ecological mechanisms maintaining agroecosystems sustainability.

Liu, Wenjing↗

An Efficient Three-Dimensional CFD-Based Numerical Wave Tank for a Wave Energy Converter in Extreme Irregular Waves

A numerical wave tank approach for computational fluid dynamics (CFD) modelling of an extreme irregular seastate is presented. The technique couples a potential flow solution with a CFD solver for more efficient numerical predictions. This method has recently become attractive both for the research community and the industry working with offshore structures. The model is used to determine the response of a submerged pressure differential wave energy converter (WEC) in a fully nonlinear irregular wave condition using the high-fidelity CFD code, STAR-CCM+. Potential flow based numerical models are commonly used to predict motions and performance of wave energy converters. Wave kinematics can deviate from potential flow predictions for extreme wave conditions; the excitation loads on an absorber can also be increasingly influenced by viscous effects, not predicted by potential flow engineering level models. In these extreme conditions, a Reynolds-averaged Navier-Stokes CFD model can better predict motions and loads for a WEC. Long time series with varying random seed numbers can be used to identify singular extreme wave events from a stochastic irregular sea state. This approach simulates a more realistic wave series for a given sea state than a regular wave or a focused wave. However, it is computationally infeasible to run these long time series for three-dimensional (3D) CFD simulations. In this work, two-dimensional (2D) CFD simulations with a long domain allow the full development of an extreme nonlinear wave condition. The results are used to identify extreme events from a 50-year storm condition for the PacWave site off the coast of Oregon. A relatively short time window including this extreme event is then mapped to a 3D simulation using a user defined wave methodology. Convergence studies for domain length, wave forcing lengths, and time before the extreme event were conducted.

CFD↗

An Efficient Three-Dimensional CFD-Based Numerical Wave Tank for a Wave Energy Converter in Extreme Irregular Waves: Preprint

A numerical wave tank approach for computational fluid dynamics (CFD) modelling of an extreme irregular seastate is presented. The technique couples a potential flow solution with a CFD solver for more efficient numerical predictions. This method has recently become attractive both for the research community and the industry working with offshore structures. The model is used to determine the response of a submerged pressure differential wave energy converter (WEC) in a fully nonlinear irregular wave condition using the high fidelity CFD code, STAR-CCM+. Potential flow based numerical models are commonly used to predict motions and performance of wave energy converters. Wave kinematics can deviate from potential flow predictions for extreme wave conditions; the excitation loads on an absorber can also be increasingly influenced by viscous effects, not captured in engineering level models. In these extreme conditions, a Reynolds-averaged Navier-Stokes CFD model can better predict motions and loads for a WEC. Long time series with varying random seed numbers can be used to identify singular extreme wave events from a stochastic irregular sea state. This approach simulates a more realistic wave series for a given sea state than a regular wave or a focused wave. However, it is computationally infeasible to run these long time series for three-dimensional (3D) CFD simulations. In this work, two-dimensional (2D) CFD simulations with a long domain allow the full development of an extreme nonlinear wave condition. The results are used to identify extreme events from a 50-year storm condition for the PacWave site off the coast of Oregon. A relatively short time window including this extreme event is then mapped to a 3D simulation using a user defined wave methodology. Convergence studies for domain length, wave forcing lengths, and time before the extreme event were conducted.

cfd↗

Inferring Stochastic Rates from Heterogeneous Snapshots of Particle Positions

Many imaging techniques for biological systems—like fixation of cells coupled with fluorescence microscopy—provide sharp spatial resolution in reporting locations of individuals at a single moment in time but also destroy the dynamics they intend to capture. In this study, these snapshot observations contain no information about individual trajectories, but still encode information about movement and demographic dynamics, especially when combined with a well-motivated biophysical model. The relationship between spatially evolving populations and single-moment representations of their collective locations is well-established with partial differential equations (PDEs) and their inverse problems. However, experimental data is commonly a set of locations whose number is insufficient to approximate a continuous-in-space PDE solution. Here, motivated by popular subcellular imaging data of gene expression, we embrace the stochastic nature of the data and investigate the mathematical foundations of parametrically inferring demographic rates from snapshots of particles undergoing birth, diffusion, and death in a nuclear or cellular domain. Toward inference, we rigorously derive a connection between individual particle paths and their presentation as a Poisson spatial process. Using this framework, we investigate the properties of the resulting inverse problem and study factors that affect quality of inference. One pervasive feature of this experimental regime is the presence of cell-to-cell heterogeneity. Rather than being a hindrance, we show that cell-to-cell geometric heterogeneity can increase the quality of inference on dynamics for certain parameter regimes. Altogether, the results serve as a basis for more detailed investigations of subcellular spatial patterns of RNA molecules and other stochastically evolving populations that can only be observed for single instants in their time evolution.

59 BASIC BIOLOGICAL SCIENCES↗

Two-Stage Estimation and Variance Modeling for Latency-Constrained Variational Quantum Algorithms

The quantum approximate optimization algorithm (QAOA) has enjoyed increasing attention in noisy, intermediate-scale quantum computing with its application to combinatorial optimization problems. QAOA has the potential to demonstrate a quantum advantage for NP-hard combinatorial optimization problems. As a hybrid quantum-classical algorithm, the classical component of QAOA resembles a simulation optimization problem in which the simulation outcomes are attainable only through a quantum computer. The simulation that derives from QAOA exhibits two unique features that can have a substantial impact on the optimization process: (i) the variance of the stochastic objective values typically decreases in proportion to the optimality gap, and (ii) querying samples from a quantum computer introduces an additional latency overhead. In this paper, we introduce a novel stochastic trust-region method derived from a derivative-free, adaptive sampling trust-region optimization method intended to efficiently solve the classical optimization problem in QAOA by explicitly taking into account the two mentioned characteristics. The key idea behind the proposed algorithm involves constructing two separate local models in each iteration: a model of the objective function and a model of the variance of the objective function. Exploiting the variance model allows us to restrict the number of communications with the quantum computer and also helps navigate the nonconvex objective landscapes typical in QAOA optimization problems. In conclusion, we numerically demonstrate the superiority of our proposed algorithm using the SimOpt library and Qiskit when we consider a metric of computational burden that explicitly accounts for communication costs.

Derivative-free Optimization↗

A Simulation Framework for Analyzing the Impact of Stochastic Occupant Behaviors on Demand Flexibility in Typical Commercial Buildings

As one of the primary users of the electric grid, buildings and building equipment, including heating, ventilation, and air conditioning (HVAC) systems, can be leveraged to provide the flexible demand needed to balance the grid. Typical strategies to achieve demand flexibility are to reduce electricity use during peak or critical periods by shutting down equipment or relaxing system setpoints, which will inevitably impact the occupants’ comfort. When occupants feel uncomfortable, they may take actions to regain their comfort, and some of those actions (such as turning on a personal fan) may have a negative impact on meeting the demand response goal. Therefore, it is important to incorporate occupant behaviors into the assessment ofthe building demand flexibility potential. In this study, a simulation framework that includes simulation of zone thermal loads, an HVAC system, and occupant behaviors, was developed to investigate the impact of occupant behaviors on demand flexibility. A case study was conducted using a small office model from the U.S. Department of Energy (DOE) Commercial Prototype Building Models to simulate the building envelope and zone loads. An agent-based occupant thermal behavior model was adapted to forecast occupants’ thermal comfort and their resulting thermal behaviors. An artificial neural network (ANN) based airflow model trained from a computational fluid dynamics (CFD) model of the zone was adopted to better predict the ambient environment of each occupant. An air-source heat pump simulation model that was calibrated from a real two-stage air-source heat pump system was used as the HVAC system. A typical load shedding event during peak hours was studied. Repeated simulations were conducted to capture the stochastic effects of occupant behaviors. The interplay between the demand flexibility, occupant comfort and behavior were analyzed by evaluating key performance indicators, including the energy use, occupant discomfort duration, and occupant behavior duration during the peak period. The results suggest that this framework can be used to analyze typical commercial buildings and their HVAC systems in terms ofdemand flexibility potential under the impact of occupant behaviors.

Chen, Zhelun↗

Acoustic Tomography of the Atmosphere: A Large-Eddy Simulation Sensitivity Study

Accurate measurement of atmospheric turbulent fluctuations is critical for understanding environmental dynamics and improving models in applications such as wind energy. Advanced remote sensing technologies are essential for capturing instantaneous velocity and temperature fluctuations. Acoustic tomography (AT) offers a promising approach that utilizes sound travel times between an array of transducers to reconstruct turbulence fields. This study presents a systematic evaluation of the time-dependent stochastic inversion (TDSI) algorithm for AT using synthetic travel-time measurements derived from large-eddy simulation (LES) fields under both neutral and convective atmospheric boundary-layer conditions. Unlike prior work that relied on field observations or idealized fields, the LES framework provides a ground-truth atmospheric state, enabling quantitative assessment of TDSI retrieval reliability, sensitivity to travel-time measurement noise, and dependence on covariance model parameters and temporal data integration. A detailed sensitivity analysis was conducted to determine the best-fit model parameters, identify the tolerance thresholds for parameter mismatch, and establish a maximum spatial resolution. The TDSI algorithm successfully reconstructed large-scale velocity and temperature fluctuations with root mean square errors ( RMSE s) below 0.35 m/s and 0.12 K, respectively. Spectral analysis established a maximum spatial resolution of approximately 1.4 m, and reconstructions remained robust for travel-time measurement uncertainties up to 0.002 s. These findings provide critical insights into the operational limits of TDSI and inform future applications of AT for atmospheric turbulence characterization and system design.

17 WIND ENERGY↗

Optimization under uncertainty of a hybrid waste tire and natural gas feedstock flexible polygeneration system using a decomposition algorithm

Market uncertainties motivate the development of flexible polygeneration systems that are able to adjust operating conditions to favor production of the most profitable product portfolio. However, this operational flexibility comes at the cost of higher capital expenditure. A scenario-based two-stage stochastic nonconvex Mixed-Integer Nonlinear Programming (MINLP) approach lends itself naturally to optimizing these trade-offs. This work studies the optimal design and operation under uncertainty of a hybrid feedstock flexible polygeneration system producing electricity, methanol, dimethyl ether, olefins or liquefied (synthetic) natural gas. A recently developed C++ based software framework (named GOSSIP) is used for modeling the optimization problem as well as its efficient solution using the Nonconvex Generalized Benders Decomposition (NGBD) algorithm. Two different cases are studied: The first uses estimates of the means and variances of the uncertain parameters from historical data, whereas the second assesses the impact of increased uncertain parameter volatility. The value of implementing flexible designs characterized by the value of the stochastic solution (VSS) is in the range of 260–405 M$ for a scale of approximately 893 MW of thermal input. Increased price volatility around the same mean results in higher expected net present value and VSS as operational flexibility allows for asymmetric exploitation of price peaks.

42 ENGINEERING↗

Combining Simulation and Optimization to Derive Operating Policies for a Concentrating Solar Power Plant

Optimizing short-term decisions over a rolling horizon and/or using deterministic penalties to capture system stochasticity can lead to myopic policies that fail to consider unplanned events and their long-term adverse effects. We present a methodology that integrates an off-line optimization model with a simulation procedure to determine the profitability of different operating strategies; specifically, the latter is used to generate additional constraints for the former when failures occur according to system component operating lifetimes that (i) are subject to exogenous uncertainty, and (ii) may degrade more quickly under specific operating conditions. We use the feedback provided by the simulation model in a parametric analysis to obtain penalties that can be used in short-term operations scheduling to maximize the long-term revenues obtained by the optimization model. We apply this research to a concentrating solar power plant; our results show that the methodology can be used to choose an operating policy that balances maximizing profit while accounting for maintenance costs. Integrating the optimization model with a simulation procedure reveals that aggressive prices for cycling yield about 55% fewer startups and 30% fewer failures compared to using a more typical start-up operating strategy, and can save hundreds of thousands to millions of dollars in repair costs over the lifetime of the plant.

concentrating solar power↗

Neural network-based model of galaxy power spectrum: fast full-shape galaxy power spectrum analysis

ABSTRACT We present a neural network-based emulator for the galaxy redshift-space power spectrum that enables several orders of magnitude acceleration in the galaxy clustering parameter inference, while preserving 3$\sigma$ accuracy better than 0.5 per cent up to $k_{\mathrm{max}}$ = 0.25 $\, h\text{Mpc}^{-1}$ within Lambda-cold dark matter ($\Lambda$CDM) and around 0.5 per cent $w_0$–$w_a$CDM. Our surrogate model only emulates the galaxy bias-invariant terms of one-loop perturbation theory predictions, these terms are then combined analytically with galaxy bias terms, counter-terms, and stochastic terms in order to obtain the non-linear redshift-space galaxy power spectrum. This allows us to avoid any galaxy bias prescription in the training of the emulator, which makes it more flexible. Moreover, we include the redshift $z \in [0,1.4]$ in the training which further avoids the need for re-training the emulator. We showcase the performance of the emulator in recovering the cosmological parameters of $\Lambda$CDM by analysing the suite of 25 AbacusSummit simulations that mimic the Dark Energy Spectroscopic Instrument luminous red galaxies at $z=0.5$ and 0.8, together as the emission line galaxies at $z=0.8$. We obtain similar performance in all cases, demonstrating the reliability of the emulator for any galaxy sample at any redshift in $0 \lt z \lt 1.4$. We will make our emulator public at github repository.

Trusov, Svyatoslav (ORCID:0000000224146720)↗

A Multi-Stage Stochastic Risk Assessment With Markovian Representation of Renewable Power

Probabilistic forecasts provide a distribution of possible outputs and so can capture the uncertainty and variability of Variable Renewable Energy (VRE). However, taking advantage of uncertainty information has practical challenges that make it difficult to integrate probabilistic forecasting into control room decision-making. This paper proposes a novel use-case for probabilistic forecasts by incorporating them into the hour-ahead operations for situational awareness via a risk-averse multi-stage stochastic program. We employ a Markovian representation of the probabilistic forecasts that enables the formulation of the multi-stage problem and avoids a scenario generation phase. We test the model on a realistically sized system to assess risk and showcase the capability of using probabilistic renewable forecast as input to produce probabilistic output forecasts of future system states. The results show that the model can capture time consistency in the reserves and Area Control Error (ACE) forecast. The solution times are adequate for risk profiling in hour-ahead timescales.

forecasting↗

Fast Computational Algorithms for Partial Differential Equations and Uncertainty Quantifications

This project concerned the construction, testing and analysis of computational algorithms for solving parameterized and stochastic partial differential equations. The study and understanding of equations of this type is of fundamental importance in numerous engineering and scientific applications. Examples include simulation of plasma dynamics in models of electric propulsion and nuclear fusion, simulation of multiphase flows, such as the flow of water, gas and oil in reservoirs, and structural analysis of the dependence of structures on materials. Parametrization is used in such settings when properties of the models such as viscosity of fluids or electric resistivity of materials are not precisely understood and instead are treated as random variables. The resulting solutions are themselves random, and having such solutions will enable engineers to use probabilistic methods to assess the likelihood of events, for example, whether a pollutant in a liquid will exceed a limit, and to use such analyses to develop ways to ensure positive outcomes. Construction of accurate (high resolution) computational solutions is expensive, requiring significant computer time and computational resources, and there is need to reduce computational cost to make simulation useful and effective. The aim of the project was to construct algorithms to efficiently compute surrogate solutions to parameterized problems to allow for efficient and accurate simulation. The technical approach used focused on two related strategies, based on rank-reduction methods and reduced-order models. These methods construct surrogate solutions of parameter-dependent models by projection or interpolation into low-dimensional approximation spaces. Cost savings are achieved if the low-dimensional spaces can be identified and constructed efficiently and if the resulting low-dimensional algebraic systems can be solved cheaply. Accomplishments include: Theoretical and empirical demonstration of the effectiveness of fast multigrid solution strategies for computing low-rank representations of parameter-dependent solutions to discrete partial differential equations, including the first proof establishing so-called textbook convergence properties for low-rank methods. Development of efficient solution algorithms for solving nonlinear parameter-dependent partial differential equations used in models of fluid dynamics. Developent of efficient algorithms for low-rank representation of solutions of time-dependent simulations of fluid dynamics using multi-dimensional tensor representations of solutions.

97 MATHEMATICS AND COMPUTING↗

Residuals-based distributionally robust optimization with covariate information

We consider data-driven approaches that integrate a machine learning prediction model within distributionally robust optimization (DRO) given limited joint observations of uncertain parameters and covariates. Our framework is flexible in the sense that it can accommodate a variety of regression setups and DRO ambiguity sets. We investigate asymptotic and finite sample properties of solutions obtained using Wasserstein, sample robust optimization, and phi-divergence-based ambiguity sets within our DRO formulations, and explore cross-validation approaches for sizing these ambiguity sets. Through numerical experiments, we validate our theoretical results, study the effectiveness of our approaches for sizing ambiguity sets, and illustrate the benefits of our DRO formulations in the limited data regime even when the prediction model is misspecified.

97 MATHEMATICS AND COMPUTING↗

Development and Integration of Predictive Models for Manufacturing and Structural Performance of Carbon Fiber Composites in Automotive Applications (Final Report)

The goal of this project is to develop integrated, state-of-the-art, computational modeling tools based on an integrated computational materials engineering (ICME) methodology that are critically needed to enable structural carbon fiber (CF) applications in automobiles. These tools are designed to predict the manufacturing and structural performance of CF composites, including stochastic effects. During the first phase of the project, the manufacturing and structural performance tools, including a stochastic driver, were developed, calibrated, and validated against coupon and component level test results. For this project, from the manufacturing side, the development efforts were focused on high-pressure resin transfer molding (HP-RTM), a potentially game-changing manufacturing technology that is capable of reaching the 3-5-minute cycle time that is necessary for volume manufacturing of composites. On the structural performance side, the crashworthiness of CF structures was studied. Accordingly, computational tools were developed and validated. The resulting differences between the numerical predictions and the experimental results in the first phase of the project were required to be less than 15%. During the second phase of the project, the manufacturing and performance tools were integrated by mapping the manufacturing outcomes (e.g., fiber angles, residual stresses, degree of cure, and defects) into the structural models. Also, using the tools developed in this project, an automotive assembly currently manufactured in steel (2016 GM Malibu) was redesigned to be manufactured using advanced CF composites with the objective of comparing the performance of the CF assembly with the developed ICME model predictions. The weight, performance and cost of the CF assembly were compared with the baseline steel assembly as well. The CF underbody design was shown to be 30% lighter than the corresponding steel design. The CF underbody assembly withstood the side pole impact with less than half the intrusion for the steel assembly. Excellent correlations within 10% for both peak impact load and intrusion were observed between the numerical predictions and experimental results. Based on the cost models developed in the project, the cost increase per Kg saved was determined to be $22. The project team has prepared a total of 28 publications in various journals and conferences and broadly communicated the project results for the benefit of the composite industry. The project team has also prepared a total of 10 patent applications that were submitted to the US Patent and Trademark office.

36 MATERIALS SCIENCE↗

Minimum entropy filtering for a single output non-Gaussian stochastic system using state transformation

This paper presents a novel filter design for the single-output stochastic non-linear systems subjected to non-Gaussian noises and the proposed assumptions. Based on a state transformation, the unmeasurable states of the systems can be estimated where non-linear terms in the systems have been eliminated. It has been shown that the estimation error is linearly dynamical regarding to the presented vector-valued filter gain which can be optimised by minimising the entropy-based performance criterion. In addition, the convergence of the presented algorithm is analysed in mean-square sense and a numerical example is given to verify the effectiveness of the presented filtering algorithm. Meanwhile, the extended Kalman filter, unscented particle filter and minimum entropy filter are given for the comparisons of the filtering performance. Following the presented framework, some extensions of the presented filtering algorithm are discussed to indicate the flexibility of the filter design. The contribution of this paper can be summarised as establishing a novel minimum entropy filtering framework which consists of model transformation, entropy optimisation and convergence analysis.

42 ENGINEERING↗

Constraining multi-field inflation using the SPHEREx all-sky survey power spectra

Abstract We investigate how well the SPHEREx all-sky survey can constrain local primordial non-Gaussianity beyond the parameterf NL using galaxy power spectra. We forecast joint constraints on the parametersf NL ,g NL andτ NL obtained assuming a simple two-field curvaton model of inflation. The parametersf NL andg NL characterise the squeezed limits of the primordial bispectrum and trispectrum respectively, and lead to a characteristic scale-dependence of the galaxy bias that increases out to arbitrarily large scales. Values of the parameterτ NL > (6/5f NL ) 2 cause the galaxy power spectrum to have a stochastic component which also increases out to arbitrarily large scales. Our MCMC forecasts indicate that SPHEREx can provide joint constraints on any two of the three parametersf NL ,g NL andτ NL . Due to strong degeneracies among these parameters, measurements of the galaxy power spectra alone may not be sufficient to jointly constrain all three. Constraints onf NL ,g NL andτ NL obtained from galaxy power spectrum observations depend on the modelling of underlying nuisance parameters. We study the robustness of our forecast constraints to modelling choices and note that even with relatively conservative modelling assumptions, SPHEREx galaxy power spectra can provide strong evidence of local non-Gaussianity, even if the particular values off NL andg NL cannot be measured precisely.

Astronomy & Astrophysics↗