Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic modelling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Stochastic Distribution Control Theory-Its Potential Application in Risk Management in Financial Systems

Stochastic Distribution Control (SDC) theory [1], originated by the author in 1996, aims at developing modeling and control strategies for dynamic and non-Gaussian stochastic systems by controlling the shape of the probability density functions of some concerned variables and parameters in stochastic systems. It generalizes the capability of standard stochastic differential equations and can therefore be applied to generic non-Gaussian systems. Since it was established in 1996, it has found a wide spectrum of applications in non-Gaussian stochastic system control, data mining, filtering and optimization for uncertain systems. In this short opinion article, discussions will be made on potential applications of SDC theory to financial systems in terms of risk analysis and management.

97 MATHEMATICS AND COMPUTING↗

Potential Vorticity Mixing in a Tangled Magnetic Field

A theory of potential vorticity (PV) mixing in a disordered (tangled) magnetic field is introduced. The analysis is in the context of β -plane MHD, with a special focus on the physics of momentum transport in the stably stratified, quasi-2D solar tachocline. A physical picture of mean PV evolution by vorticity advection and tilting of magnetic fields is proposed. In the case of weak field perturbations, quasi-linear theory predicts that the Reynolds and magnetic stresses balance as turbulence Alfvénizes for a larger mean magnetic field. Jet formation is explored quantitatively in the mean field–resistivity parameter space. However, since even a modest mean magnetic field leads to large magnetic perturbations for large magnetic Reynolds number, the physically relevant case is that of a strong but disordered field. We show that numerical calculations indicate that the Reynolds stress is modified well before Alfvénization—i.e., before fluid and magnetic energies balance. To understand these trends, a double-average model of PV mixing in a stochastic magnetic field is developed. Calculations indicate that mean-square fields strongly modify Reynolds stress phase coherence and also induce a magnetic drag on zonal flows. The physics of transport reduction by tangled fields is elucidated and linked to the related quench of turbulent resistivity. We propose here a physical picture of the system as a resisto-elastic medium threaded by a tangled magnetic network. Applications of the theory to momentum transport in the tachocline and other systems are discussed in detail.

79 ASTRONOMY AND ASTROPHYSICS↗

Coupling Warm Rain With an Eddy Diffusivity/Mass Flux Parameterization: 1. Model Description and Validation

A new version of the stochastic multiplume Jet Propulsion Laboratory Eddy-Diffusivity/Mass-Flux (JPL-EDMF) parameterization which consistently couples the simplified Khairoutdinov and Kogan (2000), https://doi.org/10.1175/1520-0493(2000)128<0229:ANCPPI>2.0.CO;2, warm phase cloud microphysical parameterization with the parameterization of cloud macrophysical and subgrid scale dynamical processes is described. The new parameterization combines the EDMF approach with an assumed shape of a joint probability density function of thermodynamic and kinematic variables which provide the basis for the computation of all parameterized processes. As far as we are aware this is the first attempt to consistently couple all of these parameterized processes in the EDMF framework. This paper is part one of a two paper series. Here, the JPL-EDMF parameterization is described and benchmark simulations of precipitating stratocumulus and cumulus convection are performed in a single-column-model framework. The parameterization results compare favorably to the reference large-eddy-simulation results. In the second part (Smalley et al., 2022, https://doi.org/10.1029/2021MS002729) the JPL-EDMF parameterization is validated for a wide range of observation-based scenarios covering the continuous transition from subtropical stratocumulus to cumulus convection derived from global reanalysis, and parameterization uncertainties are studied in detail.

54 ENVIRONMENTAL SCIENCES↗

Modeling occupancy-driven building loads for large and diversified building stocks through the use of parametric schedules

Building energy modeling provides a fundamental tool to assess the potential for energy efficiency to contribute to reducing world energy consumption and global emissions. Occupancy-related operations are a key source of uncertainty for building energy analysis, particularly for aggregated building stocks. At a district or city level, it is critical to estimate aggregated power load profiles for sizing power grid infrastructure, power plant capacity allocation, and energy efficiency measures. The stochastic nature of behavior-related operations complicates the creation of models that accurately capture building load profiles for entire building stocks. This research introduces a new methodology called parametric schedules to model occupancy-driven schedules for large and diverse building stocks. In contrast to computationally expensive methodologies proposed in the literature, our work does not use a recursive time-consuming step. Occupancy is estimated by the extrapolation of operation times directly from metered electric consumption data; occupancy-related schedules are stochastically assigned to each building model, guaranteeing diversity of operation times in the stock. Our procedure has been tested on a large, diversified data-set of 25,000 commercial buildings in Los Angeles, California. It proved to be able to adequately represent the stochastic schedules diversity of the stock and to refine the stock calibration process by 1%. This innovative approach represents a useful asset for utility companies, grid operators, urban planners, and balancing authorities, seeking to improve building stock modeling and better estimate the impact of energy conservation measures. – This work is part of a larger stock modeling tool called ComStock, which is under development by NREL.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Towards Fully Secure 5G Ultra-Low Latency Communications: A Cost-Security Functions Analysis

Future components to enhance the basic, native security of 5G networks are either complex mechanisms whose impact in the requiring 5G communications are not considered, or lightweight solutions adapted to ultra-reliable low-latency communications (URLLC) but whose security properties remain under discussion. Although different 5G network slices may have different requirements, in general, both visions seem to fall short at provisioning secure URLLC in the future. In this work we address this challenge, by introducing cost-security functions as a method to evaluate the performance and adequacy of most developed and employed non-native enhanced security mechanisms in 5G networks. We categorize those new security components into different groups according to their purpose and deployment scope. We propose to analyze them in the context of existing 5G architectures using two different approaches. First, using model checking techniques, we will evaluate the probability of an attacker to be successful against each security solution. Second, using analytical models, we will analyze the impact of these security mechanisms in terms of delay, throughput consumption, and reliability. Finally, we will combine both approaches using stochastic cost-security functions and the PRISM model checker to create a global picture. Our results are first evidence of how a 5G network that covers and strengthened all security areas through enhanced, dedicated non-native mechanisms could only guarantee secure URLLC with a probability of ~55%.

5G networks↗

Priors on red galaxy stochasticity from hybrid effective field theory

ABSTRACT We investigate the stochastic properties of typical red galaxy samples in a controlled numerical environment. We use halo occupation distribution (HOD) modelling to create mock realizations of three separate bright red galaxy samples consistent with data sets used for clustering and lensing analyses in modern galaxy surveys. Second-order Hybrid Effective Field Theory (HEFT) is used as a field-level forward model to describe the full statistical distribution of these tracer samples, and their stochastic power spectra are directly measured and compared to the Poisson shot-noise prediction. While all of the galaxy samples we consider are hosted within haloes with sub-Poisson stochasticity, we observe that the galaxy samples themselves possess stochasticities that range from sub-Poisson to super-Poisson, in agreement with predictions from the halo model. As an application of our methodology, we place priors on the expected degree of non-Poisson stochasticity in cosmological analyses using such samples. We expect these priors will be useful in reducing the complexity of the full parameter space for future analyses using second-order Lagrangian bias models. More generally, the techniques outlined here present the first application of HEFT methods to characterize models of the galaxy–halo connection at the field level, revealing new connections between once-disparate modelling frameworks.

79 ASTRONOMY AND ASTROPHYSICS↗

Bias-Variance Trade-Off in Physics-Informed Neural Networks with Randomized Smoothing for High-Dimensional PDEs

Physics-Informed Neural Networks (PINNs) have triggered a paradigm shift in scientific computing, leveraging mesh-free properties and robust approximation capabilities. While proving effective for low-dimensional partial differential equations (PDEs), the computational cost of PINNs remains a hurdle in high-dimensional scenarios. This is particularly pronounced when computing high-order and high-dimensional derivatives in the physics-informed loss. Randomized Smoothing PINN (RS-PINN) introduces Gaussian noise for stochastic smoothing of the original neural net model, enabling the use of Monte Carlo methods for derivative approximation, which eliminates the need for costly automatic differentiation. Despite its computational efficiency, especially in the approximation of high-dimensional derivatives, RS-PINN introduces biases in both loss and gradients, negatively impacting convergence, especially when coupled with stochastic gradient descent (SGD) algorithms. We present a comprehensive analysis of biases in RS-PINN, attributing them to the nonlinearity of the Mean Squared Error (MSE) loss as well as the intrinsic nonlinearity of the PDE itself. We propose tailored bias correction techniques, delineating their application based on the order of PDE nonlinearity. The derivation of an unbiased RS-PINN allows for a detailed examination of its advantages and disadvantages compared to the biased version. Specifically, the biased version has a lower variance and runs faster than the unbiased version, but it is less accurate due to the bias. To optimize the bias-variance trade-off, we combine the two approaches in a hybrid method that balances the rapid convergence of the biased version with the high accuracy of the unbiased version. In addition to methodological contributions, we present an enhanced implementation of RS-PINN. Extensive experiments on diverse high-dimensional PDEs, including Fokker-Planck, Hamilton-Jacobi-Bellman (HJB), viscous Burgers’, Allen-Cahn, and Sine-Gordon equations, illustrate the bias-variance trade-off and highlight the effectiveness of the hybrid RS-PINN. Empirical guidelines are provided for selecting biased, unbiased, or hybrid versions, depending on the dimensionality and nonlinearity of the specific PDE problem.

97 MATHEMATICS AND COMPUTING↗

Simulating High-Frequency Seismograms in Realistic Earth Models to Better Understand Source Discrimination Based on Differential Magnitudes ( M L− M c)

Discriminating low-yield underground nuclear explosions from small earthquakes is a key task in monitoring nuclear test ban treaties. P/S amplitude ratios have been an effective discriminant for moderate-sized events recorded at regional distances, but it is unclear if they are as effective in discriminating small seismic events recorded at local distances (<150 km). The difference between local magnitude (M L ) and coda duration magnitude (M c ) has been proposed as a new discriminant that may complement P/S amplitude ratios at local distances. Here, in this work, we calculate high-frequency (up to ∼4 Hz) synthetic seismograms at epicentral distances of 0–30 km in realistic models of the Salt Lake basin (Utah, United States) to better understand how variations in source type and depth affect M L −M c values. The Earth models incorporate simplified 1D and deterministic 3D structures, small-wavelength stochastic velocity perturbations, and surface topography. Coda waves are enhanced for the more complicated models compared to the base 1D model, but still underpredict observed durations by about a factor of two, which results in overprediction of amplitude to duration ratios (i.e., M L −M c values) for a near-surface explosion and a 7 km deep earthquake. For both source types, the predicted M L and M c values decrease as source depth increases, and M L −M c shows only minor variation with depth; however, M L −M c is on average ∼0.5 units smaller for explosions than earthquakes. This finding may imply that M L −M c has sensitivity to source type, in addition to being a depth discriminant, but more modeling is needed given the limitations of the current study. Future modeling should incorporate higher-frequency (≳5 Hz) simulations over a larger distance range (0–150 km), where M L and M c are commonly measured, while honoring low shear velocities (<300 m/s) near the surface and sampling a wider range of earthquake and explosion source mechanisms.

Hutchings, Sean J. [Univ. of Utah, Salt Lake City,↗

Resilient Observer Design for Cyber-Physical Systems with Data-Driven Measurement Pruning

Resilient observer design for Cyber-Physical Systems (CPS) in the presence of adversarial false data injection attacks (FDIA) is an active area of research. The existing state-of-the-art algorithms tend to break down as more and more knowledge of the system is built into the attack model; also as the percentage of attacked nodes increases. From the view of optimization theory, the problem is often cast as a classical error correction problem for which a theoretical limit of has been established as the maximum percentage attacked nodes for which state recovery is guaranteed. Beyond this limit, the performance of -minimization based schemes, for instance, deteriorates rapidly. Similar performance degradation occurs for other types of resilient observers beyond certain percentages of attacked nodes. In order to increase the corresponding percentage of attacked nodes for which state recoveries can be guaranteed, researchers have begun to incorporate prior information into the underlying resilient observer design framework. For the most pragmatic cases, this prior information is often obtained through a data-driven machine learning process. Existing results have shown a strong positive correlation between the maximum attacked percentages that can be tolerated and the accuracy of the data-driven model. Motivated by these results, this chapter examines the case for pruning algorithms designed to improve the Positive Prediction Value (PPV) of the resulting prior information, given stochastic uncertainty characteristics of the underlying machine learning model. Theoretical quantification of the achievable improvement is given. Simulation results show that the pruning algorithm significantly increases the maximum correctable percentage of attacked nodes, even for machine learning model whose prediction power is comparable to the random flip of a coin.

Resilient Observer, Cyber-physical Systems, Data-D↗

Development of a Physics-Based Combustion Model for Engine Knock Prediction

The objective of this project is to improve the prediction of engine knock by developing a new combustion modeling framework. Engine knock is a limiting factor to constrain the increase of fuel efficiency for spark ignition (SI) engines in most passenger cars. Efforts to increase fuel efficiency, increasing the compression ratio or downsizing, lead to the increase in the tendency of the knock occurrence. The knock is an undesired ignition of the end-gas, unburned fuel/air mixture ahead of the spark-ignited premixed flame, resulting in rapid in-cylinder pressure rises and engine damages. The combustion modeling framework developed in this project can consider turbulence-chemistry interactions during end-gas ignition, while using a reasonably detailed chemical mechanism developed for ignition and combustion reactions under engine relevant conditions, and the subtle characteristics of spark-ignited flame propagation. It is developed in the context of large eddy simulation (LES), which can capture stochastic in-cylinder processes. The developed model is incorporated into a commercial software for engine simulation, CONVERGE CFD, as a user defined function, and validated. Engine knock and knock-free experiments as well as direct numerical simulation (DNS) of end-gas ignition in homogeneous turbulence are performed to help model development and provide data sets for model validation. With further validation, the developed model is expected to advance the predictive capability for engine knock simulations and thus contribute to improving the fuel efficiency.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Development of a Physics-Based Combustion Model for Engine Knock Prediction

The objective of this project is to improve the prediction of engine knock by developing a new combustion modeling framework. Engine knock is a limiting factor to constrain the increase of fuel efficiency for spark ignition (SI) engines in most passenger cars. Efforts to increase fuel efficiency, increasing the compression ratio or downsizing, lead to the increase in the tendency of the knock occurrence. The knock is an undesired ignition of the end-gas, unburned fuel/air mixture ahead of the spark-ignited premixed flame, resulting in rapid in-cylinder pressure rises and engine damages. The combustion modeling framework developed in this project can consider turbulence-chemistry interactions during end-gas ignition, while using a reasonably detailed chemical mechanism developed for ignition and combustion reactions under engine relevant conditions, and the subtle characteristics of spark-ignited flame propagation. It is developed in the context of large eddy simulation (LES), which can capture stochastic in-cylinder processes. The developed model is incorporated into a commercial software for engine simulation, CONVERGE CFD, as a user defined function, and validated. Engine knock and knock-free experiments as well as direct numerical simulation (DNS) of end-gas ignition in homogeneous turbulence are performed to help model development and provide data sets for model validation. With further validation, the developed model is expected to advance the predictive capability for engine knock simulations and thus contribute to improving the fuel efficiency.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Adaptive experimental design for multi-fidelity surrogate modeling of multi-disciplinary systems

We present an adaptive algorithm for constructing surrogate models of multi-disciplinary systems composed of a set of coupled components. With this goal we introduce “coupling” variables with a priori unknown distributions that allow surrogates of each component to be built independently. Once built, the surrogates of the components are combined to form an integrated-surrogate that can be used to predict system-level quantities of interest at a fraction of the cost of the original model. The error in the integrated-surrogate is greedily minimized using an experimental design procedure that allocates the amount of training data, used to construct each component-surrogate, based on the contribution of those surrogates to the error of the integrated-surrogate. Here, the multi-fidelity procedure presented is a generalization of multi-index stochastic collocation that can leverage ensembles of models of varying cost and accuracy, for one or more components, to reduce the computational cost of constructing the integrated-surrogate. Extensive numerical results demonstrate that, for a fixed computational budget, our algorithm is able to produce surrogates that are orders of magnitude more accurate than methods that treat the integrated system as a black-box.

42 ENGINEERING↗

Conditional Karhunen-Loève expansion for uncertainty quantification and active learning in partial differential equation models

We use a conditional Karhunen-Lo` eve (KL) model to quantify and reduce uncertainty in a stochastic partial differential equation (SPDE) problem with partially-known space-dependent coefficient, Y (x). We assume that a small number of Y (x) measurements are available and model Y (x) with a KL expansion. We achieve reduction in uncertainty by conditioning the KL expansion coefficients on measurements. We consider two approaches for conditioning the KL expansion: In Approach 1, we condition the KL model first and then truncate it. In Approach 2, we first truncate the KL expansion and then condition it. We employ the conditional KL expansion together with Monte Carlo and sparse grid collocation methods to compute the moments of the solution of the SPDE problem. Uncertainty of the problem is further reduced by adaptively selecting additional observation locations using two active learning methods. Method 1 minimizes the variance of the PDE coefficient, while Method 2 minimizes the variance of the solution of the PDE. We demonstrate that conditioning leads to dimension reduction of the KL representation of Y (x). For a linear diffusion SPDE with uncertain log-normal coefficient, we show that Approach 1 provides a more accurate approximation of the conditional log-normal coefficient and solution of the SPDE than Approach 2 for the same number of random dimensions in a conditional KL expansion. Furthermore, Approach 2 provides a good estimate for the number of terms of the truncated KL expansion of the conditional field of Approach 1. Finally, we demonstrate that active learning based on Method 2 is more efficient for uncertainty reduction in the SPDE’s states (i.e., it leads to a larger reduction of the variance) than active learning using Method 2.

Conditioned Karhunen-Lo` eve expanion, machine lea↗

Loads on a Jacket-Supported Wind Turbine During Hurricane Sandy Simulation

Abstract The dynamic response of a jacket-supported offshore wind turbine under coupled wind, wave, and current fields during Hurricane Sandy is the subject of this study. To illustrate the detailed procedure related to the response evaluation of a 5-MW offshore wind turbine with a jacket support structure, we consider a single site where the water depth is 50 m. Loads are computed using two simulation tools, fast and abaqus, with partial coupling. Aerodynamic loads on the turbine rotor are first evaluated using a wind turbine model in fast with a fixed base; then, these rotor aerodynamic loads are applied as point loads at the top of a model of a tower that is supported by a jacket structure in abaqus. On the basis of stochastic simulations, we discuss the applicability of the abaqus jacket modeling and describe the characteristics and comparisons of the aerodynamic and hydrodynamic effects on loads on the jacket members. Details related to the structural model and soil–pile interaction model employed in the analyses are also discussed.

Engineering↗

Security Constrained Distributed Transaction Model for Multiple Prosumers

Massive access of renewable energy has prompted demand-side distributed resources to participate in regulation and improve flexibility of power systems. With large-scale access of massive, decentralized, and diverse distributed resources, demand-side market members have transformed from traditional “consumers” to “prosumers”. To explore the distributed transaction model of prosumers, in this paper, a multi-prosumer distributed transaction model is proposed, and the Conditional Value-at-Risk (CVaR) theory is applied to quantify potential risks caused by the stochastic characteristics inherited from renewable energy. First, a prosumer model under constraints of the distribution network including photovoltaic units, fuel cells, energy storage system, central air conditioning and flexible loads is established, and a multi-prosumer distributed transaction strategy is proposed to achieve power sharing among multiple prosumers. Second, a prosumer transaction model based on CVaR is constructed to measure risks inherited from the uncertainty of PV output within the prosumer and ensure safety of system operation in extreme PV output scenarios. Then, the alternating direction multiplier method (ADMM) is utilized to solve the constructed model efficiently. Finally, distributed transaction costs of prosumers are distributed fairly based on the generalized Nash equilibrium to maximize social benefits. Simulation results show the multi-prosumer distributed transaction mechanism established under the proposed generalized Nash equilibrium method can encourage power sharing among prosumers, increasing their own income and social benefits. Also, the CVaR can assist decision making of prosumers in weighting the risks and benefits, improving system resilience through energy management of prosumers.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Projecting the number of new HIV infections to formulate the "Getting to Zero" strategy in Illinois, USA

Objectives: Getting to Zero (GTZ) initiatives focus on expanding use of antiretroviral treatment (ART) and pre-exposure prophylaxis (PrEP) to eliminate new HIV infections. Computational models help inform policies for implementation of ART and PrEP continuums. Such models, however, vary in their design, and may yield inconsistent predictions. Using multiple approaches can help assess the consistency in results obtained from varied modeling frameworks, and can inform optimal implementation strategies. Methods: A study using three different modeling approaches is conducted. Two approaches use statistical time series analysis techniques that incorporate temporal HIV incidence data. A third approach uses stochastic stimulation, conducted using an agent-based network model (ABNM). All three approaches are used to project HIV incidence among a key population, young Black MSM (YBMSM), over the course of the GTZ implementation period (2016-2030). Results: All three approaches suggest that simultaneously increasing PrEP and ART uptake is likely to be more effective than increasing only one, but increasing ART and PrEP by 20% points may not eliminate new HIV infections among YBMSM. The results further suggest that a 20% increase in ART is likely to be more effective than a 20% increase in PrEP. All three methods consistently project that increasing ART and PrEP by 30% simultaneously can help reach GTZ goals. Conclusions: Increasing PrEP and ART uptake by about 30% might be necessary to accomplish GTZ goals. Such scale-up may require addressing psychosocial and structural barriers to engagement in HIV and PrEP care continuums. ABNMs and other flexible modeling approaches can be extended to examine specific interventions that address these barriers and may provide important data to guide the successful intervention implementation.

60 APPLIED LIFE SCIENCES↗

Permutation matrix representation quantum Monte Carlo

We present a quantum Monte Carlo algorithm for the simulation of general quantum and classical many-body models within a single unifying framework. The algorithm builds on a power series expansion of the quantum partition function in its off-diagonal terms and is both parameter-free and Trotter error-free. In our approach, the quantum dimension consists of products of elements of a permutation group. As such, it allows for the study of a very wide variety of models on an equal footing. To demonstrate the utility of our technique, we use it to clarify the emergence of the sign problem in the simulations of non-stoquastic physical models. We showcase the flexibility of our algorithm and the advantages it offers over existing state-of-the-art by simulating transverse- field Ising model Hamiltonians and comparing the performance of our technique against that of the stochastic series expansion algorithm. Furthermore, we also study a transverse-field Ising model augmented with randomly chosen two-body transverse-field interactions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗