Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “probability density function”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

The simulated catalogue of optical transients and correlated hosts (SCOTCH)

ABSTRACT As we observe a rapidly growing number of astrophysical transients, we learn more about the diverse host galaxy environments in which they occur. Host galaxy information can be used to purify samples of cosmological Type Ia supernovae, uncover the progenitor systems of individual classes, and facilitate low-latency follow-up of rare and peculiar explosions. In this work, we develop a novel data-driven methodology to simulate the time-domain sky that includes detailed modelling of the probability density function for multiple transient classes conditioned on host galaxy magnitudes, colours, star formation rates, and masses. We have designed these simulations to optimize photometric classification and analysis in upcoming large synoptic surveys. We integrate host galaxy information into the snana simulation framework to construct the simulated catalogue of optical transients and correlated hosts (SCOTCH, a publicly available catalogue of 5-million idealized transient light curves in LSST passbands and their host galaxy properties over the redshift range 0 < z < 3. This catalogue includes supernovae, tidal disruption events, kilonovae, and active galactic nuclei. Each light curve consists of true top-of-the-galaxy magnitudes sampled with high (≲2 d) cadence. In conjunction with SCOTCH, we also release an associated set of tutorials and transient-specific libraries to enable simulations of arbitrary space- and ground-based surveys. Our methodology is being used to test critical science infrastructure in advance of surveys by the Vera C. Rubin Observatory and the Nancy G. Roman Space Telescope.

Astronomy & Astrophysics↗
DOE OSTI2024

Emergence of the temperature–density relation in the low-density intergalactic medium

We examine the evolution of the phase diagram of the low-density intergalactic medium during the Epoch of Reionization in simulation boxes with varying reionization histories from the Cosmic Reionization on Computers project. The probability density function (PDF) of gas temperature at fixed density exhibits two clear modes: a warm and a cold temperature mode, corresponding to the gas inside and outside of ionized bubbles. We find that the transition between the two modes is ‘universal’ in the sense that its timing is accurately parametrized by the value of the volume-weighted neutral fraction for any reionization history. This ‘universality’ is more complex than just a reflection of the fact that ionized gas is warm and neutral gas is cold: it holds for the transition at a fixed value of gas density, and gas at different densities transitions from the cold to the warm mode at different values of the neutral fraction, reflecting a non-trivial relationship between the ionization history and the evolving gas density PDF. Furthermore, the ‘emergence’ of the tight temperature–density relation in the warm mode is also approximately ‘universally’ controlled by the volume-weighted neutral fraction for any reionization history. In particular, the ‘emergence’ of the temperature–density relation (as quantified by the rapid decrease in its width) occurs when the neutral fraction is 10 –4 ≲ X HI ≲ 10 –3 for any reionization history. Our results indicate that the neutral fraction is a primary quantity controlling the various properties of the temperature–density relation, regardless of reionization history.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

It is not σ 8 : constraining the non-linear matter power spectrum with the Dark Energy Survey Year-5 supernova sample

The weak gravitational lensing magnification of Type Ia supernovae (SNe Ia) is sensitive to the matter power spectrum on scales $k\gt 1 h$ Mpc$^{-1}$, making it unwise to interpret SNe Ia lensing in terms of power on linear scales. We compute the probability density function of SNe Ia magnification as a function of standard cosmological parameters, plus an empirical parameter $A_{\rm mod}$ which describes the suppression or enhancement of matter power on non-linear scales compared to a cold dark matter only model. While baryons are expected to enhance power on the scales relevant to SN Ia lensing, other physics such as neutrino masses or non-standard dark matter may suppress power. Using the Dark Energy Survey Year-5 sample, we find $A_{\rm mod} = 0.77^{+0.69}_{-0.40}$ (68 per cent credible interval around the median). Although the median is consistent with unity there are hints of power suppression, with $A_{\rm mod} \lt 1.09$ at 68 per cent credibility.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Impact of O4 future detections on the determination of the dense matter equations of state

Here, in view of the next LIGO-Virgo-KAGRA Observing period O4 (to start in Spring 2023), we address the question of the ability of the interferometers network to discriminate among different neutron stars equation of states better than what was possible with the observation of the binary neutron stars merger GW170817. We show that the observation of an event similar to GW170817 during O4 would allow us to resolve the dimensionless effective tidal deformability $\tilde{Λ}$ within an uncertainty 7 times better than the one obtained in O2. Thanks to the expected increase in sensitivities, we show that any GW170817-like single-event within a distance of 100 Mpc would imply significantly improved constraints of the neutron stars equations of state. We also illustrate the important impact of the noise in the analysis of the signal, showing how it can impact the effective tidal deformability probability density function for large signal-to-noise ratio.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Inverse Calculation of Burden Distribution Matrix Using B-spline Model Based PDF control in Blast Furnace Burden Charging Process

The inverse calculation of burden distribution matrix (BDM) is one of the most important challenges in the blast furnace operation in iron-making processes. In general, blast furnace consumes 65% of the total energy for the whole steel-making. Focusing on this practical challenge, this article proposes a new burden distribution spatial model in calculating burden charging process, and develops a B-spline approximation-based probability density function (PDF) control algorithm to assign the expected thickness distribution of burden layer and, thus, develops a new method for the required inverse calculation of BDM. First, a novel method for the thickness distribution of burden layer is given using B-spline model to produce an expected distribution shape subjected to a desired tracking within a specific spatial constraint. Then, according to the coexistence of continuous and bounded discrete variables in BDM, a novel hybrid optimization control method by combining integer programming and PDF tracking is further established for the effective inverse calculation of BDM. Finally, the proposed PDF-based iterative inverse calculation of BDM using B-spline models are tested using various data from industrial examples. Furthermore, the simulation results show that the proposed method is well suited to solve the BDM inverse calculation problem in practice.

42 ENGINEERING↗
DOE OSTI2021

Disaggregating Customer-Level Behind-the-Meter PV Generation Using Smart Meter Data and Solar Exemplars

Customer-level rooftop photovoltaic (PV) has been widely integrated into distribution systems. In most cases, PVs are installed behind-the-meter (BTM), and only the net demand is recorded. Therefore, the native demand and PV generation are unknown to utilities. Separating native demand and solar generation from net demand is critical for improving grid-edge observability. In this paper, a novel approach is proposed for disaggregating customer-level BTM PV generation using low-resolution but widely available hourly smart meter data. The proposed approach exploits the strong correlation between monthly nocturnal and diurnal native demands and the high similarity among PV generation profiles. First, a joint probability density function (PDF) of monthly nocturnal and diurnal native demands is constructed for customers without PVs, using Gaussian mixture modeling (GMM). Deviation from the constructed PDF is utilized to probabilistically assess the monthly solar generation of customers with PVs. Then, to identify hourly BTM solar generation for these customers, their estimated monthly solar generation is decomposed into an hourly timescale; to do this, we have proposed a maximum likelihood estimation (MLE)-based technique that utilizes hourly typical solar exemplars. Leveraging the strong monthly native demand correlation and high PV generation similarity enhances our approach's robustness against the volatility of customers’ hourly load and enables highly-accurate disaggregation. Furthermore, the proposed approach has been verified using real native demand and PV generation data.

14 SOLAR ENERGY↗
DOE OSTI2023

Modified Eigen-Decomposition-based Interval Analysis (MEDIA) for Power System Dynamic State Estimation

The Bayesian approach has been used for the dynamic state estimation (DSE) of a power system. However, due to the complexity of noise resources, it is difficult to quantify measurement and process noise using probability density functions (PDFs). To overcome the difficulty, the authors of this paper propose a modified eigen-decomposition-based interval analysis (MEDIA) method, which employs bounds instead of PDFs to quantify the noise, and uses the eigen decomposition method to reduce the negative impact of the overestimation problem. Using the simulation data generated from IEEE 16-machine and IEEE 10-machine systems, it is shown that the proposed MEDIA method can estimate the hard boundaries of dynamic states in real time. Furthermore, comparison with the forward-backward propagation method and the extended set-membership filter also shows that the proposed MEDIA method performs better by providing narrower boundaries in the DSE.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Distributionally Robust Variational Quantum Algorithms With Shifted Noise

Given their potential to demonstrate near-term quantum advantage, variational quantum algorithms (VQAs) have been extensively studied. Although numerous techniques have been developed for VQA parameter optimization, it remains a significant challenge. A practical issue is the high sensitivity of quantum noise to environmental changes, and its propensity to shift in real time. This presents a critical problem as an optimized VQA ansatz may not perform effectively under a different noise environment. For the first time, we explore how to optimize VQA parameters to be robust against unknown shifted noise. We model the noise level as a random variable with an unknown probability density function (PDF), and we assume that the PDF may shift within an uncertainty set. This assumption guides us to formulate a distributionally robust optimization problem, with the goal of finding parameters that maintain effectiveness under shifted noise. We utilize a distributionally robust Bayesian optimization solver for our proposed formulation. This provides numerical evidence in both the Quantum Approximate Optimization Algorithm (QAOA) and the Variational Quantum Eigensolver (VQE) with hardware-efficient ansatz, indicating that we can identify parameters that perform more robustly under shifted noise. We regard this work as the first step towards improving the reliability of VQAs influenced by real-time noise.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Learning error distribution kernel‐enhanced neural network methodology for multi‐intersection signal control optimization

Traffic congestion has substantially induced significant mobility and energy inefficiency. Many research challenges are identified in traffic signal control and management associated with artificial intelligence (AI)-based models. For example, developing AI-driven dynamic traffic system models that accurately capture high-resolution traffic attributes and formulate robust control algorithms for traffic signal optimization is difficult. Additionally, uncertainties in traffic system modeling and control processes can further complicate traffic signal system controllability. To partially address these challenges, this study presents a novel, hybrid neural network model enhanced with a probability density function kernel shaping technique to formulate traffic system dynamics better and improve comprehensive traffic network modeling and control. The numerical experimental tests were conducted, and the results demonstrate that the proposed control approach outperforms the baseline control strategies and reduces overall average delays by 11.64% on average. By leveraging the capabilities of this innovative model, this study aims to address major challenges related to traffic congestion and energy inefficiency toward more effective and adaptable AI-based traffic control systems.

Wang, Hong [Oak Ridge National Laboratory (ORNL), ↗
DOE OSTI2020

Validation of Numerical Models of the Offshore Wind Turbine From the Alpha Ventus Wind Farm Against Full-Scale Measurements Within OC5 Phase III

The main objective of the Offshore Code Comparison Collaboration Continuation, with Correlation (OC5) project is validation of aero-hydro-servo-elastic simulation tools for offshore wind turbines (OWTs) through comparison of simulated results to the response data of physical systems. Phase III of the OC5 project validates OWT models against the measurements recorded on a Senvion 5M wind turbine supported by the OWEC Quattropod from the alpha ventus offshore wind farm. The following operating conditions of the wind turbine were chosen for the validation: (1) idling below the cut-in wind speed, (2) rotor-nacelle assembly (RNA) rotation maneuver below the cut-in wind speed, (3) power production below and above the rated wind speed, and (4) shutdown. A number of validation load cases were defined based on these operating conditions. The following measurements were used for validation: (1) strains and accelerations recorded on the support structure and (2) pitch, yaw, and azimuth angles, generator speed, and electrical power recorded from the RNA. Strains were not directly available from the majority of the OWT simulation tools; therefore, strains were calculated based on out-of-plane bending moments, axial forces, and cross-sectional properties of the structural members. The simulation results and measurements were compared in terms of time series, discrete Fourier transforms, power spectral densities, and probability density functions of strains and accelerometers. A good match was achieved between the measurements and models setup by OC5 Phase III participants.

17 WIND ENERGY↗
DOE OSTI2022

A Stochastic Reduced-Order Model for Statistical Microstructure Descriptors Evolution

Integrated computational materials engineering (ICME) models have been a crucial building block for modern materials development, relieving heavy reliance on experiments and significantly accelerating the materials design process. However, ICME models are also computationally expensive, particularly with respect to time integration for dynamics, which hinders the ability to study statistical ensembles and thermodynamic properties of large systems for long time scales. To alleviate the computational bottleneck, we propose to model the evolution of statistical microstructure descriptors as a continuous-time stochastic process using a non-linear Langevin equation, where the probability density function (PDF) of the statistical microstructure descriptors, which are also the quantities of interests (QoIs), is modeled by the Fokker–Planck equation. In this work, we discuss how to calibrate the drift and diffusion terms of the Fokker–Planck equation from the theoretical and computational perspectives. The calibrated Fokker–Planck equation can be used as a stochastic reduced-order model to simulate the microstructure evolution of statistical microstructure descriptors PDF. Considering statistical microstructure descriptors in the microstructure evolution as QoIs, we demonstrate our proposed methodology in three integrated computational materials engineering (ICME) models: kinetic Monte Carlo, phase field, and molecular dynamics simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Solving Inverse Stochastic Problems from Discrete Particle Observations Using the Fokker--Planck Equation and Physics-Informed Neural Networks

The Fokker--Planck (FP) equation governing the evolution of the probability density function (PDF) is applicable to many disciplines, but it requires specification of the coefficients for each case, which can be functions of space-time and not just constants and hence require the development of a data-driven modeling approach. When the data available is directly on the PDF, there exist methods for inverse problems that can be employed to infer the coefficients and thus determine the FP equation and subsequently obtain its solution. Herein, we address a more realistic scenario, where only sparse data are given on the particles' positions at a few time instants, which are not sufficient to accurately construct directly the PDF even at those times from existing methods, e.g., kernel estimation algorithms. To this end, we develop a general framework based on physics-informed neural networks (PINNs) that introduces a new loss function using the Kullback--Leibler divergence to connect the stochastic samples with the FP equation to simultaneously learn the equation and infer the multidimensional PDF at all times. In particular, we consider two types of inverse problems, type I, where the FP equation is known but the initial PDF is unknown, and type II, in which, in addition to the unknown initial PDF, the drift and diffusion terms are also unknown. In both cases, we investigate problems with either Brownian or Lévy noise or a combination of both. Here, we demonstrate the new PINN framework in detail in the one-dimensional (1D) case, but we also provide results for up to five dimensions demonstrating that we can infer both the FP equation and dynamics simultaneously at all times with high accuracy using only very few discrete observations of the particles.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A Pseudoreversible Normalizing Flow for Stochastic Dynamical Systems with Various Initial Distributions

Here, we present a pseudoreversible normalizing flow method for efficiently generating samples of the state of a stochastic differential equation (SDE) with various initial distributions. The primary objective is to construct an accurate and efficient sampler that can be used as a surrogate model for computationally expensive numerical integration of SDEs, such as those employed in particle simulation. After training, the normalizing flow model can directly generate samples of the SDE’s final state without simulating trajectories. The existing normalizing flow model for SDEs depends on the initial distribution, meaning the model needs to be retrained when the initial distribution changes. The main novelty of our normalizing flow model is that it can learn the conditional distribution of the state, i.e., the distribution of the final state conditional on any initial state, such that the model only needs to be trained once and the trained model can be used to handle various initial distributions. This feature can provide a significant computational saving in studies of how the final state varies with the initial distribution. Additionally, we propose to use a pseudoreversible network architecture to define the normalizing flow model, which has sufficient expressive power and training efficiency for a variety of SDEs in science and engineering, e.g., in particle physics. We provide a rigorous convergence analysis of the pseudoreversible normalizing flow model to the target probability density function in the Kullback–Leibler divergence metric. Numerical experiments are provided to demonstrate the effectiveness of the proposed normalizing flow model.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Data-Driven Closures and Assimilation for Stiff Multiscale Random Dynamics

Here, we introduce a data-driven and physics-informed framework for propagating uncertainty in stiff, multiscale random ordinary differential equations (RODEs) driven by correlated (colored) noise. Unlike systems subjected to Gaussian white noise, a deterministic equation for the joint probability density function (PDF) of RODE state variables does not exist in closed form. Moreover, such an equation would require as many phase-space variables as there are states in the RODE system. To alleviate this curse of dimensionality, we instead derive exact, albeit unclosed, reduced-order PDF (RoPDF) equations for low-dimensional observables/quantities of interest. The unclosed terms take the form of state-dependent conditional expectations, which are directly estimated from data at sparse observation times. However, for systems exhibiting stiff, multiscale dynamics, data sparsity introduces regression discrepancies that compound during RoPDF evolution. This is overcome by introducing a kinetic-like defect term to the RoPDF equation, which is learned by assimilating in sparse, low-fidelity RoPDF estimates. Two assimilation methods are considered, namely nudging and deep neural networks, which are successfully tested against Monte Carlo simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Score-Based Physics-Informed Neural Networks for High-Dimensional Fokker–Planck Equations

The Fokker-Planck (FP) equation is a foundational partial differential equation (PDE) in stochastic processes involving Brownian motions. However, the curse of dimensionality (CoD) poses a formidable challenge when dealing with high-dimensional FP equations. Although Monte Carlo simulation and (vanilla) Physics-Informed Neural Networks (PINNs) have shown the potential to tackle CoD, both methods exhibit significant numerical errors in high dimensions when dealing with the probability density function (PDF) associated with Brownian motion. The point-wise PDF values tend to decrease exponentially as dimensionality increases, surpassing the precision of numerical simulations and resulting in substantial errors. In addition, due to its massive sampling, Monte Carlo fails to offer fast sampling. Modeling the logarithm likelihood (LL) via vanilla PINNs transforms the FP equation into a notoriously difficult Hamilton-Jacobi-Bellman (HJB) equation, which is impractical for PINN learning, whose error grows rapidly with dimension. To this end, we propose a novel approach utilizing a score-based solver to fit the score function in stochastic differential equations (SDEs). The score function, defined as the gradient of the LL, plays a fundamental role in inferring LL and PDF and enables fast SDE sampling, offering an effective means to overcome the CoD. Three fitting methods, Score Matching (SM), Sliced Score Matching (SSM), and Score-PINN, are introduced, each contributing unique advantages in computational complexity, accuracy, and generality. The proposed score-based SDE solver operates in two stages: first, employing score matching or Score-PINN to acquire the score function; and second, solving the LL via an ordinary differential equation (ODE) using the obtained score function. Comparative evaluations across these methods showcase varying trade-offs. The proposed methodology is evaluated across diverse SDEs, including anisotropic Ornstein-Uhlenbeck processes, geometric Brownian motion, and Brownian motion with varying eigenspace. We also test various distributions, including Gaussian, Log-normal, Laplace, and Cauchy distributions. The numerical results demonstrate the score-based SDE solver’s stability, speed, and performance across different experimental settings, solidifying its potential as a solution to CoD for high-dimensional FP equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

DeBoinR: Density Boxplots in R

DeBoinR (Density Boxplots in R) takes in a set of Probability Density Functions (PDFs), calculates outliers based on several notions of distance, and visualizes these outliers via functional boxplots. This code is written as a stand-along R package with the hopes of eventually submitting it to CRAN. The package is written in generality; it would be useful to any researching looking to analyze a general ensemble of PDFs.

Murph, Alexander↗
DOE OSTI2024

Statistical Treatment of Convolutional Neural Network Superresolution of Inland Surface Wind for Subgrid-Scale Variability Quantification

Abstract Machine learning models have been employed to perform either physics-free data-driven or hybrid dynamical downscaling of climate data. Most of these implementations operate over relatively small downscaling factors because of the challenge of recovering fine-scale information from coarse data. This limits their compatibility with many global climate model outputs, often available between ∼50- and 100-km resolution, to scales of interest such as cloud resolving or urban scales. This study systematically examines the capability of a type of superresolving convolutional neural network (SR-CNNs) to downscale surface wind speed data over land from different coarse resolutions (25-, 48-, and 100-km resolution) to 3 km. For each downscaling factor, we consider three convolutional neural network (CNN) configurations that generate superresolved predictions of fine-scale wind speed, which take between one and three input fields: coarse wind speed, fine-scale topography, and diurnal cycle. In addition to fine-scale wind speeds, probability density function parameters are generated through which sample wind speeds can be generated, accounting for the intrinsic stochasticity of wind speed. For assessing generalization to new data, CNN models are tested on regions with different topography and climate that are unseen during training. The evaluation of superresolved predictions focuses on subgrid-scale variability and the recovery of extremes. Models with coarse wind and fine topography as inputs exhibit the best performance when compared with other model configurations, operating across the same downscaling factor. Our diurnal cycle encoding results in lower out-of-sample generalizability when compared with other input configurations.

17 WIND ENERGY↗
DOE OSTI2020

Subcloud and Cloud-Base Latent Heat Fluxes during Shallow Cumulus Convection

Doppler and Raman lidar observations of vertical velocity and water vapor mixing ratio are used to probe the physics and statistics of subcloud and cloud-base latent heat fluxes during cumulus convection at the ARM Southern Great Plains (SGP) site in Oklahoma, United States. The statistical results show that latent heat fluxes increase with height from the surface up to ~0.8 Z i (where Z i is the convective boundary layer depth) and then decrease to ~0 at Z i . Peak fluxes aloft exceeding 500 W m −2 are associated with periods of increased cumulus cloud cover and stronger jumps in the mean humidity profile. These entrainment fluxes are much larger than the surface fluxes, indicating substantial drying over the 0–0.8 Z i layer accompanied by moistening aloft as the CBL deepens over the diurnal cycle. We also show that the boundary layer humidity budget is approximately closed by computing the flux divergence across the 0–0.8 Z i layer. Composite subcloud velocity and water vapor anomalies show that clouds are linked to coherent updraft and moisture plumes. The moisture anomaly is Gaussian, most pronounced above 0.8 Z i and systematically wider than the velocity anomaly, which has a narrow central updraft flanked by downdrafts. This size and shape disparity results in downdrafts characterized by a high water vapor mixing ratio and thus a broad joint probability density function (JPDF) of velocity and mixing ratio in the upper CBL. We also show that cloud-base latent heat fluxes can be both positive and negative and that the instantaneous positive fluxes can be very large (~10 000 W m −2 ). However, since cloud fraction tends to be small, the net impact of these fluxes remains modest.

54 ENVIRONMENTAL SCIENCES↗