Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Probabilistic models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Probabilistic estimation of depth-resolved profiles of soil thermal diffusivity from temperature time series: Supporting Data

This dataset consists of soil temperature time series that were used to estimate soil thermal diffusivity and its uncertainty trough the probabilistic modelling approach developed and presented in the article named "Probabilistic estimation of depth-resolved profiles of soil thermal diffusivity from temperature time series" and published in Earth Surface Dynamics. There are two compressed (.zip) files that contains synthetic (Synthetic_soiltemp_Teller.zip) and field (Field_soiltemp_Teller.zip) data. There is one MATLAB file that requires MATLAB to execute but any text editor can open it. The Synthetic_soiltemp_Teller.zip file includes 5 comma-delimited data files (.csv) each of which contains soil temperature time series generated through forward modeling (i.e., heat-conduction process in a heterogeneous medium using an explicit finite difference method) to mimic various types of temperature gradients, trend and fluctuations. These synthetic soil temperatures were used to investigate the impact of different environmental conditions on the uncertainty of thermal diffusivity estimates. The Field_soiltemp_Teller.zip file contains 28 comma-delimited data files (.csv) out of which (a) 27 files includes soil temperature time series recorded from 27 temperature probes located in a site along Teller Road about 40 km northwest of Nome, Alaska (64.72°N, 165.94°W), (b) one includes the name and coordinates of the 27 probes. These field soil temperatures were used to infer soil thermal diffusivity at numerous locations and depths in a discontinuous permafrost environment, and to evaluate the links between the estimated soil thermal diffusivity values and soil physical properties. The comma-delimited data files (.csv) of the synthetic and field soil temperature time series includes date and time (UTC) in the first column and soil temperature from 5 cm below the ground surface to 1.05 m depth (with 5 or 10 cm spacing between sensors) in the other columns. The measurements were acquired every 15 minutes. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

An Energy Service Interface for Distributed Energy Resources

Renewable energy resources, particularly wind and solar photovoltaic, are becoming significant contributors to electric power generation. These re-sources will contribute towards achieving sustainable electric power systems. However, renewable resources will dramatically increase the demand for flexible power system operations. This paper proposes an energy service interface that will allow aggregated distributed energy resources, such as residential loads and inverter-based systems, to participate in NERC-defined smart energy reliability services. Such cyber-physical systems will increase system flexibility by ensuring match between energy supply and energy demand.Aggregation and coordinated dispatch of millions of distributed energy resources will require development of large-scale computing networks. Several smart grid interface-enabling technologies, including IEEE 2030.5, Common Smart Inverter Profile, SunSpec Modbus, and CTA 2045, are discussed. Residential loads are categorized by their static and dynamic energy characteristics to identify services in which they can participate. The business model for the energy services interface as well as probabilistic modeling for resource estimation are highlighted as future considerations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

ClimGen: Learning the Forcing-Response Relationship in Climate System

Solar Radiation Management (SRM) is emerging as a potential geoengineering strategy to address the anthropogenic impact on climate, but its effective implementation requires an iterative and large ensemble of highly accurate and efficient climate projections. Traditional climate projections rely on executing computationally demanding and time-consuming numerical climate models. Recent advances in machine learning (ML) aim to enhance these approaches by emulating traditional methods. In this work, we propose a novel framework for directly learning the relationship between solar radiation flux at the top of the atmosphere and the corresponding surface temperature response. To evaluate the feasibility of this direct ML-based projection, we developed a dataset using an intermediate complexity model, incorporating a comprehensive suite of different forcing patterns and evaluation metrics to rigorously assess the ML model’s performance. We introduce a Conditional Denoising Diffusion Probabilistic Model (cDDPM) for this task, which demonstrates encouraging skill in representing climate statistics under previously unseen forcing patterns. This approach provides a promising pathway for direct climate projections by accurately learning the forcing-response relationship, with a wide range of applications in impact mitigation, emissions policy design, and SRM strategies.

Chen, Tse-Chun [BATTELLE (PACIFIC NW LAB)] (ORCID:↗
DOE OSTI2021

A REDUCED ORDER MODELING APPROACH TO PROBABILISTIC CREEP-DAMAGE PREDICTIONS IN FINITE ELEMENT ANALYSIS

This paper introduces a computationally efficient Reduced Order Modeling (ROM) approach for the probabilistic prediction of creep-damage failure. Component-level probabilistic simulations are needed to assess the reliability and safety of high-temperature components. Full-scale probabilistic creep-damage modeling in finite element (FE) approach is computationally expensive requiring many hundreds of simulations to replicate the uncertainty of component failure. To that end, ROM is proposed to minimize the elevated computational cost while controlling the loss of accuracy. It is proposed that full-scale probabilistic simulations can be completed in 1D at a reduced cost, the extremum conditions extracted, and those conditions applied for lower-cost 2D/3D probabilistic simulations of components that capture the mean and uncertainty of failure. The probabilistic Sine-hyperbolic (Sinh) model is selected which in previous work was calibrated to alloy 304 stainless steel. The Sinh model includes probability density functions (pdfs) for test condition (stress and temperature), initial damage (i.e. microstructure), and material properties uncertainty. The Sinh model is programmed into ANSYS finite element software using the USERCREEP.F material subroutine. First, the Sinh model and FE code are subject to verification and validation to ensure the accuracy of the simulations. Numerous Monte Carlo simulations are executed in a 1D model to generate probabilistic creep deformation, damage, and rupture data. This data is analyzed and the probabilistic parameters corresponding to extreme creep response are extracted. The ROM concept is applied where only the extreme conditions are applied in the 2D probabilistic prediction of a component. The probabilistic predictions between the 1D and 2D geometry is compared to assess ROM for creep. The accuracy of the probabilistic prediction employing the ROM approach will potentially reduce the time and cost of simulating complex engineering systems. Future studies will introduce multi-stage Sinh, stochasticity, and spatial uncertainty for improved prediction.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Deblending galaxies with variational autoencoders: A joint multiband, multi-instrument approach

ABSTRACT Blending of galaxies has a major contribution in the systematic error budget of weak-lensing studies, affecting photometric and shape measurements, particularly for ground-based, deep, photometric galaxy surveys, such as the Rubin Observatory Legacy Survey of Space and Time (LSST). Existing deblenders mostly rely on analytic modelling of galaxy profiles and suffer from the lack of flexible yet accurate models. We propose to use generative models based on deep neural networks, namely variational autoencoders (VAE), to learn probabilistic models directly from data. We train a VAE on images of centred, isolated galaxies, which we reuse, as a prior, in a second VAE-like neural network in charge of deblending galaxies. We train our networks on simulated images including six LSST bandpass filters and the visible and near-infrared bands of the Euclid satellite, as our method naturally generalizes to multiple bands and can incorporate data from multiple instruments. We obtain median reconstruction errors on ellipticities and r-band magnitude between ±0.01 and ±0.05, respectively, in most cases, and ellipticity multiplicative bias of 1.6 per cent for blended objects in the optimal configuration. We also study the impact of decentring and prove the method to be robust. This method only requires the approximate centre of each target galaxy, but no assumptions about the number of surrounding objects, pointing to an iterative detection/deblending procedure we leave for future work. Finally, we discuss future challenges about training on real data and obtain encouraging results when applying transfer learning.

Arcelin, Bastien↗
DOE OSTI2024

A flexible class of priors for orthonormal matrices with basis function-specific structure

Statistical modeling of high-dimensional matrix-valued data motivates the use of a low-rank representation that simultaneously summarizes key characteristics of the data and enables dimension reduction. Low-rank representations commonly factor the original data into the product of orthonormal basis functions and weights, where each basis function represents an independent feature of the data. However, the basis functions in these factorizations are typically computed using algorithmic methods that cannot quantify uncertainty or account for basis function correlation structure a priori. While there exist Bayesian methods that allow for a common correlation structure across basis functions, empirical examples motivate the need for basis function-specific dependence structure. We propose a prior distribution for orthonormal matrices that can explicitly model basis function-specific structure. The prior is used within a general probabilistic model for singular value decomposition to conduct posterior inference on the basis functions while accounting for measurement error and fixed effects. We discuss how the prior specification can be used for various scenarios and demonstrate favorable model properties through synthetic data examples. Finally, we apply our method to two-meter air temperature data from the Pacific Northwest, enhancing our understanding of the Earth system’s internal variability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Generation and evaluation of synthetic patient data

Background: Machine learning (ML) has made a significant impact in medicine and cancer research; however, its impact in these areas has been undeniably slower and more limited than in other application domains. A major reason for this has been the lack of availability of patient data to the broader ML research community, in large part due to patient privacy protection concerns. High-quality, realistic, synthetic datasets can be leveraged to accelerate methodological developments in medicine. By and large, medical data is high dimensional and often categorical. These characteristics pose multiple modeling challenges. Methods: In this paper, we evaluate three classes of synthetic data generation approaches; probabilistic models, classification-based imputation models, and generative adversarial neural networks. Metrics for evaluating the quality of the generated synthetic datasets are presented and discussed. Results: While the results and discussions are broadly applicable to medical data, for demonstration purposes we generate synthetic datasets for cancer based on the publicly available cancer registry data from the Surveillance Epidemiology and End Results (SEER) program. Specifically, our cohort consists of breast, respiratory, and non-solid cancer cases diagnosed between 2010 and 2015, which includes over 360,000 individual cases. Conclusions: We discuss the trade-offs of the different methods and metrics, providing guidance on considerations for the generation and usage of medical synthetic data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Benchmarking the performance of uncertainty quantification methods for neural network-based interatomic potentials

Machine-learned interatomic potentials (ML-IAPs) continue to gain popularity as accurate, computationally efficient replacements for traditional, physics-based interatomic potentials and expensive ab initio methods. Uncertainty quantification (UQ) of ML-IAPs is a growing area of research as UQ is critical in many applications of IAPs, such as developing curated datasets, active learning-based data augmentation, self-improving models, and estimating the uncertainty of molecular dynamics simulations. In this paper, we construct and benchmark a series of different neural network potentials (NNPs) with varying network architectures to determine the performance of these models with respect to both the mean and uncertainty calibration error. Each NNP method is specifically designed to predict either epistemic or aleatoric uncertainty with particular focus on the differences in behavior between the epistemic and aleatoric uncertainty estimates. We benchmark these methods using multiple datasets common in the ML-IAP literature. The results show that the aleatoric uncertainty from single-shot model architectures is a competitive alternative to ensemble-based epistemic uncertainty predictions in regions of sufficient data-density. However, in regions where the representative data is sparse, aleatoric uncertainty models tend to overpredict and epistemic methods tend to underpredict the actual model error. We conclude that the type of UQ is crucial when discussing performance of probabilistic model results as different methods have different performance characteristics depending on the regime in which they are evaluated. Therefore, the type of UQ method should be carefully evaluated against both the data characteristics and requirements for the intended application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Hydrogen Plus Other Alternative Fuels Risk Assessment Models (HyRAM+) Version 4.1 Technical Reference Manual

The HyRAM+ software toolkit provides a basis for conducting quantitative risk assessment and consequence modeling for hydrogen, methane, and propane systems. HyRAM+ is designed to facilitate the use of state-of-the-art models to conduct robust, repeatable assessments of safety, hazards, and risk. HyRAM+ integrates deterministic and probabilistic models for quantifying accident scenarios, predicting physical effects, characterizing hazards (thermal effects from jet fires, overpressure effects from delayed ignition), and assessing impacts on people. HyRAM+ is developed at Sandia National Laboratories to support the development and revision of national and international codes and standards, and to provide developed models in a publicly-accessible toolkit usable by all stakeholders. This document provides a description of the methodology and models contained in HyRAM+ version 4.1. The two most significant changes for HyRAM+ version 4.1 from HyRAM+ version 4.0 are direct incorporation of unconfined overpressure into the QRA calculations and modification of the models for cryogenic liquid flow through an orifice. In QRA mode, the user no longer needs to input peak overpressure and impulse values that were calculated separately; rather, the unconfined overpressure is estimated for the given system inputs, leak size, and occupant location. The orifice flow model now solves for the maximum mass flux through the orifice at constant entropy while conserving energy, which does not require a direct speed of sound calculation. This does not affect the mass flow for all-gaseous releases; the method results in the same speed of sound for choked flow. However, this method does result in a higher (and more realistic) mass flow rate for a given leak size for liquid releases than was previously calculated.

08 HYDROGEN↗
DOE OSTI2022

Hydrogen Plus Other Alternative Fuels Risk Assessment Models (HyRAM+) Version 5.0 Technical Reference Manual

The HyRAM+ software toolkit provides a basis for conducting quantitative risk assessment and consequence modeling for hydrogen, natural gas, and autogas systems. HyRAM+ is designed to facilitate the use of state-of-the-art models to conduct robust, repeatable assessments of safety, hazards, and risk. HyRAM+ integrates deterministic and probabilistic models for quantifying leak sizes and rates, predicting physical effects, characterizing hazards (thermal effects from jet fires, overpressure effects from delayed ignition), and assessing impacts on people. HyRAM+ is developed at Sandia National Laboratories to support the development and revision of national and international codes and standards, and to provide developed models in a publicly-accessible toolkit usable by all stakeholders. This document provides a description of the methodology and models contained in HyRAM+ version 5.0. The most significant change for HyRAM+ version 5.0 from HyRAM+ version 4.1 is the ability to model blends of different fuels. HyRAM+ was previously only suitable for use with hydrogen, methane, or propane, with users having the ability to use methane as a proxy for natural gas and propane as a proxy for autogas/liquefied petroleum gas. In version 5.0, real natural gas or autogas compositions can be modeled as the fuel, or even blends of natural gas with hydrogen. These blends can be used in the standalone physics models, but not yet in the quantitative risk assessment mode of HyRAM+.

03 NATURAL GAS↗
DOE OSTI2023

Hydrogen Plus Other Alternative Fuels Risk Assessment Models (HyRAM+) Version 5.1 Technical Reference Manual

The HyRAM+ software toolkit provides a basis for conducting quantitative risk assessment and consequence modeling for hydrogen, natural gas, and autogas systems. HyRAM+ is designed to facilitate the use of state-of-the-art models to conduct robust, repeatable assessments of safety, hazards, and risk. HyRAM+ integrates deterministic and probabilistic models for quantifying leak sizes and rates, predicting physical effects, characterizing hazards (thermal effects from jet fires, overpressure effects from delayed ignition), and assessing impacts on people. HyRAM+ is developed at Sandia National Laboratories to support the development and revision of national and international codes and standards, and to provide developed models in a publicly-accessible toolkit usable by all stakeholders. This document provides a description of the methodology and models contained in HyRAM+ version 5.1. The most significant changes for HyRAM+ version 5.1 from HyRAM+ version 5.0 are updated default leak frequency values for propane, new default component counts for different fuel types, and an improved fuel specification view in the graphical user interface.

02 PETROLEUM↗
DOE OSTI2024

Sensitivity of fatigue reliability in wind turbines: effects of design turbulence and the Wöhler exponent

Fatigue assessment of wind turbines involves three main sources of uncertainty: material resistance, load, and the damage accumulation model. Many studies focus on increasing the accuracy of fatigue load assessment to improve the fatigue reliability. Probabilistic modeling of the wind's turbulence standard deviation is an example of an approach used for this purpose. Editions 3 and 4 of the IEC standard for the design of wind energy generation systems (IEC 61400-1) suggest different probability distributions as alternatives for the representative turbulence in the normal turbulence model (NTM) of edition 1. There are debates on whether the suggested distributions provide conservative reliability levels, as the established design safety factors are calibrated based on the representative turbulence approach. The current study addresses the debate by comparing annual reliability based on different scenarios of NTM using a probabilistic approach. More importantly, it elaborates on the relative importance of load assessment accuracy in defining the fatigue reliability. Using the DTU 10 MW reference wind turbine and the first-order reliability method (FORM), we study the changes in the annual reliability level and its sensitivity to the three main random inputs. We perform the study considering the blade root flapwise and the tower base fore–aft moments, assuming different fatigue exponents in each load channel. The results show that integration over distributions of turbulence in each mean wind speed results in less conservative annual reliability levels than representative turbulence. The difference in the reliability levels varies according to turbulence distribution and the fatigue exponent. In the case of the tower base, the difference in the annual reliability index after 20 years can be up to 50 %. However, the model and material uncertainty have much higher effects on the reliability levels compared to load uncertainty. Knowledge about such differences in the reliability levels due to the choice of turbulence distribution is especially important, as it impacts the extent of lifetime extension through reliability reassessments.

17 WIND ENERGY↗
DOE OSTI2024

Probabilistic Assessment of Structural Integrity

A probability-based approach, combining deterministic and probabilistic methods, was developed for analyzing building and component failures, which are especially crucial for complex structures like nuclear power plants. This method links finite element and probabilistic software to assess structural integrity under static and dynamic loads. This study uses NEPTUNE software, which is validated, for a deterministic transient analysis and ProFES software for probabilistic models. In a case study, deterministic analyses with varied random variables were transferred to ProFES for probabilistic analyses of piping failure and wall damage. A Monte Carlo Simulation, First-Order Reliability Method, and combined methods were employed for probabilistic analyses under severe transient loading, focusing on a postulated accident at the Ignalina Nuclear Power Plant. The study considered uncertainties in material properties, component geometry, and loads. The results showed the Monte Carlo Simulation method to be conservative for high failure probabilities but less so for low probabilities. The Response Surface/Monte Carlo Simulation method explored the impact load–failure probability relationship. Given the uncertainties in material properties and loads in complex structures, a deterministic analysis alone is insufficient. Probabilistic analysis is imperative for extreme loading events and credible structural safety evaluations.

Mathematics↗
DOE OSTI2024

Time Dilated Bundt Cake Analysis of PV Output [Poster]

We present a novel method for modeling time-dependent statistics in the power signal generated by a photovoltaic (PV) system. Our white-box machine learning method is interpretable and auditable, based on principles of multiperiodic basis functions and convex optimization. Our proposed method of time dilating the daily signal to remove night time values results in a novel representation of PV power signals, evocative of a ‘Bundt cake’. The proposed model describes the marginal distribution of power output as a function of date and time. The resulting probabilistic model of a PV system can be used to perform a variety of tasks, and here, we demonstrate the application of clear sky detection.

14 SOLAR ENERGY↗
DOE OSTI2020

Initial development of a high temperature life prediction method directly accounting for variability in material properties

This report presents the initial development of a life prediction method that accounts for the variability of the material properties in Grade 91 steel. We account for material variability by both fitting a variable 3-parameter Weibull distribution to the rupture data of the material and by quantifying the effect that the creep deformation properties have on stresses via a Monte Carlo approach. To ensure a reasonable time frame when applying Monte Carlo to the creep stress, we propose a methodology that models the material as an extremely viscous Stokes flow with a non-Newtonian viscosity, therefore solving the problem in a single step. We use the final probabilistic model for structural failure developed in this document to evaluate a Flat Head Vessel designed with the Section III, Division 5 ASME Boiler Pressure and Vessel Code rules with a 100,000h design life and assess its probability of premature failure.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Joint Management and Optimization of Residential Natural Gas and Electricity Distribution Networks Coupled via Fuel Cells

The attractive features of natural gas as well as the growing electric power demand worldwide have created increasing interest in natural-gas-based distributed generation applications for electric distribution networks. Here, this paper investigates the interdependency between a residential natural gas network and an electric distribution network that are linked together via fuel cells. The modeling of the natural gas network is introduced first, and then the algorithm for gas flow study is presented. The optimal placement and sizing of fuel cell based distributed generation systems are formulated to minimize the losses in both the natural gas network and the electric distribution grid, subject to the constraints imposed by both networks. In addition, a probabilistic model for both gas and electricity demands is developed based on historical electricity and natural gas demand data. A K-means clustering method is used to determine the hourly load states to solve the joint probabilistic optimization problem. Simulation studies are carried out on an integrated system consisting of the IEEE 69-bus distribution network and a radial 27-node natural gas network to verify the developed optimization model and the proposed method.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

The Gaia DR2 parallax zero-point: hierarchical modelling of red clump stars

ABSTRACT The systematic offset of Gaia parallaxes has been widely reported with Gaia’s second data release, and it is expected to persist in future Gaia data. In order to use Gaia parallaxes to infer distances to high precision, we develop a hierarchical probabilistic model to determine the Gaia parallax zero-point offset along with the calibration of an empirical model for luminosity of red clump stars by combining astrometric and photometric measurements. Using a cross-matched sample of red clump stars from the Apache Point Observatory Galactic Evolution Experiment and Gaia Data Release 2 (DR2), we report the parallax zero-point offset in DR2 to be $\varpi _0 = -48 \pm 1\,\mu \text{as}$. We infer the red clump absolute magnitude to be −1.622 ± 0.004 in Ks, 0.435 ± 0.004 in G, −1.019 ± 0.004 in J, and −1.516 ± 0.004 in H. The intrinsic scatter of the red clump is ∼0.09 mag in J, H, and Ks, or ∼ 0.12 mag in G. We tailor our models to accommodate more complex analyses such as investigating the variations of the parallax zero-point with each source’s observed magnitude, observed colour, and sky position. In particular, we find fluctuations of the zero-point across the sky to be of order or less than a few 10s of $\mu \text{as}$.

Chan, Victor C.↗
DOE OSTI2023

DUET - Distribution of Understory using Elliptical Transport: A mechanistic model of leaf litter and herbaceous spatial distribution based on tree canopy structure

Heterogeneity in surface fuels produced by overstory trees and understory vegetation is a major driver of fire behavior and ecosystem dynamics. Previous attempts at predicting tree leaf and needle litter accumulation over time have been constrained in scope to probabilistic models that consider a limited number of key factors influencing tree litter dispersal patterns and decomposition processes. Here we present a mechanistic model for estimating variation in surface fuels called the Distribution of Understory using Elliptical Transport (DUET). DUET uses a pre-generated voxelated canopy array and distributes the leaf litter from the trees in an elliptical shape based on tree species characteristics, wind data, and location-specific features. DUET then calculates grass growth between trees and around the litter patterns and sets moisture levels based on relative humidity. In this study, we use DUET to simulate spatial distributions of leaf litter and illustrate model sensitivity to several parameters, providing inputs for testing fuel spatial heterogeneity impacts on fire behavior using process-based models.

54 ENVIRONMENTAL SCIENCES↗