Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Multimodel Ensemble Predictions of Precipitation using Bayesian Neural Networks

Multimodel ensembling improves predictions and considers model uncertainties. In this study, we present a Bayesian Neural Network (BNN) ensemble approach for large-scale precipitation predictions based on a set of climate models. BNN infers spatiotemporally varying model weights and biases through the calibration against observations. This ensemble scheme of BNN sufficiently leverages individual model skill for accurate predictions as well as provides interpretability about which models contribute more to the ensemble prediction at which locations and times to inform model development. Additionally, BNN accurately quantifies epistemic uncertainty to avoid overconfident projections. We demonstrate BNN’s superior prediction performance to three state-of-the-art ensemble approaches and discuss its interpretability and uncertainty quantification.

Fan, Patrick↗
DOE OSTI2022

Inference-Optimized AI and High Performance Computing for Gravitational Wave Detection at Scale

We introduce an ensemble of artificial intelligence models for gravitational wave detection that we trained in the Summit supercomputer using 32 nodes, equivalent to 192 NVIDIA V100 GPUs, within 2 h. Once fully trained, we optimized these models for accelerated inference using NVIDIA TensorRT. We deployed our inference-optimized AI ensemble in the ThetaGPU supercomputer at Argonne Leadership Computer Facility to conduct distributed inference. Using the entire ThetaGPU supercomputer, consisting of 20 nodes each of which has 8 NVIDIA A100 Tensor Core GPUs and 2 AMD Rome CPUs, our NVIDIA TensorRT-optimized AI ensemble processed an entire month of advanced LIGO data (including Hanford and Livingston data streams) within 50 s. Our inference-optimized AI ensemble retains the same sensitivity of traditional AI models, namely, it identifies all known binary black hole mergers previously identified in this advanced LIGO dataset and reports no misclassifications, while also providing a 3X inference speedup compared to traditional artificial intelligence models. We used time slides to quantify the performance of our AI ensemble to process up to 5 years worth of advanced LIGO data. In this synthetically enhanced dataset, our AI ensemble reports an average of one misclassification for every month of searched advanced LIGO data. We also present the receiver operating characteristic curve of our AI ensemble using this 5 year long advanced LIGO dataset. This approach provides the required tools to conduct accelerated, AI-driven gravitational wave detection at scale.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Machine learning materials properties with accurate predictions, uncertainty estimates, domain guidance, and persistent online accessibility

One compelling vision of the future of materials discovery and design involves the use of machine learning (ML) models to predict materials properties and then rapidly find materials tailored for specific applications. However, realizing this vision requires both providing detailed uncertainty quantification (model prediction errors and domain of applicability) and making models readily usable. At present, it is common practice in the community to assess ML model performance only in terms of prediction accuracy (e.g. mean absolute error), while neglecting detailed uncertainty quantification and robust model accessibility and usability. Here, we demonstrate a practical method for realizing both uncertainty and accessibility features with a large set of models. We develop random forest ML models for 33 materials properties spanning an array of data sources (computational and experimental) and property types (electrical, mechanical, thermodynamic, etc). All models have calibrated ensemble error bars to quantify prediction uncertainty and domain of applicability guidance enabled by kernel-density-estimate-based feature distance measures. All data and models are publicly hosted on the Garden-AI infrastructure, which provides an easy-to-use, persistent interface for model dissemination that permits models to be invoked with only a few lines of Python code. We demonstrate the power of this approach by using our models to conduct a fully ML-based materials discovery exercise to search for new stable, highly active perovskite oxide catalyst materials.

domain of applicability↗
DOE OSTI2024

Selecting Appropriate Model Complexity: An Example of Tracer Inversion for Thermal Prediction in Enhanced Geothermal Systems

Abstract A major challenge in the inversion of subsurface parameters is the ill‐posedness issue caused by the inherent subsurface complexities and the generally spatially sparse data. Appropriate simplifications of inversion models are thus necessary to make the inversion process tractable and meanwhile preserve the predictive ability of the inversion results. In this study, we investigate the effect of model complexity on fracture aperture inversion and thermal performance prediction in a field‐scale EGS model. Principal component analysis was used to map the aperture field to a low‐dimensional latent space. The complexity of the inversion model was quantitatively represented by the percentage of total variance in the original aperture fields preserved by the latent space. Tracer, pressure and flow rate data were used to invert for fracture aperture through an ensemble‐based inversion method, and the inferred aperture field was used to predict thermal performance. With an over‐simplified aperture model, ensemble collapse occurred. The inverted aperture models failed to resolve necessary flow and transport features, leading to a biased thermal performance prediction. A complex aperture model involved excessive features and was prone to overinterpreting the inversion data. Both the tracer/pressure/flow rate data reproduction and thermal prediction showed significant uncertainties, making it difficult to properly estimate long‐term thermal performance. Fortunately, our results indicate that there exists an appropriate model complexity which can simultaneously match inversion data and predict thermal performance with an acceptable uncertainty. The quality of the fit of tracer data appears to be a useful indicator of such an appropriate model complexity.

15 GEOTHERMAL ENERGY↗
DOE OSTI2023

CMIP6-based Multi-model Streamflow Projections over the Conterminous US

This dataset presents an ensemble of streamflow projections based on the hydroclimate projections dataset supporting the SECURE Water Act Section 9505 Assessment for the US Department of Energy (DOE) Water Power Technologies Office (WPTO). The six-member General Climate Model (GCM) ensemble from the Coupled Models Intercomparison Project phase 6 (CMIP6) downscaled using statistical (i.e., DBCCA) and dynamical (i.e., RegCM) and bias-corrected using two meteorological reference observations (Daymet & Livneh) are driven through two calibrated hydrologic models (VIC & PRMS) to simulate projected future hydrologic responses. This leads to the production of an ensemble of hydroclimate projections, including total runoff (surface runoff and baseflow) for 1980–2019 baseline and 2020–2059 near-term future periods under multiple emission scenarios at 1/24° (~4 km) spatial resolution across the CONUS. The total runoff projections are routed through the Routing Application for Parallel computatIon of Discharge (RAPID) routing model to produce an ensemble of streamflow projections for both periods across 2.7 million NHDPlusV2 stream reaches in the CONUS.

13 HYDRO ENERGY↗
DOE OSTI2022

A Process‐Model Perspective on Recent Changes in the Carbon Cycle of North America

Continental North America has been found to be a carbon (C) sink over recent decades by multiple studies employing a variety of estimation approaches. However, several key questions and uncertainties remain with these assessments. Here we used results from an ensemble of 19 state-of-the-art dynamic global vegetation models from the TRENDYv9 project to improve these estimates and study the drivers of its interannual variability. Our results show that North America has been a C sink with a magnitude of 0.37 ± 0.38 (mean and one standard deviation) PgC year —1 for the period 2000–2019 (0.31 and 0.44 PgC year —1 in each decade); split into 0.18 ± 0.12 PgC year —1 in Canada (0.15 and 0.20), 0.16 ± 0.17 in the United States (0.14 and 0.17), 0.02 ± 0.05 PgC year —1 in Mexico (0.02 and 0.02) and 0.01 ± 0.02 in Central America and the Caribbean (0.01 and 0.01). About 57% of the new C assimilated by terrestrial ecosystems is allocated into vegetation, 30% into soils, and 13% into litter. Losses of C due to fire account for 41% of the interannual variability of the mean net biome productivity for all North America in the model ensemble. Finally, we show that drought years (e.g., 2002) have the potential to shift the region to a small net C source in the simulations (—0.02 ± 0.46 PgC year —1 ). Our results highlight the importance of identifying the major drivers of the interannual variability of the continental-scale land C cycle along with the spatial distribution of local sink-source dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Leveraging AI and Spatial Data to Unlock Pipeline Integrity Insights: NETL’s Advanced Infrastructure Integrity Model (AIIM)

Maintaining the integrity of natural gas infrastructure plays a critical role in ensuring energy security. Robust, data-driven foundational AI models for pipeline integrity can help address risk management and mitigation issues. Trusted foundational models can help with industry adoption and accelerate innovation by enhancing integrity predictions, reduce costs, and informing infrastructure build-out. The AIIM dashboard was released in 2022 and utilizes multi-ML models for ensemble-type insights. It was expanded to include analytics on reported incidents. It was developed as an ESRI Dashboard to support data visualization & interrogation and contains pipeline data and model results.

Advanced Infrastructure Integrity Model (AIIM)↗
DOE OSTI2020

Parameterizing Subgrid Variations of Land Surface Heat Fluxes to the Atmosphere Improves Boreal Summer Land Precipitation Simulation With the NCAR CESM1.2

Subgrid horizontal variations of land surface heat fluxes to the atmosphere resulting from subgrid land cover heterogeneity are important in land-atmosphere interaction in global climate models (GCMs). To incorporate it, a parameterization using stochastic sampling based on truncated normal distributions diagnosed from the land model and internal ensemble mean of multiple calls to the planetary boundary layer and deep convection schemes is developed. After its implementation in the National Center for Atmospheric Research (NCAR) Community Earth System Model version 1.2 (CESM1.2), large changes of simulated land precipitation are found to occur in regions where large subgrid variations of surface heat fluxes exist. The simulated precipitation is improved in boreal summer, especially over eastern China and the coastal areas of the Bay of Bengal. The improved precipitation is mainly a result of improved large-scale moisture convergence and advection by altered vertical diffusion and convection.

58 GEOSCIENCES↗
DOE OSTI2025

Impact of the Earth’s Density Profile on Atmospheric Neutrino Oscillations

As atmospheric neutrinos traverse the Earth, the matter potential influences their oscillation probabilities in intricate ways, enhancing and suppressing the conversion of one neutrino’s flavor to another along the propagation. Comprehending their behavior within Earth’s complex density profile, primarily described by the Preliminary Reference Earth Model (PREM) [1], is essential for accurately describing oscillations and determining expected atmospheric neutrino event rates in the DUNE Far Detector. In this study, we address this challenge by considering an ensemble of Earth models constrained by astronomical measurements of the planet’s mass and moment of inertia. We evaluate how variations in densities and layer boundaries can affect oscillation probabilities and event rates, and what implications this could have on various physics analyses.

Ismerio Oliveira, Marcelo [Rio de Janeiro, Pont. U↗
DOE OSTI2024

How well are hazards associated with derechos reproduced in regional climate simulations?

Abstract. A 15-member ensemble of convection-permitting regional simulations of the fast-moving and destructive derecho of 29–30 June 2012 that impacted the northeastern urban corridor of the USA is presented. This event generated 1100 reports of damaging winds, generated significant wind gusts over an extensive area of up to 500 000 km2, caused several fatalities, and resulted in widespread loss of electrical power. Extreme events such as this are increasingly being used within pseudo-global-warming experiments to examine the sensitivity of historical, societally important events to global climate non-stationarity and how they may evolve as a result of changing thermodynamic and dynamic contexts. As such it is important to examine the fidelity with which such events are described in hindcast experiments. The regional simulations presented herein are performed using the Weather Research and Forecasting (WRF) model. The resulting ensemble is used to explore simulation fidelity relative to observations for wind gust magnitudes, spatial scales of convection (as is manifest in high composite reflectivity, cREF), and both rainfall and hail production as a function of model configuration (microphysics parameterization, lateral boundary conditions (LBCs), start date, use of nudging, compiler choice, damping, and number of vertical levels). We also examine the degree to which each ensemble member differs with respect to key mesoscale drivers of convective systems (e.g., convective available potential energy and vertical wind shear) and critical manifestations of deep convection, e.g., vertical velocities, cold-pool generation, and how those properties relate to the correct characterization of the associated atmospheric hazards (wind gusts and hail). Use of a double-moment, seven-class scheme with number concentrations for all species (including hail and graupel) results in the greatest fidelity of model-simulated wind gusts and convective structure to the observations of this event. All ensemble members, however, fail to capture the intensity of the event in terms of the spatial extent of convection and the production of high near-surface wind gusts. We further show very high sensitivity to the LBCs employed and specifically that simulation fidelity is higher for simulations nested within ERA-Interim compared to ERA5. Excess convective available potential energy (CAPE) in all ensemble members after the derecho passage leads to excess production of convective cells, wind gusts, cREF > 40 dBZ, and precipitation during a frontal passage on the subsequent day. This event proved very challenging to forecast in real time and to reproduce in the 15-member hindcast simulation ensemble presented here. Future work could examine if simulations with other initial and lateral boundary conditions can achieve greater fidelity.

Shepherd, Tristan (ORCID:0000000186276419)↗
DOE OSTI2023

The Misrepresentation of the Southern African Easterly Jet in Models and Its Implications for Aerosol, Clouds, and Precipitation Distributions

The southern African easterly jet (AEJ-S) is an important midtropospheric feature critical to understanding the tropical convective system over central Africa and the aerosol–cloud interactions over the southeast Atlantic Ocean. However, it remains unclear how well models represent the AEJ-S and its influence on aerosol transport, clouds, and precipitation distribution. Here, in this work, we use ground- and satellite-based observations and reanalysis datasets to assess the representation of AEJ-S in the Coupled Model Intercomparison Project phase 6 (CMIP6) models between September and October during the peak of midtropospheric winds, aerosol transport, clouds, and precipitation. We find that most CMIP6 models have difficulty accurately simulating the strength, position, and spatial distribution of the AEJ-S. Specifically, the AEJ-S is relatively weaker and at a slightly lower altitude in the ensemble of CMIP6 models than represented by observation and reanalysis datasets. To assess the influence of the misrepresented the AEJ-S on CMIP6-simulated aerosol, clouds, and precipitation distributions, we performed composite analyses using models with low and high biases based on the estimates of their midtropospheric easterly wind speed. We find that the misrepresentation of the AEJ-S in CMIP6 models is associated with the overestimation of clouds and precipitation over central Africa, the underestimation of clouds over the southeast Atlantic Ocean, and the limitation of aerosol transport over the continent or the deviation of its spatial distribution from the typical zonal transport over the Atlantic Ocean. Because aerosols, clouds, and precipitation are important components of the regional climate system, we conclude that accurate representation of the AEJ-S is essential over central Africa and the southeast Atlantic Ocean.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

An uncertain future change in aridity over the tropics

Abstract An ensemble of climate models from phase six of the Coupled Model Intercomparison Project shows that temperature and potential evapotranspiration (PET) are projected to increase globally towards the end of the 21st century. However, climate models show a spatially heterogeneous change in precipitation over the tropics. Consequently, future changes in aridity (a measure of water availability) are complex and location-dependent. We assess future changes in aridity using three climate models and several single-forcing experiments. Near-term (2021–2040) changes in aridity are small, and we focus instead on its long-term (2081–2100) changes. We show that the increase in greenhouse gases (GHG) primarily explains the spatial pattern, magnitude and ensemble spread of the long-term future changes in aridity. On this timescale, the effects of changes in emissions of anthropogenic aerosols are moderate compared to the effects of increases in atmospheric GHG concentrations. Model diversity in the responses to GHG concentration is large over northern Africa and North and South America. We suggest the large uncertainty is due to differences between models in simulating the effects of an increase in GHG concentrations on surface air temperature over the North Atlantic Ocean, on the interhemispheric temperature gradient, and on PET over North and South America.

Environmental Sciences & Ecology↗
DOE OSTI2022

Ensemble-function relationships to dissect mechanisms of enzyme catalysis

Decades of structure-function studies have established our current extensive understanding of enzymes. However, traditional structural models are snapshots of broader conformational ensembles of interchanging states. We demonstrate the need for conformational ensembles to understand function, using the enzyme ketosteroid isomerase (KSI) as an example. Comparison of prior KSI cryogenic x-ray structures suggested deleterious mutational effects from a misaligned oxyanion hole catalytic residue. However, ensemble information from room-temperature x-ray crystallography, combined with functional studies, excluded this model. Ensemble-function analyses can deconvolute effects from altering the probability of occupying a state (P-effects) and changing the reactivity of each state (k-effects); our ensemble-function analyses revealed functional effects arising from weakened oxyanion hole hydrogen bonding and substrate repositioning within the active site. Ensemble-function studies will have an integral role in understanding enzymes and in meeting the future goals of a predictive understanding of enzyme catalysis and engineering new enzymes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Models, data, and scripts associated with “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning”

This data package is associated with the publication “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning’’ submitted to the Journal of Geophysical Research: Machine Learning and Computation (Scheibe et al. 2024). River sediment respiration observations are expensive and labor intensive to obtain and there is no physical model for predicting this quantity. The Worldwide Hydrobiogeochemisty Observation Network for Dynamic River Systems (WHONDRS) observational data set (Goldman et al.; 2020) is used to train machine learning (ML) models to predict respiration rates at unsampled sites. This repository archives training data, ML models, predictions, and model evaluation results for the purposes of reproducibility of the results in the associated manuscript and community reuse of the ML models trained in this project. One of the key challenges in this work was to find an optimum configuration for machine learning models to work with this feature-rich (i.e. 100+ possible input variables) data set. Here, we used a two-tiered approach to managing the analysis of this complex data set: 1) a stacked ensemble of ML models that can automatically optimize hyperparameters to accelerate the process of model selection and tuning and 2) feature permutation importance to iteratively select the most important features (i.e. inputs) to the ML models. The major elements of this ML workflow are modular, portable, open, and cloud-based, thus making this implementation a potential template for other applications. This data package is associated with the GitHub repository found at Please see the file level metadata (flmd; “sl-archive-whondrs_flmd.csv”) for a list of all files contained in this data package and descriptions for each. Please see the data dictionary (dd; “sl-archive-whondrs_dd.csv”) for a list of all column headers contained within comma separated value (csv) files in this data package and descriptions for each. The GitHub repository is organized into five top-level directories: (1) “input_data” holds the training data for the ML models; (2) “ml_models” holds machine learning models trained on the data in “input_data”; (3) “scripts” contains data preprocessing and postprocessing scripts and intermediate results specific to this data set that bookend the ML workflow; (4) “examples” contains the visualization of the results in this repository including plotting scripts for the manuscript (e.g., model evaluation, FPI results) and scripts for running predictions with the ML models (i.e., reusing the trained ML models); (5) “output_data” holds the overall results of the ML model on that branch. Each trained ML model resides on its own branch in the repository; this means that inputs and outputs can be different branch-to-branch. Furthermore, depending on the number of features used to train the ML models, the preprocessing and postprocessing scripts, and their intermediate results, can also be different branch-to-branch. The “main-*” branches are meant to be starting points (i.e. trunks) for each model branch (i.e. sprouts). Please see the Branch Navigation section in the top-level README.md in the GitHub repository for more details. There is also one hidden directory “.github/workflows”. This hidden directory contains information for how to run the ML workflow as an end-to-end automated GitHub Action but it is not needed for reusing the ML models archived here. Please the top-level README.md in the GitHub repository for more details on the automation.

13C↗
DOE OSTI2022

The WRF-Solar Ensemble Prediction System: Development, Test, and Validation

Providing reliable probabilistic solar radiation information is needed to improve management of the uncertainty and variability of solar generation. Thus, guidance on how to develop skillful and accurate ensemble forecasts is essential and it will ultimately contribute to integration of high amounts of solar energy on the grid. A team from the National Renewable Energy Laboratory and the National Center for Atmospheric Research had been collaborating to develop the WRF-Solar ensemble prediction system (WRF-Solar EPS) in the past three years to produce probabilistic solar irradiance forecasts and better predict solar energy by quantifying forecast uncertainty. The WRF-Solar EPS basically generates ensemble members for solar irradiance based on stochastic perturbations to provide intraday and day-ahead probabilistic forecasts. This study will present main research steps in developing the WRF-Solar EPS including: (a) tangent linear analysis for identifying key input variables of six WRF-Solar modules significantly related to predicting of cloud and solar irradiance, (b) combining stochastic perturbation technique with the WRF-Solar model, and (c) ensemble calibration method to decrease error and uncertainty of ensemble-based solar forecasts. The capability of WRF-Solar EPS is now updated to the most recent version of standard WRF model. This presentation will summarize comprehensive results from the evaluation of forecasts against the National Solar Radiation Data Base as well as ground-measured observations. Moreover, we will introduce the user's guide for WRF-Solar EPS (e.g., parameters to configure stochastic perturbations) and future extension of this research.

day-ahead forecast↗
DOE OSTI2021

Pooling Data Improves Multimodel IDF Estimates over Median-Based IDF Estimates: Analysis over the Susquehanna and Florida

Traditional multimodel methods for estimating future changes in precipitation intensity, duration, and frequency (IDF) curves rely on mean or median of models’ IDF estimates. Such multimodel estimates are impaired by large estimation uncertainty, shadowing their efficacy in planning efforts. Here, assuming that each climate model is one representation of the underlying data generating process, i.e., the Earth system, we propose a novel extension of current methods through pooling model data: (i) evaluate performance of climate models in simulating the spatial and temporal variability of the observed annual maximum precipitation (AMP), (ii) bias-correct and pool historical and future AMP data of reasonably performing models, and (iii) compute IDF estimates in a nonstationary framework from pooled historical and future model data. Pooling enhances fitting of the extreme value distribution to the data and assumes that data from reasonably performing models represent samples from the “true” underlying data generating distribution. Through Monte Carlo simulations with synthetic data, we show that return periods derived from pooled data have smaller biases and lesser uncertainty than those derived from ensembles of individual model data. We apply this method to NA-CORDEX models to estimate changes in 24-h precipitation intensity–frequency (PIF) estimates over the Susquehanna watershed and Florida peninsula. Our approach identifies significant future changes at more stations compared to median-based PIF estimates. The analysis suggests that almost all stations over the Susquehanna and at least two-thirds of the stations over the Florida peninsula will observe significant increases in 24-h precipitation for 2–100-yr return periods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

MetaFlux: Meta-learning global carbon fluxes from sparse spatiotemporal observations

We provide a global, long-term carbon flux dataset of gross primary production and ecosystem respiration generated using meta-learning, called MetaFlux. The idea behind meta-learning stems from the need to learn efficiently given sparse data by learning how to learn broad features across tasks to better infer other poorly sampled ones. Using meta-trained ensemble of deep models, we generate global carbon products on daily and monthly timescales at a 0.25-degree spatial resolution from 2001 to 2021, through a combination of reanalysis and remote-sensing products. Site-level validation finds that MetaFlux ensembles have lower validation error by 5–7% compared to their non-meta-trained counterparts. In addition, they are more robust to extreme observations, with 4–24% lower errors. We also checked for seasonality, interannual variability, and correlation to solar-induced fluorescence of the upscaled product and found that MetaFlux outperformed other machine-learning based carbon product, especially in the tropics and semi-arids by 10–40%. Overall, MetaFlux can be used to study a wide range of biogeochemical processes.

54 ENVIRONMENTAL SCIENCES↗