Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensembles”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Large-Scale High-Resolution Coastal Mangrove Forests Mapping Across West Africa With Machine Learning Ensemble and Satellite Big Data

Coastal mangrove forests provide important ecosystem goods and services, including carbon sequestration, biodiversity conservation, and hazard mitigation. However, they are being destroyed at an alarming rate by human activities. To characterize mangrove forest changes, evaluate their impacts, and support relevant protection and restoration decision making, accurate and up-to-date mangrove extent mapping at large spatial scales is essential. Available large-scale mangrove extent data products use a single machine learning method commonly with 30 m Landsat imagery, and significant inconsistencies remain among these data products. With huge amounts of satellite data involved and the heterogeneity of land surface characteristics across large geographic areas, finding the most suitable method for large-scale high-resolution mangrove mapping is a challenge. The objective of this study is to evaluate the performance of a machine learning ensemble for mangrove forest mapping at 20 m spatial resolution across West Africa using Sentinel-2 (optical) and Sentinel-1 (radar) imagery. The machine learning ensemble integrates three commonly used machine learning methods in land cover and land use mapping, including Random Forest (RF), Gradient Boosting Machine (GBM), and Neural Network (NN). The cloud-based big geospatial data processing platform Google Earth Engine (GEE) was used for pre-processing Sentinel-2 and Sentinel-1 data. Extensive validation has demonstrated that the machine learning ensemble can generate mangrove extent maps at high accuracies for all study regions in West Africa (92%–99% Producer’s Accuracy, 98%–100% User’s Accuracy, 95%–99% Overall Accuracy). This is the first-time that mangrove extent has been mapped at a 20 m spatial resolution across West Africa. The machine learning ensemble has the potential to be applied to other regions of the world and is therefore capable of producing high-resolution mangrove extent maps at global scales periodically.

coastal environment↗

Reduced El NiñO Variability in the Mid-Pliocene According to the Pliomip2 Ensemble

The mid-Pliocene warm period (3.264–3.025 Ma) is the most recent geological period during which atmospheric CO 2 levels were similar to recent historical values (∼400 ppm). Several proxy reconstructions for the mid-Pliocene show highly reduced zonal sea surface temperature (SST) gradients in the tropical Pacific Ocean, indicating an El Niño-like mean state. However, past modelling studies do not show these highly reduced gradients. Efforts to understand mid-Pliocene climate dynamics have led to the Pliocene Model Intercomparison Project (PlioMIP). Results from the first phase (PlioMIP1) showed clear El Niño variability (albeit significantly reduced) and did not show the greatly reduced time-mean zonal SST gradient suggested by some of the proxies. In this work, we study El Niño–Southern Oscillation (ENSO) variability in the PlioMIP2 ensemble, which consists of additional global coupled climate models and updated boundary conditions compared to PlioMIP1. We quantify ENSO amplitude, period, spatial structure and “flavour”, as well as the tropical Pacific annual mean state in mid-Pliocene and pre-industrial simulations. Results show a reduced ENSO amplitude in the model-ensemble mean (−24 %) with respect to the pre-industrial, with 15 out of 17 individual models showing such a reduction. Furthermore, the spectral power of this variability considerably decreases in the 3–4-year band. The spatial structure of the dominant empirical orthogonal function shows no particular change in the patterns of tropical Pacific variability in the model-ensemble mean, compared to the pre-industrial. Although the time-mean zonal SST gradient in the equatorial Pacific decreases for 14 out of 17 models (0.2 ∘C reduction in the ensemble mean), there does not seem to be a correlation with the decrease in ENSO amplitude. The models showing the most “El Niño-like” mean state changes show a similar ENSO amplitude to that in the pre-industrial reference, while models showing more “La Niña-like” mean state changes generally show a large reduction in ENSO variability. The PlioMIP2 results show a reasonable agreement with both time-mean proxies indicating a reduced zonal SST gradient and reconstructions indicating a reduced, or similar, ENSO variability.

mid-Pliocene warm period↗

Development and Evaluation of Ensemble Consensus Precipitation Estimates over High Mountain Asia

Precipitation estimates are highly uncertain in complex regions such as High-Mountain Asia (HMA), where ground measurements are very difficult to obtain, and atmospheric dynamics poorly understood. Though gridded products derived from satellite-based observations and/or reanalysis can provide temporally and spatially distributed estimates of precipitation, there are significant inconsistencies in these products. As such, to date, there is little agreement in the community on the best and most accurate gridded precipitation product in HMA, which is likely area dependent because of HMA’s strong heterogeneities and complex orography. Targeting these gaps, this article presents the development of a consensus ensemble precipitation product using three gridded precipitation datasets (the Integrated Multi-satellitE Retrieals for Global Precipitation Measurement IMERG, the Climate Hazards group Infrared Precipitation with Stations CHIRPS, and the ECMWF Reanalysis ERA5) with a localized probability matched mean (LPM) approach. We evaluate the performance of the LPM estimate along with a simple ensemble mean (EM) estimate to overcome the differences and disparities of the three selected constituent products on long-term averages and trends in HMA. Our analysis demonstrates that LPM reduces the high biases embedded in the ensemble members and provides more realistic spatial patterns compared to EM. LPM is also a good alternative for merging data products with different spatio-temporal resolutions. By filtering disparities among the individual ensemble members, LPM overcomes the problem of a certain product performing well only in a particular area and provides a consensus estimate with plausible temporal trends.

Fadji Z Maina↗

HIGH-RESOLUTION ATMOSPHERIC ENSEMBLE MODELING AT SRNL

The High-Resolution Mid-Atlantic Forecasting Ensemble (HME) is a federated effort to improve operational forecasts related to precipitation, convection and boundary layer evolution, and fire weather utilizing data and computing resources from a diverse group of cooperating institutions in order to create a mesoscale ensemble from independent members. Collaborating organizations involved in the project include universities, National Weather Service offices, and national laboratories, including the Savannah River National Laboratory (SRNL). The ensemble system is produced from an overlapping numerical weather prediction model domain and parameter subsets provided by each contributing member. The coordination, synthesis, and dissemination of the ensemble information are performed by the Renaissance Computing Institute (RENCI) at the University of North Carolina-Chapel Hill. This paper discusses background related to the HME effort, SRNL participation, and example results available from the RENCI website.

54 ENVIRONMENTAL SCIENCES↗

FLEET: Flexible Efficient Ensemble Training for Heterogeneous Deep Neural Networks

Parallel training of an ensemble of Deep Neural Networks (DNN) on a cluster of nodes is an effective approach to shorten the process of neural network architecture search and hyper-parameter tuning for a given learning task. Prior efforts have shown that data sharing, where the common preprocessing operation is shared across the DNN training pipelines, saves computational resources and improves pipeline efficiency. Data sharing strategy, however, performs poorly for a heterogeneous set of DNNs where each DNN has varying computational needs and thus different training rate and convergence speed. This paper proposes FLEET, a flexible ensemble DNN training framework for efficiently training a heterogeneous set of DNNs. We build FLEET via several technical innovations. We theoretically prove that an optimal resource allocation is NP-hard and propose a greedy algorithm to efficiently allocate resources for training each DNN with data sharing. We integrate data-parallel DNN training into ensemble training to mitigate the differences in training rates and introduce checkpointing into this context to address the issue of different convergence speeds. Experiments show that FLEET significantly improves the training efficiency of DNN ensembles without compromising the quality of the result.

Guan, Hui↗

CryoFold: Determining protein structures and data-guided ensembles from cryo-EM density maps

Cryoelectron microscopy requires molecular modeling for refinement of structures. Ensemble models arrive at low free-energy molecular structures, but are computationally expensive and limited to resolving only small proteins. Here, we introduce CryoFold, a pipeline of molecular dynamics simulations that determines ensembles of protein structures by integrating density data of varying sparsity at 3–5 Å resolution with sequence information and coarse-grained topological knowledge of the protein folds. We present six examples, folding proteins between 72 and 2,000 residues, including large membrane and multi-domain systems, and results from two Electron Microscopy Data Bank (EMDB) competitions. Driven by data from a single state, CryoFold discovers ensembles of common low-energy models together with rare low-probability structures that capture the equilibrium distribution of proteins constrained by the density maps. Many of these conformations are experimentally validated and functionally relevant. We arrive at a set of best practices for data-guided protein folding that are controlled using a Python graphical user interface (GUI).

59 BASIC BIOLOGICAL SCIENCES↗

A Novel Modeling Framework for Computationally Efficient and Accurate Real-Time Ensemble Flood Forecasting With Uncertainty Quantification

A novel modeling framework that simultaneously improves accuracy, predictability, and computational efficiency is presented. It embraces the benefits of three modeling techniques integrated together for the first time: surrogate modeling, parameter inference, and data assimilation. The use of polynomial chaos expansion (PCE) surrogates significantly decreases computational time. Parameter inference allows for model faster convergence, reduced uncertainty, and superior accuracy of simulated results. Ensemble Kalman filters assimilate errors that occur during forecasting. To examine the applicability and effectiveness of the integrated framework, we developed 18 approaches according to how surrogate models are constructed, what type of parameter distributions are used as model inputs, and whether model parameters are updated during the data assimilation procedure. We conclude that (1) PCE must be built over various forcing and flow conditions, and in contrast to previous studies, it does not need to be rebuilt at each time step; (2) model parameter specification that relies on constrained, posterior information of parameters (so-called Selected specification) can significantly improve forecasting performance and reduce uncertainty bounds compared to Random specification using prior information of parameters; and (3) no substantial differences in results exist between single and dual ensemble Kalman filters, but the latter better simulates flood peaks. The use of PCE effectively compensates for the computational load added by the parameter inference and data assimilation (up to ~80 times faster). Therefore, the presented approach contributes to a shift in modeling paradigm arguing that complex, high-fidelity hydrologic and hydraulic models should be increasingly adopted for real-time and ensemble flood forecasting.

54 ENVIRONMENTAL SCIENCES↗

Coupled machine learning–ecosystem ensemble models substantially improve predictions of nitrous oxide (N 2 O) fluxes from US croplands

Nitrous oxide (N 2 O) is a potent and persistent greenhouse gas, with rising atmospheric concentrations driven in part by inefficient use of synthetic nitrogen (N) fertilizers in agriculture. Predicting soil N 2 O emissions is challenging due to high spatial and temporal variability arising from complex soil biogeochemical processes. Process-based ecosystem models and standalone machine learning (ML) approaches without extensive site-specific calibration often miss high-emission episodes. Here, we show how an Ensemble Modeling System (EMS) based on outputs from an ensemble of ecosystem models coupled to an ensemble of ML models can improve predictions and understanding of N 2 O fluxes from US cropland. Trained and validated on ~12,000 N 2 O chamber measurements at 17 US Midwest sites (six crops, 35 management practices), the EMS accurately predicted daily fluxes of N 2 O at both training (R 2 = 0.84, RMSE = 16.4 g N ha −1 d −1 ) and held-out testing sites (R 2 = 0.84, RMSE = 6.2 g N ha −1 d −1 ). Analyses identified six dominant N 2 O drivers: soil organic carbon (SOC), NH 4 + , NO 3 - , water-filled pore space, temperature, and aboveground biomass production. Wet, warm soils produced large N 2 O peaks only with sufficient SOC and mineral N; in low-SOC soils, fluxes remained low. Incorporating these drivers into process-based models might significantly improve their predictive capacity. The EMS demonstrates a strong potential to predict N 2 O fluxes at unseen sites, enabling more reliable regional inventories, improved gap-filling where measurements are sparse, and enhanced understanding of mechanisms to advance targeted mitigation strategies in food, feed, and bioenergy crops.

AI↗

Challenges in Visual Analysis of Ensembles

Modeling physical phenomena through computational simulation increasingly relies on generating a collection of related runs, known as an ensemble. In this paper, we explore the challenges we face in developing analysis and visualization systems for large and complex ensemble data sets, which we seek to understand without having to view the results of every simulation run. Implementing approaches and ideas developed in response to this goal, we demonstrate the analysis of a 15K run material fracturing study using Slycat, our ensemble analysis system.

97 MATHEMATICS AND COMPUTING↗

Data from: Coupled machine learning-ecosystem ensemble models substantially improve predictions of nitrous oxide (N 2 O) fluxes from US croplands

Nitrous oxide (N₂O) is a potent and persistent greenhouse gas, with rising atmospheric concentrations driven in part by inefficient use of synthetic nitrogen (N) fertilizers in agriculture. Predicting soil N₂O emissions is challenging due to high spatial and temporal variability arising from complex soil biogeochemical processes. Process-based ecosystem models and standalone machine learning (ML) approaches without extensive site-specific calibration often miss high emission episodes. Here, we show how an Ensemble Modeling System (EMS) based on outputs from an ensemble of ecosystem models coupled to an ensemble of ML models can improve predictions and understanding of N2O fluxes from US cropland. Trained and validated on approximately 12,000 N2O chamber measurements at 17 U.S. Midwest sites (six crops, 35 management practices), the EMS accurately predicted daily fluxes of N2O at both training (R² = 0.84, RMSE = 16.4 g N ha⁻¹ d⁻¹) and held-out testing sites (R² = 0.84, RMSE = 6.2 g N ha⁻¹ d⁻¹). Analyses identified six dominant N₂O drivers: soil organic carbon (SOC), NH₄⁺, NO₃⁻, water-filled pore space (WFPS), soil temperature, and biomass production. Wet, warm soils produced large N₂O peaks only with sufficient SOC and mineral N; in low-SOC soils, fluxes remained low. Incorporating these drivers into process-based models might significantly improve their predictive capacity. The EMS demonstrates a strong potential to predict N₂O fluxes at unseen sites, enabling more reliable regional inventories, improved gap-filling where measurements are sparse, and enhanced understanding of mechanisms to advance targeted mitigation strategies in food, feed, and bioenergy crops.

agricultural sciences↗

A second-order ensemble method based on a blended backward differentiation formula timestepping scheme for time-dependent Navier-Stokes equations

Here, we present a second-order ensemble method based on a blended three-step backward differentiation formula (BDF) timestepping scheme to compute an ensemble of Navier–Stokes equations. Compared with the only existing second-order ensemble method that combines the two-step BDF timestepping scheme and a special explicit second-order Adams–Bashforth treatment of the advection term, this method is more accurate with nominal increase in computational cost. We give comprehensive stability and error analysis for the method. Numerical examples are also provided to verify theoretical results and demonstrate the improved accuracy of the method.

97 MATHEMATICS AND COMPUTING↗

A Framework to Analyze the Performance of Load Balancing Schemes for Ensembles of Stochastic Simulations

Ensembles of simulations are employed to estimate the statistics of possible future states of a system, and are widely used in important applications such as climate change and biological modeling. Ensembles of runs can naturally be executed in parallel. However, when the CPU times of individual simulations vary considerably, a simple strategy of assigning an equal number of tasks per processor can lead to serious work imbalances and low parallel efficiency. This paper presents a new probabilistic framework to analyze the performance of dynamic load balancing algorithms for ensembles of simulations where many tasks are mapped onto each processor, and where the individual compute times vary considerably among tasks. Four load balancing strategies are discussed: most-dividing, all-redistribution, random-polling, and neighbor-redistribution. Simulation results with a stochastic budding yeast cell cycle model are consistent with the theoretical analysis. It is especially significant that there is a provable global decrease in load imbalance for the local rebalancing algorithms due to scalability concerns for the global rebalancing algorithms. The overall simulation time is reduced by up to 25 %, and the total processor idle time by 85 %.

ALGORITHMS↗

A combined ensemble-volume average homogenization method for lattice structures with defects under dynamic and static loading

In the study of lattices structures, both experiments and numerical simulations are often conducted with small samples. Using combined ensemble and volume averaging, this work introduces a method to extract a macroscopic constitutive response of a lattice material from numerical simulations performed in periodic domains. The domain size needed to obtain statistically accurate results is investigated. Similar to molecular dynamics, the concept of the virial stress is introduced after homogenized equations are derived using the ensemble averaging method. Under static conditions, the virial stress is shown to agree with the volume averaged solid stress. Using the homogenization method, constitutive relations for this stress can be obtained from systems with uniform strains. Application of such obtained constitutive relations to more general cases results in an error proportional to the square of the ratio between the lattice length scale and the macroscopic length scale. Taking advantage of this property, numerical simulations are performed in systems with a uniform gradient of the average velocity. The volume average method is then used to accelerate convergence when studying lattices with defects. To avoid the artificial numerical time scale from the size of a representative volume element divided by the wave speed, a numerical scheme is developed to enforce a spatially uniform velocity gradient within the computational domain while allowing fluctuations of the velocity or displacement to develop naturally. To account for probability distribution of lattice defects, the stress is calculated as the ensemble-volume averaged value. For dynamic systems, energy dissipation properties are also studied.

36 MATERIALS SCIENCE↗

DART-PFLOTRAN: An ensemble-based data assimilation system for estimating subsurface flow and transport model parameters

Ensemble-based Data Assimilation (EDA), based on the Monte Carlo approach, has been effectively applied to estimate model parameters through inverse modeling in subsurface flow and transport problems. However, implementation of EDA approach involves a complicated workflow that include setting up and executing ensemble forward model simulations, processing observations and model simulation results for parameter updates, and repeat for sequential or iterative EDA. To facilitate the management of such workflow and lower the barriers for adopting EDA-based parameter estimation in subsurface science, we develop a generic software frame-work linking the Data Assimilation Research Testbed (DART) with a massively parallel subsurface FLOw and TRANsport code PFLOTRAN. The new DART-PFLOTRAN leverages both the core data assimilation engines in DART and the computational power afforded by PFLOTRAN. In addition to the standard smoother and filtering options, DART-PFLOTRAN enables an iterative EDA workflow based on the Ensemble Smoother for Multiple Data Assimilation method (ES-MDA) to improve estimation accuracy for nonlinear forward problems. Here, we verify the implementation of ES-MDA in DART-PFLOTRAN using two synthetic cases designed to estimate static permeability and dynamic exchange fluxes across the riverbed, respectively, from continuous temperature measurements made across a depth profile. One-dimensional hydro-thermal simulations are performed in both cases to relate temperature responses with the parameters of interest. In the case of estimating dynamic parameters, we demonstrate the flexibility of DART-PFLOTRAN in automating sequential ES-MDA workflow, which will significantly reduce the time researchers spend on managing complex workflows in similar applications. Both studies yield accurate estimations of the parameters compared to their synthetic truth, while ES-MDA leads to more accurate estimation when a high level of nonlinearity exist between observed responses and unknown parameters. With a code base in Python and Fortran, DART-PFLOTRAN paves the way for applications in large-scale subsurface inverse modeling by automating the complex workflow of sequential ES-MDA that can be executed on various computing platforms.

97 MATHEMATICS AND COMPUTING↗

Uncertainty guided online ensemble for non-stationary data streams in fusion science

Machine Learning (ML) is poised to play a pivotal role in the development and operation of next-generation fusion devices. Fusion data shows non-stationary behavior with distribution drifts, resulted by both experimental evolution and machine wear-and-tear. ML models assume stationary distribution and fail to maintain performance when encountered with such non-stationary data streams. Online learning techniques have been leveraged in other domains, however it has been largely unexplored for fusion applications. In this paper, we investigate online learning for continuous adaptation to drifting data streams in the prediction of Toroidal Field (TF) coils deflection at the DIII-D fusion facility. We further address the short-term performance degradation inherent to standard online learning, which arises because ground truth is unavailable at prediction time. To mitigate this issue, we propose an uncertainty-guided online ensemble framework. The method leverages the Deep Gaussian Process Approximation (DGPA) for calibrated uncertainty estimation and uses these uncertainty measures to guide a meta-algorithm that aggregates predictions from learners trained over different historical horizons. Our results show that online learning reduces prediction error by 80% compared to a static model. The online ensemble and the proposed uncertainty-guided ensemble further reduce error by approximately 6%, and 10% respectively, relative to standard single-model online learning, while also providing calibrated uncertainty estimates to support operational decision-making.

AI↗

Consistent Timing of Arctic Permafrost Loss Across the CESM1 Large Ensemble

Abstract The Arctic is especially vulnerable to climate change and is warming faster than the global average. Changes in this region pose a heightened threat due to the immense amount of carbon frozen as organic material in the soil. When permafrost thaws, organic material decays and releases as greenhouse gases into the atmosphere, contributing to further warming. A better understanding of the processes that influence permafrost degradation is needed to inform climate adaptation and mitigation planning. This study assesses changes to Arctic permafrost across 35 ensemble member simulations from the Community Earth System Model 1 Large Ensemble Project, under the Representative Concentration Pathway 8.5 21st century scenario. Most Arctic near‐surface permafrost is lost by 2100, but timing varies across regions and with soil depth. Internal climate variability, represented by differences between ensemble members, has a constrained influence on degradation timing due to relative consistency of summer temperature increases and insulation by winter snow cover.

54 ENVIRONMENTAL SCIENCES↗

Enhancing the activity of Pd ensembles on graphene by manipulating coordination environment

Atomic dispersion of metal catalysts on a substrate accounts for the increased atomic efficiency of single-atom catalysts (SACs) in various catalytic schemes compared to the nanoparticle counterparts. However, lacking neighboring metal sites has been shown to deteriorate the catalytic performance of SACs in a few industrially important reactions, such as dehalogenation, CO oxidation, and hydrogenation. Metal ensemble catalysts (M n ), an extended concept to SACs, have emerged as a promising alternative to overcome such limitation. Inspired by the fact that the performance of fully isolated SACs can be enhanced by tailoring their coordination environment (CE), we here evaluate whether the CE of M n can also be manipulated in order to enhance their catalytic activity. We synthesized a set of Pd ensembles (Pd n ) on doped graphene supports (Pd n /X-graphene where X = O, S, B, and N). We found that introducing S and N onto oxidized graphene modifies the first shell of Pd n converting Pd–O to Pd–S and Pd–N, respectively. Also, we further found that the B dopant significantly affected the electronic structure of Pd n by serving as an electron donor in the second shell. We examined the performance of Pd n /X-graphene toward selective reductive catalysis, such as bromate reduction, brominated organic hydrogenation, and aqueous-phase CO 2 reduction. We observed that Pd n /N-graphene exhibited superior performance by lowering the activation energy of the rate-limiting step, i.e., H 2 dissociation into atomic hydrogen. The results collectively suggest controlling the CE of SACs in an ensemble configuration is a viable strategy to optimize and enhance their catalytic performance.

36 MATERIALS SCIENCE↗

Realistic simulations of spin squeezing and cooperative coupling effects in large ensembles of interacting two-level systems

We describe an efficient numerical method for simulating the dynamics of interacting spin ensembles in the presence of dephasing and decay. The method builds on the discrete truncated Wigner approximation for isolated systems, which combines the mean-field dynamics of a spin ensemble with a Monte Carlo sampling of discrete initial spin values to account for quantum correlations. Here we show how this approach can be generalized for dissipative spin systems by replacing the deterministic mean-field evolution by a stochastic process, which describes the decay of coherences and populations while preserving the length of each spin. We demonstrate the application of this technique for simulating nonclassical spin-squeezing effects or the dynamics and steady states of cavity QED models with 10 5 interacting two-level systems. This opens up the possibility to perform accurate real-scale simulations of a diverse range of experiments in quantum optics or with solid-state spin ensembles under realistic laboratory conditions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗