Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Prognostic analysis of high-flow nasal cannula therapy and non-invasive ventilation in mild to moderate hypoxemia patients and construction of a machine learning model for 48-h intubation prediction—a retrospective analysis of the MIMIC database

Background This study aims to investigate the clinical outcome between high-flow nasal cannula (HFNC) and non-invasive ventilation (NIV) therapy in mild to moderate hypoxemic patients on the first ICU day and to develop a predictive model of 48-h intubation. Methods The study included adult patients from the MIMIC III and IV databases who first initiated HFNC or NIV therapy due to mild to moderate hypoxemia (100 < PaO2/FiO2 ≤ 300). The 48-h and 30-day intubation rates were compared using cross-sectional and survival analysis. Nine machine learning and six ensemble algorithms were deployed to construct the 48-h intubation predictive models, of which the optimal model was determined by its prediction accuracy. The top 10 risk and protective factors were identified using the Shapley interpretation algorithm. Result A total of 123,042 patients were screened, of which, 673 were from the MIMIC IV database for ventilation therapy comparison (HFNC n = 363, NIV n = 310) and 48-h intubation predictive model construction (training dataset n = 471, internal validation set n = 202) and 408 were from the MIMIC III database for external validation. The NIV group had a lower intubation rate (23.1% vs. 16.1%, p = 0.001), ICU 28-day mortality (18.5% vs. 11.6%, p = 0.014), and in-hospital mortality (19.6% vs. 11.9%, p = 0.007) compared to the HFNC group. Survival analysis showed that the total and 48-h intubation rates were not significantly different. The ensemble AdaBoost decision tree model (internal and external validation set AUROC 0.878, 0.726) had the best predictive accuracy performance. The model Shapley algorithm showed Sequential Organ Failure Assessment (SOFA), acute physiology scores (APSIII), the minimum and maximum lactate value as risk factors for early failure and age, the maximum PaCO 2 and PH value, Glasgow Coma Scale (GCS), the minimum PaO 2 /FiO 2 ratio, and PaO 2 value as protective factors. Conclusion NIV was associated with lower intubation rate and ICU 28-day and in-hospital mortality. Further survival analysis reinforced that the effect of NIV on the intubation rate might partly be attributed to the other impact factors. The ensemble AdaBoost decision tree model may assist clinicians in making clinical decisions, and early organ function support to improve patients’ SOFA, APSIII, GCS, PaCO 2 , PaO 2 , PH, PaO 2 /FiO 2 ratio, and lactate values can reduce the early failure rate and improve patient prognosis.

Fu, Wei↗
DOE OSTI2022

Simulation process and data flow for a large system dynamics model

This paper documents the workflow and supporting technologies that a large system dynamics model, the biomass scenario model, employs to streamline the data preparation, simulation, quality control, and analysis process at the National Renewable Energy Laboratory. The workflow centers on automation of routine aspects of the flow of data between data stores, simulations, and visualizations. It enforces quality checks on data, reproducibility of computations, and traceability of results, while maintaining complete archives of modeling and analysis artifacts. The resulting frictionless simulation/analysis environment supports large-scale sensitivity analysis, interactive creation of ensembles of simulations, and rapid visualization-based exploration of simulation results.

09 BIOMASS FUELS↗
DOE OSTI2023

Efficient Probabilistic Prediction and Uncertainty Quantification of Tropical Cyclone–Driven Storm Tides and Inundation

Abstract This study proposes and assesses a methodology to obtain high-quality probabilistic predictions and uncertainty information of near-landfall tropical cyclone–driven (TC-driven) storm tide and inundation with limited time and resources. Forecasts of TC track, intensity, and size are perturbed according to quasi-random Korobov sequences of historical forecast errors with assumed Gaussian and uniform statistical distributions. These perturbations are run in an ensemble of hydrodynamic storm tide model simulations. The resulting set of maximum water surface elevations are dimensionality reduced using Karhunen–Loève expansions and then used as a training set to develop a polynomial chaos (PC) surrogate model from which global sensitivities and probabilistic predictions can be extracted. The maximum water surface elevation is extrapolated over dry points incorporating energy head loss with distance to properly train the surrogate for predicting inundation. We find that the surrogate constructed with third-order PCs using elastic net penalized regression with leave-one-out cross validation provides the most robust fit across training and test sets. Probabilistic predictions of maximum water surface elevation and inundation area by the surrogate model at 48-h lead time for three past U.S. landfalling hurricanes (Irma in 2017, Florence in 2018, and Laura in 2020) are found to be reliable when compared to best track hindcast simulation results, even when trained with as few as 19 samples. The maximum water surface elevation is most sensitive to perpendicular track-offset errors for all three storms. Laura is also highly sensitive to storm size and has the least reliable prediction. Significance Statement The purpose of this study is to develop and evaluate a methodology that can be used to provide high-quality probabilistic predictions of hurricane-induced storm tide and inundation with limited time and resources. This is important for emergency management purposes during or after the landfall of hurricanes. Our results show that sampling forecast errors using quasi-random sequences combined with machine learning techniques that fit polynomial functions to the data are well suited to this task. The polynomial functions also have the benefit of producing exact sensitivity indices of storm tide and inundation to the forecasted hurricane properties such as path, intensity, and size, which can be used for uncertainty estimation. The code implementing the presented methodology is publicly available on GitHub.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Feedforward-feedback ammonia control at a water resource recovery facility based on a digital twin with hybrid model

Ammonia-based aeration control (ABAC) at full-scale Water Resource Recovery Facilities (WRRFs) can be challenged by diurnal loading and transport delays. This work addressed these challenges using a hybrid feedforward–feedback controller built on Activated Sludge Model 1 (ASM1), marking the first full-scale deployment to pair a mechanistic feedforward core with data-driven corrections. The objectives were to improve ammonia setpoint tracking, assess performance of the mechanistic model when enhanced with data-driven corrections, and document full-scale operation. The hybrid model incorporates two data-driven components: (1) a Mechanistic Error Forecasting Engine (MEFE), consisting of a multivariate linear regressor and a long short-term memory (LSTM) ensemble. Defying expectations, low-parameter models outperformed more complex alternatives, reducing the mechanistic error by 71%. (2) A Residual Oscillation Forecasting Engine (ROFE), based on Fast Fourier Transform, reduced the remaining error by another 35%. Two proportional–integral (PI) feedback loops further (i) trim the feedforward output and (ii) eliminate residual controller error in the final aerobic zone. In full-scale operation, the controller reduced mean-squared error (MSE) by 94% over the baseline and produced more stable dissolved oxygen (DO) setpoints. Overall, it was proven that layering multi-timescale data-driven models on a mechanistic core can yield reliable ABAC performance at WRRFs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Atomic Layer Deposition with TiO2 for Enhanced Reactivity and Stability of Aromatic Hydrogenation Catalysts

Hydrogenation of aromatic molecules in fossil- and bio-derived fuels is essential for decreasing emissions of harmful combustion products and addressing growing concerns around urban air pollution. In this work, we used atomic layer deposition to significantly enhance the hydrogenation performance of a conventional supported Pd catalyst by applying an ultrathin coating of TiO2 in a scalable powder coating process. The TiO2-coated catalyst showed substantial gains in the conversion of multiple aromatic molecules, including a 5-fold improvement in turnover frequency versus the uncoated catalyst in the hydrogenation of naphthalene. This activity enhancement was maintained upon scaling the coating synthesis process from 3 to 100 g. Based on the results from Xray photoelectron spectroscopy, X-ray absorption spectroscopy, and computational modeling, the activity enhancement was attributed to ensemble effects resulting from partial TiO2 coverage of the Pd surface rather than fundamental changes to the Pd electronic structure. Additional durability testing confirmed that the TiO2 coating improved the thermal and hydrothermal stability of the catalyst as well as tolerance toward sulfur impurities in the reactant stream. Using an economic model of an industrial deep hydrogenation process, we found that an increase in catalyst activity or lifetime of 2× would justify even a relatively high estimate for the cost of TiO2 atomic layer deposition coatings at scale

atomic layer↗
DOE OSTI2025

Towards robust surrogate models: Benchmarking machine learning approaches to expediting phase field simulations of brittle fracture

Data-driven approaches have the potential to make modeling complex, nonlinear physical phenomena significantly more computationally tractable. For example, computational modeling of fracture is a core challenge where machine learning techniques have the potential to provide a much needed speedup that would enable progress in areas such as multi-scale modeling and uncertainty quantification. Currently, phase field modeling (PFM) of fracture is one such approach that offers a convenient variational formulation to model crack nucleation, branching and propagation. To date, machine learning techniques have shown promise in approximating PFM simulations. While standard fracture benchmarks represent realistic scenarios frequently observed in practice, they typically do not provide sufficiently challenging tests for data-driven methods. Here, to address this gap, we introduce a challenging dataset based on PFM simulations designed to benchmark and advance ML methods for fracture modeling. This dataset includes three energy decomposition methods, two boundary conditions, and 1000 random initial crack configurations for a total of 6000 simulations. Each sample contains 100 time steps capturing the temporal evolution of the crack field. Alongside this dataset, we also implement and evaluate Physics Informed Neural Networks (PINN), Fourier Neural Operators (FNO), and UNet models as baselines, and explore the impact of ensembling strategies on prediction accuracy. With this combination of our dataset and baseline models drawn from the literature we aim to provide a standardized and challenging benchmark for evaluating machine learning approaches to solid mechanics. Our results highlight both the promise and limitations of popular current models, and demonstrate the utility of this dataset as a testbed for advancing machine learning in fracture mechanics research.

Benchmark dataset↗
DOE OSTI2022

Prismatic-to-basal plastic slip transition in zirconium

Here, we model three-dimensional dislocation ensembles in Zr pillars using newly developed mobility laws for dislocations on prismatic and basal planes. The effects of the loading orientation and temperature on the micro-scale mechanical response of single crystals are systematically explored. Easy dislocation glide is observed on prismatic planes, while hard glide occurs on basal planes. By selection of sample temperature and loading orientation, we show that the transition from prismatic to basal glide of dislocation ensembles can be controlled. We also show that the presence of dislocation cross-slip strongly promotes prismatic glide as a result of prismatic/basal cross-slip energy asymmetry. Cross-slip does not alter the occurrence of plastic slip transition but only induces a shift towards higher temperatures. The preponderance of plastic slip on basal or prismatic planes is found to be mediated by a transitional dislocation, which is composed of glissile segments on parallel prismatic planes connected by glissile super-jogs on basal planes. These findings provide a mechanistic understanding of experiments and highlight the significance of transitional prismatic-basal dislocations on the macroscopic characteristics of plasticity in HCP crystals.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Paw-Net: Stacking ensemble deep learning for segmenting scanning electron microscopy images of fine-grained shale samples

Segmentation of scanning electron microscopy (SEM) images is critical yet time-consuming for geological analyses, as it needs to differentiate the boundaries for different mineral objects to facilitate subsequent analyses, such as porosity calculation. Recently, various machine learning methods, especially convolutional neural networks (CNNs), have been explored to segment SEM images of fine-grained shale samples. However, we found that general CNNs do not yield optimal performance due to insufficient training data and imbalanced objects in SEM images. This work has revised the U-Net architecture, a popular approach for biomedical image analyses, by incorporating a loss function that addresses the imbalance issue. Furthermore, we used the ensemble learning method to train multiple models and combined the results to improve the overall performance of segmentation. We prepared 2162 sub-images from raw SEM images in our experiments and divided them into training, validation, and testing datasets. The overall results show that our method improves the average Intersection over Union (IOU) of mineral objects from 0.49 to 0.58, compared to the original U-Net model. Our method can clearly distinguish each object from others with boundaries, even in highly imbalanced images. Training our models takes less than three minutes using a single GPU, while manual labeling can take up to three hours for each image. Furthermore, the method helps geoscientists gain insights quickly and effectively by building neural network models from a small dataset of SEM images.

58 GEOSCIENCES↗
DOE OSTI2019

Emergent Relationships Among Sea Ice, Longwave Radiation, and the Beaufort High Circulation Exposed Through Parameter Uncertainty Analysis

Using a perturbed parameter ensemble of a coupled climate model, emerging relationships are identified between sea ice area, net surface longwave radiation, and the atmospheric circulation over the Beaufort gyre. There is a strong positive correlation between sea ice area and the net longwave radiation over the ocean-ice surface during the melting season and a negative correlation during the freezing season. The mechanisms responsible for the longwave radiation balance at the surface are mainly driven by sea ice variations in the freezing season and by clouds in the melting season. A strong positive (negative) correlation is also found between the fall (summer) total sea ice area in the Arctic and the sea level pressure over the Beaufort High region. It is argued that as sea ice coverage is lost, static stability losses are severe in fall, resulting in enhanced evaporation, vertical motions, and weakening of the general large-scale anticyclonic circulation of the Beaufort High.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Investigating Future Arctic Sea Ice Loss and Near–Surface Wind Speed Changes Related to Surface Roughness Using the Community Earth System Model

The Arctic is undergoing a pronounced and rapid transformation in response to changing greenhouse gasses, including reduction in sea ice extent and thickness. There are also projected increases in near-surface Arctic wind. This study addresses how the winds trends may be driven by changing surface roughness and/or stability in different Arctic regions and seasons, something that has not yet been thoroughly investigated. We analyze 50 experiments from the Community Earth System Model Version 2 (CESM2) Large Ensemble and five experiments using CESM2 with an artificially decreased sea ice roughness to match that of the open ocean. We find that with a smoother surface there are higher mean wind speeds and slower mean ice speeds in the autumn, winter, and spring. The artificially reduced surface roughness also strongly impacts the wind speed trends in autumn and winter, and we find that atmospheric stability changes are also important contributors to driving wind trends in both experiments. In contrast to the clear impacts on winds, the sea ice mean state and trends are statistically indistinguishable, suggesting that near-surface winds are not major drivers of Arctic sea ice loss. Two major results of this work are: (a) the near-surface wind trends are driven by changes in both surface roughness and near-surface atmospheric stability that are themselves changing from sea ice loss, and (b) the sea ice mean state and trends are driven by the overall warming trend due to increasing greenhouse gas emissions and not significantly impacted by coupled feedbacks with the surface winds.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Trends and Drivers of Terrestrial Sources and Sinks of Carbon Dioxide: An Overview of the TRENDY Project

The terrestrial biosphere plays a major role in the global carbon cycle, and there is a recognized need for regularly updated estimates of land-atmosphere exchange at regional and global scales. An international ensemble of Dynamic Global Vegetation Models (DGVMs), known as the “Trends and drivers of the regional scale terrestrial sources and sinks of carbon dioxide” (TRENDY) project, quantifies land biophysical exchange processes and biogeochemistry cycles in support of the annual Global Carbon Budget assessments and the REgional Carbon Cycle Assessment and Processes, phase 2 project. DGVMs use a common protocol and set of driving data sets. A set of factorial simulations allows attribution of spatio-temporal changes in land surface processes to three primary global change drivers: changes in atmospheric CO 2 , climate change and variability, and Land Use and Land Cover Changes (LULCC). Here, we describe the TRENDY project, benchmark DGVM performance using remote-sensing and other observational data, and present results for the contemporary period. Simulation results show a large global carbon sink in natural vegetation over 2012–2021, attributed to the CO 2 fertilization effect (3.8 ± 0.8 PgC/yr) and climate (–0.58 ± 0.54 PgC/yr). Forests and semi-arid ecosystems contribute approximately equally to the mean and trend in the natural land sink, and semi-arid ecosystems continue to dominate interannual variability. The natural sink is offset by net emissions from LULCC (–1.6 ± 0.5 PgC/yr), with a net land sink of 1.7 ± 0.6 PgC/yr. Despite the largest gross fluxes being in the tropics, the largest net land-atmosphere exchange is simulated in the extratropical regions.

58 GEOSCIENCES↗
DOE OSTI2020

A joint role for forced and internally-driven variability in the decadal modulation of global warming

Despite the observed monotonic increase in greenhouse-gas concentrations, global mean temperature displays important decadal fluctuations typically attributed to both external forcing and internal variability. Here, we provide a robust quantification of the relative contributions of anthropogenic, natural, and internally-driven decadal variability of global mean sea surface temperature (GMSST) by using a unique dataset consisting of 30-member large initial-condition ensembles with five Earth System Models (ESM-LE). We present evidence that a large fraction (~29–53%) of the simulated decadal-scale variance in individual timeseries of GMSST over 1950–2010 is externally forced and largely linked to the representation of volcanic aerosols. Comparison with the future (2010–2070) period suggests that external forcing provides a source of additional decadal-scale variability in the historical period. Given the unpredictable nature of future volcanic aerosol forcing, it is suggested that a large portion of decadal GMSST variability might not be predictable.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Global roll-out of comprehensive policy measures may aid in bridging emissions gap

Closing the emissions gap between Nationally Determined Contributions (NDCs) and the global emissions levels needed to achieve the Paris Agreement’s climate goals will require a comprehensive package of policy measures. National and sectoral policies can help fill the gap, but success stories in one country cannot be automatically replicated in other countries. They need to be adapted to the local context. Here, we develop a new Bridge scenario based on nationally relevant, short-term measures informed by interactions with country experts. These good practice policies are rolled out globally between now and 2030 and combined with carbon pricing thereafter. We implement this scenario with an ensemble of global integrated assessment models. We show that the Bridge scenario closes two-thirds of the emissions gap between NDC and 2°C scenarios by 2030 and enables a pathway in line with the 2 °C goal when combined with the necessary long-term changes, i.e. more comprehensive pricing measures after 2030. The Bridge scenario leads to a scale-up of renewable energy (reaching 52%-88% of global electricity supply by 2050), electrification of end-uses, efficiency improvements in energy demand sectors, and enhanced afforestation and reforestation. Our analysis suggests that early action via good-practice policies is less costly than a delay in global climate cooperation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Dynamically downscaled seasonal heat wave projections in the CONUS

Heat waves are a well-documented hazard that are projected to increase in intensity, duration, and frequency with climate change. Regions of the US experience widely varying temperatures; for example, 35 °C is extremely hot for spring in the Northeast but not for summer in the Southeast. It is important to evaluate projections within a regional context and at a high enough resolution to understand the risks to populations. We identify heat waves across the Conterminous US (CONUS) under SSP5–8.5 from 2020 to 2059 with an ensemble of dynamically downscaled Coupled Model Intercomparison Project Phase 6 (CMIP6) model outputs. We demonstrate that there are regional differences caused by seasonal and local drivers of persistent hot temperatures. Summer heat waves are increasing in intensity and duration faster than winter heat waves because of the atmospheric conditions that promote these events. Our analysis emphasizes the value of fine-resolution modeling for projecting future climate risks.

Rubin, Hannah [University of Tennessee, Knoxville ↗
DOE OSTI2022

Modulation of ENSO teleconnections over North America by the Pacific decadal oscillation

In this study, we investigate whether the Pacific decadal oscillation (PDO) can enhance or diminish El Niño Southern Oscillation (ENSO) temperature and precipitation teleconnections over North America using five single model initial-condition large ensembles (SMILEs). The use of SMILEs facilitates a statistically robust comparison of ENSO events that occur during different phases of the PDO. We find that a positive PDO enhances winter and spring El Niño temperature and precipitation teleconnections and diminishes La Niña teleconnections. A negative PDO has the opposite effect. The modulation of ENSO by the PDO is mediated by differences in the location and strength of the Aleutian Low and Pacific Jet during ENSO events under different phases of the PDO. This modulation is a simple combination of the individual effects of the PDO and ENSO over North America. Finally, we show that ENSO and the PDO can be used to evaluate the likelihood of the occurrence of temperature and precipitation anomalies in different regions, but cannot be used as a deterministic predictor of these anomalies due to the large variability between individual events.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Assessing decadal variability of subseasonal forecasts of opportunity using explainable AI

Abstract Identifying predictable states of the climate system allows for enhanced prediction skill on the generally low-skill subseasonal timescale via forecasts with higher confidence and accuracy, known as forecasts of opportunity. This study takes a neural network approach to explore decadal variability of subseasonal predictability, particularly during forecasts of opportunity. Specifically, this work quantifies subseasonal prediction skill provided by the tropics within the Community Earth System Model Version 2 (CESM2) Large Ensemble and assesses how this skill evolves on decadal timescales. Utilizing the networks’ confidence and explainable artificial intelligence, physically meaningful sources of predictability associated with periods of enhanced skill are identified. Using these networks, we find that tropically-driven subseasonal predictability varies on decadal timescales during forecasts of opportunity. Further, we investigate the drivers of the low frequency modulation of the tropical-extratropical teleconnection and discuss the implications. Analysis is extended to ECMWF Reanalysis v5 data, revealing that the relationships learned within the CESM2-Large Ensemble holds in modern reanalysis data. These results indicate that the neural networks are capable of identifying predictable decadal states of the climate system within CESM2 that are useful for making confident, accurate subseasonal precipitation predictions in the real world.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

MARS: Malleable Actor-Critic Reinforcement Learning Scheduler

In this paper, we introduce MARS, a new scheduling system for HPC-cloud infrastructures based on a cost-aware, flexible reinforcement learning approach, which serves as an intermediate layer for next generation HPC-cloud resource manager. MARS ensembles the pre-trained models from heuristic workloads and decides on the most cost-effective strategy for optimization. A whole workflow application would be split into several optimizable dependent sub-tasks, then based on the pre- defined resource management plan, a reward will be generated after executing a scheduled task. Lastly, MARS updates the Deep Neural Network (DNN) model based on the reward. MARS is designed to optimize the existing models through reinforcement mechanisms. MARS adapts to the dynamics of workflow applications, selects the most cost-effective scheduling solution among pre-built scheduling strategies (backfilling, SJF, etc.) and self- learning deep neural network model at run-time. We evaluate MARS with different real-world workflow traces. MARS can achieve 5%-60% increased performance compare to state-of-the- art approaches.

Baheri, Betis↗
DOE OSTI2025

In-Transit Data Transport Strategies for Coupled AI-Simulation Workflow Patterns

Coupled AI-Simulation workflows are becoming the major workloads for HPC facilities, and their increasing complexity necessitates new tools for performance analysis and prototyping of new in-situ workflows. We present SimAI-Bench, a tool designed to both prototype and evaluate these coupled workflows. In this paper, we use SimAI-Bench to benchmark the data transport performance of two common patterns on the Aurora supercomputer: a one-to-one workflow with co-located simulation and AI training instances, and a many-to-one workflow where a single AI model is trained from an ensemble of simulations. For the one-to-one pattern, our analysis shows that node-local and DragonHPC data staging strategies provide excellent performance compared Redis and Lustre file system. For the many-to-one pattern, we find that data transport becomes a dominant bottleneck as the ensemble size grows. Our evaluation reveals that file system is the optimal solution among the tested strategies for the many-to-one pattern.

Tummalapalli, Harikrishna [Argonne National Labora↗