Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Improving the accuracy of freight mode choice models: A case study using the 2017 CFS PUF data set and ensemble learning techniques

Here, the US Census Bureau has collected two rounds of experimental data from the Commodity Flow Survey, providing shipment-level characteristics of nationwide commodity movements, published in 2012 (i.e., Public Use Microdata) and in 2017 (i.e., Public Use File). With this information, data-driven methods have become increasingly valuable for understanding detailed patterns in freight logistics. In this study, we used the 2017 Commodity Flow Survey Public Use File data set to explore building a high-performance freight mode choice model, considering three main improvements: (1) constructing local models for each separate commodity/industry category; (2) extracting useful geographical features, particularly the derived distance of each freight mode between origin/destination zones; and (3) applying additional ensemble learning methods such as stacking or voting to combine results from local and unified models for improved performance. The proposed method achieved over 92% accuracy without incorporating external information, an over 19% increase compared to directly fitting Random Forests models over 10,000 samples. Furthermore, SHAP (Shapely Additive Explanations) values were computed to explain the outputs and major patterns obtained from the proposed model. The model framework could enhance the performance and interpretability of existing freight mode choice models.

42 ENGINEERING↗
DOE OSTI2024

Enhancing Fluid Flow Pressure and Saturation Prediction Accuracy and Reducing Uncertainty with Committee Machine – Illinois Basin Decatur Project (IBDP) as a Case Study

Presentation at the 17th International Conference on Greenhouse Gas Control Technologies GHGT-17 held in Calgary, Canada, October 20-24, 2024. Carbon capture and storage (CCS) is a way to play a critical role in the global transition to a low-emission economy. Current progress is hampered by a number of factors, among which the lack of risk-informed design tools and decision support frameworks is seen as a major roadblock. Significant interest exists in using artificial intelligence to accelerate CCS site feasibility studies, as well as to facilitate the permit application process. Existing works commonly train a single deep learning model. This work investigates the feasibility of using a conventional ensemble learning (committee machine) technique to further improve prediction accuracy. Ensemble-based algorithms generally improve over individual base learners in terms of robustness and accuracy. Deep ensembles, however, are time-consuming to create and train. A pragmatic question is whether small-sized ensembles may lead to prediction improvement. Here we evaluated the efficacy of an ensemble learning technique using the latent spectral model (LSM), an efficient deep neural operator algorithm, as base learners. Preliminary results, obtained using the Illinois Basin-Decatur Project (IBDP) carbon sequestration data/model, show that small-sized ensembles can improve prediction over the base learners, achieving prediction accuracy of ~1.6 psi root mean square error (RMSE) on pressure (relative the average reservoir pressure of 3150 psi), and less than 1.3% for saturation.

Sun, Alexander↗
DOE OSTI2024

Enhancing Fluid Flow Pressure and Saturation Prediction Accuracy and Reducing Uncertainty with Committee Machine – Illinois Basin Decatur Project (IBDP) as a Case Study

This is the conference paper accompanying an oral presentation at the 17th International Conference on Greenhouse Gas Control Technologies GHGT-17 held in Calgary, Canada, October 20-24, 2024. Carbon capture and storage (CCS) is a way to play a critical role in the global transition to a low-emission economy. Current progress is hampered by a number of factors, among which the lack of risk-informed design tools and decision support frameworks is seen as a major roadblock. Significant interest exists in using artificial intelligence to accelerate CCS site feasibility studies, as well as to facilitate the permit application process. Existing works commonly train a single deep learning model. This work investigates the feasibility of using a conventional ensemble learning (committee machine) technique to further improve prediction accuracy. Ensemble-based algorithms generally improve over individual base learners in terms of robustness and accuracy. Deep ensembles, however, are time-consuming to create and train. A pragmatic question is whether small-sized ensembles may lead to prediction improvement. Here we evaluated the efficacy of an ensemble learning technique using the latent spectral model (LSM), an efficient deep neural operator algorithm, as base learners. Preliminary results, obtained using the Illinois Basin-Decatur Project (IBDP) carbon sequestration data/model, show that small-sized ensembles can improve prediction over the base learners, achieving prediction accuracy of ~1.6 psi root mean square error (RMSE) on pressure (relative the average reservoir pressure of 3150 psi), and less than 1.3% for saturation.

Sun, Alexander↗
DOE OSTI2020

Automated Integration of Continental-Scale Observations in Near-Real Time for Simulation and Analysis of Biosphere–Atmosphere Interactions

The National Ecological Observatory Network (NEON) is a continental-scale observatory with sites across the US collecting standardized ecological observations that will operate for multiple decades. To maximize the utility of NEON data, we envision edge computing systems that gather, calibrate, aggregate, and ingest measurements in an integrated fashion. Edge systems will employ machine learning methods to cross-calibrate, gap-fill and provision data in near-real time to the NEON Data Portal and to High Performance Computing (HPC) systems, running ensembles of Earth system models (ESMs) that assimilate the data. For the first time gridded EC data products and response functions promise to offset pervasive observational biases through evaluating, benchmarking, optimizing parameters, and training new machine learning parameterizations within ESMs all at the same model-grid scale. Leveraging open-source software for EC data analysis, we are already building software infrastructure for integration of near-real time data streams into the International Land Model Benchmarking (ILAMB) package for use by the wider research community. We will present a perspective on the design and integration of end-to-end infrastructure for data acquisition, edge computing, HPC simulation, analysis, and validation, where Artificial Intelligence (AI) approaches are used throughout the distributed workflow to improve accuracy and computational performance.

Durden, David J.↗
DOE OSTI2020

Robust late twenty-first century shift in the regional monsoons in RegCM-CORDEX simulations

Abstract We use an unprecedented ensemble of regional climate model (RCM) projections over seven regional CORDEX domains to provide, for the first time, an RCM-based global view of monsoon changes at various levels of increased greenhouse gas (GHG) forcing. All regional simulations are conducted using RegCM4 at a 25 km horizontal grid spacing using lateral and lower boundary forcing from three General Circulation Models (GCMs), which are part of the fifth phase of the Coupled Model Inter-comparison Project (CMIP5). Each simulation covers the period from 1970 through 2100 under two Representative Concentration Pathways (RCP2.6 and RCP8.5). Regional climate simulations exhibit high fidelity in capturing key characteristics of precipitation and atmospheric dynamics across monsoon regions in the historical period. In the future period, regional monsoons exhibit a spatially robust delay in the monsoon onset, an increase in seasonality, and a reduction in the rainy season length at higher levels of radiative forcing. All regions with substantial delays in the monsoon onset exhibit a decrease in pre-monsoon precipitation, indicating a strong connection between pre-monsoon drying and a shift in the monsoon onset. The weakening of latent heat driven atmospheric warming during the pre-monsoon period delays the overturning of atmospheric subsidence in the monsoon regions, which defers their transitioning into deep convective states. Monsoon changes under the RCP2.6 scenario are mostly within the baseline variability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Projections of winter polynyas and their biophysical impacts in the Ross Sea Antarctica

Abstract This study investigates winter polynyas in the southern Ross Sea, Antarctica where several polynyas are known to form. Coastal polynyas are areas of lower sea ice concentration and/or thickness along the coast that are otherwise surrounded by more extensive, thicker sea ice pack. Polynyas are also locations where organisms can exploit both the ice substrate and pelagic resources. Using a self organizing map algorithm, we identify polynya events in the Community Earth System Model Version 2 Large Ensemble (CESM2-LE). The neural network algorithm is able to identify polynya events without imposing an ice concentration or thickness threshold, as is often done when identifying polynyas. The CESM2-LE produces a wintertime polynya feature comparable in size and location to the Ross Sea polynya, and during polynya events there are large turbulent heat fluxes and export of sea ice from the Ross Sea. In the CESM2-LE polynya event frequency is projected to decrease sharply in the later twentyfirst century, leading to increasing sea ice concentrations and thicknesses in the region. The drivers of the polynya frequency decline are likely both large scale circulation changes and local atmosphere and ocean feedbacks. If declines in wintertime polynya frequency over the twentyfirst century do occur they may impact Antarctic Bottom Water formation and local net primary productivity. Thus, better understanding potential local and unexpected sea ice changes in the Ross Sea is important for both assessing climate system impacts and ecological impacts on the Ross Sea ecosystem, which is currently protected by an internationally recognized marine protected area.

Meteorology & Atmospheric Sciences↗
DOE OSTI2024

Large-scale atomistic model construction of subbituminous and bituminous coals for solvent extraction simulations with reactive molecular dynamics

Large-scale atomistic models for complex polycyclic aromatic hydrocarbon systems help understand the chemical properties and behaviors of complex feedstocks such as coal or petroleum. However, the development and utilization of large-scale models remain limited due to the difficulty in achieving the varied structural characteristics necessary to capture stochastic nature of these feedstocks. Here we demonstrate a systematic workflow to construct stochastic molecular systems from a broad analytical suite: high-resolution transmission electron microscopy (HRTEM), carbon-13 nuclear magnetic resonance spectroscopy ( 13 C NMR), laser desorption ionization mass spectroscopy (LDI-MS), and elemental analysis. We present a model construction and analysis utility of a new Python-based module. We selected one subbituminous and three high-volatile bituminous coals to construct large-scale models (~40,000 atoms). The constructed models were utilized to examine the affinity for solvent extraction (naphthalene or tetralin) and the effect of structural properties (e.g., aromatic cluster size, functional groups, and cross-linking) in reactive molecular dynamics simulations. Complex chemical reactions were monitored with bond order transitions, intermediates formation, and mass distributions. Reactive molecular dynamics simulations suggest a plausible chemical extraction process and products for the complex fossil feedstocks. The results indicated that radical formations with bond breaking of bridging oxygens and carbons were required at high temperatures to facilitate hydrogeneration and extraction of gas molecules from radical-free molecules. We observed that aliphatic chains of tetralin were easily decomposed and combined with radicals to form small size of molecules with aryl bonding, mainly increasing molecules in the 500–1000 Da, while naphthalene had little impact on chemical extraction process.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Revisiting point defect thermodynamics in group IVB and VB transition metal carbides

We present a comprehensive re-examination of point defect thermodynamics in group IVB and VB transition metal carbides (TMCs) with the rocksalt structure using a combination of density functional theory (DFT) calculations and a statistical mechanical Wagner-Schottky model within the canonical ensemble. The most stable configurations of point defects were discovered using basin-hopping global optimization, driven by either a machine learning interatomic potential (MLIP) or DFT. A key finding is the identification of previously unreported dicarbon antisites—a C–C dimer occupying a metal site—as the structural (constitutional) defects on the carbon-rich side of stoichiometry in all group IVB and VB TMCs except TaC. Furthermore, dicarbon antisite-containing thermal defect complexes, such as quadruple and interbranch defects, can dominate in TMCs under specific stoichiometric and temperature conditions. In conclusion, by incorporating dicarbon antisites into the defect landscape, this work provides a revised understanding of the thermodynamics of point defects in TMCs.

Carbides↗
DOE OSTI2022

Short-term solar radiation forecast using total sky imager via transfer learning

Ground-based sky cameras, which capture hemispherical images, have been extensively used for localized monitoring of clouds. This paper proposes a short-term forecasting approach based on transfer learning using Total Sky-Imager (TSI) images of the Southern Great Plains (SGP) site obtained from the Atmospheric Radiation Measurement (ARM) dataset. An accurate estimation of solar irradiance using TSI is key for short-term solar energy generation forecasting and optimal energy consumption planning. We make use of deep neural network architectures such as AlexNet and ResNet-101 to extract the underlying deep convolution features from TSI images and then train using an ensemble learning approach to model and forecast solar radiation. We demonstrate the performance of the proposed approach by showcasing the best and worst cases. Thus, the transfer learning approach significantly reduces the time and resources required for modeling solar radiation. We outperform with reference to another state-of-art technique for solar modeling using TSI images at different forecast lead times.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Quantifying the Effect of Climate Change on Midlatitude Subseasonal Prediction Skill Provided by the Tropics

Abstract Subseasonal timescales (∼2 weeks–2 months) are known for their lack of predictability, however, specific Earth system states known to have a strong influence on these timescales can be harnessed to improve prediction skill (known as “forecasts of opportunity”). As the climate continues warming, it is hypothesized these states may change and consequently, their importance for subseasonal prediction may also be impacted. Here, we examine changes to midlatitude subseasonal prediction skill provided by the tropics under anthropogenic warming using artificial neural networks to quantify skill. The network is tasked to predict the sign of the 500 hPa geopotential height for historical and future time periods in the Community Earth System Model Version 2 ‐ Large Ensemble across the Northern Hemisphere at a 3 week lead using tropical precipitation. We show prediction skill changes substantially in key midlatitude regions and these changes appear linked to changes in seasonal variability with the largest differences in accuracy occurring during forecasts of opportunity.

Mayer, Kirsten J.↗
DOE OSTI2024

The Potential of Stratospheric Aerosol Injection to Reduce the Climatic Risks of Explosive Volcanic Eruptions

Sulfur-rich volcanic eruptions happen sporadically. If Stratospheric Aerosol Injection (SAI) were to be deployed, it is likely that explosive volcanic eruptions would happen during such a deployment. Here we use an ensemble of Earth System Model simulations to show how changing the injection strategy post-eruption could be used to reduce the climate risks of a large volcanic eruption; the risks are also modified even without any change to the strategy. For a medium-size eruption (10 Tg-SO 2 ) comparable to the SAI injection rate, the volcanic-induced cooling would be reduced if it occurs under SAI, especially if artificial sulfur dioxide injections were immediately suspended. Alternatively, suspending injection only in the eruption hemisphere and continuing injection in the opposite would reduce shifts in precipitation in the tropical belt and thus mitigate eruption-induced drought. Finally, we show that for eruptions much larger than the SAI deployment, changes in SAI strategy would have minimal effect.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Human influence on joint changes in temperature, rainfall and continental aridity

Despite the pervasive impact of drought on human and natural systems, the large-scale mechanisms conducive to regional drying remain poorly understood. Here we use a multivariate approach to identify two distinct externally forced fingerprints from multiple ensembles of Earth system model simulations. The leading fingerprint, F M1 (x), is characterized by global warming, intensified wet–dry patterns and progressive large-scale continental aridification, largely driven by multidecadal increases in greenhouse gas (GHG) emissions. The second fingerprint, F M2 (x), captures a pronounced interhemispheric temperature contrast, associated meridional shifts in the intertropical convergence zone and correlated anomalies in precipitation and aridity over California, the Sahel and India. F M2 (x) exhibits nonlinear temporal behaviour: the intertropical convergence zone moves southwards before 1975 in response to increases in hemispherically asymmetric sulfate aerosol emissions, and it shifts northwards after 1975 due to reduced sulfur dioxide emissions and the GHG-induced warming of Northern Hemisphere landmasses. Both fingerprints are statistically identifiable in observations of joint changes in temperature, rainfall and aridity during 1950–2014. Furthermore, we show that the reliable simulation of these changes requires combined forcing by GHGs, direct and indirect effects of aerosols, and large volcanic eruptions. Our results suggest that GHG-induced aridification may be modulated regionally by future reductions in sulfate aerosol emissions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Increased exposure of coastal cities to sea-level rise due to internal climate variability

Adaptation to future sea-level rise is based on projections of continuously improving climate models. These projections are accompanied by inherent uncertainties, including those due to internal climate variability (ICV). The ICV arises from complex and unpredictable interactions within and between climate-system components, rendering its impact irreducible. Although neglecting this uncertainty can lead to an underestimation of future sea-level rise, its estimation and impacts have not been fully explored. Combining the Community Earth System Model version 1 Large Ensemble experiments with power-law statistics, we show that, by 2100, if the ICV uncertainty reaches its upper limit, new sea-level-rise hotspots would appear in Southeast Asian megacities (Chennai, Kolkata, Yangon, Bangkok, Ho Chi Minh City and Manila), in western tropical Pacific Islands and the Western Indian Ocean. Here, the better the ICV uncertainty is taken into account and correctly estimated, the more effective adaptation strategies can be elaborated with confidence and actions to follow.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Global burned area increasingly explained by climate change

Fire behaviour is changing in many regions worldwide. However, nonlinear interactions between fire weather, fuel, land use, management and ignitions have impeded formal attribution of global burned area changes. Here, in this work, we demonstrate that climate change increasingly explains regional burned area patterns, using an ensemble of global fire models. The simulations show that climate change increased global burned area by 15.8% (95% confidence interval (CI) [13.1–18.7]) for 2003–2019 and increased the probability of experiencing months with above-average global burned area by 22% (95% CI [18–26]). In contrast, other human forcings contributed to lowering burned area by 19.1% (95% CI [21.9–15.8]) over the same period. Moreover, the contribution of climate change to burned area increased by 0.22% (95% CI [0.22–0.24]) per year globally, with the largest increase in central Australia. Our results highlight the importance of immediate, drastic and sustained GHG emission reductions along with landscape and fire management strategies to stabilize fire impacts on lives, livelihoods and ecosystems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Interannual fires as a source for subarctic summer decadal climate variability mediated by permafrost thawing

Climate model simulations run under the Coupled Model Intercomparison Project Phase 6 (CMIP6) use an inhomogeneous biomass burning aerosol (BBA) emission dataset, which exhibits pronounced interannual variability from 1997–2014 due to the infusion of satellite data. Using the Community Earth System Model version 2 Large Ensemble (CESM2-LE) with original and smoothed CMIP6 BBA forcings, we show that the CMIP6 data inhomogeneity causes spurious decadal subarctic land warming. During years with reduced aerosol concentrations, increased solar radiation can trigger abrupt subarctic permafrost thawing, increased soil water drainage, upper soil drying, and subsequent surface warming. This slow process, which is further amplified by nonlinear cloud-aerosol interactions, cannot be completely offset during years of increased aerosol fluxes, thereby reddening surface temperature spectra in response to large-amplitude interannual aerosol forcing. More generally, our CESM2 experiments identify a pathway for generating decadal variability in high latitudes, involving interannual shortwave forcing and slow nonlinear soil responses.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Projected changes in African easterly wave activity due to climate change

African easterly waves significantly influence regional hydroclimate, making it crucial to understand how global warming will impact their activity. Here, we investigate future changes in wave activity and assess the underlying mechanisms using an ensemble of Earth system models. We find a robust increase in wave activity over the Sahel–Sahara region by the end of the 21st century under two emission scenarios. This intensification is linked to increased baroclinicity associated with a strengthening of the meridional temperature gradient between the Guinea Coast and the Sahara. Our results also indicate that low-level warming enhances the waves by reinforcing monsoon flow, leading to increased convergence and vertical motion along the intertropical discontinuity. These energetic alterations significantly modify the conditions that currently produce these waves. Overall, our findings suggest that changes in wave activity could impact the transport of Saharan dust and mesoscale convective activity over the Sahel.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Quantifying contributions of natural variability and anthropogenic forcings on increased fire weather risk over the western United States

Previous studies have identified a recent increase in wildfire activity in the western United States (WUS). However, the extent to which this trend is due to weather pattern changes dominated by natural variability versus anthropogenic warming has been unclear. Using an ensemble constructed flow analogue approach, we have employed observations to estimate vapor pressure deficit (VPD), the leading meteorological variable that controls wildfires, associated with different atmospheric circulation patterns. Our results show that for the period 1979 to 2020, variation in the atmospheric circulation explains, on average, only 32% of the observed VPD trend of 0.48 ± 0.25 hPa/decade (95% CI) over the WUS during the warm season (May to September). The remaining 68% of the upward VPD trend is likely due to anthropogenic warming. The ensemble simulations of climate models participating in the sixth phase of the Coupled Model Intercomparison Project suggest that anthropogenic forcing explains an even larger fraction of the observed VPD trend (88%) for the same period and region. These models and observational estimates likely provide a lower and an upper bound on the true impact of anthropogenic warming on the VPD trend over the WUS. During August 2020, when the August Complex “Gigafire” occurred in the WUS, anthropogenic warming likely explains 50% of the unprecedented high VPD anomalies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Characterizing the acceleration time of laser-driven ion acceleration with data-informed neural networks

Peak ion energy is an important figure-of-merit in short-pulse, laser-driven ion acceleration and is dependent on an associated acceleration time. Standard metrics for these quantities depend on analytical results such as the self-similar fluid model or empirical models based on relatively small experimental and simulation datasets. In this work we attempt to use a data-informed neural network (NN) as a surrogate model for a large ensemble of PIC simulations to investigate an effective acceleration time. We explore the application of a stacked convolutional and recurrent NN architecture for improved regression by incorporating the time dependencies of the data into the training process. Of particular note is how pretraining a network on lower fidelity data, e.g. 1D analytical results, greatly improves the network's ability to learn more complex, higher fidelity data. Finally, the dependency of the acceleration time on various laser and plasma parameters is explored.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗