Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Changing windstorm characteristics over the US Northeast in a single model large ensemble

Abstract Extreme windstorms pose a significant hazard to infrastructure and public safety, particularly in the highly populated US Northeast (NE). However, the influence climate change and changing land use will have on these events remains unclear. A large ensemble generated using the Max-Planck Institute (MPI) Earth system model is used to generate projections of NE windstorms under different shared socioeconomic pathways (SSPs) and to attribute changes to projected land use land cover (LULC) change, externally forced changes and internal climate variability. To reduce the influence of coarse grid cell resolution and uncertainties in surface roughness lengths, windstorms are identified using simultaneous widespread exceedance of local 99th percentile 10 m wind speeds (U 99 ). Projected declines in forest cover in the NE and the resulting reductions in surface roughness length under SSP3-7.0 lead to projections of large increases in U 99 and derived windstorm intensity and scale. However, these projected changes in regional LULC under SSP3-7.0 are unprecedented in a historical context and may not be realistic. After corrections are applied to remove the influence of LULC on wind speeds, regionally averaged U 99 exhibit declines for most of the single model initial-condition large ensemble (SMILE) members which are broadly proportional to the radiative forcing and global air temperature increase in the SSPs, with a median value of −0.15 ms −1 °C −1 . While weak cyclones are projected to decline in frequency in the NE, intense cyclones and the resulting windstorms and indices of socioeconomic loss do not. Where present, significant trends in these loss indices are positive, and some MPI SMILE members generate future windstorms that are unprecedented in the historical period.

Coburn, Jacob (ORCID:0000000309538117)↗
DOE OSTI2025

Uncertainty of 21st Century western U.S. snowfall loss derived from regional climate model large ensemble

Abstract The western United States is dependent on winter snowfall over its major mountain ranges, which gradually melts each year, serving as a natural reservoir for water resources. In a future warmer climate, much of this snowfall could be replaced by rain, making it more challenging to capture and store water. In this study, we utilize an ensemble of dynamically downscaled simulations forced by 14 global climate models (GCMs). These GCMs project wildly different futures, in terms of both temperature and precipitation change, producing significant uncertainty in snowfall projections. Here we exploit the robust statistics of the downscaled ensemble, and diagose the sensitivity of end-of-century snowfall loss across the region to both warming and regional wetting/drying in the driving GCM. The windward slopes of the Sierra Nevada and Cascades are particularly sensitive to warming (losing ~ 15% annual snowfall per degree warming), with little influence of precipitation. By contrast, snowfall loss in the inter-mountain west is less sensitive to warming (~ 5% K −1 ), but is significantly offset/exacerbated by precipitation changes (~ 0.5% snow per 1% precipitation). Combining such sensitivities with the warming and regional precipitation signals in the full CMIP6 ensemble, we can fully quantify likely snowfall loss and its uncertainty at any location, for any emissions scenario. We find that the western U.S. as a whole will lose 34 ± 8% of its total volumetric snowfall by end-of-century under the high-emissions SSP3-7.0 scenario, but 25 ± 6% and 17 ± 6% under the lower-emissions SSP2-4.5 and SSP1-2.6 scenarios.

Norris, Jesse (ORCID:0000000289883326)↗
DOE OSTI2024

On the uncertainty of long-period return values of extreme daily precipitation

Methods for calculating return values of extreme precipitation and their uncertainty are compared using daily precipitation rates over the Western U.S. and Southwestern Canada from a large ensemble of climate model simulations. The roles of return-value estimation procedures and sample size in uncertainty are evaluated for various return periods. We compare two different generalized extreme value (GEV) parameter estimation techniques, namely L-moments and maximum likelihood (MLE), as well as empirical techniques. Even for very large datasets, confidence intervals calculated using GEV techniques are narrower than those calculated using empirical methods. Furthermore, the more efficient L-moments parameter estimation techniques result in narrower confidence intervals than MLE parameter estimation techniques at small sample sizes, but similar best estimates. It should be noted that we do not claim that either parameter fitting technique is better calibrated than the other to estimate long period return values. While a non-stationary MLE methodology is readily available to estimate GEV parameters, it is not for the L-moments method. Comparison of uncertainty quantification methods are found to yield significantly different estimates for small sample sizes but converge to similar results as sample size increases. Finally, practical recommendations about the length and size of climate model ensemble simulations and the choice of statistical methods to robustly estimate long period return values of extreme daily precipitation statistics and quantify their uncertainty.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Lithium-Ion Battery Diagnostics Using Electrochemical Impedance via Machine-Learning

Diagnosing battery states such as health, state-of-charge, or temperature is crucial for ensuring the safety and reliability of electrochemical energy storage systems. While some states, such as temperature, may be measured using cheap sensors, accurate diagnosis of battery health metrics usually requires time-consuming performance measurements, making them infeasible for use in real-world operation. These health metrics can be measured during lab-testing and then estimated on-line using predictive life models or via state observer algorithms such as Kalman filters, but these predictive methods should be supplemented by actual measurement of battery health whenever possible to ensure reliability. Rapid measurement of battery health may be done by various types of fast diagnostic techniques such as electrochemical impedance spectroscopy (EIS), which can be performed in only a few minutes and require only a fraction of the energy and power needed for a full charge and discharge measurement. But there is a substantial challenge for estimating battery health using EIS data, as EIS is sensitive to cell temperature, state-of-charge, current, and resting time in addition to health. Thus, utilizing EIS data to predict battery capacity requires correcting for all these additional variables, a task that is extremely difficult to handle analytically. This talk utilizes machine-learning methods to estimate the effectiveness of battery capacity prediction from EIS data, leveraging a data set of hundreds of EIS measurements recorded at varying temperature and state-of-charge throughout a 500-day aging study of 32 commercial, large-format NMC-Graphite lithium-ion batteries. Using EIS as input to machine-learning models is complicated by the nonlinear response of impedance to battery health, temperature, and state-of-charge, as well as the collinearity between the impedance response at neighboring frequencies, which can easily lead to overfit models. To train robust models, features from EIS data need to be extracted from the data or some subset of critical frequencies selected. Many approaches for extracting and selecting features from EIS data from electrochemical analysis and machine-learning fields were identified for analysis: using the entire raw spectra; selection of one, two, or many frequencies from the entire spectra; selecting interesting points from the EIS measurement using domain knowledge; fitting EIS with an equivalent-circuit model; calculating statistics on the raw impedance values; and reducing the dimensionality of the data using unsupervised linear (principal component analysis) and non-linear (uniform manifold approximation and projection) methods. These approaches were rigorously compared using a machine-learning pipeline approach, training linear, Gaussian process, and random forest regression models and quantifying performance using cross-validation as well as a held-out test set. An artificial neural network model trained on the raw spectra was also tested. Promising pipelines were fine-tuned via Bayesian hyperparameter optimization using cross-validation loss and training with class-specific weights to counter data set imbalance. The most reliable method for utilizing impedance in this work was the selection of two optimal frequencies through an exhaustive search, resulting in about 2% mean absolute error on test data for both Gaussian process and random forest model architectures. Interrogation of a variety of models reveals critical frequencies of 100 Hz and 103 Hz for this data set, though the optimal set of frequencies is not necessarily intuitive, i.e., the best performing models are not simply those that use impedance at frequencies that have the highest correlation to the relative discharge capacity. The best performing model is an ensemble model, which is able to predict battery capacity with 1.9% mean absolute error for unseen cells using impedance recorded at a variety of temperatures and states-of-charge.

battery↗
DOE OSTI2022

An adaptive knowledge-based data-driven approach for turbulence modeling using ensemble learning technique under complex flow configuration: 3D PWR sub-channel with DNS data

This work describes a new approach to increase the accuracy of Reynolds-averaged Navier–Stokes (RANS) in modeling turbulence flow leveraging the machine learning technique. Traditionally, different turbulence models for Reynolds stress are developed for different flow patterns based on human knowledge. Each turbulence model has a certain application domain and prediction uncertainty. In recent years, with the rapid improvements of machine learning techniques, researchers start to develop an approach to compensate for the prediction discrepancy of traditional turbulence models with statistical models and data. However, the approach has deficiencies in several aspects. For example, the amount of human knowledge introduced to the statistical model couldn’t be controlled, which makes the statistical model learn from a very naïve stage and limits its application. In this work, a new approach is developed to address those deficiencies. Here, the new approach uses the “ensemble learning” technique to control the amount of human knowledge introduced into the statistical model. Therefore, the new approach could be adaptive to the multiple application domains. In conclusion, according to the results of case study, the new approach shows higher accuracy than both traditional turbulence models and the previous machine learning approach.

42 ENGINEERING↗
DOE OSTI2023

Single-Point Extrapolation to the Complete Basis Set Limit through Deep Learning

Machine learning (ML) offers an attractive method for making predictions about molecular systems while circumventing the need to run expensive electronic structure calculations. Once trained on ab initio data, the promise of ML is to deliver accurate predictions of molecular properties that were previously computationally infeasible. In this work, we develop and train a graph neural network model to correct the basis set incompleteness error (BSIE) between a small and large basis set at the RHF and B3LYP levels of theory. Our results show that, when compared to fitting to the total potential, an ML model fitted to correct the BSIE is better at generalizing to systems not seen during training. We test this ability by training on single molecules while evaluating on molecular complexes. We also show that ensemble models yield better behaved potentials in situations where the training data is insufficient. However, even when only fitting to the BSIE, acceptable performance is only achieved when the training data sufficiently resemble the systems one wants to make predictions on. As a result, the test error of the final model trained to predict the difference between the cc-pVDZ and cc-pV5Z potential is 0.184 kcal/mol for the B3LYP density functional, and the ensemble model accurately reproduces the large basis set interaction energy curves on the S66x8 dataset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Plateau to River Model Predictive Simulations for All Ensemble Realizations to Support Modeling Work in Fiscal Year 2025

The purpose of this environmental calculation file (ECF) is to document predictions of flow and hydraulic head on the Central Plateau of the Hanford Site using the Plateau-to-River (P2R) Model (CP-57037, Model Package Report for the Plateau-to-River Model: Version 9.1). This calculation documents the simulation of the groundwater for the parent model domain of the P2R Model as a basis for use in other applications of the P2R Model. This application is unique from the standpoint that it will simulate all ensemble member models of the P2R Model whereas other applications may only utilize specific ensemble members. These simulations provide results that can be used in the process of selecting an appropriate subset of ensemble members for other applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Evaluation of top-down and bottom-up global terrestrial respiration estimates and their mismatch with model simulations

Terrestrial respiration is one of the most poorly understood processes in the global carbon cycle, making respiration predictions uncertain. However, expanding observations and machine learning approaches have led to a proliferation of estimates. We compiled total ecosystem and heterotrophic respiration estimates derived from top-down atmospheric inversions and bottom-up upscaling of ecosystem observations and compared them with dynamic vegetation models (DGVM) simulations over the 1980-2020 period. Our analysis revealed a convergence in mean annual global total ecosystem respiration estimates between top-down 97.1 (± SD 6.8) PgC yr-1 and bottom-up 98.5 (+/-13.4) PgC yr-1, which were both significantly lower than the ensemble mean from DGVMs estimates 133.7 (±4.7) PgC yr-1. We also found similar temporal trends between top-down estimates with a mean of 0.075 (±0.05) PgC yr-2, and bottom-up estimates of 0.05 (±0.05) PgC yr-2, which were 5 to 7 times smaller than the ensemble mean trend of 0.34 PgC yr-2 simulated by DGVMs. Global heterotrophic respiration showed much less agreement, ranging from top-down estimates of 42.7 (±4.0) PgC yr-1 to bottom-up estimates of 51.5 (±4.0) PgC yr-1 and a significantly larger ensemble model mean estimate of 60.8 PgC yr-1 (±1.9). The temporal trends in observation-based bottom-up estimates of heterotrophic respiration of 0.03 PgC yr-2 were five times lower than the model ensemble mean 0.15 PgC yr-2. Large regional disagreements in heterotrophic respiration estimates and simulations were evident in tropical and boreal latitudes. Therefore, improved regional and heterotrophic respiration estimates are necessary to reduce uncertainties regarding the future vulnerability of soil carbon.

Ballantyne, Ashley↗
DOE OSTI2026

Comparison of CNN-Based Image Classification Approaches for Implementation of Low-Cost Multispectral Arcing Detection

Camera-based sensing has benefited in recent years from developments in machine learning data processing methods, as well as improved data collection options such as Unmanned Aerial Vehicles (UAV) mounted sensors. However, cost considerations, both for the initial purchase of sensors as well as updates, maintenance, or potential replacement if damaged, can limit adoption of more expensive sensing options for some applications. To evaluate more affordable options with less expensive, more available, and more easily replaceable hardware, we examine the use of machine learning-based image classification with custom datasets, utilizing deep learning based-image classification and the use of ensemble models for sensor fusion. Utilizing the same models for each camera to reduce technical overhead, we showed that for a very representative training dataset, camera-based detection can be successful for detection of electrical arcing. We also use multiple validation datasets, based on conditions expected to be of varying difficulty, to evaluate custom data. These results show that ensemble models of different data sources can mitigate risks from gaps in training data, though the system will be less redundant for those cases unless other precautions are taken. We found that with good quality custom datasets, data fusion models can be utilized without specialization in design to the specific cameras utilized, allowing for less specialized, more accessible equipment to be utilized as multispectral camera components. This approach can provide an alternative to expensive sensing equipment for applications in which lower-cost or more easily replaceable sensing equipment is desirable.

convolutional neural networks↗
DOE OSTI2023

Bayesian weighting of climate models based on climate sensitivity

Using climate model ensembles containing members that exhibit very high climate sensitivities to increasing CO 2 concentrations can result in biased projections. Various methods have been proposed to ameliorate this ‘hot model’ problem, such as model emulators or model culling. Here, we utilize Bayesian Model Averaging as a framework to address this problem without resorting to outright rejection of models from the ensemble. Taking advantage of multiple lines of evidence used to construct the best estimate of the earth’s climate sensitivity, the Bayesian Model Averaging framework produces an unbiased posterior probability distribution of model weights. The updated multi-model ensemble projects end-of-century global mean surface temperature increases of 2 °C for a low emissions scenario (SSP1-2.6) and 5 °C for a high emissions scenario (SSP5-8.5). These estimates are lower than those produced using a simple multi-model mean for the CMIP6 ensemble. The results are also similar to results from a model culling approach, but retain some weight on low-probability models, allowing for consideration of the possibility that the true value could lie at the extremes of the assessed distribution. Our results showcase Bayesian Model Averaging as a path forward to project future climate change that is commensurate with the available scientific evidence.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Future precipitation increase constrained by climatological pattern of cloud effect

The fractional increase in global mean precipitation (?P ¯/P ¯) is a first-order measure of the hydrological cycle intensification under anthropogenic warming. However, ?P ¯/P ¯ varies by a factor of more than three among model projections, hindering credible assessments of the associated climate impacts. The uncertainty in ?P ¯/P ¯ stems from uncertainty in both hydrological sensitivity (global mean precipitation increase per unit warming) and climate sensitivity (global mean temperature increase per forcing). Here, by investigating hydrological and climate sensitivities in a unified surface-energy-balance perspective, we find that both sensitivities are significantly correlated with surface shortwave cloud feedback, which is further linked to the climatological pattern of cloud shortwave effect. The observed pattern of cloud effect thus constrains both sensitivities and consequently constrains ?P ¯/P ¯. The 5%-95% uncertainty range of ?P ¯/P ¯ from 1979-2005 to 2080-2100 under the high-emission (moderate-emission) scenario is constrained from 6.34±3.53% (4.19±2.28%) in the raw ensemble-model projection to 7.03±2.59% (4.63±1.71%). The constraint thus suggests a higher most-likely ?P ¯/P ¯ and reduces the uncertainty by ~25%, providing valuable information for impact assessments.

Zhou, Wenyu↗
DOE OSTI2023

Estimating Ocean Observation Impacts on Coupled Atmosphere‐Ocean Models Using Ensemble Forecast Sensitivity to Observation (EFSO)

Ensemble Forecast Sensitivity to Observation (EFSO) is a technique that can efficiently identify the beneficial/detrimental impacts of every observation in ensemble-based data assimilation (DA). While EFSO has been successfully employed on atmospheric DA, it has never been applied to ocean or coupled DA due to the lack of a suitable error norm for oceanic variables. This study introduces a new density-based error norm incorporating sea temperature and salinity forecast errors, making EFSO applicable to ocean DA for the first time. We implemented the oceanic EFSO on the CFSv2-LETKF and investigated the impact of ocean observations under a weakly coupled DA framework. By removing the detrimental ocean observations detected by EFSO, the CFSv2 forecasts were significantly improved, showing the validation of impact estimation and the great potential of EFSO to be extended as a data selection criterion.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Projected evolution of droughts and human exposure in the contiguous United States under SSP5-8.5: a regional downscaling perspective

The increasingly unpredictable and extreme weather patterns under a warming climate underscore the urgency of accurate regional assessments of future drought risk. This study evaluates the projected drought evolution in the contiguous United States under the high-emission shared socioeconomic pathway 5–8.5 climate scenario for the coming decades. Using a multi-model ensemble of six Coupled Model Intercomparison Project Phase 6 global climate models combined with dynamical downscaling techniques, we analyzed near-term (2020–2039) and mid-term (2040–2059) drought patterns using the self-calibrating palmer drought severity index (ScPDSI), the standardized precipitation index (SPI-12), and the Standardized Precipitation-Evapotranspiration Index (SPEI-12). Results reveal a widespread increase in abnormally dry (D0) and moderate drought (D1) conditions, particularly in urban areas, while severe (D2), extreme (D3), and exceptional (D4) droughts are expected to become less common in many regions. Meanwhile, persistent and intensifying droughts are projected in the western and southwestern U.S., driven by long-term soil moisture deficits. The ScPDSI projects that 1.1 million urban residents will be affected by D0 conditions in 2050, while SPI-12 suggests a decrease in the total affected populations after 2040. ScPDSI indicates prolonged droughts in the West, and SPI-12 captures transient variability. Although the total drought-exposed population is expected to decrease, urban areas will continue to bear a greater burden, particularly for mild droughts (D0, D1). These findings highlight a shift toward more frequent mild droughts, fewer severe droughts, and persistent drying in the Southwest, emphasizing the need for region-specific adaptation strategies.

CMIP6↗
DOE OSTI2023

Tree-Based Ensemble Learning Models for Wall Temperature Predictions in Post-Critical Heat Flux Flow Regimes at Subcooled and Low-Quality Conditions

Accurately predicting post-critical heat flux (CHF) heat transfer is an important but challenging task in water-cooled reactor design and safety analysis. Although numerous heat transfer correlations have been developed to predict post-CHF heat transfer, these correlations are only applicable to relatively narrow ranges of flow conditions due to the complex physical nature of the post-CHF heat transfer regimes. In this paper, a large quantity of experimental data is collected and summarized from the literature for steady-state subcooled and low-quality film boiling regimes with water as the working fluid in vertical tubular test sections. In addition, a low-quality water film boiling (LWFB) database is consolidated with a total of 22,813 experimental data points, which cover a wide flow range of the system pressure from 0.1 to 9.0 MPa, mass flux from 25 to 2750 kg/m 2 s, and inlet subcooling from 1 to 70 °C. Two machine learning (ML) models, based on random forest (RF) and gradient boosted decision tree (GBDT), are trained and validated to predict wall temperatures in post-CHF flow regimes. The trained ML models demonstrate significantly improved accuracies compared to conventional empirical correlations. To further evaluate the performance of these two ML models from a statistical perspective, three criteria are investigated and three metrics are calculated to quantitatively assess the accuracy of these two ML models. For the full LWFB database, the root-mean-square errors between the measured and predicted wall temperatures by the GBDT and RF models are 5.7% and 6.2%, respectively, confirming the accuracy of the two ML models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Assessing sensitivities of climate model weighting to multiple methods, variables, and domains in the south-central United States

Given the increasing use of climate projections and multi-model ensemble weighting for a diverse array of applications, this project assesses the sensitivities of climate model weighting strategies and their resulting ensemble means to multiple components, such as the weighting schemes, climate variables, or spatial domains of interest. The purpose of this study is to assess the sensitivities associated with multi-model weighting strategies. The analysis makes use of global climate models from the Coupled Model Intercomparison Project Phase 5 (CMIP5) and their statistically downscaled counterparts created with the localized constructed analogs (LOCA) method. This work focuses on historical and projected future mean precipitation and daily high temperatures of the south-central United States. Results suggest that the model weights and the corresponding weighted model means can be sensitive to the weighting strategy that is applied. For instance, when estimating model weights based on Louisiana precipitation, the weighted projections show a wetter and cooler south-central domain in the future compared to other weighting strategies. Alternatively, for example, when estimating model weights based on New Mexico temperature, the weighted projections show a drier and warmer south-central domain in the future. However, when considering the entire south-central domain in estimating the model weights, the weighted future projections show a compromise in the precipitation and temperature estimates. As for uncertainty, our matrix of results provided a more certain picture of future climate compared to the spread in the original model ensemble. If future impact assessments utilize weighting strategies, then our findings suggest that how the specific weighting strategy is used with climate projections may depend on the needs of an impact assessment or adaptation plan.

54 ENVIRONMENTAL SCIENCES↗