Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

The Lack of a QBO-MJO Connection in Climate Models With a Nudged Stratosphere

The observed stratospheric quasi-biennial oscillation (QBO) and the tropospheric Madden-Julian oscillation (MJO) are strongly connected in boreal winter, with stronger MJO activity when lower-stratospheric winds are easterly. However, the current generation of climate models with internally generated representations of the QBO and MJO do not simulate the observed QBO-MJO connection, for reasons that remain unclear. Furthermore, this study builds on prior work exploring the QBO-MJO link in climate models whose stratospheric winds are relaxed toward reanalysis, reducing stratospheric biases in the model and imposing a realistic QBO. A series of ensemble experiments are performed using four state-of-the-art climate models capable of representing the MJO over the period 1980–2015, each with similar nudging in the stratosphere. In these four models, nudging leads to a good representation of QBO wind and temperature signals, however no model simulates the observed QBO-MJO relationship. Biases in MJO vertical structure and cloud-radiative feedbacks are investigated, but no conclusive model bias or mechanism is identified that explains the lack of a QBO-MJO connection.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Simulated wind speed and initial conditions over the WFIP2 region: Cold-front (D01)

The purpose of this work is to assess the sensitivity of the forecast for turbine height wind speed to initial condition (IC) uncertainties over the Columbia River Gorge and Columbia River Basin for two typical weather phenomena: a local thermal gradient induced by a marine air intrusion and passage of a cold front. The Weather Research and Forecasting (WRF) model data assimilation system (WRFDA) was used to generate ensemble ICs from the North American Regional Analysis (NARR) for the WRF model initialization. The simulated turbine-height wind speeds were categorized into four types using the self-organizing map (SOM) technique. This work advances understanding of IC uncertainties impacts on wind speed forecasts and locates the high-impact regions.

17 WIND ENERGY↗
DOE OSTI2022

Simulated wind speed and initial conditions over the WFIP2 region: Cold-front (D02)

The purpose of this work is to assess the sensitivity of the forecast for turbine height wind speed to initial condition (IC) uncertainties over the Columbia River Gorge and Columbia River Basin for two typical weather phenomena: a local thermal gradient induced by a marine air intrusion and passage of a cold front. The Weather Research and Forecasting (WRF) model data assimilation system (WRFDA) was used to generate ensemble ICs from the North American Regional Analysis (NARR) for the WRF model initialization. The simulated turbine-height wind speeds were categorized into four types using the self-organizing map (SOM) technique. This work advances understanding of IC uncertainties impacts on wind speed forecasts and locates the high-impact regions.

17 WIND ENERGY↗
DOE OSTI2022

Simulated wind speed and initial conditions over the WFIP2 region: Sea-breeze (D01)

The purpose of this work is to assess the sensitivity of the forecast for turbine height wind speed to initial condition (IC) uncertainties over the Columbia River Gorge and Columbia River Basin for two typical weather phenomena: a local thermal gradient induced by a marine air intrusion and passage of a cold front. The Weather Research and Forecasting (WRF) model data assimilation system (WRFDA) was used to generate ensemble ICs from the North American Regional Analysis (NARR) for the WRF model initialization. The simulated turbine-height wind speeds were categorized into four types using the self-organizing map (SOM) technique. This work advances understanding of IC uncertainties impacts on wind speed forecasts and locates the high-impact regions.

17 WIND ENERGY↗
DOE OSTI2022

Simulated wind speed and initial conditions over the WFIP2 region: Sea-breeze (D02)

The purpose of this work is to assess the sensitivity of the forecast for turbine height wind speed to initial condition (IC) uncertainties over the Columbia River Gorge and Columbia River Basin for two typical weather phenomena: a local thermal gradient induced by a marine air intrusion and passage of a cold front. The Weather Research and Forecasting (WRF) model data assimilation system (WRFDA) was used to generate ensemble ICs from the North American Regional Analysis (NARR) for the WRF model initialization. The simulated turbine-height wind speeds were categorized into four types using the self-organizing map (SOM) technique. This work advances understanding of IC uncertainties impacts on wind speed forecasts and locates the high-impact regions.

17 WIND ENERGY↗
DOE OSTI2024

Quantum chaos on edge

Recently, the physics of many-body quantum chaotic systems close to their ground states has come under intensified scrutiny. Such studies are motivated by the emergence of model systems exhibiting chaotic fluctuations throughout the entire spectrum [the Sachdev-Ye-Kitaev (SYK) model being a renowned representative] as well as by the physics of holographic principles, which likewise unfold close to ground states. Interpreting the edge of the spectrum as a quantum critical point, here we combine a wide range of analytical and numerical methods to the identification and comprehensive description of two different universality classes: the near edge physics of “sparse” and the near edge of “dense” chaotic systems. The distinction lies in the ratio between the number of a system's random parameters and its Hilbert space dimension, which is exponentially small or algebraically small in the sparse and dense case, respectively. Notable representatives of the two classes are generic chaotic many-body models (sparse) and invariant random matrix ensembles or chaotic gravitational systems (dense). While the two families share identical spectral correlations at energy scales comparable to the level spacing, the density of states and its fluctuations near the edge are different. Considering the SYK model as a representative of the sparse class, we apply a combination of field theory and exact diagonalization to a detailed discussion of its edge spectrum. Conversely, Jackiw-Teitelboim gravity is our reference model for the dense class, where an analysis of the gravitational path integral and random matrix theory reveal universal differences to the sparse class, whose implications for the construction of holographic principles we discuss. Published by the American Physical Society 2024

Altland, Alexander (ORCID:0000000229914805)↗
DOE OSTI2025

Evaluation of the 2022 West Nile virus forecasting challenge, USA

Abstract Background West Nile virus (WNV) is the most common cause of mosquito-borne disease in the continental USA, with an average of ~1200 severe, neuroinvasive cases reported annually from 2005 to 2021 (range 386–2873). Despite this burden, efforts to forecast WNV disease to inform public health measures to reduce disease incidence have had limited success. Here, we analyze forecasts submitted to the 2022 WNV Forecasting Challenge, a follow-up to the 2020 WNV Forecasting Challenge. Methods Forecasting teams submitted probabilistic forecasts of annual West Nile virus neuroinvasive disease (WNND) cases for each county in the continental USA for the 2022 WNV season. We assessed the skill of team-specific forecasts, baseline forecasts, and an ensemble created from team-specific forecasts. We then characterized the impact of model characteristics and county-specific contextual factors (e.g., population) on forecast skill. Results Ensemble forecasts for 2022 anticipated a season at or below median long-term WNND incidence for nearly all (> 99%) counties. More counties reported higher case numbers than anticipated by the ensemble forecast median, but national caseload (826) was well below the 10-year median (1386). Forecast skill was highest for the ensemble forecast, though the historical negative binomial baseline model and several team-submitted forecasts had similar forecast skill. Forecasts utilizing regression-based frameworks tended to have more skill than those that did not and models using climate, mosquito surveillance, demographic, or avian data had less skill than those that did not, potentially due to overfitting. County-contextual analysis showed strong relationships with the number of years that WNND had been reported and permutation entropy (historical variability). Evaluations based on weighted interval score and logarithmic scoring metrics produced similar results. Conclusions The relative success of the ensemble forecast, the best forecast for 2022, suggests potential gains in community ability to forecast WNV, an improvement from the 2020 Challenge. Similar to the previous challenge, however, our results indicate that skill was still limited with general underprediction despite a relative low incidence year. Potential opportunities for improvement include refining mechanistic approaches, integrating additional data sources, and considering different approaches for areas with and without previous cases. Graphical Abstract

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Joint state-parameter estimation for the reduced fracture model via the united filter

Here, in this paper, we introduce an effective United Filter method for jointly estimating the solution state and physical parameters in flow and transport problems within fractured porous media. Fluid flow and transport in fractured porous media are critical in subsurface hydrology, geophysics, and reservoir geomechanics. Reduced fracture models, which represent fractures as lower-dimensional interfaces, enable efficient multi-scale simulations. However, reduced fracture models also face accuracy challenges due to modeling errors and uncertainties in physical parameters such as permeability and fracture geometry. To address these challenges, we propose a United Filter method, which integrates the Ensemble Score Filter (EnSF) for state estimation with the Direct Filter for parameter estimation. EnSF, based on a score-based diffusion model framework, produces ensemble representations of the state distribution without deep learning. Meanwhile, the Direct Filter, a recursive Bayesian inference method, estimates parameters directly from state observations. The United Filter combines these methods iteratively: EnSF estimates are used to refine parameter values, which are then fed back to improve state estimation. Numerical experiments demonstrate that the United Filter method surpasses the state-of-the-art Augmented Ensemble Kalman Filter, delivering more accurate state and parameter estimation for reduced fracture models. This framework also provides a robust and efficient solution for PDE-constrained inverse problems with uncertainties and sparse observations.

Bayesian inference↗
NASA NTRS2012

On the Causes of and Long Term Changes in Eurasian Heat Waves

The MERRA reanalysis, other observations, and the GEOS-S model have been used to diagnose the causes of Eurasian heat waves including the recent extreme events that occurred in Europe during 2003 and in Russia during 2010. The results show that such extreme events are an amplification of natural patterns of atmospheric variability (in this case a particular large-scale atmospheric planetary wave) that develop over the Eurasian continent as a result of internal atmospheric forcing. The amplification occurs when the wave occasionally becomes locked in place for several weeks to months resulting in extreme heat and drying with the location depending on the phase of the upper atmospheric wave. Model experiments suggest that forcing from both the ocean (SST) and land playa role phase-locking the waves. An ensemble of very long GEOS-S model simulations (spanning the 20th century) forced with observed SST and greenhouse gases show that the model is capable of generating very similar heat waves, and that they have become more extreme in the last thirty years as a result of the overall warming of the Asian continent.

Schubert, Siegfried↗
DOE OSTI2024

Deep energy-pressure regression for a thermodynamically consistent EOS model

Abstract In this paper, we aim to explore novel machine learning (ML) techniques to facilitate and accelerate the construction of universal equation-Of-State (EOS) models with a high accuracy while ensuring important thermodynamic consistency. When applying ML to fit a universal EOS model, there are two key requirements: (1) a high prediction accuracy to ensure precise estimation of relevant physics properties and (2) physical interpretability to support important physics-related downstream applications. We first identify a set of fundamental challenges from the accuracy perspective, including an extremely wide range of input/output space and highly sparse training data. We demonstrate that while a neural network (NN) model may fit the EOS data well, the black-box nature makes it difficult to provide physically interpretable results, leading to weak accountability of prediction results outside the training range and lack of guarantee to meet important thermodynamic consistency constraints. To this end, we propose a principled deep regression model that can be trained following a meta-learning style to predict the desired quantities with a high accuracy using scarce training data. We further introduce a uniquely designed kernel-based regularizer for accurate uncertainty quantification. An ensemble technique is leveraged to battle model overfitting with improved prediction stability. Auto-differentiation is conducted to verify that necessary thermodynamic consistency conditions are maintained. Our evaluation results show an excellent fit of the EOS table and the predicted values are ready to use for important physics-related tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

The changing nature of hydroclimatic risks across South Africa

We present results from large ensembles of projected twenty-first century changes in seasonal precipitation and near-surface air temperature for the nation of South Africa. These ensembles are a result of combining Monte Carlo projections from a human-Earth system model of intermediate complexity with pattern-scaled responses from climate models of the Coupled Model Intercomparison Project Phase 5 (CMIP5). These future ensemble scenarios consider a range of global actions to abate emissions through the twenty-first century. We evaluate distributions of surface-air temperature and precipitation change over three sub-national regions: western, central, and eastern South Africa. In all regions, we find that without any emissions or climate targets in place, there is a greater than 50% likelihood that mid-century temperatures will increase threefold over the current climate’s two-standard deviation range of variability. However, scenarios that consider more aggressive climate targets all but eliminate the risk of these salient temperature increases. A preponderance of risk toward decreased precipitation (3 to 4 times higher than increased) exists for western and central South Africa. Strong climate targets abate evolving regional hydroclimatic risks. Under a target to limit global climate warming to 1.5 °C by 2100, the risk of precipitation changes within South Africa toward the end of this century (2065–2074) is commensurate to the risk during the 2030s without any global climate target. Thus, these regional hydroclimate risks over South Africa could be delayed by 30 years and, in doing so, provide invaluable lead-time for national efforts to prepare, fortify, and/or adapt.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Natural variability contributes to model–satellite differences in tropical tropospheric warming

Significance Climate models have, on average, simulated substantially more tropical tropospheric warming than satellite data, with few simulations matching observations. It has been suggested that this discrepancy arises because climate models are overly sensitive to greenhouse gas increases. Tropical tropospheric temperature trends from a large ensemble of simulations performed with a single climate model span a wide range that is solely due to natural climate variability. A subset of these simulations have warming rates in accord with satellite observations. Simulations with diminished tropical tropospheric warming due to climate variability exhibit characteristic patterns of surface warming that are similar to the observed record. Our results indicate that multidecadal variability can explain current model–observational differences in the rate of tropical tropospheric warming.

58 GEOSCIENCES↗
DOE OSTI2021

A 3d disordered superconformal fixed point

We initiate the study of a three dimensional disordered supersymmetric field theory. Specifically, we consider a $\mathcal{N}$= 2 large N Wess-Zumino like model with cubic superpotential involving couplings drawn from a Gaussian random ensemble. Taking inspiration from analyses of lower dimensional SYK like models we demonstrate that the theory flows to a strongly coupled superconformal fixed point in the infra-red. In particular, we obtain leading large N spectral data and operator product coefficients at the critical point. Moreover, the analytic control accorded by the model allows us to compare our results against those derived in the conformal bootstrap program and demonstrate consistency with general expectations.

1/N expansion↗
NASA NTRS2026

South Asian Monsoon Response to Regional Aerosol Emission Reductions: Insights From RAMIP

Anthropogenic aerosol and associated precursor gas emissions are already declining in many regions and are likely to decline significantly by 2050, with major implications for regional climate. Unlike greenhouse gases, aerosol impacts are spatially heterogeneous and can influence climate both near emission sources and through remote teleconnections. This is particularly important for the South Asian monsoon system, where both local and remote aerosol changes can significantly affect precipitation patterns. Using simulations from the Regional Aerosol Model Intercomparison Project, we examine how local and remote aerosol emission reductions influence South Asian climate across both pre-monsoon and monsoon seasons, including weakening of the elevated heat pump (EHP) mechanism during pre-monsoon months. Our analysis employs 10-member ensembles from 10 CMIP6-era models to compare three experiments with global, South Asian, and East Asian aerosol reductions relative to a high-emission baseline (SSP3-7.0). This experimental design allows us to isolate and quantify the distinct impacts of regional emission changes. Results reveal that global aerosol reductions produce a larger all-India precipitation increase (+0.28 mm day −1 ) than South Asian reductions alone (+0.19 mm day −1 ), with the strongest regional responses over the northern Bay of Bengal, the Western Ghats and Indo-Gangetic Plains. East Asian reductions show uncertain but modest precipitation reductions of 0.2-0.6 mm day −1 over parts of west-central and eastern Indian regions. Pre-monsoon carbonaceous aerosol reductions systematically weaken the EHP, cooling the mid-troposphere over the Himalayan foothills by up to 0.4 K and producing localised anomalous descent that opposes the climatological pre-monsoon ascent. Substantial inter-model diversity exists in the spatial patterns and magnitudes of these responses, highlighting key uncertainties in aerosol–monsoon interactions. The South Asian precipitation response is driven by enhanced land–sea thermal contrast, while the pre-monsoon EHP weakening is attributable exclusively to local South Asian carbonaceous aerosol forcing rather than remote teleconnections. These findings have direct implications for air quality and climate adaptation planning across South Asia as regional aerosol emissions diverge under different development pathways.

cmip6↗
DOE OSTI2025

A Data-Agnostic, Continuous Machine Learning Framework for Application in High Energy Physics and Beyond: Phase 1 Final Scientific/Technical Report

This Phase 1 effort has focused on the development of continual learning frameworks for use in machine learning, specifically in the applied context of High Energy Physics (HEP). Machine learning (ML) is a transformative technology by which computers, typically through the use of neural networks, are able to perform tasks with proficiency that rivals or surpasses that of human users. Model Degradation & Catastrophic Forgetting are two undesired phenomena which can occur in ML where the performance of a model degrades when either deployed on novel data streams, or trained on novel data which are sufficiently different than the data the models were initially trained on. A natural example where these sorts of effects can be observed is in the performance of detectors in harsh environments, where the detector signature may change over the lifetime of the detector as it ages and deteriorates — precisely what occurs in the experiments conducted in HEP. Real world HEP data is therefore an excellent test-ground and use-case for Continual Learning paradigms, which are techniques used in ML to counteract these problems. Ensemble learning is one such technique, where multiple smaller models are trained on subsets of the overall data and are ensembled together during inference. The intuition behind this technique is that, although there are shifts in the distributions which govern the incoming data streams, these shifts are not expected to be homogeneous or global. If a sufficient diversity in solutions within the various sub-models has been achieved, then at least one sub-model is expected to retain its performance within the overall ensemble. One further strength of this approach is that the architectures of the various models do not need to be identical, and in fact even different modalities of data can naturally be combined in this way. This work focused on applying ensemble learning techniques to derive results using two main datasets, anomaly detection in HEP data & time-series forecasting in semiconductor manufacturing data. Semiconductor manufacturing involves data with surprising similarity to that of HEP (e.g. wafer maps look very similar to digi-occupancy maps) and Cerium Lab’s prominence within the semiconductor industry makes semiconductor manufacturing a natural opportunity for commercialization of this work. Our efforts have led to two strong results. The first is that we evaluated the proposed ensembling techniques using previously proposed machine learning architectures for use in anomaly detection, namely AutoEncoder based models and their derivatives. We also developed new architectures which have not been evaluated in this context before. In fact, this work marks the first use of Vision Transformers for anomaly detection in HEP. Second, we demonstrated that ensemble learning significantly improves model performance in scenarios prone to degradation, validating its effectiveness across both HEP and semiconductor datasets. These results further support ensemble learning as a powerful strategy for mitigating catastrophic forgetting and maintaining robust performance in evolving data environments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Reconfigurable structure and tunable transport in synchronized active spinner materials

Ensembles of actuated colloids are excellent model systems to explore emergent out-of-equilibrium structures, complex collective dynamics, and design rules for the next generation materials. Here, we demonstrate that ferromagnetic microparticles suspended at an air-water interface and energized by an external rotating magnetic field spontaneously form dynamic ensembles of synchronized spinners in a certain range of the excitation field parameters. Each spinner generates strong hydrodynamic flows, and collective interactions of the multiple spinners promote a formation of dynamic lattices. On the basis of experiments and simulations, we reveal structural transitions from liquid to nearly crystalline states in this novel active spinner material and demonstrate that dynamic spinner lattices are reconfigurable, capable of self-healing behavior and that the transport of embedded inert cargo particles can be remotely tuned by the parameters of the external excitation field. Our findings provide insights into the behavior of active spinner materials with reconfigurable structural order and tunable functionalities.

36 MATERIALS SCIENCE↗
NASA NTRS2011

Precipitation Estimates for Hydroelectricity

Hydroelectric plants require precise and timely estimates of rain, snow and other hydrometeors for operations. However, it is far from being a trivial task to measure and predict precipitation. This paper presents the linkages between precipitation science and hydroelectricity, and in doing so it provides insight into current research directions that are relevant for this renewable energy. Methods described include radars, disdrometers, satellites and numerical models. Two recent advances that have the potential of being highly beneficial for hydropower operations are featured: the Global Precipitation Measuring (GPM) mission, which represents an important leap forward in precipitation observations from space, and high performance computing (HPC) and grid technology, that allows building ensembles of numerical weather and climate models.

Tapiador, Francisco J.↗
DOE OSTI2022

Assessing the impact of substrate-level enzyme regulations limiting ethanol titer in Clostridium thermocellum using a core kinetic model

Clostridium thermocellum is a promising candidate for consolidated bioprocessing because it can directly ferment cellulose to ethanol. Despite significant efforts, achieved yields and titers fall below industrially relevant targets. This implies that there still exist unknown enzymatic, regulatory, and/or possibly thermodynamic bottlenecks that can throttle back metabolic flow. By (i) elucidating internal metabolic fluxes in wild-type C. thermocellum grown on cellobiose via 13 C-metabolic flux analysis ( 13 C-MFA), (ii) parameterizing a core kinetic model, and (iii) subsequently deploying an ensemble-docking workflow for discovering substrate-level regulations, this paper aims to reveal some of these factors and expand our knowledgebase governing C. thermocellum metabolism. Generated 13 C labeling data were used with 13 C-MFA to generate a wild-type flux distribution for the metabolic network. Notably, flux elucidation through MFA alluded to serine generation via the mercaptopyruvate pathway. Using the elucidated flux distributions in conjunction with batch fermentation process yield data for various mutant strains, we constructed a kinetic model of C. thermocellum core metabolism (i.e. k-ctherm138). Subsequently, we used the parameterized kinetic model to explore the effect of removing substrate-level regulations on ethanol yield and titer. Upon exploring all possible simultaneous (up to four) regulation removals we identified combinations that lead to many-fold model predicted improvement in ethanol titer. In addition, by coupling a systematic method for identifying putative competitive inhibitory mechanisms using K-FIT kinetic parameterization with the ensemble-docking workflow, we flagged 67 putative substrate-level inhibition mechanisms across central carbon metabolism supported by both kinetic formalism and docking analysis.

59 BASIC BIOLOGICAL SCIENCES↗