Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

The Influence of ENSO Diversity on Future Atlantic Tropical Cyclone Activity

El Niño–Southern Oscillation (ENSO) influences seasonal Atlantic tropical cyclone (TC) activity by impacting environmental conditions important for TC genesis. However, the influence of future climate change on the teleconnection between ENSO and Atlantic TCs is uncertain, as climate change is expected to impact both ENSO and the mean climate state. We used the Weather Research and Forecasting Model on a tropical channel domain to simulate 5-member ensembles of Atlantic TC seasons in historical and future climates under different ENSO conditions. Experiments were forced with idealized sea surface temperature configurations based on the Community Earth System Model (CESM) Large Ensemble representing: a monthly varying climatology, eastern Pacific El Niño, central Pacific El Niño, and La Niña. The historical simulations produced fewer Atlantic TCs during eastern Pacific El Niño compared to central Pacific El Niño, consistent with observations and other modeling studies. For each ENSO state, the future simulations produced a similar teleconnection with Atlantic TCs as in the historical simulations. Specifically, La Niña continues to enhance Atlantic TC activity, and El Niño continues to suppress Atlantic TCs, with greater suppression during eastern Pacific El Niño compared to central Pacific El Niño. In addition, we found a decrease in the Atlantic TC frequency in the future relative to historical regardless of ENSO state, which was associated with a future increase in northern tropical Atlantic vertical wind shear and a future decrease in the zonal tropical Pacific sea surface temperature (SST) gradient, corresponding to a more El Niño–like mean climate state. Our results indicate that ENSO will remain useful for seasonal Atlantic TC prediction in the future.

54 ENVIRONMENTAL SCIENCES↗

Bayesian Optimized Deep Ensemble for Uncertainty Quantification of Deep Neural Networks: a System Safety Case Study on Sodium Fast Reactor Thermal Stratification Modeling

Deep neural networks (DNNs) are increasingly important to scientific computing and engineering system simulations. Accurate uncertainty quantification (UQ) for DNNs is critical in safety-sensitive engineering domains. Traditional Deep Ensemble (DE) methods, while easy to implement, frequently suffer from poorly calibrated uncertainty estimates and limited predictive accuracy due to reliance on fixed architectures with varied weight initializations. To address these issues, we introduce a workflow that combines Bayesian Optimization (BO) and DE. The workflow is modular, scalable, and integrates parallel BO initialized with Sobol sequences to individually optimize the hyperparameters of each ensemble member. This method enhances ensemble diversity, improves predictive accuracy, and provides reliable uncertainty estimates. We evaluate the proposed BODE approach in a sodium fast reactor thermal stratification modeling case study, where we used a densely connected convolutional neural network to predict turbulent viscosity during the reactor transient with consideration of data noise. We benchmark its performance against several optimization approaches, including baseline deep ensemble, evolutionary algorithm-optimized ensemble, ensemble formed via random search combined with greedy selection, and a BO ensemble using random initialization. Here, our results demonstrate superior performance of the developed BODE approach. In noise-free scenarios, BODE notably reduces incorrect aleatoric uncertainty and significantly enhances predictive accuracy. Under conditions of 5% and 10% Gaussian noise, BODE adaptively quantifies uncertainty proportional to data noise, achieving up to an 80% reduction in root mean square error compared to baseline methods and producing well-calibrated prediction intervals.

Bayesian optimization↗

Anomalous Loss Reduction Below Two‐Level System Saturation in Aluminum Superconducting Resonators

Superconducting resonators are widely used in many applications such as qubit readout for quantum computing, and kinetic inductance detectors. These resonators are susceptible to numerous loss and noise mechanisms, especially the dissipation due to two-level systems (TLS) which become the dominant source of loss in the few-photon and low temperature regime. In this study, capacitively-coupled aluminum half-wavelength coplanar waveguide resonators are investigated. Surprisingly, the loss of the resonators is observed to decrease with a lowering temperature at low excitation powers and temperatures below the TLS saturation. This behavior is attributed to the reduction of the TLS resonant response bandwidth with decreasing temperature and power to below the detuning between the TLS and the resonant photon frequency in a discrete ensemble of TLS. When response bandwidths of TLS are smaller than their detunings from the resonance, the resonant response and thus the loss is reduced. At higher excitation powers, the loss follows a logarithmic power dependence, consistent with predictions from the generalized tunneling model (GTM). A model combining the discrete TLS ensemble with the GTM is proposed and matches the temperature and power dependence of the measured internal loss of the resonator with reasonable parameters.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Synthetic Streamflow Datasets Derived from DOE 9505 for Select Texas Basins

This dataset is generated using a Bayesian Hidden Markov Model trained on the DOE 9505 streamflow projection ensemble. A set of 21,000 streamflow realizations are generated for the Colorado, Sabine, and Trinity river basins in Texas. Separate models are trained either using the full 9505 ensemble or a subset based on three hyperparameters: bias correction, downscaling, and hydrological model.

drought↗

Probabilistic Forecast of All-Sky Solar Radiation Using Enhanced WRF-Solar: Preprint

This study presents enhancements of the Weather Research and Forecasting model with solar extensions (WRF-Solar) to provide probabilistic forecasts of solar radiation. Our approach builds ensemble WRF-Solar runs by introducing stochastic perturbations of variables that produce the largest uncertainties in predicting surface irradiance and clouds. The key variables are identified using tangent linear sensitivity analysis of six physics packages responsible for all-sky irradiance variability. An optimal strategy to stochastically perturb the selected variables is developed and applied to WRF-Solar to generate ensemble members for day-ahead solar prediction. The National Solar Radiation Database (NSRDB) is used to validate the ensemble forecast at arbitrary locations on the model grid. Preliminary results indicate that the proposed technique can potentially produce WRF-Solar ensembles providing reliable information of solar prediction uncertainty. This study describes the implemented methodology and initial results as well as future research to improve ensemble-based probabilistic forecasts with WRF-Solar.

all-sky↗

CMIP6-based Multi-model Streamflow Projections over the Conterminous US, Version 1.1

This dataset presents an ensemble of streamflow projections covering the conterminous United States (CONUS), developed to support the SECURE Water Act Section 9505 Assessment for the US Department of Energy (DOE) Water Power Technologies Office (WPTO). Multiple Coupled Models Intercomparison Project phase 6 (CMIP6) Global Climate Models (GCMs) were downscaled using either statistical (DBCCA) or dynamical (RegCM) downscaling methods, based on two meteorological reference datasets (Daymet and Livneh). Subsequently, the downscaled precipitation, temperature, and wind speed data were used to drive two calibrated hydrologic models (VIC and PRMS), with total runoff routed through the Routing Application for Parallel computatIon of Discharge (RAPID) routing model, producing an ensemble of streamflow projections across 2.7 million NHDPlusV2 stream reaches across the CONUS. Each ensemble member covers the 1980-2019 baseline and 2020-2059 near-future periods under the high-end (SSP585) emission scenario. Additionally, using only DBCCA and Daymet, the projections extend to the 2060-2099 far-future period and encompass three additional emission scenarios (SSP370, SSP245, and SSP126). This dataset is designed to support the SECURE Water Act Section 9505 Assessment for the US Department of Energy (DOE) Water Power Technologies Office (WPTO). For further details, refer to Kao et al. (2022), Rastogi et al. (2022), and Ghimire et al. (2023).

13 HYDRO ENERGY↗

Dataset and scripts for manuscript "Using Neural Network Ensembles to Separate Ocean Biogeochemical and Physical Drivers of Phytoplankton Biogeography in Earth System Models"

Please note: The title of this version contains an updated title for the manuscript compared to the previous version of this dataset. This is only due to title updates during the peer review process for the manuscript. The zip file contains the scripts, functions, and source files for the manuscript titled "Using Neural Network Ensembles to Separate Ocean Biogeochemical and Physical Drivers of Phytoplankton Biogeography in Earth System Models." The manuscript has been submitted for peer review. Please consult the README file for information on the specifications of the files. These files may occasionally be updated to add annotations to the scripts to make them more user friendly and to correct any errors.

54 ENVIRONMENTAL SCIENCES↗

Microstructure in matrix elements

We investigate the simple model of Pennington, Shenker, Stanford and Yang for modeling the density matrix of Hawking radiation, but further include dynamics for EOW branes behind the horizon. This allows interactions that scatter one interior state to another, and also allows EOW loops. At strong coupling, we find that EOW states are no longer random; the ensemble has collapsed, and coupling constants encode the microscopic matrix elements of Hawking radiation. This suggests strong interior dynamics are important for understanding evaporating black holes, without any ensemble average. In this concrete model the density matrix of the radiation deviates from the thermal state, small off-diagonal fluctuations encode equivalences between naively orthogonal states, and bound the entropy from above. For almost evaporated black holes the off-diagonal terms become as large as the diagonal ones, eventually giving a pure state. We also find the unique analytic formula for all Renyi entropies.

2D gravity↗

On the additivity of climate responses to the volcanic and solar forcing in the early 19th century

The early 19th century was the coldest period over the past 500 years, when strong tropical volcanic events and a solar minimum coincided. The 1809 unidentified eruption and the 1815 Tambora eruption happened consecutively during the Dalton minimum of solar irradiance; however, the relative role of the two forcing (volcano and solar) agents is still unclear. In this study, we examine the responses from a set of early 19th century simulations with combined and separated volcanic and solar forcing agents, as suggested in the protocol for the past1000 experiment of the Paleoclimate Modelling Intercomparison Project – Phase 4 (PMIP4). From 20-member ensemble simulations with the Max Planck Institute Earth system model (MPI-ESM1.2-LR), we find that the volcano- and solar-induced surface cooling is additive in the global mean/large scale, regardless of combining or separating the forcing agents. The two solar reconstructions (SATIRE (Spectral and Total Irradiance REconstruction-Millennia model) and PMOD (Physikalisch-Meteorologisches Observatorium Davos)) contribute to a cooling before and after 1815 of ~0.05 and ~0.15 K monthly average near-surface air cooling, respectively, indicating a limited solar contribution to the early 19th century cold period. The volcanic events provide the main cooling contributions, inducing a surface cooling that peaks at ~0.82 K for the 1809 event and ~1.35 K for Tambora. After the Tambora eruption, the temperature in most regions increases toward climatology largely within 5 years, along with the reduction of volcanic forcing. In the northern extratropical oceans, the temperature increases slowly at a constant rate until 1830, which is related to the reduction of seasonality and the concurrent changes in Arctic sea-ice extent. The albedo feedback of Arctic sea ice is found to be the main contributor to the Arctic amplification of the cooling signal. Several non-additive responses to solar and volcanic forcing happen on regional scales. In the atmosphere, the stratospheric polar vortex tends to strengthen when combining both volcano and solar forcing, even though the two forcing agents separately induce opposite-sign changes in stratospheric temperatures and zonal winds. In the ocean, when combining the two forcings, additional surface cold water propagates to the northern extratropics from the additional solar cooling in the tropics, which results in regional cooling along the propagation. Overall, this study not only quantifies the surface responses from combinations of the volcano and solar forcing, but also highlights the components that cannot be simply added from the responses of the individual forcing agents, indicating that a relatively small forcing agent (such as solar in early 19th century) can impact the response from the large forcing (such as the 1815 Tambora eruption) when considering regional climates.

54 ENVIRONMENTAL SCIENCES↗

Active Learning Framework

Machine learning (ML) of interatomic potentials show great promise to accelerate scientific simulation, e.g., by emulating expensive computations at a high accuracy but much reduced computational cost. Training datasets are calculated from computationally expensive ab initio quantum mechanics methods, density functional theory (DFT). Trained on this data, an ML model can be very successful in predicting energy and forces for new atomic configurations. A critical factor is the quality and diversity of the training dataset. Thus, a highly automated approach to dataset construction based on active learning framework is designed suitable for material physics. The active learning scheme begins with fully randomized atomic configurations. Then, many Molecular Dynamics (MD) trajectories are simulated using current ML potentials, where each MD trajectory is initialized to a random disordered configuration. The temperature is varied in order to diversify the sampled configuration during these simulations. The variance of predictions for eight neural networks within an ensemble is analyzed to determine whether the model is operating as expected. This helps in determining whether collecting more data would be helpful to the model by checking the ensemble variance is greater than the threshold. In this case, the MD trajectory is terminated and the final atomic configuration is placed on a queue (SQL database) for DFT calculations and added to training dataset. Periodically, ML model is retrained to the updated training model. This Active Learning loop is iterated until the cost of MD simulations becomes prohibitively expensive. The MD simulations will hopefully be sufficiently robust to support nucleation after many active learning iterations. In this sense, active learning scheme must automatically discover the important low energy and nonequilibrium physics.

Nebgen, Benjamin↗

Current and Projected Future Distribution of Plant Community Types for the Southern Seward Peninsula, Alaska

Landscape scale maps of plant community distribution at 5 m resolution were developed for southern Seward Peninsula. A Random Forest based environmental niche model was developed using topographic and climate data sets. Models were trained for the 2010-2019 period and applied to develop plant community distributions for contemporary (2010-2019) period. Trained model was applied to project the plant community distributions under future climate. Using downscaled projections for RCP8.5 scenario from five climate models (CCSM4, GFDL-CM3, GISS-E2-R, IPSL-CM5A-LR, MRI-CGCM3) and multi-model mean, a six member ensemble of plant community distribution were developed for current decade (2010-2019) and for future decades (2020-2029, 2030-2039, 2040-2049, 2050-2059). Contains *.tif and *.sh files. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Reweighting configurations generated by transferable, machine learned models for protein sidechain backmapping

Multiscale modeling requires the linking of models at different levels of detail, with the goal of gaining accelerations from lower fidelity models while recovering fine details from higher resolution models. Communication across resolutions is particularly important in modeling soft matter, where tight couplings exist between molecular-level details and mesoscale structures. While multiscale modeling of biomolecules has become a critical component in exploring their structure and self-assembly, backmapping from coarse-grained to fine-grained, or atomistic, representations presents a challenge, despite recent advances through machine learning. A major hurdle, especially for strategies utilizing machine learning, is that backmappings can only approximately recover the atomistic ensemble of interest. We demonstrate conditions for which backmapped configurations may be reweighted to exactly recover the desired atomistic ensemble. By training separate decoding models for each sidechain type, we develop an algorithm based on normalizing flows and geometric algebra attention to autoregressively propose backmapped configurations for any protein sequence. Critical for reweighting with modern protein force fields, our trained models include all hydrogen atoms in the backmapping and make probabilities associated with atomistic configurations directly accessible. We also demonstrate, however, that reweighting is extremely challenging despite state-of-the-art performance on recently developed metrics and generation of configurations with low energies in atomistic protein force fields. Through detailed analysis of configurational weights, we show that machine-learned backmappings must not only generate configurations with reasonable energies, but also correctly assign relative probabilities under the generative model. These are broadly important considerations in generative modeling of atomistic molecular configurations.

Monroe, Jacob I. [Univ. of Arkansas, Fayetteville,↗

eFESTA: Ensemble Feature Exploration with Surface Density Estimates

We propose surface density estimate (SDE) to model the spatial distribution of surface features-isosurfaces, ridge surfaces, and streamsurfaces-in 3D ensemble simulation data. The inputs of SDE computation are surface features represented as polygon meshes, and no field datasets are required (e.g., scalar fields or vector fields). The SDE is defined as the kernel density estimate of the infinite set of points on the input surfaces and is approximated by accumulating the surface densities of triangular patches. We also propose an algorithm to guide the selection of a proper kernel bandwidth for SDE computation. An ensemble Feature Exploration method based on Surface densiTy EstimAtes (eFESTA) is then proposed to extract and visualize the major trends of ensemble surface features. For an ensemble of surface features, each surface is first transformed into a density field based on its contribution to the SDE, and the resulting density fields are organized into a hierarchical representation based on the pairwise distances between them. The hierarchical representation is then used to guide visual exploration of the density fields as well as the underlying surface features. We demonstrate the application of our method using isosurface in ensemble scalar fields, Lagrangian coherent structures in uncertain unsteady flows, and streamsurfaces in ensemble fluid flows.

Computational modeling↗

Early Fault Detection in Particle Accelerator Power Electronics Using Ensemble Learning

Early fault detection and fault prognosis are crucial to ensure efficient and safe operations of complex engineering systems such as the Spallation Neutron Source (SNS) and its power electronics (high voltage converter modulators). Following an advanced experimental facility setup that mimics SNS operating conditions, the authors successfully conducted 21 early fault detection experiments, where fault precursors are introduced in the system to a degree enough to cause degradation in the waveform signals, but not enough to reach a real fault. Nine different machine learning techniques based on ensemble trees, convolutional neural networks, support vector machines, and hierarchical voting ensembles are proposed to detect the fault precursors. Although all 9 models have shown a perfect and identical performance during the training and testing phase, the performance of most models has decreased in the next test phase once they got exposed to realworld data from the 21 experiments. The hierarchical voting ensemble, which features multiple layers of diverse models, maintains a distinguished performance in early detection of the fault precursors with 95% success rate (20/21 tests), followed by adaboost and extremely randomized trees with 52% and 48% success rates, respectively. The support vector machine models were the worst with only 24% success rate (5/21 tests). The study concluded that a successful implementation of machine learning in the SNS or particle accelerator power systems would require a major upgrade in the controller and the data acquisition system to facilitate streaming and handling big data for the machine learning models. In addition, this study shows that the best performing models were diverse and based on the ensemble concept to reduce the bias and hyperparameter sensitivity of individual models.

43 PARTICLE ACCELERATORS↗

CoarsenConf: Equivariant Coarsening with Aggregated Attention for Molecular Conformer Generation

Molecular conformer generation (MCG) is an important task in cheminformatics and drug discovery. The ability to efficiently generate low-energy 3D structures can avoid expensive quantum mechanical simulations, leading to accelerated virtual screenings and enhanced structural exploration. Several generative models have been developed for MCG, but many struggle to consistently produce high-quality conformers for meaningful downstream applications. To address these issues, we introduce CoarsenConf, which coarse-grains molecular graphs based on torsional angles and integrates them into an SE(3)-equivariant hierarchical variational autoencoder. Through equivariant coarse-graining, we aggregate the fine-grained atomic coordinates of subgraphs connected via rotatable bonds, creating a variable-length coarse-grained latent representation. Our model uses a novel aggregated attention mechanism to restore fine-grained coordinates from the coarse-grained latent representation, enabling efficient generation of accurate conformers. Furthermore, we evaluate the chemical and biochemical quality of our generated conformers on multiple downstream applications, including property prediction and large-scale oracle-based protein docking. Overall, CoarsenConf generates more accurate conformer ensembles compared to prior generative models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A multi‐variable framework for selecting WRF physics configurations at convection‐permitting scales: An Amazon wet‐season case study

Tropical convection over rainforests modulates atmospheric circulation and the energy and hydrological cycles across multiple scales. However, the scarcity of observations still limits our understanding of these processes. Although numerical models are utilized to investigate atmospheric physical processes, their performance depends on the choice of parameterizations and grid resolution. Here, in this work, we introduce and apply a multi‐variable, multi‐physics framework to evaluate and rank the Advanced Research Weather Research and Forecasting (WRF–ARW) configurations at 1‐km resolution over the central Amazon during the wet season. A 48‐member ensemble combines three land‐surface models (LSMs), four planetary boundary layer (PBL), and four microphysics (MP) schemes. Model performance for seven convection‐related near‐surface and boundary‐layer variables is assessed using Taylor diagrams and the Taylor skill score (TSS), analysis of variance (ANOVA)‐based sensitivity metrics, and non‐parametric rank tests. We then construct a combined, weighted TSS to identify configurations that are comparatively robust across variables. Results showed that most configurations reproduce near‐surface temperature, sensible and latent heat fluxes, and boundary‐layer height reasonably well, whereas humidity and rainfall remain challenging. LSM choice has the strongest impact on the surface fluxes and a secondary influence on near‐surface temperature and humidity, PBL schemes dominate boundary‐layer height, and MP schemes exert the largest control on rainfall. No single configuration is optimal for all variables, but the combination of Noah (LSM), Yonsei University (PBL), and Morrison (MP) emerges as the most robust configuration for this case, with the WRF single‐moment six‐class scheme (WSM6) providing a competitive, computationally cheaper MP alternative. The framework is general and can be applied to other regions, seasons, and convective regimes.

Amazon rainforest↗

Climate Change Projection in the Twenty-First Century Simulated by NIMS-KMA CMIP6 Model Based on New GHGs Concentration Pathways

Abstract The National Institute of Meteorological Sciences-Korea Meteorological Administration (NIMS-KMA) has participated in the Coupled Model Inter-comparison Project (CMIP) and provided long-term simulations using the coupled climate model. The NIMS-KMA produces new future projections using the ensemble mean of KMA Advanced Community Earth system model (K-ACE) and UK Earth System Model version1 (UKESM1) simulations to provide scientific information of future climate changes. In this study, we analyze four experiments those conducted following the new shared socioeconomic pathway (SSP) based scenarios to examine projected climate change in the twenty-first century. Present day (PD) simulations show high performance skill in both climate mean and variability, which provide a reliability of the climate models and reduces the uncertainty in response to future forcing. In future projections, global temperature increases from 1.92 °C to 5.20 °C relative to the PD level (1995–2014). Global mean precipitation increases from 5.1% to 10.1% and sea ice extent decreases from 19% to 62% in the Arctic and from 18% to 54% in the Antarctic. In addition, climate changes are accelerating toward the late twenty-first century. Our CMIP6 simulations are released to the public through the Earth System Grid Federation (ESGF) international data sharing portal and are used to support the establishment of the national adaptation plan for climate change in South Korea.

54 ENVIRONMENTAL SCIENCES↗

Seasonally Dependent Future Changes in the U.S. Midwest Hydroclimate and Extremes

This study investigates the responses of the hydroclimate and extremes in the U.S. Midwest to global warming, based on ensemble projections of phase 6 of the Coupled Model Intercomparison Project and the multimodel initial-condition large-ensemble simulations. The precipitation response features a seasonally dependent change with increased precipitation in April–May but reduced precipitation in July–August. In this work, the late-spring wetting is attributed to the enhanced low-level moisture-transporting southerlies, which are induced by regional sea level pressure anomalies linked to the poleward shift of the North American westerly jet (NAWJ). The late-summer drying is attributed to the weakened storm track, which is also linked to the poleward NAWJ shift. The seasonally dependent future changes of the Midwest precipitation are analogous to its climatological seasonal progression, which increases over late spring as the NAWJ approaches the Midwest and decreases over late summer as the NAWJ migrates away. In response to the mean precipitation changes, extremely wet late springs (April–May precipitation above the 99th percentile of the historical period) and extremely dry late summers (below the 1st percentile) will occur much more frequently, implying increased late-spring floods and late-summer droughts. Future warming in the Midwest is amplified in late summer due to the reduced precipitation. With amplified background warming and increased occurrence, future late-summer droughts will be more devastating. Our results highlight that, under a time-invariant poleward jet shift, opposite precipitation changes arise before and after the peak rainy month, leading to substantial increases in the subseasonal extremes. The severity of such climate impacts is obscured in projections of the rainy-season mean.

54 ENVIRONMENTAL SCIENCES↗