Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Using Convolutional Neural Network to Emulate Seasonal Tropical Cyclone Activity

Abstract It has been widely recognized that tropical cyclone (TC) genesis requires favorable large‐scale environmental conditions. Based on these linkages, numerous efforts have been made to establish an empirical relationship between seasonal TC activities and large‐scale environmental favorability in a quantitative way, which lead to conceptual functions such as the TC genesis index. However, due to the limited amount of reliable TC observations and complexity of the climate system, a simple analytic function may not be an accurate portrait of the empirical relationship between TCs and their ambiences. In this research, we use convolution neural networks (CNNs) to disentangle this complex relationship. To circumvent the limited amount of seasonal TC observation records, we implement transfer‐learning technique to train ensemble of CNNs first on suites of high‐resolution climate model simulations with realistic seasonal TC activities and large‐scale environmental conditions, and then on a state‐of‐the‐art reanalysis from 1950 to 2019. The trained CNNs can well reproduce the historical TC records and yields significant seasonal prediction skills when the large‐scale environmental inputs are provided by operational climate forecasts. Furthermore, by inputting the ensemble CNNs with 20th century reanalysis products and Phase 6 of the Coupled Model Intercomparison Project (CMIP6) simulations, we investigated TC variability and its changes in the past and future climates. Specifically, our ensemble CNNs project a decreasing trend of global mean TC activity in the future warming scenario, which is consistent with our future projections using high‐resolution climate model.

Meteorology & Atmospheric Sciences↗

Saharan Dust Transport Predictability Utilizing a Subseasonal Experiment (SubX) Model

Prediction of Saharan dust customarily requires complex aerosols models and observations. A previous study of the Miami, Florida dust record in conjunction to reanalysis data discovered a possible source of subseasonal predictability using a dust-transport-efficiency (DTE) index. Development of the Subseasonal Forecast Experiment (SubX) has expanded global forecast products; producing multi-model ensemble forecasts out to 45 days. Retrospective forecast data from the Community Climate System Model version 4.0 (CCSM4) is used in direct comparison to National Centers for Environmental Prediction (NCEP) reanalysis to evaluate the CCSM4 subseasonal forecast and DTE index prediction skill of weekly dust variability. Successful prediction of weekly dust transport using the DTE index is variable year-to-year. The DTE most successfully predicts dust when there is high variability in the tropical winds, likely due to a fluctuating subtropical high, and is not dependent on the overall mean flow or total dust mass transported. The CCSM4 SubX retrospective forecast well represents North Atlantic meteorology out to week-3 in both mean flow and variability. Dust transport can be predicted using the DTE index and CCSM4 SubX retrospective forecasts at week-1 leads to the same success as contemporaneous NCEP reanalysis.

54 ENVIRONMENTAL SCIENCES↗

Regional climate change: consensus, discrepancies, and ways forward

Climate change has emerged across many regions. Some observed regional climate changes, such as amplified Arctic warming and land-sea warming contrasts have been predicted by climate models. However, many other observed regional changes, such as changes in tropical sea surface temperature and monsoon rainfall are not well simulated by climate model ensembles even when taking into account natural internal variability and structural uncertainties in the response of models to anthropogenic radiative forcing. This suggests climate model predictions may not fully reflect what our future will look like. The discrepancies between models and observations are not well understood due to several real and apparent puzzles and limitations such as the “signal-to-noise paradox” and real-world record-shattering extremes falling outside of the possible range predicted by models. Addressing these discrepancies, puzzles and limitations is essential, because understanding and reliably predicting regional climate change is necessary in order to communicate effectively about the underlying drivers of change, provide reliable information to stakeholders, enable societies to adapt, and increase resilience and reduce vulnerability. The challenges of achieving this are greater in the Global South, especially because of the lack of observational data over long time periods and a lack of scientific focus on Global South climate change. To address discrepancies between observations and models, it is important to prioritize resources for understanding regional climate predictions and analyzing where and why models and observations disagree via testing hypotheses of drivers of biases using observations and models. Gaps in understanding can be discovered and filled by exploiting new tools, such as artificial intelligence/machine learning, high-resolution models, new modeling experiments in the model hierarchy, better quantification of forcing, and new observations. Conscious efforts are needed toward creating opportunities that allow regional experts, particularly those from the Global South, to take the lead in regional climate research. This includes co-learning in technical aspects of analyzing simulations and in the physics and dynamics of regional climate change. Finally, improved methods of regional climate communication are needed, which account for the underlying uncertainties, in order to provide reliable and actionable information to stakeholders and the media.

54 ENVIRONMENTAL SCIENCES↗

Multitask graph neural networks for elastoplastic response prediction in dual-phase polycrystals

Microstructure-sensitive prediction of elastoplastic response remains a recurring bottleneck in multiscale damage and fatigue modeling, where large ensembles of statistically distinct polycrystals are required to quantify variability and extreme-value behavior. In this work, we develop a multitask graph neural network (GNN) surrogate that maps dual-phase ferrite–martensite polycrystal microstructures to Statistical Volume Element (SVE)-level elastoplastic Quantities of Interest (QoIs). Each SVE is represented as a grain-adjacency graph, with node features encoding phase, geometry, and crystallographic orientation, and edge features encoding relative misorientation. A message-passing graph convolution generates node embeddings, which are pooled into a graph representation and passed to a multitask regression head that jointly predicts 10 scalar QoIs and vector-valued stress–strain responses in orthogonal loading directions across multiple martensite volume fractions and SVE sizes. Results show high accuracy for scalar QoIs and strong agreement for full stress–strain trajectories, with population envelopes reproducing both median behavior and finite-SVE variability across compositions and partition scales. A unified model trained on pooled volume-fraction data preserves most within-regime accuracy relative to regime-specific models while also capturing the broader cross-regime variation reflected in the pooled test set. Distributional comparisons further demonstrate that the surrogate preserves heterogeneity under SVE partitioning, enabling statistically consistent block-wise random-field construction for mesoscale analyses. Overall, the proposed grain-graph surrogate provides a practical pathway to accelerate ensemble-based studies of SVE-level constitutive variability in dual-phase polycrystals.

Crystal plasticity↗

Active learning of ternary alloy structures and energies

Abstract Machine learning models with uncertainty quantification have recently emerged as attractive tools to accelerate the navigation of catalyst design spaces in a data-efficient manner. Here, we combine active learning with a dropout graph convolutional network (dGCN) as a surrogate model to explore the complex materials space of high-entropy alloys (HEAs). We train the dGCN on the formation energies of disordered binary alloy structures in the Pd-Pt-Sn ternary alloy system and improve predictions on ternary structures by performing reduced optimization of the formation free energy, the target property that determines HEA stability, over ensembles of ternary structures constructed based on two coordinate systems: (a) a physics-informed ternary composition space, and (b) data-driven coordinates discovered by the Diffusion Maps manifold learning scheme. Both reduced optimization techniques improve predictions of the formation free energy in the ternary alloy space with a significantly reduced number of DFT calculations compared to a high-fidelity model. The physics-based scheme converges to the target property in a manner akin to a depth-first strategy, whereas the data-driven scheme appears more akin to a breadth-first approach. Both sampling schemes, coupled with our acquisition function, successfully exploit a database of DFT-calculated binary alloy structures and energies, augmented with a relatively small number of ternary alloy calculations, to identify stable ternary HEA compositions and structures. This generalized framework can be extended to incorporate more complex bulk and surface structural motifs, and the results demonstrate that significant dimensionality reduction is possible in thermodynamic sampling problems when suitable active learning schemes are employed.

Chemistry↗

Ensemble‐Based Spatially Distributed CLM5 Hydrological Parameter Estimation for the Continental United States

Abstract One of the major challenges in large‐domain hydrological modeling efforts lies in the estimation of spatially distributed hydrological parameters while simultaneously accounting for their associated uncertainties. Addressing this challenge is particularly difficult in ungauged locations. With growing societal demands for large‐scale streamflow projections to inform water resource management and long‐term planning, evaluating and constraining hydrological parameter uncertainty is increasingly vital. This study introduces a hybrid regionalization approach to enhance hydrological predictions of the Community Land Model version 5 (CLM5) across the Continental United States (CONUS), with a total of 50,629 1/8° grid cells. This hybrid method combines the strengths of two existing techniques: parameter regionalization and streamflow signature regionalization. It identifies ensemble behavioral parameters for each 1/8° grid cell across the CONUS domain, tailored to three distinct streamflow signatures focused on low flows, high flows, and annual water balance. Evaluating this hybrid method for 464 CAMELS (Catchment Attributes and Meteorology for Large‐sample Studies) basins demonstrates a significant improvement in CLM5 hydrological predictions, even in challenging arid regions. In CONUS applications, the derived spatially distributed parameter sets capture both spatial continuity and variation of parameters, highlighting their heterogeneous nature within specific regions. Overall, this hybrid regionalization approach offers a promising solution to the complex task of improving hydrological modeling over large domains for important hydrological applications.

CLM5↗

Teleconnections of the Quasi–Biennial Oscillation in a multi–model ensemble of QBO–resolving models

The quasi-biennial oscillation (QBO) dominates the interannual variability of the tropical stratosphere and influences other regions of the atmosphere. The high predictability of the QBO implies that its teleconnections could lead to in-creased skill of seasonal and decadal forecasts provided the relevant mechanisms are accurately represented in models. Here modelling and sampling uncertainties of QBO teleconnections are examined using a multi-model ensemble of QBO-resolving atmospheric general circulation models that have carried out a set of coordinated experiments as part of the Stratosphere-troposphere Processes And their Role in Climate (SPARC) QBO initiative (QBOi). During Northern Hemisphere winter the stratospheric polar vortex in most of these models strengthens when the QBO near 50 hPa is westerly and weakens when it is easterly, consistent with, but weaker than, the observed response. These weak responses are likely due to model errors, such as systematically weak QBO amplitudes near 50 hPa, affecting the teleconnection. The teleconnection to the North Atlantic Oscillation is less well captured overall, but of similar strength to the observed signal in the few models that do show it. Furthermore, the models do not show clear evidence of a QBO teleconnection to the Northern Hemisphere Pacific sector subtropical jet.

54 ENVIRONMENTAL SCIENCES↗

Deep learning-accelerated 3D carbon storage reservoir pressure forecasting based on data assimilation using surface displacement from InSAR

Fast forecasting of the reservoir pressure distribution during geologic carbon storage (GCS) by assimilating monitoring data is a challenging problem. Due to high drilling cost, GCS projects usually have spatially sparse measurements from few wells, leading to high uncertainties in reservoir pressure prediction. To address this challenge, we use low-cost Interferometric Synthetic-Aperture Radar (InSAR) data as monitoring data to infer reservoir pressure build up. We develop a deep learning-accelerated workflow to assimilate surface displacement maps interpreted from InSAR and to forecast dynamic reservoir pressure. Employing an Ensemble Smoother Multiple Data Assimilation (ES-MDA) framework, the workflow updates three-dimensional (3D) geologic properties and predicts reservoir pressure with quantified uncertainties. We use a synthetic commercial-scale GCS model with bimodally distributed permeability and porosity to demonstrate the efficacy of the workflow. A two-step CNN-PCA approach is employed to parameterize the bimodal fields. The computational efficiency of the workflow is boosted by two residual U-Net based surrogate models for surface displacement and reservoir pressure predictions, respectively. The workflow can complete data assimilation and reservoir pressure forecasting in half an hour on a personal computer.

25 ENERGY STORAGE↗

Kaon gluon parton distribution and momentum fraction from 2+1+1 lattice QCD with high statistics

We present a high-statistics lattice-QCD determination of the kaon gluon parton distribution function and gluon momentum fraction. We use clover valence fermion action to take 1,296,640 kaon-correlator measurements on a highly improved staggered quark ensemble with 𝑎 ≈ 0.12 fm and 310-MeV pion mass generated by the MILC Collaboration. A detailed investigation into the impact of gauge-link smearing on the gluonic matrix elements indicates that five steps of hypercubic smearing offer an effective balance between signal quality and preservation of long-distance physics. We report a nonperturbatively renormalized kaon gluon momentum fraction of Math output error at 𝜇 = 2 GeV in the Math output error scheme. Using reduced pseudo-Ioffe-time-distribution matrix elements and pseudo-parton-distribution-function (PDF) matching, we extract the kaon gluon PDF and compare with the prediction from the Dyson-Schwinger equation and with the pion PDF obtained from the same ensemble.

First-principles calculations↗

A deep learning-accelerated data assimilation and forecasting workflow for commercial-scale geologic carbon storage

Fast assimilation of monitoring data to update forecasts of pressure buildup and carbon dioxide (CO 2 ) plume migration under geologic uncertainties is a challenging problem in geologic carbon storage. The high computational cost of data assimilation with a high-dimensional parameter space impedes fast decision-making for commercial-scale reservoir management. We propose to leverage physical understandings of porous medium flow behavior with deep learning techniques to develop a fast data assimilation-reservoir response forecasting workflow. Applying an Ensemble Smoother Multiple Data Assimilation (ES-MDA) framework, the workflow updates geologic properties and predicts reservoir performance with quantified uncertainty from pressure history and CO 2 plumes interpreted through seismic inversion. As the most computationally expensive component in such a workflow is reservoir simulation, we developed surrogate models to predict dynamic pressure and CO 2 plume extents under multi-well injection. The surrogate models employ deep convolutional neural networks, specifically, a wide residual network and a residual U-Net. The workflow is validated against a flat threedimensional reservoir model representative of a clastic shelf depositional environment. Intelligent treatments are applied to bridge between quantities in a true-3D reservoir model and those in a single-layer reservoir model. The workflow can complete history matching and reservoir forecasting with uncertainty quantification in less than one hour on a mainstream personal workstation.

25 ENERGY STORAGE↗

Robust deep learning framework for constitutive relations modeling

Modeling the full-range deformation behaviors of materials under complex loading and materials conditions is a significant challenge for constitutive relations (CRs) modeling. Here, we propose a general encoder-decoder deep learning framework that can model high-dimensional stress-strain data and complex loading histories with robustness and universal capability. The framework employs an encoder to project high-dimensional input information (e.g., loading history, loading conditions, and materials information) to a lower-dimensional hidden space and a decoder to map the hidden representation to the stress of interest. We evaluated various encoder architectures, including gated recurrent unit (GRU), GRU with attention, temporal convolutional network (TCN), and the Transformer encoder, on two complex stress-strain datasets that were designed to include a wide range of complex loading histories and loading conditions. All architectures achieved excellent test results with an root-mean-square error (RMSE) below 1 MPa. Additionally, we analyzed the capability of the different architectures to make predictions on out-of-domain applications, with an uncertainty estimation based on deep ensembles. The proposed approach provides a robust alternative to empirical/semi-empirical models for CRs modeling, offering the potential for more accurate and efficient materials design and optimization.

36 MATERIALS SCIENCE↗

Dilute Alloys Based on Au, Ag, or Cu for Efficient Catalysis: From Synthesis to Active Sites

The development of new catalyst materials for energy-efficient chemical synthesis is critical as over 80% of industrial processes rely on catalysts, with many of the most energy-intensive processes specifically using heterogeneous catalysis. Catalytic performance is a complex interplay of phenomena involving temperature, pressure, gas composition, surface composition and structure over multiple length and time scales. In response to this complexity, the integrated approach to heterogeneous dilute-alloy catalysis reviewed here brings together materials synthesis, mechanistic surface chemistry, reaction kinetics, in-situ and operando characterization, and theoretical calculations in a coordinated effort to develop design principles to predict and improve catalytic selectivity. Dilute alloy catalysts—in which isolated atoms or small ensembles of the minority metal on the host metal lead to enhanced reactivity while retaining selectivity—are particularly promising as selective catalysts. Several dilute alloy materials using Au, Ag and Cu as the majority host element, including more recently introduced support-free nanoporous metals and oxide-supported nanoparticle "raspberry colloid templated (RCT)" materials, are reviewed for selective oxidation and hydrogenation reactions. Progress in understanding how such dilute alloy catalysts can be used to enhance selectivity of key synthetic reactions is reviewed, including quantitative scaling from model studies to catalytic conditions. The dynamic evolution of catalyst structure and composition studied in surface science and catalytic conditions and their relationship to catalytic function are also discussed, followed by advanced characterization and theoretical modeling that have been developed to determine the distribution of minority metal atoms at or near the surface. Furthermore, the integrated approach demonstrates the success of bridging the divide between fundamental knowledge and design of catalytic processes in complex catalytic systems, which can accelerate the development of new and efficient catalytic processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deforestation Increases Vegetation Vulnerability to Drought Across Biomes

Land use and land cover changes have altered terrestrial ecosystem carbon storage, but their impacts on ecosystem sensitivity to drought and temperature fluctuations have not been evaluated spatially over the globe. We estimate drought and temperature sensitivities of ecosystems using vegetation greenness from satellite observations and vegetation biomass from dynamic global vegetation model (DGVM) simulations. Using a space-for-time substitution with satellite data, we first illustrate the effects of vegetation cover changes on drought and temperature sensitivity and compare them with the effects estimated from DGVMs. We also compare simulations forced by scenarios with and without land cover changes to estimate the historical land cover change effects. Satellite data and vegetation models both show that converting forests to grasslands results in a more negative or decreased positive sensitivity of vegetation greenness or biomass to drought. Significant variability exists among models for other types of land cover transitions. We identify substantial effects of historical land cover changes on drought sensitivity from model simulations with a generally positive direction globally. Deforestation can lead to either an increased negative sensitivity, as drought-tolerant forests are replaced by grasslands based on model ensemble mean, or a decreased negative sensitivity, since forests under current land cover are predicted to exhibit greater drought resistance compared to those under pre-industrial land cover. Overall, our findings emphasize the critical role of forests in maintaining ecosystem stability and resistance to drought and temperature fluctuations, thereby implying their importance in stabilizing the carbon stock under increasingly extreme climate conditions.

Xiao, Chenwei [Max Planck Institute for Biogeochem↗

APACE: AlphaFold2 and advanced computing as a service for accelerated discovery in biophysics

The prediction of protein 3D structure from amino acid sequence is a computational grand challenge in biophysics and plays a key role in robust protein structure prediction algorithms, from drug discovery to genome interpretation. The advent of AI models, such as AlphaFold, is revolutionizing applications that depend on robust protein structure prediction algorithms. To maximize the impact, and ease the usability, of these AI tools we introduce APACE, AlphaFold2 and advanced computing as a service, a computational framework that effectively handles this AI model and its TB-size database to conduct accelerated protein structure prediction analyses in modern supercomputing environments. We deployed APACE in the Delta and Polaris supercomputers and quantified its performance for accurate protein structure predictions using four exemplar proteins: 6AWO, 6OAN, 7MEZ, and 6D6U. Using up to 300 ensembles, distributed across 200 NVIDIA A100 GPUs, we found that APACE is up to two orders of magnitude faster than off-the-self AlphaFold2 implementations, reducing time-to-solution from weeks to minutes. This computational approach may be readily linked with robotics laboratories to automate and accelerate scientific discovery.

97 MATHEMATICS AND COMPUTING↗

Spectral Data Fusion From Handheld Laser-Induced Breakdown Spectroscopy (LIBS) and X-ray Fluorescence (XRF) Analyzers for Improved Detection of Cerium in a Simulated Dispersal Accident

Here, this work implements a mid-level data fusion methodology on spectral data from handheld X-ray fluorescence and laser-induced breakdown spectroscopy analyzers to quantify plutonium surrogate (CeO 2 ) contamination in soil samples for the first time. Spectral data from each analyzer were used independently to train supervised machine learning regressions to predict Ce concentration. Fused features from both data sets were then used to train the same models, comparing prediction performance by evaluating model precision and sensitivity. Fusing principal component scores from the two sensors yielded an order of magnitude improvement in precision and sensitivity of predictions made with an artificial neural network, compared to predictions made by models trained on independent sensor data. As a result, a boosted ensemble trained on the fused spectral features yielded an ideal predictor with root-mean-squared error on the order of 10 –6 and calculated limit of detection order 10 –5 wt %.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Quantifying the role of moss in terrestrial ecosystem carbon dynamics in northern high latitudes

Mosses are ubiquitous in northern terrestrial ecosystems, and play an important role in regional carbon, water and energy cycling. Current global land surface models that do not consider mosses may bias the quantification of regional carbon dynamics. Here we incorporate mosses as a new plant functional type into the process-based Terrestrial Ecosystem Model (TEM 5.0), to develop a new model (TEM_Moss). The new model explicitly quantifies the interactions between vascular plants and mosses and their competition for energy, water, and nutrients. Compared to the estimates using TEM 5.0, the new model estimates that the regional terrestrial soils currently store 132.7 Pg more C and will store 157.5 and 179.1 Pg more C under the RCP8.5 and RCP2.6 scenarios, respectively, by the end of the 21st century. Ensemble regional simulations forced with different parameters for the 21st century with TEM_Moss predict that the region will accumulate 161.1±142.1 Pg C under the RCP2.6 scenario and 186.7±166.1 Pg C under the RCP8.5 scenario over the century. Our study highlights the necessity of coupling moss into Earth system models to adequately quantify terrestrial carbon–climate feedbacks in the Arctic.

54 ENVIRONMENTAL SCIENCES↗

Efficient Distance-based Global Sensitivity Analysis for Terrestrial Ecosystem Modeling

Sensitivity analysis in terrestrial ecosystem modeling is important for understanding controlling processes, guiding model development, and targeting new observations to reduce parameter and prediction uncertainty. Complex and computationally expensive terrestrial ecosystem models (TEM) limit the number of ensemble simulations, requiring sophisticated and efficient methods to analyze sensitivities of multiple model responses to different types of parameter uncertainties. In this study, we propose a distance-based global sensitivity analysis (DGSA) method. DGSA first classifies model response samples into a small set of discrete classes and then calculates the distance between parameter frequency distributions in different classes to measure the parameter sensitivity. The principle is that, if the parameter distribution is the same in each class, then the model response is insensitive to the parameter, while a large difference in the distributions indicates the parameter is influential to the response. Built on this idea, DGSA can be applied to analyze sensitivity of a single and a group of responses to different kinds of parameter uncertainties including continuous, discrete and even stochastic. Besides the main-effect sensitivity from a single parameter, DGSA can also quantify the sensitivity from parameter interactions. Additionally, DGSA is computationally efficient which can use a small number of model evaluations to obtain an accurate and statistically significant result. We applied DGSA to two TEMs, one having eight parameters and three kinds of model responses, and the other having 47 parameters and a long-period response. We demonstrated that DGSA can be used for sensitivity problems with multiple responses and high-dimensional parameters efficiently.

Lu, Dan↗

Projecting spatiotemporally explicit effects of climate change on stream temperature: A model comparison and implications for coldwater fishes

Conservation planners and resource managers seek information about how the availability and locations of cold-water habitats will change in the future and how these predictions vary among models. In this work, we used a physical process-based model to demonstrate the implications of climate change for streamflow and water temperature in two watersheds with distinctive flow regimes: the Snoqualmie watershed (WA) and Siletz watershed (OR), USA. Our model incorporated a downscaled ensemble of global climate model outputs and was calibrated with in situ and remotely sensed water temperatures. Furthermore, we compared predictions from our processed-based model to those from a publicly available and widely used statistical model. The process-based model projected greater changes in summer maximum water temperatures for the mixed-rain-snow Snoqualmie watershed than for the rain-dominated Siletz watershed as a result of the near-complete loss of winter snowpack and significant reduction in summer flow in the Snoqualmie watershed expected by the 2080s. Both models projected generally similar future spatial patterns of maximum water temperature in the two rivers, with cool reaches distributed farther upstream and fewer in number. However, the process-based model projected higher spatial heterogeneity in water temperature due to our spatially explicit simulation of streamflow and because we calibrated the model with spatially continuous remotely sensed water temperature data. We used stream temperature projections to assess the vulnerability of Pacific salmon and trout to changes in the spatial distribution of cold-water habitats during August by the 2080s. Results suggest that salmonids may have fewer summertime cold-water habitats in both watersheds. Projected stream warming may further limit particular species and life stages, especially in the Snoqualmie watershed. Our comparison of models highlights the importance of considering what might be gained by using a process-based model for evaluating and prioritizing management actions that mitigate climate impacts on cold-water habitats for stream fishes.

54 ENVIRONMENTAL SCIENCES↗