Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Differential credibility assessment for statistical downscaling

Climate science is increasingly using (i) ensembles of climate projections from multiple models derived using different assumptions and/or scenarios and (ii) process-oriented diagnostics of model fidelity. Efforts to assign differential credibility to projections and/or models are also rapidly advancing. A framework to quantify and depict the credibility of statistically downscaled model output is presented and demonstrated. Here, the approach employs transfer functions in the form of robust and resilient generalized linear models applied to downscale daily minimum and maximum temperature anomalies at 10 locations using predictors drawn from ERA-Interim reanalysis and two global climate models (GCM; GFDL-ESM2M and MPI-ESM-LR). The downscaled time series are used to derive several impact relevant CLIMDEX temperature indices that are assigned credibility based on (1) the reproduction of relevant large-scale predictors by the GCMs (i.e. fraction of regression beta-weights derived from predictors that are well-reproduced) and (2) the degree of variance in the observations reproduced in the downscaled series following application of a new variance inflation technique. Credibility of the downscaled predictands varies across locations, between the two GCM and is generally higher for minimum temperature than maximum temperature. The differential credibility assessment framework demonstrated here is easy to use and flexible. It can be applied as is to inform decision makers regarding projection confidence, and/or extended to include other components of the transfer functions, and/or used to weight members of a statistically downscaled ensemble.

54 ENVIRONMENTAL SCIENCES↗

The ongoing need for high-resolution regional climate models: Process understanding and stakeholder information

Regional climate modeling addresses our need to understand and simulate climatic processes and phenomena unresolved in global models. High resolution models are generally more skillful in simulating extremes, such as heavy precipitation, strong winds, and severe storms. In addition, research has shown that fine-scale features such as mountains, coastlines, lakes, irrigation, land use, and urban heat islands can substantially influence a region’s climate and its response to changing forcings. Regional climate simulations explicitly simulating convection are now being performed, providing an opportunity to illuminate new physical behavior that previously was represented by parameterizations with large uncertainties. Regional and global models are both advancing toward higher resolution, as computational capacity increases. However, the resolution and ensemble size necessary to produce a sufficient statistical sample of these processes in global models has proven too costly for contemporary supercomputing systems. Regional climate models are thus indispensable tools that complement global models for understanding regional climate variability and change, and are critical for supporting societal responses to changing climate.

Gutowski, William↗

A Hybrid Climate Modeling System Using AI-assisted Process Emulators

This white paper addresses Focus Area II. We advocate developing a hybrid modeling system to improve the understanding of decadal- and longer-scale predictability of high impact water cycle components. This hybrid model combines a partial differential equation (PDE)-based dynamic core with AI/ML based emulators to represent many of the computationally expensive processes in Earth’s climate models. The hybrid modeling system has the potential to exploit emerging graphics processing unit (GPU)-accelerated architectures and allows for the generation of large ensemble (~1000’s) simulations to better characterize the model uncertainty and understand predictability.

58 GEOSCIENCES↗

A baseline for ensemble-based, time-resolved inflow reconstruction for a single turbine using large-eddy simulations and latent diffusion models

We are interested in reconstructing winds flowing through a turbine on a second-by-second basis over a 10 min window. Previously, we developed a machine learning algorithm that takes in a snapshot of wind speed measurements and generates ensembles of three-dimensional wind field estimates. Here, we use these estimates as initial conditions in large-eddy simulations and reconstruct atmospheric and turbine response dynamic quantities in a synthetic field campaign. In doing so, we establish a baseline for model validation that future time-aware data assimilation techniques will be compared to. In turbine-free case studies, ground truth wind speeds consistently fall within our estimated wind speed distribution for the first 100 s after the simulation start. In simulations with turbines, the wind estimates show a small bias of 0.10 m s 1 and good correlation of 0.80 during the first 100 s. During this window, our estimates of the Blade 1 bending moment and generator power typically span the ground truth, with the estimate of the former performing better overall. In summary, this approach shows promise as a stand-alone technique for reconstructing real-world inflow and turbine dynamics in 1-2 min windows and as a foundation for future time-aware data assimilation techniques.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Earth's record-high greenness and its attributions in 2020

Terrestrial vegetation is a crucial component of Earth's biosphere, regulating global carbon and water cycles and contributing to human welfare. Despite an overall greening trend, terrestrial vegetation exhibits a significant inter-annual variability. The mechanisms driving this variability, particularly those related to climatic and anthropogenic factors, remain poorly understood, which hampers our ability to project the long-term sustainability of ecosystem services. Here, in this work, by leveraging diverse remote sensing measurements, we pinpointed 2020 as a historic landmark, registering as the greenest year in modern satellite records from 2001 to 2020. Using ensemble machine learning and Earth system models, we found this exceptional greening primarily stemmed from consistent growth in boreal and temperate vegetation, attributed to rising CO 2 levels, climate warming, and reforestation efforts, alongside a transient tropical green-up linked to the enhanced rainfall. Contrary to expectations, the COVID-19 pandemic lockdowns had a limited impact on this global greening anomaly. Our findings highlight the resilience and dynamic nature of global vegetation in response to diverse climatic and anthropogenic influences, offering valuable insights for optimizing ecosystem management and informing climate mitigation strategies.

54 ENVIRONMENTAL SCIENCES↗

High-throughput screening of tribological properties of monolayer films using molecular dynamics and machine learning

Monolayer films have shown promise as a lubricating layer to reduce friction and wear of mechanical devices with separations on the nanoscale. These films have a vast design space with many tunable properties that can affect their tribological effectiveness. For example, terminal group chemistry, film composition, and backbone chemistry can all lead to films with significantly different tribological properties. This design space, however, is very difficult to explore without a combinatorial approach and an automatable, reproducible, and extensible workflow to screen for promising candidate films. Here, using the Molecular Simulation Design Framework (MoSDeF), a combinatorial screening study was performed to explore 9747 unique monolayer films (116 964 total simulations) and a machine learning (ML) model using a random forest regressor, an ensemble learning technique, to explore the role of terminal group chemistry and its effect on tribological effectiveness. The most promising films were found to contain small terminal groups such as cyano and ethylene. The ML model was subsequently applied to screen terminal group candidates identified from the ChEMBL small molecule library. Approximately 193 131 unique film candidates were screened with approximately a five order of magnitude speed-up in analysis compared to simulation alone. The ML model was thus able to be used as a predictive tool to greatly speed up the initial screening of promising candidate films for future simulation studies, suggesting that computational screening in combination with ML can greatly increase the throughput in combinatorial approaches to generate in silico data and then train ML models in a controlled, self-consistent fashion.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Quantifying airborne fraction trends and the destination of anthropogenic CO 2 by tracking carbon flows in a simple climate model

Abstract Atmospheric carbon dioxide (CO 2 ) concentrations have increased as a direct result of human activity and are at their highest level over the last 2 million years, with profound impacts on the Earth system. However, the magnitude and future dynamics of land and ocean carbon sinks are not well understood; therefore, the amount of anthropogenic fossil fuel emissions that remain in the atmosphere (the airborne fraction) is poorly constrained. This work aims to quantify the sources and controls of atmospheric CO 2 , the fate of anthropogenic CO 2 over time, and the likelihood of a trend in the airborne fraction. We use Hector v3.0, a coupled simple climate and carbon cycle model with the novel ability to explicitly track carbon as it flows through the Earth system. We use key model parameters in a Monte Carlo analysis of 15 000 model runs from 1750 to 2300. Results are filtered for physical realism against historical observations and CMIP6 projection data, and we calculate the relative importance of parameters controlling how much anthropogenic carbon ends up in the atmosphere. Modeled airborne fraction was roughly 52%, consistent with observational studies. The overwhelming majority of model runs exhibited a negative trend in the airborne fraction from 1960–2020, implying that current-day land and ocean sinks are proportionally taking up more carbon than the atmosphere. However, the percentage of atmospheric CO 2 derived from anthropogenic origins can be much higher because of Earth system feedbacks. We find it peaks at over 90% between 2010–2050. Moreover, when looking at the destination of anthropogenic fossil fuel emissions, only a quarter ends up in the atmosphere while more than half of emissions are taken up by the land sink on centennial timescales. This study evaluates the likelihood of airborne fraction trends and provides insights into the dynamics of anthropogenic CO 2 in the Earth system.

54 ENVIRONMENTAL SCIENCES↗

Time-dependent relaxation of observables in complex quantum systems

Abstract We consider time-dependent relaxation of observables in quantum systems of chaotic and regular type. Using statistical arguments and exact numerical solutions we show that the spread of the initial wave function in the Hilbert space and the main characteristics of evolution of observables have certain generic features. The study compares examples of regular dynamics, a completely chaotic case of the Gaussian orthogonal ensemble, a bosonic system with random interactions, and a fully realistic case of the time evolution of various initial non-stationary states in the nuclear shell model. In the case of the Gaussian orthogonal ensemble we show that the survival probability obtained analytically also fully defines the relaxation timescale of observables. This is not the case in general. Using the realistic nuclear shell model and the quadrupole moment as an observable we demonstrate that the relaxation time is significantly longer than defined by the survival probability of the initial state. The full analysis does not show the presence of an analog of the Lyapunov exponent characteristic for examples of classical chaos.

Volya, Alexander (ORCID:0000000217656466)↗

Fouling modeling and prediction approach for heat exchangers using deep learning

In this article, we develop a generalized and scalable statistical model for accurate prediction of fouling resistance using commonly measured parameters of industrial heat exchangers. This prediction model is based on deep learning where a scalable algorithmic architecture learns non-linear functional relationships between a set of target and predictor variables from large number of training samples. Here, the efficacy of this modeling approach is demonstrated for predicting fouling in an analytically modeled cross-flow heat exchanger, designed for waste heat recovery from flue-gas using room temperature water. The performance results of the trained models demonstrate that the mean absolute prediction errors are under 10 –4 KW –1 for flue-gas side, water side and overall fouling resistances. The coefficients of determination (R 2 ), which characterize the goodness of fit between the predictions and observed data, are over 99%. Even under varying levels of measurement noise in the inputs, we demonstrate that predictions over an ensemble of multiple neural networks achieves better accuracy and robustness to noise. We find that the proposed deep-learning fouling prediction framework learns to follow heat exchanger flow and heat transfer physics, which we confirm using locally interpretable model agnostic explanations around randomly selected operating points. Overall, we provide a robust algorithmic framework for fouling prediction that can be generalized and scaled to various types of industrial heat exchangers.

42 ENGINEERING↗

Process-oriented stochastic perturbations applied to the parametrization of turbulence and shallow convection for ensemble prediction

Weather forecasting nowadays often requires some estimation of uncertainties associated with the output of meteorological models, in order to better inform decision making, especially in the context of intense weather events. Ensemble prediction systems provide such information through sets of possible scenarios which are designed to represent various uncertainty sources, including model uncertainties. A wide variety of methods have been proposed to estimate model uncertainties, among which perturbation methods targeting uncertain processes are a promising research field. Here, we focus on the representation of small-scale variability by process-oriented perturbation schemes applied to two key physical processes, namely turbulence and shallow convection. The perturbations are applied to a single-column version of the convection-permitting AROME model, in three idealized boundary-layer cases. Large-eddy simulations (LESs) of the same cases serve as a reference for the subgrid variability that has to be represented, and the results are also compared to those given by the Stochastically Perturbed Parametrization Tendencies (SPPT) method, which is a method commonly used by weather forecast centres to represent model uncertainty. The spread produced by our process-oriented perturbations of turbulence and shallow convection does not represent all the small-scale variability implied by the LESs for temperature and humidity. However, it is of a similar order of magnitude for the wind, thanks to perturbations generated by the stochastic turbulence scheme. The dispersion is structurally different from what is obtained with SPPT. It is non-negligible in the lower levels, where SPPT perturbations are usually suppressed because of numerical instabilities, indicating a possible complementarity between the schemes.

54 ENVIRONMENTAL SCIENCES↗

Benchmarking the performance of uncertainty quantification methods for neural network-based interatomic potentials

Machine-learned interatomic potentials (ML-IAPs) continue to gain popularity as accurate, computationally efficient replacements for traditional, physics-based interatomic potentials and expensive ab initio methods. Uncertainty quantification (UQ) of ML-IAPs is a growing area of research as UQ is critical in many applications of IAPs, such as developing curated datasets, active learning-based data augmentation, self-improving models, and estimating the uncertainty of molecular dynamics simulations. In this paper, we construct and benchmark a series of different neural network potentials (NNPs) with varying network architectures to determine the performance of these models with respect to both the mean and uncertainty calibration error. Each NNP method is specifically designed to predict either epistemic or aleatoric uncertainty with particular focus on the differences in behavior between the epistemic and aleatoric uncertainty estimates. We benchmark these methods using multiple datasets common in the ML-IAP literature. The results show that the aleatoric uncertainty from single-shot model architectures is a competitive alternative to ensemble-based epistemic uncertainty predictions in regions of sufficient data-density. However, in regions where the representative data is sparse, aleatoric uncertainty models tend to overpredict and epistemic methods tend to underpredict the actual model error. We conclude that the type of UQ is crucial when discussing performance of probabilistic model results as different methods have different performance characteristics depending on the regime in which they are evaluated. Therefore, the type of UQ method should be carefully evaluated against both the data characteristics and requirements for the intended application.

97 MATHEMATICS AND COMPUTING↗

Attribution of the role of climate change in the forest fires in Sweden 2018

In this study, we analyse the role of climate change in the forestfires that raged through large parts of Sweden in the summer of 2018 from ameteorological perspective. This is done by studying the Canadian FireWeather Index (FWI) based on sub-daily data, both in reanalysis data sets(ERA-Interim, ERA5, the Japanese 55 year Reanalysis, JRA-55, and Modern-Era Retrospective analysis for Research and Applications version 2, MERRA-2) and three large-ensemble climatemodels (EC-Earth, weather@home, W@H, and Community Earth System Model, CESM) simulations. The FWI, based on reanalysis, correlates well with the observed burnt area in summer (r=0.6 to 0.8). We find that the maximum FWI in July 2018 had return times of ~24 years (90 % CI, confidence interval, > 10 years) for southern and northern Sweden. Furthermore, we find a negative trend of the FWI for southern Sweden over the 1979 to 2017 time period in the reanalyses, yielding a non-significant reduced probability of such an event. However, the short observational record, large uncertainty between the reanalysis products and large natural variability of the FWI give a large confidence interval around this number that easily includes no change, so we cannot draw robust conclusions from reanalysis data. The three large-ensembles with climate models point to a roughly 1.1 (0.9 to 1.4) times increased probability (non-significant) for such events in the current climate relative to preindustrial climate. For a future climate (2 °C warming), we find a roughly 2 (1.5 to 3) times increased probability for such events relative to the preindustrial climate. The increased fire weather risk is mainly attributed to the increase intemperature. The other main factor, i.e. precipitation during summer months, isprojected to increase for northern Sweden and decrease for southern Sweden. We, however, do not find a clear change in prolonged dry periods in summer months that could explain the increased fire weather risk in the climate models. In summary, we find a (non-significant) reduced probability of such eventsbased on reanalyses, a small (non-significant) increased probability due to global warming up to now and a more robust (significant) increase in the risk for such events in the future based on the climate models.

54 ENVIRONMENTAL SCIENCES↗

Projected changes in extreme streamflow and inland flooding in the mid-21st century over Northeastern United States using ensemble WRF-Hydro simulations

Study region: Northeastern United States (NEUS). Study focus: We investigate the potential impacts of climate change on precipitation, streamflow, and inland flooding in the NEUS during the mid-21st century. Dynamically downscaled climate projections from three global climate models for historical (1995-2004) and future (2045-2054) periods under business-as-usual scenarios were used to force the hydrologic model WRF-Hydro at 200-meter resolution and create ensemble hydrologic simulations. Additionally, an extreme value model was developed to project the risks associated with low-frequency hydrologic events. New hydrological insights for the region: Results from four major watersheds indicate a significantly wetter regime in winter months and potential drier conditions during late spring to early summer. Discharges in fall are projected to decrease in the northern watersheds and increase toward the south. Extreme flow and water depths resulting from extreme inland flooding are projected to increase by 5-20% and > 100%, respectively. The extent of the total flooded area is likely to be 20% greater by the mid-century. These increased risks can be attributed to (i) an approximate 25% increase in decadal mean and > 40% increase in decadal extreme precipitation intensity, (ii) up to 30% lower snow availability and 5-25% higher evapotranspiration throughout the year, and (iii) a projected 5% increase in soil moisture in all seasons except summer. Furthermore, rapid snow melting in winter will likely cause an earlier peak flow in the rivers.

54 ENVIRONMENTAL SCIENCES↗

Feature‐shared adaptive‐boost deep learning for invasiveness classification of pulmonary subsolid nodules in CT images

Purpose In clinical practice, invasiveness is an important reference indicator for differentiating the malignant degree of subsolid pulmonary nodules. These nodules can be classified as atypical adenomatous hyperplasia (AAH), adenocarcinoma in situ (AIS), minimally invasive adenocarcinoma (MIA), or invasive adenocarcinoma (IAC). The automatic determination of a nodule's invasiveness based on chest CT scans can guide treatment planning. However, it is challenging, owing to the insufficiency of training data and their interclass similarity and intraclass variation. To address these challenges, we propose a two‐stage deep learning strategy for this task: prior‐feature learning followed by adaptive‐boost deep learning. Methods The adaptive‐boost deep learning is proposed to train a strong classifier for invasiveness classification of subsolid nodules in chest CT images, using multiple 3D convolutional neural network (CNN)‐based weak classifiers. Because ensembles of multiple deep 3D CNN models have a huge number of parameters and require large computing resources along with more training and testing time, the prior‐feature learning is proposed to reduce the computations by sharing the CNN layers between all weak classifiers. Using this strategy, all weak classifiers can be integrated into a single network. Results Tenfold cross validation of binary classification was conducted on a total of 1357 nodules, including 765 noninvasive (AAH and AIS) and 592 invasive nodules (MIA and IAC). Ablation experimental results indicated that the proposed binary classifier achieved an accuracy of with an AUC of 81.3 . These results are superior compared to those achieved by three experienced chest imaging specialists who achieved an accuracy of , , and , respectively. About 200 additional nodules were also collected. These nodules covered 50 cases for each category (AAH, AIS, MIA, and IAC, respectively). Both binary and multiple classifications were performed on these data and the results demonstrated that the proposed method definitely achieves better performance than the performance achieved by nonensemble deep learning methods. Conclusions It can be concluded that the proposed adaptive‐boost deep learning can significantly improve the performance of invasiveness classification of pulmonary subsolid nodules in CT images, while the prior‐feature learning can significantly reduce the total size of deep models. The promising results on clinical data show that the trained models can be used as an effective lung cancer screening tool in hospitals. Moreover, the proposed strategy can be easily extended to other similar classification tasks in 3D medical images.

Wang, Jun↗

Three different directions in which the European Union could replace Russian natural gas

Russia's invasion of Ukraine fuelled an energy crisis, which considerably impacted Europe given its heavy reliance on Russian natural gas imports. This study uses an ensemble of four global integrated assessment models, which are further soft-linked to two sectoral models, and explores the synergies and trade-offs among three approaches to living without Russian gas in Europe: (a) replacing with other gas imports, (b) boosting domestic energy production, and (c) reducing demand and accelerating energy efficiency. We find that substituting Russian gas from other trade partners would miss an opportunity to accelerate decarbonisation in end-use sectors while risking further fossil-fuel lock-ins, despite featuring the lowest gas price spikes and potentially reducing heating costs for end-users in the near term. Boosting domestic, primarily renewable, energy production on the other hand would instead require considerable investments, potentially burdening consumers. Energy demand reductions, however, could offer considerable space for further emissions cuts at the lowest power-sector investment costs; nonetheless, an energy efficiency-driven strategy would also risk relocation of energy-intensive industries, an aspect of increasing relevance to EU policymakers.

03 NATURAL GAS↗

Hydrological projections over the Upper Indus Basin at 1.5 °C and 2.0 °C temperature increase

We analyse an ensemble of statistically downscaled Global Climate Models (GCMs) to investigate future water availability in the Upper Indus Basin (UIB) of Pakistan for the time horizons when the global and/or regional warming levels cross Paris Agreement (PA) targets. The GCMs data is obtained from the 5th Phase of Coupled Model Inter-Comparison Project under two Representative Concentration Pathways (RCP4.5 and RCP8.5). Based on the five best performing GCMs, we note that global 1.5 °C and 2.0 °C warming thresholds are projected in 2026 and 2047 under RCP4.5 and 2022 and 3036 under RCP8.5 respectively while these thresholds are reached much earlier over Pakistan i.e. 2016 and 2030 under RCP4.5 and 2012 and 2025 under RCP8.5 respectively. Interestingly, the GCMs with the earliest emergence at the global scale are not necessarily the ones with the earliest emergence over Pakistan, highlighting spatial non-linearity in GCMs response. The emergence of 2.0 °C warming at global scale across 5 GCMs ranges from 2031 (CCSM4) to 2049 (NorESM) under RCP8.5. Precipitation generally exhibits a progressive increasing trend with stronger changes at higher warming or radiative forcing levels. Hydrological simulations representing the historical, 1.5 °C and 2.0 °C global and region warming time horizons indicate a robust but seasonally varying increase in the inflows. The highest inflows in the baseline and future are witnessed in July. However, the highest future increase in inflows is projected in October under RCP4.5 (37.99% and 65.11% at 1.5 °C and 2.0 °C) and in April under RCP8.5 (37% and 62.05% at 1.5 °C and 2.0 °C). These hydrological changes are driven by increases in the snow and glacial melt contribution, which are more pronounced at 2.0 °C warming level. These findings should help for effective water management in Pakistan over the coming decades.

54 ENVIRONMENTAL SCIENCES↗

Smaller Is Better: The Case for Lower-Order Iodoplumbate Species Dominating MAPbI 3 /Dimethylformamide Solutions

Here, using complementary experimental measurements and computational predictions of spectroscopic measurements (EXAFS, XANES, and UV–vis), we have determined the identity of the most stable iodoplumbate species in dilute lead halide perovskite precursor solutions. We have determined which species are most likely to be thermodynamically stable compared to others that are unstable or metastable. Condensed phase ab initio models were constructed, and the resulting ensembles were used to directly compare the computed signals to the experimental results of the EXAFS, XANES, and UV–vis spectra of PbI 2 :MAI in DMF. The results of this study suggest that only Pb 2+ , PbI + , and PbI 2 are dominant in the dilute lead perovskite precursor solutions as thermodynamically stable entities. Our interpretation of the relative stability of iodoplumbate species in solution, based on an analysis of EXAFS and XANES spectra, provides critically important new insight into the species most likely to be responsible for crystal nucleation and growth in these materials. This insight will have a significant consequence on the broad scientific community and will necessitate the reinterpretation of peaks in the UV–vis spectra of lead halide perovskite precursor solutions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Superlattices are Greener on the Other Side: How Light Transforms Self-Assembled Mixed Halide Perovskite Nanocrystals

Perovskite nanocrystal superlattices (NC SLs) are the nearest real-world approximations to monodisperse NC ensembles. NC SLs thus represent ideal model systems for evaluating the optical and structural stability of CsPb(I 1– x Br x ) 3 NCs at a macroscopic level. Here, photoinduced changes to CsPb(I 1– x Br x ) 3 NC SLs (0 < x < 1.0) are probed via in situ photoluminescence, X-ray diffraction, and electron microscopy. We find that prolonged (~10–20 h) ultraviolet–visible irradiation causes irreversible PL blueshifts, photobrightening, and crystal structure contractions. These changes stem from gradual photoinduced I 2 sublimation, which transforms CsPb(I 1– x Br x ) 3 into CsPbBr 3 . Despite eliminating half of the initial halides from individual CsPb(I 0.53 Br 0.47 ) 3 particles, NCs within SLs remarkably preserve their initial crystallinity, cuboidal shapes, edge lengths, and size distributions. This work illustrates compositional control toward generating precisely engineered perovskite NC SLs. It also highlights iodide photo-oxidation as a hurdle that must be overcome if mixed halide perovskite nanomaterials are to be applied beyond fundamental studies.

36 MATERIALS SCIENCE↗