Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

A generalized approximate control variate framework for multifidelity uncertainty quantification

We describe and analyze a variance reduction approach for Monte Carlo (MC) sampling that accelerates the estimation of statistics of computationally expensive simulation models using an ensemble of models with lower cost. These lower cost models — which are typically lower fidelity with unknown statistics — are used to reduce the variance in statistical estimators relative to a MC estimator with equivalent cost. We derive the conditions under which our proposed approximate control variate framework recovers existing multifidelity variance reduction schemes as special cases. We demonstrate that existing recursive/nested strategies are suboptimal because they use the additional low-fidelity models only to efficiently estimate the unknown mean of the first low-fidelity model. As a result, they cannot achieve variance reduction beyond that of a control variate estimator that uses a single low-fidelity model with known mean. However, there often exists about an order-of-magnitude gap between the maximum achievable variance reduction using all low-fidelity models and that achieved by a single low-fidelity model with known mean. We show that our proposed approach can exploit this gap to achieve greater variance reduction by using non-recursive sampling schemes. The proposed strategy reduces the total cost of accurately estimating statistics, especially in cases where only low-fidelity simulation models are accessible for additional evaluations. Several analytic examples and an example with a hyperbolic PDE describing elastic wave propagation in heterogeneous media are used to illustrate the main features of the methodology.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Distilling physical origins of hardness in multi-principal element alloys directly from ensemble neural network models

Abstract Despite a plethora of data being generated on the mechanical behavior of multi-principal element alloys, a systematic assessment remains inaccessible via Edisonian approaches. We approach this challenge by considering the specific case of alloy hardness, and present a machine-learning framework that captures the essential physical features contributing to hardness and allows high-throughput exploration of multi-dimensional compositional space. The model, tested on diverse datasets, was used to explore and successfully predict hardness in Al x Ti y (CrFeNi) 1- x - y , Hf x Co y (CrFeNi) 1- x - y and Al x (TiZrHf) 1- x systems supported by data from density-functional theory predicted phase stability and ordering behavior. The experimental validation of hardness was done on TiZrHfAl x . The selected systems pose diverse challenges due to the presence of ordering and clustering pairs, as well as vacancy-stabilized novel structures. We also present a detailed model analysis that integrates local partial-dependencies with a compositional-stimulus and model-response study to derive material-specific insights from the decision-making process.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Deep Learning Image Segmentation for Atmospheric Rivers

Abstract The identification of atmospheric rivers (ARs) is crucial for weather and climate predictions as they are often associated with severe storm systems and extreme precipitation, which can cause large impacts on society. This study presents a deep learning model, termed ARDetect, for image segmentation of ARs using ERA5 data from 1960 to 2020 with labels obtained from the TempestExtremes tracking algorithm. ARDetect is a convolutional neural network (CNN)-based U-Net model, with its structure having been optimized using automatic hyperparameter tuning. Inputs to ARDetect were selected to be the integrated water vapor transport (IVT) and total column water (TCW) fields, as well as the AR mask from TempestExtremes from the previous time step to the one being considered. ARDetect achieved a mean intersection-over-union (mIoU) rate of 89.04% for ARs, indicating its high accuracy in identifying these weather patterns and a superior performance than most deep learning–based models for AR detection. In addition, ARDetect can be executed faster than the TempestExtremes method (seconds vs minutes) for the same period. This provides a significant benefit for online AR detection, especially for high-resolution global models. An ensemble of 10 models, each trained on the same dataset but having different starting weights, was used to further improve on the performance produced by ARDetect, thus demonstrating the importance of model diversity in improving performance. ARDetect provides an effective and fast deep learning–based model for researchers and weather forecasters to better detect and understand ARs, which have significant impacts on weather-related events such as floods and droughts.

Galea, Daniel↗

A Robust Multi-Scale Modeling System for the Study of Cloud and Precipitation Processes

During the past decade, numerical weather and global non-hydrostatic models have started using more complex microphysical schemes originally developed for high resolution cloud resolving models (CRMs) with 1-2 km or less horizontal resolutions. These microphysical schemes affect the dynamic through the release of latent heat (buoyancy loading and pressure gradient) the radiation through the cloud coverage (vertical distribution of cloud species), and surface processes through rainfall (both amount and intensity). Recently, several major improvements of ice microphysical processes (or schemes) have been developed for cloud-resolving model (Goddard Cumulus Ensemble, GCE, model) and regional scale (Weather Research and Forecast, WRF) model. These improvements include an improved 3-ICE (cloud ice, snow and graupel) scheme (Lang et al. 2010); a 4-ICE (cloud ice, snow, graupel and hail) scheme and a spectral bin microphysics scheme and two different two-moment microphysics schemes. The performance of these schemes has been evaluated by using observational data from TRMM and other major field campaigns. In this talk, we will present the high-resolution (1 km) GeE and WRF model simulations and compared the simulated model results with observation from recent field campaigns [i.e., midlatitude continental spring season (MC3E; 2010), high latitude cold-season (C3VP, 2007; GCPEx, 2012), and tropical oceanic (TWP-ICE, 2006)].

Tao, Wei-Kuo↗

Predicting concrete compressive strength using hybrid ensembling of surrogate machine learning models

This study aims to implement a hybrid ensemble surrogate machine learning technique in predicting the compressive strength (CS) of concrete, an important parameter used for durability design and service life prediction of concrete structures in civil engineering projects. For this purpose, an experimental database consisting of 1030 records has been compiled from the machine learning repository of the University of California, Irvine. The database was used to train and validate four conventional machine learning (CML) models, namely Artificial Neural Network (ANN), Linear and Non-Linear Multivariate Adaptive Regression Splines (MARS-L and MARS-C), Gaussian Process Regression (GPR), and Minimax Probability Machine Regression (MPMR). Subsequently, the predicted outputs of CML models were combined and trained using ANN to construct the Hybrid Ensemble Model (HENSM). It is observed that the proposed HENSM produces higher predictive accuracy compared to the CML models used in the present study. The predictive performance of all models for CS prediction was compared using the testing dataset and it is found that the HENSM model attained the highest predictive accuracy in both phases. Based on the experimental results, the newly constructed HENSM model is very potential to be a new alternative in handling the overfitting issues of CML models and hence, can be used to predict the concrete CS, including the design of less polluting and more sustainable concrete constructions.

36 MATERIALS SCIENCE↗

Nonlinear Ensemble Filtering with Diffusion Models: Application to the Surface Quasigeostrophic Dynamics

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here, we explore another promising solution in which diffusion models are used to formulate a robust nonlinear ensemble filter for sequential data assimilation. Unlike standard machine learning methods, the proposed ensemble score filter (EnSF) is completely training free and can efficiently generate a set of analysis ensemble members. Here, in this study, we apply the EnSF to a surface quasigeostrophic model and compare its performance against the popular local ensemble transform Kalman filter (LETKF), which makes Gaussian assumptions in the analysis step. Numerical tests demonstrate that EnSF maintains stable performance in the absence of localization and for a variety of experimental settings. We find that while LETKF maintains optimal performance in the case of linear observations of the entire state and a perfect model, EnSF shows improvements over LETKF when nonlinear observations are assimilated and the system is subject to unexpected model errors. A spectral decomposition of the analysis results in this nonlinear observation regime shows that the largest improvements over LETKF occur at large scales (small wavenumbers), where LETKF lacks sufficient ensemble spread. Overall, this initial application of EnSF to a geophysical model of intermediate complexity motivates further development of the algorithm for more realistic problems.

Artificial intelligence↗

Estimation of Kalman filter model parameters from an ensemble of tests

A methodology for estimating initial mean and covariance parameters in a Kalman filter model from an ensemble of nonidentical tests is presented. In addition, the problem of estimating time constants and process noise levels is addressed. Practical problems such as developing and validating inertial instrument error models from laboratory test data or developing error models of individual phases of a test are generally considered.

Gibbs, B. P.↗

DART-PFLOTRAN: An ensemble-based data assimilation system for estimating subsurface flow and transport model parameters

Ensemble-based Data Assimilation (EDA), based on the Monte Carlo approach, has been effectively applied to estimate model parameters through inverse modeling in subsurface flow and transport problems. However, implementation of EDA approach involves a complicated workflow that include setting up and executing ensemble forward model simulations, processing observations and model simulation results for parameter updates, and repeat for sequential or iterative EDA. To facilitate the management of such workflow and lower the barriers for adopting EDA-based parameter estimation in subsurface science, we develop a generic software frame-work linking the Data Assimilation Research Testbed (DART) with a massively parallel subsurface FLOw and TRANsport code PFLOTRAN. The new DART-PFLOTRAN leverages both the core data assimilation engines in DART and the computational power afforded by PFLOTRAN. In addition to the standard smoother and filtering options, DART-PFLOTRAN enables an iterative EDA workflow based on the Ensemble Smoother for Multiple Data Assimilation method (ES-MDA) to improve estimation accuracy for nonlinear forward problems. Here, we verify the implementation of ES-MDA in DART-PFLOTRAN using two synthetic cases designed to estimate static permeability and dynamic exchange fluxes across the riverbed, respectively, from continuous temperature measurements made across a depth profile. One-dimensional hydro-thermal simulations are performed in both cases to relate temperature responses with the parameters of interest. In the case of estimating dynamic parameters, we demonstrate the flexibility of DART-PFLOTRAN in automating sequential ES-MDA workflow, which will significantly reduce the time researchers spend on managing complex workflows in similar applications. Both studies yield accurate estimations of the parameters compared to their synthetic truth, while ES-MDA leads to more accurate estimation when a high level of nonlinearity exist between observed responses and unknown parameters. With a code base in Python and Fortran, DART-PFLOTRAN paves the way for applications in large-scale subsurface inverse modeling by automating the complex workflow of sequential ES-MDA that can be executed on various computing platforms.

97 MATHEMATICS AND COMPUTING↗

CMIP6-based Multi-model Hydroclimate Projection over the Conterminous US

We present a suite of high-resolution downscaled hydro-climate projections over the conterminous United States (CONUS) based on a six-member General Climate Model (GCM) ensemble from the Coupled Models Intercomparison Project phase 6 (CMIP6). The CMIP6 GCMs are downscaled using two different downscaling approaches (statistical-based DBCCA & dynamical-based RegCM) based on two meteorological reference observations (Daymet & Livneh), and then fed to two calibrated hydrologic models (VIC & PRMS) to simulate projected future hydrologic responses. Each ensemble member covers 1980–2019 in the historic period and 2020–2059 in the near-term future period under the high-end (SSP585) emission scenario. Major variables such as daily maximum temperature (tmax), daily minimum temperature (tmin), daily total precipitation (prcp), daily average wind speed (wind), and daily total runoff (runoff) at 1/24° (~4 km) spatial resolution across the CONUS are provided through this data portal. This dataset is derived to support the SECURE Water Act Section 9505 Assessment for the US Department of Energy (DOE) Water Power Technologies Office (WPTO). Further details of this dataset can be referred to Kao et al. (2022) and Rastogi et al. (2022).

13 HYDRO ENERGY↗

Design and Implementation of a Parallel Multivariate Ensemble Kalman Filter for the Poseidon Ocean General Circulation Model

A multivariate ensemble Kalman filter (MvEnKF) implemented on a massively parallel computer architecture has been implemented for the Poseidon ocean circulation model and tested with a Pacific Basin model configuration. There are about two million prognostic state-vector variables. Parallelism for the data assimilation step is achieved by regionalization of the background-error covariances that are calculated from the phase-space distribution of the ensemble. Each processing element (PE) collects elements of a matrix measurement functional from nearby PEs. To avoid the introduction of spurious long-range covariances associated with finite ensemble sizes, the background-error covariances are given compact support by means of a Hadamard (element by element) product with a three-dimensional canonical correlation function. The methodology and the MvEnKF configuration are discussed. It is shown that the regionalization of the background covariances; has a negligible impact on the quality of the analyses. The parallel algorithm is very efficient for large numbers of observations but does not scale well beyond 100 PEs at the current model resolution. On a platform with distributed memory, memory rather than speed is the limiting factor.

Keppenne, Christian L.↗

Ensemble PM2.5 Forecasting during the 2018 Camp Fire Event Using the HYSPLIT Transport and Dispersion Model

Biomass burning releases a vast amount of aerosols into the atmosphere, often leading to severe air quality and health problems. Prediction of the air quality effects from biomass burning emissions is challenging due to uncertainties in fire emission, plume rise calculation, and other model inputs/processes. Ensemble forecasting is increasingly used to represent model uncertainties. In this paper, an ensemble forecast was conducted to predict surface PM2.5 during the 2018 California Camp Fire event using the NOAA HYSPLIT dispersion model at 0.1- degree horizontal resolution. Different combinations of four satellite-based fire emission datasets (FEER, FLAMBE, GBBEPx and GFAS), two plume rise schemes (Briggs and Sofiev), various meteorology inputs and model setup options were used to create the forecast ensemble, for a total of 112 experiments. The performance of each ensemble member and the ensemble mean were evaluated using ground-based observations, with four statistical metrics and an overall rank. The ensemble spread of the 112 members reached 1000 μg/m3, highlighting the large uncertainty in wildfire forecast. The ensemble mean displayed the best performance. Each fire emission product contributed to one or more members among the top ten performers, revealing the forecasting dependence on both the quality of fire emissions data and model representation of emission, transport and removal processes. In addition, an ensemble size reduction technique was introduced. With the help of this technique, the ensemble size was reduced from 112 to 28 members and still produced an ensemble mean that yielded comparable or even better performance to that of the full ensemble.

Biomass Burning↗

A test of a cumulus parameterization model using the GATE data

Two parametric, ensemble cloud models were tested with data obtained during GATE (GARP Atlantic Tropical Experiment) (1974). The first model is an adaption of the Arakawa-Schubert scheme which uses an entraining jet to represent individual cumulus cloud types. The second model consists of an ensemble of cylindrical cells to represent the convective cloud field.

Rodenhuis, D.↗

Error Estimation of An Ensemble Statistical Seasonal Precipitation Prediction Model

This NASA Technical Memorandum describes an optimal ensemble canonical correlation forecasting model for seasonal precipitation. Each individual forecast is based on the canonical correlation analysis (CCA) in the spectral spaces whose bases are empirical orthogonal functions (EOF). The optimal weights in the ensemble forecasting crucially depend on the mean square error of each individual forecast. An estimate of the mean square error of a CCA prediction is made also using the spectral method. The error is decomposed onto EOFs of the predictand and decreases linearly according to the correlation between the predictor and predictand. Since new CCA scheme is derived for continuous fields of predictor and predictand, an area-factor is automatically included. Thus our model is an improvement of the spectral CCA scheme of Barnett and Preisendorfer. The improvements include (1) the use of area-factor, (2) the estimation of prediction error, and (3) the optimal ensemble of multiple forecasts. The new CCA model is applied to the seasonal forecasting of the United States (US) precipitation field. The predictor is the sea surface temperature (SST). The US Climate Prediction Center's reconstructed SST is used as the predictor's historical data. The US National Center for Environmental Prediction's optimally interpolated precipitation (1951-2000) is used as the predictand's historical data. Our forecast experiments show that the new ensemble canonical correlation scheme renders a reasonable forecasting skill. For example, when using September-October-November SST to predict the next season December-January-February precipitation, the spatial pattern correlation between the observed and predicted are positive in 46 years among the 50 years of experiments. The positive correlations are close to or greater than 0.4 in 29 years, which indicates excellent performance of the forecasting model. The forecasting skill can be further enhanced when several predictors are used.

Shen, Samuel S. P.↗

Cybersecurity Anomaly Detection in SCADA-Assisted OT Networks Using Ensemble-Based State Prediction Model

The cybersecurity threats of power system gradually grow due to the increased sophisticated interactions between Information Technology (IT) and Operational Technology (OT) networks. False data injection attack (FDIA) that aims to compromise the Supervisory Control and Data Acquisition (SCADA) measurement and disturb the system operation is one of such cyber threats. Such attacks can potentially lead to significant operational issues at the control centers and substations, and hence, result in severe physical consequences. To avoid catastrophic failure across the power grid resulting from these attacks, it is essential to arm the OT network with real-time vulnerability assessment tools. To this end, this paper outlines various drawbacks of the Purdue architecture model to defend against cyberattacks in the OT network. Furthermore, a novel ensemble-based state prediction model is proposed to detect cybersecurity anomalies in SCADA assisted OT networks. The proposed model uses control center level generation and load forecasts, scheduled, and forced outages, power flow solutions, and the substation level historical data. The hypothesis of the proposed scheme relies on the fact that additional control center and substation data can hardly be accessed and compromised by attackers. One of the vital features of the proposed scheme is an hour-ahead prediction of the operational feasibility of the SCADA measurement range at the control center and substation in real time helps in detecting anomalies in measurements across both substation and the control center.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evaluating the Large-Scale Hydrological Cycle Response within the Pliocene Model Intercomparison Project Phase 2 (PlioMIP2) Ensemble

The mid-Pliocene (∼3 Ma) is one of the most recent warm periods with high CO2 concentrations in the atmosphere and resulting high temperatures, and it is often cited as an analog for near-term future climate change. Here, we apply a moisture budget analysis to investigate the response of the large-scale hydrological cycle at low latitudes within a 13-model ensemble from the Pliocene Model Intercomparison Project Phase 2 (PlioMIP2). The results show that increased atmospheric moisture content within the mid-Pliocene ensemble (due to the thermodynamic effect) results in wetter conditions over the deep tropics, i.e., the Pacific intertropical convergence zone (ITCZ) and the Maritime Continent, and drier conditions over the subtropics. Note that the dynamic effect plays a more important role than the thermodynamic effect in regional precipitation minus evaporation (PmE) changes (i.e., northward ITCZ shift and wetter northern Indian Ocean). The thermodynamic effect is offset to some extent by a dynamic effect involving a northward shift of the Hadley circulation that dries the deep tropics and moistens the subtropics in the Northern Hemisphere (i.e., the subtropical Pacific). From the perspective of Earth's energy budget, the enhanced southward cross-equatorial atmospheric transport (0.22 PW), induced by the hemispheric asymmetries of the atmospheric energy, favors an approximately 1∘ northward shift of the ITCZ. The shift of the ITCZ reorganizes atmospheric circulation, favoring a northward shift of the Hadley circulation. In addition, the Walker circulation consistently shifts westward within PlioMIP2 models, leading to wetter conditions over the northern Indian Ocean. The PlioMIP2 ensemble highlights that an imbalance of interhemispheric atmospheric energy during the mid-Pliocene could have led to changes in the dynamic effect, offsetting the thermodynamic effect and, hence, altering mid-Pliocene hydroclimate.

mid-Pliocene↗

Characterization of organic aerosol across the global remote troposphere: a comparison of ATom measurements and global chemistry models

The spatial distribution and properties of submicron organic aerosol (OA) are among the key sources of uncertainty in our understanding of aerosol effects on climate. Uncertainties are particularly large over remote regions of the free troposphere and Southern Ocean, where very few data have been available and where OA predictions from AeroCom Phase II global models span 2 to 3 orders of magnitude, greatly exceeding the model spread over source regions. The (nearly) pole-to-pole vertical distribution of non-refractory aerosols was measured with an aerosol mass spectrometer onboard the NASA DC-8 aircraft as part of the Atmospheric Tomography (ATom) mission during the Northern Hemisphere summer (August 2016) and winter (February 2017). This study presents the first extensive characterization of OA mass concentrations and their level of oxidation in the remote atmosphere. OA and sulfate are the major contributors by mass to submicron aerosols in the remote troposphere, together with sea salt in the marine boundary layer. Sulfate was dominant in the lower stratosphere. OA concentrations have a strong seasonal and zonal variability, with the highest levels measured in the lower troposphere in the summer and over the regions influenced by biomass burning from Africa (up to 10 µg sm -3 ). Lower concentrations (~0.1–0.3 µg sm -3 ) are observed in the northern middle and high latitudes and very low concentrations (<0.1 µg sm -3 ) in the southern middle and high latitudes. The ATom dataset is used to evaluate predictions of eight current global chemistry models that implement a variety of commonly used representations of OA sources and chemistry, as well as of the AeroCom-II ensemble. The current model ensemble captures the average vertical and spatial distribution of measured OA concentrations, and the spread of the individual models remains within a factor of 5. These results are significantly improved over the AeroCom-II model ensemble, which shows large overestimations over these regions. However, some of the improved agreement with observations occurs for the wrong reasons, as models have the tendency to greatly overestimate the primary OA fraction and underestimate the secondary fraction. Measured OA in the remote free troposphere is highly oxygenated, with organic aerosol to organic carbon (OA/OC) ratios of ~2.2–2.8, and is 30 %–60 % more oxygenated than in current models, which can lead to significant errors in OA concentrations. The model–measurement comparisons presented here support the concept of a more dynamic OA system as proposed by Hodzic et al. (2016), with enhanced removal of primary OA and a stronger production of secondary OA in global models needed to provide better agreement with observations.

54 ENVIRONMENTAL SCIENCES↗

Amundsen Sea Embayment ice-sheet mass-loss predictions to 2050 calibrated using observations of velocity and elevation change

Mass loss from the Amundsen Sea Embayment of the West Antarctic Ice Sheet is a major contributor to global sea-level rise (SLR) and has been increasing over recent decades. Predictions of future SLR are increasingly modelled using ensembles of simulations within which model parameters and external forcings are varied within credible ranges. Accurately reporting the uncertainty associated with these predictions is crucial in enabling effective planning for, and construction of defences against, rising sea levels. Calibrating model simulations against current observations of ice-sheet behaviour enables the uncertainty to be reduced. Here we calibrate an ensemble of BISICLES ice-sheet model simulations of ice loss from the Amundsen Sea Embayment using remotely sensed observations of surface elevation and ice speed. Each calibration type is shown to be capable of reducing the 90% credibility bounds of predicted contributions to SLR by 34 and 43% respectively.

54 ENVIRONMENTAL SCIENCES↗