Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

Exploring Coupled Land-Atmosphere Carbon Dynamics and Seasonal Carbon Forecast Skill

Terrestrial biosphere is an integral part of the climate system and plays a vital role in controlling the dynamics of the Earth’s carbon cycle. In this talk, I will present recent efforts to explore coupled land-atmosphere carbon dynamics and seasonal carbon cycle predictability. First, by imposing an idealized spring drought in coupled land‐atmosphere ensemble simulations, we investigated the impact of a regional drought on land and atmospheric carbon. Through the drought-induced impact on remote meteorology, the capability of the land’s carbon uptake is altered in both the drought area and the adjacent areas. The induced anomalies of the atmospheric CO2 extend to an area up to three times of that of the imposed drought, which suggests that atmospheric transport needs to be considered in the interpretation of the drought impact on carbon anomalies. Increase in column‐averaged monthly CO2 is at the edge of the uncertainty from single soundings of current greenhouse gas observing satellites. Secondly, the seasonal carbon forecast skill was explored using NASA’s subseasonal-to-seasonal (S2S) ensemble forecast and terrestrial biosphere model. The result demonstrates an ability to accurately predict spring-summer carbon uptake in the Northern Hemisphere mid and high latitude land at multi-month leads. The prediction skill appears to be achieved by accurate forecasts of snow removal timing, which provides a latent predictability to the forecast system, and by proper initialization of carbon and nitrogen states. Additionally, I will briefly discuss other ongoing research to improve hydrometeorological prediction by integrating biogeochemical processes, to evaluate forecast skill of wildfire carbon, and to apply subseasonal forecasts to water resources management.

Eunjee Lee↗

Impacts of Marine Surface Pressure Observations From A Spaceborne Differential Absorption Radar Investigated With an Observing System Simulation Experiment

A new instrument has been proposed for measuring surface air pressure over the marine surface with a combined active/passive scanning multi-channel differential absorption radar (DAR) to provide an estimate of the total atmospheric column oxygen content. A demonstrator instrument, the Microwave Barometric Radar and Sounder (MBARS), has been funded by the National Aeronautics and Space Administration (NASA) for airborne test missions. Here, a proof-of-concept study to evaluate the potential impact of spaceborne surface pressure data on numerical weather prediction is performed using the Goddard Modeling and Assimilation Office global observing system simulation experiment (OSSE) framework. This OSSE framework employs the Goddard Earth Observing System model and the hybrid 4D ensemble variational Gridpoint Statistical Interpolation data assimilation system. Multiple flight and scanning configurations of potential spaceborne orbits are examined. Swath width and observation spacing for the surface pressure data are varied to explore a range of sampling strategies. For wider swaths, the addition of surface pressures reduces the root mean square surface pressure analysis error by as much as 20% over some ocean regions. The forecast sensitivity observation impact tool estimates impacts on the Pacific Ocean basin boundary layer 24-hour forecast temperatures for spaceborne surface pressures on par with rawinsondes and aircraft, and greater impacts than the current network of ships and buoys. The largest forecast impacts are found in the southern hemisphere extratropics.

N.C. Privé↗

Aerosols Delay the Emergence of Greenhouse Gas Forcing on 21st Century South Asian Monsoon Precipitation By Several Decades

Anthropogenic aerosols (AERs) affect several aspects of the climate system across the world through radiative forcing and microphysical effects. These influences are particularly strong across South Asia, where AER concentrations are highest and further projected to increase in coming decades. Using large ensemble experiments from Earth system model, we examine how AERs shape the evolution of seasonal precipitation over South Asia inlate 20th century and 21st century climate in the presence of rising greenhouse gases (GHGs) concentrations. We find that AERs strongly reduce monsoon precipitation, moderately reduce post-monsoon precipitation, and negligibly influence pre-monsoon precipitation. Consequently, AERs delay the emergence of GHG-forced increases in precipitation by ~5 decades in the monsoon season and ~1 decade in the post-monsoon season. However, GHGs are projected to outpace the influence of AERs by mid 21st century, causing a steep intensification of monsoon and post-monsoon precipitation. We further show that local AERs have the strongest influence on precipitation in the monsoon and post monsoon seasons in the near-future (2020-2049). However, the contribution from remote AERs changes is also important in shaping the monsoon precipitation changes over northwestern South Asia. Further, the influence of local AERs monsoon precipitation remains stationary throughout the 21st century, indicating the insensitivity of relationship between local AOD and precipitation to the projected warming. A better understanding of aerosol-climate interactions and associated precipitation responses in is pertinent for policymakers to address the critical aspect of regional consequences over South Asia induced by externally forced climate change.

Aerosols↗

Multiyear Dry Periods in Southern Africa

Characteristics and physical features related to low precipitation across many years in Southern Africa that lead to societal disruptions are diagnosed using observed analyses and an ensemble of historical coupled climate model simulations during 1921 to 2014. Four regions are evaluated, as identified through a hierarchical clustering algorithm applied to the Standardized Precipitation Index (SPI) during the October–April precipitation season. Although dryness spanning many October–April occurs periodically in each region, they seldom occur simultaneously, consistent with largely insignificant SPI cross-correlations between them. However, characteristics relevant to low precipitation across many years are generalizable between the four regions, including the serial persistence of October–April precipitation, the likelihood of consecutive dry October–April, and the likelihood of dry October–April in temporal extents of up to 10 consecutive such 7-month seasons. Systematic precipitation persistence is not a feature in any of the four Southern Africa regions, as serial correlations of October–April SPI are not statistically significant at any time lags. It follows that there is an exponential-folding decay in the likelihood of consecutive October–April for various SPI thresholds and that there is a large spread in the likelihood of low October–April SPI across many years. In terms of physical features, low October–April SPI in each Southern Africa region is closely related to local atmospheric circulations; however, they are not as closely related to sea surface temperatures (SSTs). These results suggest that dryness spanning many years is determined primarily by persistent local circulations related to atmospheric variability and to a lesser extent variability related to SST anomalies, including the El Niño–Southern Oscillation.

subtropical Indian Ocean dipole↗

Machine Learning for Predicting Multipactor Susceptibility in Planar RF Structures

Multipactor discharge is a persistent challenge in high-power microwave (HPM) and accelerator systems, where secondary electron avalanches can cause heating, vacuum degradation, and failure. This work presents the first supervised machine learning (ML) framework for multipactor prediction, trained on high-fidelity 3D Particle-in-Cell (PIC) simulation data in planar geometries. The model maps operational, geometric, and material-dependent secondary electron yield (SEY) parameters to the time-averaged electron growth rate, enabling rapid reconstruction of susceptibility charts. Among the models evaluated, tree-based ensemble methods such as Random Forest and Extra Trees demonstrate superior generalization to unseen materials compared to neural networks such as multilayer perceptron (MLP). Performance metrics, including Intersection over Union (IoU), Structural Similarity Index Measure (SSIM), and Pearson correlation, show close agreement with simulation benchmarks. Principal Component Analysis attributes generalization limits to material feature-space disjointedness.

43 PARTICLE ACCELERATORS↗

Visual HPC Workflows for the Analysis of System Dynamics Models

Visual analytics supported by high performance computing (HPC) accelerates and enhances the discovery, exploration, and analysis of causal patterns in complex system dynamics (SD) models. We present a suite of visualization-assisted ensemble-based techniques for hypothesis generation and testing, and for sensitivity analysis. By employing HPC to provide parallel, on-demand simulation of SD models, one can “steer” an ensemble of simulated scenarios in real time as one first formulates and then informally tests those hypotheses: this provides rapid feedback for analysts to refine their understanding of the causal relationships emergent from a model. Such understandings can be followed and augmented by rigorous application of statistical methods, namely global variance-based sensitivity analysis, Monte-Carlo filtering, adaptive regional sensitivity analysis, and self-organized maps: here timely computation relies on HPC, while effective presentation emphasizes high-dimensional multivariate data visualization. Immersive visualization in virtual 3D environments provides an excellent adjunct to the traditional 2D graphics typically used for SD models, as it generates an embodied understanding of model behavior and facilitates an active, collaborative critique of model structure and output. Finally, we summarize prospects for HPC-enabled visual analytics applied to SD modeling.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Evaluation of global terrestrial evapotranspiration using state-of-the-art approaches in remote sensing, machine learning and land surface modeling

Evapotranspiration (ET) is critical in linking global water, carbon and energy cycles. However, direct measurement of global terrestrial ET is not feasible. Here, we first reviewed the basic theory and state-of-the-art approaches for estimating global terrestrial ET, including remote-sensing-based physical models, machine-learning algorithms and land surface models (LSMs). We then utilized 4 remote-sensing-based physical models, 2 machine-learning algorithms and 14 LSMs to analyze the spatial and temporal variations in global terrestrial ET. The results showed that the ensemble means of annual global terrestrial ET estimated by these three categories of approaches agreed well, with values ranging from 589.6 mm/yr (6.56×10^4 cu.km/yr) to 617.1 mm/yr (6.87×10^4 cu.km/yr). For the period from 1982 to 2011, both the ensembles of remote-sensing-based physical models and machine-learning algorithms suggested increasing trends in global terrestrial ET (0.62 mm/sq.yr with a significance level of p<0.05 and 0.38 mm yr−2 with a significance level of p<0.05, respectively). In contrast, the ensemble mean of the LSMs showed no statistically significant change (0.23 mm/sq.yr, p>0.05), although many of the individual LSMs reproduced an increasing trend. Nevertheless, all 20 models used in this study showed that anthropogenic Earth greening had a positive role in increasing terrestrial ET. The concurrent small interannual variability, i.e., relative stability, found in all estimates of global terrestrial ET, suggests that a potential planetary boundary exists in regulating global terrestrial ET, with the value of this boundary being around 600 mm/yr. Uncertainties among approaches were identified in specific regions, particularly in the Amazon Basin and arid/semiarid regions. Improvements in parameterizing water stress and canopy dynamics, the utilization of new available satellite retrievals and deep-learning methods, and model–data fusion will advance our predictive understanding of global terrestrial ET.

surface modeling↗

Micromechanical Surrogate Machine Learning Model for Creep Deformation Modeling

Process variability during the manufacture of gas turbine engine hot section components can significantly affect the material’s resulting microstructure. In casting, for instance, geometric variation within a component (thin sections versus thick sections, radial location) influences cooling rates and the resulting grain size. The high temperature creep response is known to be sensitive to grain size owing to a diffusional creep mechanism which occurs more readily along grain boundaries. Microstructural variation correspondingly drives mechanical behavior which propagates into component scale performance uncertainty. These factors are essential when planning inspection, maintenance, and repair strategies within a reliability framework. These benefits provide opportunities to increase overall energy efficiency through refined margins. Critically, there is an opportunity to bolster existing data-driven reliability models using physics-driven process-structure-property relations. Here we present recent work establishing a framework for evaluating the probabilistic creep performance of high-temperature materials. A novel microstructure-sensitive crystal plasticity finite element model is established that captures both grain boundary and crystallographic deformation effects. The computationally expensive physics model is calibrated using a statistical approach and this high-fidelity model is subsequently used to train a computationally efficient machine learning surrogate model. The surrogate model is essential for sampling a large ensemble of simulated structure-property pair results. The ensemble data are then mined to extract salient trends to be incorporated into a microstructure-sensitive reliability model. The proposed approach represents a novel way to capture microstructure-sensitive trends from physics-based models within a modern reliability framework.

Fernandez-Zelaia, Patxi [ORNL]↗

Near-term heatwave risk in HighResMIP models across different temperature zones of West Africa

This study projects near-future (2031–2050) changes in heatwave (HW) risk across West Africa (WA) using an ensemble of eight high-resolution global climate models from the High-Resolution Model Intercomparison Project under a high-emission scenario. Using K-means clustering, we divided WA into four unique temperature zones and examined projected changes in extreme temperatures, HW occurrence and magnitude. Our results indicate a statistically significant increase in future HW events across most parts of WA, although considerable spread exists over the region and among individual models. The most pronounced increases are evident in the Sahel/Sahara and the Guinea Highlands subregions, with an ensemble mean increase of ∼10 HW events per year. In contrast, the lowest increase in HW events is projected in central WA, with increases ranging between 1 and 5 events per year. Similarly, the magnitude of HW events is projected to increase in most models, with Sahel/Sahara exhibiting the largest increases. Additionally, projections suggest that the strongest HWs will become more frequent, particularly in northern and southwestern WA. These findings highlight significant spatial heterogeneity in future HW risk across WA, emphasizing the need for targeted adaptation strategies.

HighResMIP↗

Evaluation of simulated soil carbon dynamics in Arctic-Boreal ecosystems

Given the magnitude of soil carbon stocks in northern ecosystems, and the vulnerability of these stocks to climate warming, land surface models must accurately represent soil carbon dynamics in these regions. We evaluate soil carbon stocks and turnover rates, and the relationship between soil carbon loss with soil temperature and moisture, from an ensemble of eleven global land surface models. We focus on the region of NASA's Arctic-Boreal vulnerability experiment (ABoVE) in North America to inform data collection and model development efforts. Models exhibit an order of magnitude difference in estimates of current total soil carbon stocks, generally under- or overestimating the size of current soil carbon stocks by greater than 50 PgC. We find that a model's soil carbon stock at steady-state in 1901 is the prime driver of its soil carbon stock a hundred years later—overwhelming the effect of environmental forcing factors like climate. The greatest divergence between modeled and observed soil carbon stocks is in regions dominated by peat and permafrost soils, suggesting that models are failing to capture the frozen soil carbon dynamics of permafrost regions. Using a set of functional benchmarks to test the simulated relationship of soil respiration to both soil temperature and moisture, we find that although models capture the observed shape of the soil moisture response of respiration, almost half of the models examined show temperature sensitivities, or Q10 values, that are half of observed. Significantly, models that perform better against observational constraints of respiration or carbon stock size do not necessarily perform well in terms of their functional response to key climatic factors like changing temperature. This suggests that models may be arriving at the right result, but for the wrong reason. The results of this work can help to bridge the gap between data and models by both pointing to the need to constrain initial carbon pool sizes, as well as highlighting the importance of incorporating functional benchmarks into ongoing, mechanistic modeling activities such as those included in ABoVE.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of global terrestrial evapotranspiration using state-of-the-art approaches in remote sensing, machine learning and land surface modeling

Abstract. Evapotranspiration (ET) is critical in linking global water, carbon and energy cycles. However, direct measurement of global terrestrial ET is not feasible. Here, we first reviewed the basic theory and state-of-the-art approaches for estimating global terrestrial ET, including remote-sensing-based physical models, machine-learning algorithms and land surface models (LSMs). We then utilized 4 remote-sensing-based physical models, 2 machine-learning algorithms and 14 LSMs to analyze the spatial and temporal variations in global terrestrial ET. The results showed that the ensemble means of annual global terrestrial ET estimated by these three categories of approaches agreed well, with values ranging from 589.6 mm yr-1 (6.56×104 km3 yr-1) to 617.1 mm yr-1 (6.87×10 4 km3 yr -1 ). For the period from 1982 to 2011, both the ensembles of remote-sensing-based physical models and machine-learning algorithms suggested increasing trends in global terrestrial ET (0.62 mm yr -2 with a significance level of p<0.05 and 0.38 mm yr -2 with a significance level of p<0.05, respectively). In contrast, the ensemble mean of the LSMs showed no statistically significant change (0.23 mm yr -2 , p>0.05), although many of the individual LSMs reproduced an increasing trend. Nevertheless, all 20 models used in this study showed that anthropogenic Earth greening had a positive role in increasing terrestrial ET. The concurrent small interannual variability, i.e., relative stability, found in all estimates of global terrestrial ET, suggests that a potential planetary boundary exists in regulating global terrestrial ET, with the value of this boundary being around 600 mm yr -1 . Uncertainties among approaches were identified in specific regions, particularly in the Amazon Basin and arid/semiarid regions. Improvements in parameterizing water stress and canopy dynamics, the utilization of new available satellite retrievals and deep-learning methods, and model–data fusion will advance our predictive understanding of global terrestrial ET.

58 GEOSCIENCES↗

Large-scale molecular dynamics simulations of bubble collapse in water: Effects of system size, water model, and nitrogen

Molecular dynamics simulations in the microcanonical ensemble are performed to study the collapse of a bubble in liquid water using the single-site mW and the four-site TIP4P/2005 water models. To study system size effects, simulations for pure water systems are performed using periodically replicated simulation boxes with linear dimensions, L, ranging from 32 to 512 nm with the largest systems containing 8.7 × 10 6 and 4.5 × 10 9 molecules for the TIP4P/2005 and mW water models, respectively. The computationally more efficient mW water model allows us to reach converging behavior when the bubble dynamics results are plotted in reduced units, and the limiting behavior can be obtained through linear extrapolation in L –1 . Qualitative differences are observed between simulations with the mW and TIP4P/2005 water models, but they can be explained by the models’ differences in predicted viscosity and surface tension. Although bubble collapse occurs on time scales of only hundreds of picoseconds, the system sizes used here are sufficiently large to obtain bubble dynamics consistent with the Rayleigh–Plesset equation when using the models’ thermophysical properties as input. For the conditions explored here, extreme heating of the interfacial water molecules near the time of collapse is observed for the larger mW water systems (but the model underpredicts the viscosity), whereas heating is less pronounced for the TIP4P/2005 water systems because its larger viscosity contribution slows the collapse dynamics. The presence of nitrogen within the bubble only starts to affect bubble dynamics near the very end of the initial collapse, leading to an incomplete collapse and strong rebound for the mW water model. Although nitrogen is non-condensable at 300 K, it becomes highly compressed and reaches a liquid-like density near the collapse point. We find that the dissolution of nitrogen is much slower than the movement of the collapsing water front, and the re-expansion of the dense nitrogen droplet gives rise to bubble rebound. The incompatibility of the collapse and dissolution time scales should be considered for continuum-scale modeling of bubble dynamics. Finally, we also confirm that the diffusion coefficient for dissolved nitrogen is insensitive to pressure as the liquid transitions from a compressed to a stretched state.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Application of the CloudSat and NEXRAD Radars Toward Improvements in High Resolution Operational Forecasts

As computational power increases, operational forecast models are performing simulations with higher spatial resolution allowing for the transition from sub-grid scale cloud parameterizations to an explicit forecast of cloud characteristics and precipitation through the use of single- or multi-moment bulk water microphysics schemes. investments in space-borne and terrestrial remote sensing have developed the NASA CloudSat Cloud Profiling Radar and the NOAA National Weather Service NEXRAD system, each providing observations related to the bulk properties of clouds and precipitation through measurements of reflectivity. CloudSat and NEXRAD system radars observed light to moderate snowfall in association with a cold-season, midlatitude cyclone traversing the Central United States in February 2007. These systems are responsible for widespread cloud cover and various types of precipitation, are of economic consequence, and pose a challenge to operational forecasters. This event is simulated with the Weather Research and Forecast (WRF) Model, utilizing the NASA Goddard Cumulus Ensemble microphysics scheme. Comparisons are made between WRF-simulated and observed reflectivity available from the CloudSat and NEXRAD systems. The application of CloudSat reflectivity is made possible through the QuickBeam radiative transfer model, with cautious application applied in light of single scattering characteristics and spherical target assumptions. Significant differences are noted within modeled and observed cloud profiles, based upon simulated reflectivity, and modifications to the single-moment scheme are tested through a supplemental WRF forecast that incorporates a temperature dependent snow crystal size distribution.

Molthan, A. L.↗

Quantifying Progress Across Different CMIP Phases With the ESMValTool

Abstract More than 40 model groups worldwide are participating in the Coupled Model Intercomparison Project Phase 6 (CMIP6), providing a new and rich source of information to better understand past, present, and future climate change. Here, we use the Earth System Model Evaluation Tool (ESMValTool) to assess the performance of the CMIP6 ensemble compared to the previous generations CMIP3 and CMIP5. While CMIP5 models did not capture the observed pause in the increase in global mean surface temperature between 1998 and 2013, the historical CMIP6 simulations agree well with the observed recent temperature increase, but some models have difficulties in reproducing the observed global mean surface temperature record of the second half of the twentieth century. While systematic biases in annual mean surface temperature and precipitation remain in the CMIP6 multimodel mean, individual models and high‐resolution versions of the models show significant reductions in many long‐standing biases. Some improvements are also found in the vertical temperature, water vapor, and zonal wind speed distributions, and root‐mean‐square errors for selected fields are generally smaller with reduced intermodel spread and higher average skill in the correlation patterns relative to observations. An emerging property of the CMIP6 ensemble is a higher effective climate sensitivity with an increased range between 2.3 and 5.6 K. A possible reason for this increase in some models is improvements in cloud representation resulting in stronger shortwave cloud feedbacks than in their predecessor versions.

Bock, L.↗

Influence of African Easterly Wave Suppression on Atlantic Tropical Cyclone Activity in a Convection-Permitting Model

African easterly waves (AEWs) are strongly linked to Atlantic tropical cyclones (TCs) on the synoptic timescale by serving as seedling disturbances for TC genesis. However, it is unclear whether climatological TC frequency is limited by AEWs. We investigated the impact of suppressing AEWs using a 3-member ensemble of convection-permitting regional model simulations, in which AEWs were either retained or removed through the lateral boundary conditions. Suppressing AEWs did not substantially change seasonal TC number, but did influence TC intensity, genesis time and location. Suppressing AEWs produced stronger TCs, shifted peak TC genesis from September to August, and reduced (increased) TC genesis in the eastern Atlantic (Gulf of Mexico). Without AEWs, TCs generated under more favorable large-scale atmospheric conditions. Furthermore, these results indicate that AEWs may not be reliable predictors of basin-wide seasonal TC frequency. However, simulations provide evidence that AEWs could influence the large-scale environment that is important for TCs.

54 ENVIRONMENTAL SCIENCES↗

Data assimilation for combustion ignition delay time simulation using schlieren image velocimetry

This study sought to improve the accuracy of simulating spray penetration and combustion ignition delay by means of data assimilation (DA). The simulations were conducted using the Reynolds-averaged Navier–Stokes (RANS) equations and assimilating the schlieren image data. In DA, an ensemble square root filter (EnSRF) was used to build the statistical model, making the simulation results more accurate without any change in the governing equations. Recognizing that the spray-cone injection angle has a large effect on penetration, we created ensemble members with different injection angles. And we applied the two-component velocity distribution calculated via SIV and updated both velocity and temperature by using a DA statistical model derived from RANS ensemble simulations. The ignition delay time is generally known to vary even under the same experimental conditions because it is influenced by many factors. In this study, we attempted the transient DA-assisted RANS simulation to predict the ignition delay time even when the temporal resolution and accuracy of the observation data ware insufficient. Our trials offer an example of how a combination of techniques can be effectively used to assimilate experimental data obtained under restricted conditions.

Combustion simulation↗

Cumulus cloud transport of transient tracers

A theoretical framework is developed for including cumulus cloud transport, rainout of water soluble gases, and aqueous phase chemistry into gas phase photochemical models. Cloud populations are represented as ensemble distributions of individual clouds of various heights. An individual cloud is represented as a one-dimensional, steady state plume with height-independent radius entraining air from the boundary of the cloud. The model is applied to several hypothetical atmospheric tracers to show how clouds may affect the tropospheric distributions of ozone, NO(y), SO2, peroxyacetylnitrate, hydrocarbons, and other gases. Although the numerical experiments were based on cloud mass fluxes from diagnostic studies in the tropics and thus are not representative of the entire globe, it was found that an increasing mixing ratio with height in the free troposphere can be produced for some gases with only a surface source when clouds are present. This suggests that some reactive tropospheric species with primarily surface sources may play a somewhat more important role in tropospheric chemistry than is presently believed depending on the global distribution of cloud mass fluxes. Deficiencies in existing photochemical models due to the way clouds are typically treated are discussed.

Gidel, L. T.↗

Using High-Resolution NSRDB Data to Evaluate Cloud Mask Forecast from WRF-Solar EPS

Validating spatiotemporal distributions of cloud forecasts using numerical weather prediction (NWP) models is difficult as this requires high-quality cloud-property at significantly high spatial and temporal resolution over extended periods of time. Observations of cloud properties, such as cloud mask, cloud optical thickness, and cloud type, are vital for assessing the capability of NWP models to forecast various types of clouds. Using the National Solar Radiation Database (NSRDB), this research evaluates ensemble cloud-mask predictions from the WRF-Solar ensemble prediction system (WRF-Solar EPS). From the WRF-Solar EPS, day-ahead solar forecasts for the contiguous United States (CONUS) for 2018 are simulated. Given the NSRDB data is accessible at a resolution of 2 km, we can calculate the cloud fraction across the 9-km grid of WRF-Solar EPS. This allows us to spatially assess the cloud-mask forecasts using two methods against the high-resolution NSRDB: (a) considering all 2-km NSRDB clouds in the forecast domain (EMAll), and (b) using a minimum cloud fraction threshold of 50% to designate a pixel as cloudy (EMP50). The low-resolution cloud masks from WRF-Solar EPS are evaluated directly against the cloud-resolving scale gridded observations from NSRDB using EMAll. With EMP50, we presume that scenes with less than 50% cloud cover from the 2-km NSRDB are clear. Thus, this assessment approach allows for a fair comparison with WRF-Solar EPS resolved to a 9-km grid. A method of point-by-point verification is used to evaluate dichotomous (yes/no) cloud mask predictions against the NSRDB. For each pixel of model extent, cloud frequency and traditional metrics (e.g., probability of detection, false alarm rate, and hit rate, etc.) are computed and compared with satellite-derived data sets. Mismatched cloud frequency (MCF) is computed to measure the present capability of WRF-Solar EPS in representing various types of clouds, which are categorized using three levels of cloud top height (CTH) and cloud optical depth (COD) across entire CONUS. Preliminary results show that the WRF-Solar EPS provides MCF values ranging from 9% to 46%, 16% to 33%, and 8% to 27% for low-level, middle-level, and high-level clouds, respectively, for three CTHs. The model produces MCFs ranging from 27% to 46%, 13% to 34%, and 8% to 19% for thin, medium-thickness, and thick clouds, respectively, for three CODs. The presentation will include a detailed description of the current outcomes as well as potential future extensions. The evaluation approach established in this study is readily extensible to the evaluation of cloud predictions from different ensemble NWP models. In addition, the findings of the suggested evaluation technique aid in identifying model weaknesses and will ultimately lead to advances in WRF-Solar EPS's skill in predicting clouds and solar irradiance.

cloud mask forecast↗