Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cloud mask forecast”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Evaluating WRF-Solar EPS cloud mask forecast using the NSRDB

Improving the accuracy of day-ahead solar forecasts using numerical weather prediction models requires improving the forecasting of cloud occurrence and properties. Validating cloud forecasts is challenging because this requires evaluating different types of clouds over a wide variety of regions. This study analyzes the cloud occurrence (or cloud mask) over the contiguous United States (CONUS), predicted by the Weather Research and Forecasting-Solar Ensemble Prediction System (WRF-Solar EPS), to identify the strengths and limitations of the model in reproducing cloud fields. To enable the in-depth analysis of cloud mask forecasts covering CONUS, we use satellite observations from the National Solar Radiation Database (NSRDB). Two evaluation methods are implemented to consider all clouds and partially removed clouds from the 2-km NSRDB in evaluating the 9-km WRF-Solar EPS cloud mask. Cloud detection metrics as well as the frequency of cloud occurrence are used to quantify the monthly performance of WRF-Solar EPS. Mismatched cloud frequency (MCF) is used to assess the model's capability to predict different types of clouds, which are classified using three levels of cloud optical depth (COD) and cloud top height (CTH). The day-ahead forecasts covering the full year of 2018 demonstrate that WRF-Solar EPS produces MCFs ranging from 27%-46%, 13%-34%, and 8%-19% for thin, mid-thickness, and thick clouds, respectively. For three CTH levels, the model shows MCFs ranging from 19%-46%, 16%-33%, and 8%-27% for low-level, middle-level, and high-level clouds, respectively. This comprehensive characterization of model performance helps identify model weakness and will eventually lead to improvements in cloud and solar radiation forecasting.

14 SOLAR ENERGY↗
DOE OSTI2023

Using High-Resolution NSRDB Data to Evaluate Cloud Mask Forecast from WRF-Solar EPS

Validating spatiotemporal distributions of cloud forecasts using numerical weather prediction (NWP) models is difficult as this requires high-quality cloud-property at significantly high spatial and temporal resolution over extended periods of time. Observations of cloud properties, such as cloud mask, cloud optical thickness, and cloud type, are vital for assessing the capability of NWP models to forecast various types of clouds. Using the National Solar Radiation Database (NSRDB), this research evaluates ensemble cloud-mask predictions from the WRF-Solar ensemble prediction system (WRF-Solar EPS). From the WRF-Solar EPS, day-ahead solar forecasts for the contiguous United States (CONUS) for 2018 are simulated. Given the NSRDB data is accessible at a resolution of 2 km, we can calculate the cloud fraction across the 9-km grid of WRF-Solar EPS. This allows us to spatially assess the cloud-mask forecasts using two methods against the high-resolution NSRDB: (a) considering all 2-km NSRDB clouds in the forecast domain (EMAll), and (b) using a minimum cloud fraction threshold of 50% to designate a pixel as cloudy (EMP50). The low-resolution cloud masks from WRF-Solar EPS are evaluated directly against the cloud-resolving scale gridded observations from NSRDB using EMAll. With EMP50, we presume that scenes with less than 50% cloud cover from the 2-km NSRDB are clear. Thus, this assessment approach allows for a fair comparison with WRF-Solar EPS resolved to a 9-km grid. A method of point-by-point verification is used to evaluate dichotomous (yes/no) cloud mask predictions against the NSRDB. For each pixel of model extent, cloud frequency and traditional metrics (e.g., probability of detection, false alarm rate, and hit rate, etc.) are computed and compared with satellite-derived data sets. Mismatched cloud frequency (MCF) is computed to measure the present capability of WRF-Solar EPS in representing various types of clouds, which are categorized using three levels of cloud top height (CTH) and cloud optical depth (COD) across entire CONUS. Preliminary results show that the WRF-Solar EPS provides MCF values ranging from 9% to 46%, 16% to 33%, and 8% to 27% for low-level, middle-level, and high-level clouds, respectively, for three CTHs. The model produces MCFs ranging from 27% to 46%, 13% to 34%, and 8% to 19% for thin, medium-thickness, and thick clouds, respectively, for three CODs. The presentation will include a detailed description of the current outcomes as well as potential future extensions. The evaluation approach established in this study is readily extensible to the evaluation of cloud predictions from different ensemble NWP models. In addition, the findings of the suggested evaluation technique aid in identifying model weaknesses and will ultimately lead to advances in WRF-Solar EPS's skill in predicting clouds and solar irradiance.

cloud mask forecast↗
DOE OSTI2021

Assessment of Cloud Mask Forecasts from the WRF-Solar Ensemble Prediction System: Preprint

Numerical weather prediction (NWP) models are important tools used by government agencies and the renewable energy enterprise to forecast solar radiation. Cloud prediction, a key process of NWP models, has the highest impact on the accuracy of solar forecasting. This study uses satellite observations from the National Solar Radiation Data Base (NSRDB) to evaluate the cloud mask forecast by the WRF-Solar Ensemble Prediction System (WRF-Solar EPS). Preliminary analysis of the data in 2018 demonstrates the need of further improvement in predicting thin and low-level clouds. The information obtained from this work will be used to enhance the WRF-Solar EPS in reproducing the cloud field over the contiguous U.S. and reducing solar forecasting errors.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2022

Evaluation of WRF-Solar Cloud Forecast Using the NSRDB: Preprint

Cloud forecast is a crucial component in predicting solar irradiance from numerical weather prediction (NWP) models. Assessing cloud properties from the NWP models requires significant work due to the need for high-quality data, spatial analysis covering model extent, and detailed analysis of model performance for different types of clouds. This study presents an evaluation of the WRF-Solar cloud forecast using the National Solar Radiation Database (NSRDB). We propose an evaluation framework applied to a single model prediction as well as ensemble-based forecasts. Various cloud detection metrics are calculated when comparing with the satellite-derived dataset. The mismatched clouds from the WRF-Solar model are quantified using nine cloud types classified by cloud top height and cloud optical depth. The results based on the WRF-Solar forecasts covering the entire U.S. for the full year of 2018 shows mismatched cloud frequency in the range of 8% - 46% for thick and high-level (deep convective) to thin and low-level (cumulus) clouds.

cloud mask forecast↗
NASA NTRS2008

CALIPSO Satellite Lidar Identification Of Elevated Dust Over Australia Compared With Air Quality Model PM60 Forecasts

Global measurements of the vertical distribution of clouds and aerosols have been recorded by the lidar on board the CALIPSO (Cloud Aerosol Lidar Infrared Pathfinder Satellite Observations) satellite since June 2006. Such extensive, height-resolved measurements provide a rare and valuable opportunity for developing, testing and validating various atmospheric models, including global climate, numerical weather prediction, chemical transport and air quality models. Here we report on the initial results of an investigation into the performance of the Australian Air Quality Forecast System (AAQFS) model in forecasting the distribution of elevated dust over the Australian region. The model forecasts of PM60 dust distribution are compared with the CALIPSO lidar Vertical Feature Mask (VFM) data product. The VFM classifies contiguous atmospheric regions of enhanced backscatter as either cloud or aerosols. Aerosols are further classified into six subtypes. By comparing forecast PM60 concentration profiles to the spatial distribution of dust reported in the CALIPSO VFM, we can assess the model s ability to predict the occurrence and the vertical and horizontal extents of dust events within the study area.

Young, Stuart A.↗
NASA NTRSDate not supplied

A New ML-Based Adaptive Thinning Methodology to Improve the Impact of AIRS and CrIS Assimilation on Global Tropical Cyclone Forecasts

This work builds on previous research performed by this team to improve the forecast of Tropical Cyclones (TCs) by assimilating AIRS and CrIS radiances into the NASA Global Earth Observing System (GEOS). Past published work demonstrated that the assimilation of radiances with variable density was beneficial to TC forecasting in the GEOS. In the previous setup, a fixed-size moving square named 'TC domain' was activated by the so-called TC-vitals, an international real-time message accessible to all NWP forecasting centers, that documents the existence of a TC, its estimated position, and its size. The information from TC-vitals activated a switch in the GEOS, which allowed to reduce the distance used for thinning AIRS and CrIS data inside a 15 degrees by 15 degrees moving TC domain centered on the storm, so that more data were assimilated in the vicinity of the TC during its lifetime. The methodology produced improved TC analyses and led to better forecasts, particularly related to intensity, without damaging the global forecast skill. In the new version, the adaptive thinning methodology is based on a machine-learning technique. The technique searches for TCs and creates TC masks by using cloud-top temperatures from all geostationary satellites without the need for additional information. It is being trained against the International Best Track Archive for Climate Stewardship (IBTrACS) data base. Once a TC mask is created, a switch identical to the one used in the previous adaptive thinning method is activated, allowing the GEOS to ingest more data in the TC-shaped size-changing domain that follows the storm. As of today, the team has been able to successfully assimilate data inside the ML-detected TC domains. Future work includes an improved capability of reducing false alarm rates (i.e., cloud systems that are erroneously labeled as TCs).

Oreste Reale↗
NASA NTRS2008

Integration of Satellite-Derived Cloud Phase, Cloud Top Height, and Liquid Water Path into an Operational Aircraft Icing Nowcasting System

Operational products used by the U.S. Federal Aviation Administration to alert pilots of hazardous icing provide nowcast and short-term forecast estimates of the potential for the presence of supercooled liquid water and supercooled large droplets. The Current Icing Product (CIP) system employs basic satellite-derived information, including a cloud mask and cloud top temperature estimates, together with multiple other data sources to produce a gridded, three-dimensional, hourly depiction of icing probability and severity. Advanced satellite-derived cloud products developed at the NASA Langley Research Center (LaRC) provide a more detailed description of cloud properties (primarily at cloud top) compared to the basic satellite-derived information used currently in CIP. Cloud hydrometeor phase, liquid water path, cloud effective temperature, and cloud top height as estimated by the LaRC algorithms are into the CIP fuzzy logic scheme and a confidence value is determined. Examples of CIP products before and after the integration of the LaRC satellite-derived products will be presented at the conference.

Haggerty, Julie↗
DOE OSTI2021

Examination of Humidity and Ice Supersaturation Profiles Over West Antarctica Using Ground-Based G-Band Radiometer Retrievals

Humidity profiles retrieved from a ground-based millimeter-wave radiometer located at McMurdo Station, Antarctica and the West Antarctica Ice Sheet Divide are presented and their suitability to study the humidity of the polar climate is assessed. The dry conditions of the Antarctic winter and spring are ideal for ground-based millimeter-wave measurements and the retrievals appear to realistically reproduce the spatial and temporal variability of humidity at both sites. Furthermore, the radiometer has the ability to capture daily variability of very low humidity (0.5 to 4 g/kg) in the low-to-mid troposphere with an uncertainty of 10-20% during the Antarctic winter, spring, and summer. Despite the coarse vertical resolution (200-600 m in the first 4 km), the retrievals provide additional information with respect to the European Centre for Medium Range Weather Forecasts (ECMWF) profiles used as background information. The radiometer is also able to realistically identify the location and frequency of supersaturated layers with respect to ice in the mid troposphere. The occurrence of supersaturated layers is correlated with the occurrence of ice clouds identified by a cloud mask. Overall, results show that ground-based microwave and millimeter-wave radiometry is a viable complement to satellite observations to provide continuous information on the thermodynamic state of the low-to-mid troposphere at high latitudes.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

Machine-Learning-Based Adaptive Thinning of CrIS Radiances to Improve Global Tropical Cyclone Analysis and Forecasts

This work is focused on optimizing the assimilation of hyperspectral infrared (IR) radiances from the Cross-track Infrared Sounder (CrIS) with the goal of improving the representation of tropical cyclones (TCs) in global analyses and forecasts. Current operational assimilation systems rely on subsampling IR radiances on a regular thinning grid. A new and improved adaptive methodology based on machine learning (ML) recognizes TCs from geostationary satellite imagery and is implemented in the Goddard Earth Observing System (GEOS) model and data assimilation framework. The ML methodology is extensively trained on existing TC data sets and creates for each TC a dynamic mask, based on the evolving shape and life cycle of that specific event. Once a TC mask is created, a switch is then activated in the data assimilation system to alter the thinning, ingesting more CrIS radiances within the moving mask, thus increasing the TC sampling. After the TC dissipates, the assimilation of CrIS radiances reverts to normal data density. Results of TC segmentation provided by a state-of-the-art generative machine learning model known as the Denoising Diffusion Probabilistic Model (DDPM) are compared to the previously used U-Net model. The new approach surpasses the performance of the previously developed one. The methodology is applied to both clear-sky and cloud-cleared radiances. Benefits from the latter methodology, particularly in improving the structure of TCs and the intensity forecasts, are presented.

Oreste Reale↗
NASA NTRS2001

AVHRR-Based Polar Pathfinder Products: Evaluation, Enhancement and Transition to MODIS

The Advanced Very High Resolution Radiometer (AVHRR)-Based Polar Pathfinder (APP) products include calibrated AVHRR channel data, surface temperatures, albedo, satellite scan and solar geometries, and cloud mask, all composited into twice-per-day images, and daily averaged fields of sea ice motion, for regions poleward of 50 latitude. Our general goals under this grant: (1) Quantify the APP accuracy and sources of error by comparing Pathfinder products with field measurements; (2) Determine the consistency of mean fields and trends in comparison with longer time series of available station data and forecast model output; (3) Investigate the consistency of the products between the different AVHRR instruments over the 1982-present period of the NOAA program; and (4) Compare and annual cycle of the APP products with MODIS to establish a baseline for extending Pathfinder-type products into the new ESE period.

Fowler, Charles↗
NASA NTRS2001

AVHRR-Based Polar Pathfinder Products: Evaluation, Enhancement, and Transition to MODIS

The AVHRR-Based Polar Pathfinder (APP) products include calibrated AVHRR channel data, surface temperatures, albedo, satellite scan and solar geometries, and a cloud mask composited into twice- per-day images, and daily averaged fields of sea ice motion, for regions poleward of 50 deg. latitude. Our goals under this grant, in general, are four-fold: 1. To quantify the APP accuracy and sources of error by comparing Pathfinder products with field measurements. 2. To determine the consistency of mean fields and trends in comparison with longer time series of available station data and forecast model output. 3. To investigate the consistency of the products between the different AVHRR instruments over the 1982-present period of the NOAA program. 4. To compare an annual cycle of the AVHRR Pathfinder products with MODIS to establish a baseline for extending Pathfinder-type products into the new ESE period. Year One tasks include intercomparisons of the Pathfinder products with field measurements, testing of algorithm assumptions, collection of field data, and further validation and possible improvement of the multi-sensor ice motion fields. Achievements for these tasks are summarized below.

Fowler, Charles↗
NASA NTRSDate not supplied

Advancing Wildfire Monitoring with TEMPO and ML tools: Hourly Smoke and Fire‑Front Mapping and Near‑Surface NO₂ Predictions

Wildfires impose substantial impacts on communities and regions downwind of wildfire smoke. We present a TEMPO‑enabled workflow that generates value‑added Level‑3 smoke‑plume masks and fire‑front maps for large wildfires, such as 2024 Park Fire, using the self‑supervised deep learning system SIT‑FUSE, along with near‑surface NO₂ predictions produced by a foundation model (Microsoft Aurora). We conclude by outlining a roadmap for expanding these capabilities to additional Western U.S. wildfire events and for delivering actionable tools to stakeholders. This open-source, reproducible workflow provides a scalable framework for cross-agency wildfire monitoring to overcome traditional limitations in smoke-cloud discrimination and air-quality forecasting by incorporating TEMPO data and beyond.

Xiaohua Pan↗
NASA NTRS2021

Southern Idaho Health & Air Quality II: Evaluating Atmospheric Mixing Height Estimations in the Western United States

Wildfires in the western United States have caused immense infrastructure damage and loss of human life in recent years. Wildfire smoke, which travels far from its original source, is also harmful to human health. Mixing height, which acts as a lid and prevents smoke from rising above a certain altitude in the lower troposphere, is a critical input in smoke dispersion and air quality models used by agencies that monitor wildfires. These models, coupled with forecaster expertise, are also used to decide when it is safe to execute a prescribed burn. The DEVELOPID team partnered with the National Weather Service (NWS) Fire Weather Program, Bureau of Land Management (BLM), National Interagency Fire Center (NIFC), and National Park Service (NPS) Fire Management Program Center (FMPC) to help improve reliability and confidence in mixing height estimations, and therefore the burn prescription decision-making process. To that end, the team developed a toolbox for measuring smoke-related aerosol mixing heights using Cloud-Aerosol LiDAR and Infrared Pathfinder Satellite Observations (CALIPSO) Vertical Feature Mask granules. CALIPSO mixing heights and NWS estimations covaried significantly and positively. However, substantial disagreement between the methods stymied the team’s attempts to quantify systematic bias in a meaningful way. The relative error between the methods was especially large at low mixing heights, which suggests that this method of validation may only be suitable at higher altitudes.

Dean Berkowitz↗
NASA NTRSDate not supplied

Machine Learning Algorithms for Aerosol and Cloud Detection Using CATS on the ISS

Clouds and aerosols are one of the largest uncertainties in understanding and forecasting the Earth’s changing climate system. The type and height of aerosols are important factors in determining the top-of-atmosphere (TOA) radiation budget, either direct reflection of solar radiation back to space and/or absorption of solar radiation. In addition to their impact on the Earth’s climate system, aerosols near the surface from wildfires, man-made pollution events, and dust storms are hazardous to human health. The phase and height of clouds also play a critical role in determining the role of clouds in the Earth’s climate system. Cirrus clouds in the upper troposphere can induce a significant daytime TOA warming effect, while liquid water clouds near the surface cause a large corresponding cooling effect. Lidar measurements provide accurate vertically resolved information about clouds and aerosols, including complex multi-layer scenes where passive sensors are challenged and at night, when passive sensors are unable to measure cloud and aerosol properties. The Cloud-Aerosol Transport System (CATS) is a lidar instrument that operated for 33 months on the International Space Station (ISS) at the 1064 nm wavelength to measure attenuated total backscatter and depolarization ratio. These fundamental measurements are used to derive “vertical feature mask” cloud and aerosol products, including layer top/base heights, layer geometrical thickness, aerosol type, and cloud phase. While space-based lidar systems like CATS provide cloud and aerosol vertical distributions that improve our understanding of the climate system, averaging of the daytime data from these sensors is required, at the expense of spatial resolution, to improve the daytime signal-to noise (SNR) and thus atmospheric layer detection. This presentation shows results from machine learning (ML) techniques that, when applied to CATS data: 1. improve the 1064 nm SNR 2. enable detection of atmospheric features during daytime with a horizontal resolution of 350 m or 5 km (compared to the 60 km required for standard CATS data products) 3. increase the number of atmospheric layers detected in the CATS data. A Convolutional Neural Network (CNN) trained using CATS standard data products also demonstrated the potential for improved cloud-aerosol discrimination, cloud phase, and aerosol typing compared to the operational CATS algorithms for cloud edges and complex near-surface scenes during daytime. The ML tools described in this paper can facilitate the development of smaller, low-cost lidar systems in the future and enable real-time accessibility of lidar data products from future lidar systems for monitoring and forecasting of hazardous events.

John Yorks↗
DOE OSTI2020

Image Collection Simulation Using High-Resolution Atmospheric Modeling

A new method is described for simulating the passive remote sensing image collection of ground targets that includes effects from atmospheric physics and dynamics at fine spatial and temporal scales. The innovation in this research is the process of combining a high-resolution weather model with image collection simulation to attempt to account for heterogeneous and high-resolution atmospheric effects on image products. The atmosphere was modeled on a 3D voxel grid by a Large-Eddy Simulation (LES) driven by forcing data constrained by local ground-based and air-based observations. The spatial scale of the atmospheric model (10–100 m) came closer than conventional weather forecast scales (10–100 km) to approaching the scale of typical commercial multispectral imagery (2 m). This approach was demonstrated through a ground truth experiment conducted at the Department of Energy Atmospheric Radiation Measurement Southern Great Plains site. In this experiment, calibrated targets (colored spectral tarps) were placed on the ground, and the scene was imaged with WorldView-3 multispectral imagery at a resolution enabling the tarps to be visible in at least 9–12 image pixels. The image collection was simulated with Digital Imaging and Remote Sensing Image Generation (DIRSIG) software, using the 3D atmosphere from the LES model to generate a high-resolution cloud mask. The high-resolution atmospheric model-predicted cloud coverage was usually within 23% of the measured cloud cover. The simulated image products were comparable to the WorldView-3 satellite imagery in terms of the variations of cloud distributions and spectral properties of the ground targets in clear-sky regions, suggesting the potential utility of the proposed modeling framework in improving simulation capabilities, as well as testing and improving the operation of image collection processes.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2013

Multi-sensor Cloud Retrieval Simulator and Remote Sensing from Model Parameters : Synthetic Sensor Radiance Formulation - Pt. 1

In this paper we describe a general procedure for calculating synthetic sensor radiances from variable output from a global atmospheric forecast model. In order to take proper account of the discrepancies between model resolution and sensor footprint, the algorithm takes explicit account of the model subgrid variability, in particular its description of the probability density function of total water (vapor and cloud condensate.) The simulated sensor radiances are then substituted into an operational remote sensing algorithm processing chain to produce a variety of remote sensing products that would normally be produced from actual sensor output. This output can then be used for a wide variety of purposes such as model parameter verification, remote sensing algorithm validation, testing of new retrieval methods and future sensor studies.We show a specific implementation using the GEOS-5 model, the MODIS instrument and the MODIS Adaptive Processing System (MODAPS) Data Collection 5.1 operational remote sensing cloud algorithm processing chain (including the cloud mask, cloud top properties and cloud optical and microphysical properties products). We focus on clouds because they are very important to model development and improvement.

Simulations↗
NASA NTRS2013

Equivalent Sensor Radiance Generation and Remote Sensing from Model Parameters: Equivalent Sensor Radiance Formulation - Part 1

In this paper we describe a general procedure for calculating equivalent sensor radiances from variables output from a global atmospheric forecast model. In order to take proper account of the discrepancies between model resolution and sensor footprint the algorithm takes explicit account of the model subgrid variability, in particular its description of the probably density function of total water (vapor and cloud condensate.) The equivalent sensor radiances are then substituted into an operational remote sensing algorithm processing chain to produce a variety of remote sensing products that would normally be produced from actual sensor output. This output can then be used for a wide variety of purposes such as model parameter verification, remote sensing algorithm validation, testing of new retrieval methods and future sensor studies. We show a specific implementation using the GEOS-5 model, the MODIS instrument and the MODIS Adaptive Processing System (MODAPS) Data Collection 5.1 operational remote sensing cloud algorithm processing chain (including the cloud mask, cloud top properties and cloud optical and microphysical properties products.) We focus on clouds and cloud/aerosol interactions, because they are very important to model development and improvement.

Simulations↗