Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “CLOUD DATA”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

A radiation closure study of Arctic stratus cloud microphysical properties using the collocated satellite-surface data and Fu-Liou radiative transfer model

Retrievals of cloud microphysical properties based on passive satellite imagery are especially difficult over snow-covered surfaces because of the bright and cold surface. To help quantify their uncertainties, single-layered overcast liquid-phase Arctic stratus cloud microphysical properties retrieved by using the Clouds and the Earth's Radiant Energy System Edition 2 and Edition 4 (CERES Ed2 and Ed4) algorithms are compared with ground-based retrievals at the Atmospheric Radiation Measurement North Slope of Alaska (ARM NSA) site at Barrow, AK, during the period from March 2000 to December 2006. A total of 206 and 140 snow-free cases (Rsfc ≤ 0.3), and 108 and 106 snow cases (R sfc > 0.3), respectively, were selected from Terra and Aqua satellite passes over the ARM NSA site. The CERES Ed4 and Ed2 optical depth (τ) and liquid water path (LWP) retrievals from both Terra and Aqua are almost identical and have excellent agreement with ARM retrievals under snow-free and snow conditions. In order to reach a radiation closure study for both the surface and top of atmosphere (TOA) radiation budgets, the ARM precision spectral pyranometer-measured surface albedos were adjusted (63.6% and 80% of the ARM surface albedos for snow-free and snow cases, respectively) to account for the water and land components of the domain of 30 km × 30 km. Most of the radiative transfer model calculated SW↓ sfc and SW↑ TOA fluxes by using ARM and CERES cloud retrievals and the domain mean albedos as input agree with the ARM and CERES flux observations within 10 W m -2 for both snow-free and snow conditions. Sensitivity studies show that the ARM LWP and r e retrievals are less dependent on solar zenith angle (SZA), but all retrieved optical depths increase with SZA.

54 ENVIRONMENTAL SCIENCES↗

Machine Learning for Synchrophasor Analysis

The report presents results from the development of a cloud-based, Big Data analysis framework for power systems. The computational pipeline uses the Apache Spark framework running in an OpenStack cloud infrastructure. A real-world phasor measurement unit (PMU) dataset has been used to carry out the analysis. Several Machine Learning (ML) methods have been developed and implemented for event and anomaly detection and classification. Actual examples of power system events detection and analysis using synchrophasor data are presented. It has been shown that applications of the cloud-based computing environment and the Apache Spark framework enable a significant increase in the computational efficiency of large-scale PMU data analysis.

20 FOSSIL-FUELED POWER PLANTS↗

Cloud cover estimation using bispectral satellite measurements

An algorithm has been developed for cloud cover estimation using bispectral satellite measurements. Based on the distribution of pixels in albedo-brightness temperature space, a number of threshold values are applied to identify those pixels which are most likely totally cloud filled. Mean cloudy-column albedo in a region much larger than a single pixel is then estimated and cloud cover computed. The algorithm has been applied to the International Satellite Cloud Climatology Project Geostationary Meteorological Satellite B2 data. Locations of tropical convective cells and the passage of fronts in higher latitudes are identified. Since these features represent the states of large-scale atmospheric circulations, it is concluded that the algorithm can yield consistent cloud data sets useful for climate studies.

Chou, M.-D.↗

The EOS CERES Global Cloud Mask

To detect long-term climate trends, it is essential to produce long-term and consistent data sets from a variety of different satellite platforms. With current global cloud climatology data sets, such as the International Satellite Cloud Climatology Experiment (ISCCP) or CLAVR (Clouds from Advanced Very High Resolution Radiometer), one of the first processing steps is to determine whether an imager pixel is obstructed between the satellite and the surface, i.e., determine a cloud 'mask.' A cloud mask is essential to studies monitoring changes over ocean, land, or snow-covered surfaces. As part of the Earth Observing System (EOS) program, a series of platforms will be flown beginning in 1997 with the Tropical Rainfall Measurement Mission (TRMM) and subsequently the EOS-AM and EOS-PM platforms in following years. The cloud imager on TRMM is the Visible/Infrared Sensor (VIRS), while the Moderate Resolution Imaging Spectroradiometer (MODIS) is the imager on the EOS platforms. To be useful for long term studies, a cloud masking algorithm should produce consistent results between existing (AVHRR) data, and future VIRS and MODIS data. The present work outlines both existing and proposed approaches to detecting cloud using multispectral narrowband radiance data. Clouds generally are characterized by higher albedos and lower temperatures than the underlying surface. However, there are numerous conditions when this characterization is inappropriate, most notably over snow and ice of the cloud types, cirrus, stratocumulus and cumulus are the most difficult to detect. Other problems arise when analyzing data from sun-glint areas over oceans or lakes over deserts or over regions containing numerous fires and smoke. The cloud mask effort builds upon operational experience of several groups that will now be discussed.

Berendes, T. A.↗

Hosting Hyrax in the Cloud While Preserving the User Experience

Cloud object stores enable data providers to reduce costs and provide uniform data servers across organizational divisions. This talk will address how new capabilities provided by cloud computing can be used with existing software so that users get the benefits provided by cloud technology (access to data at lower cost, e.g.) without disrupting their existing workflow(s). We will address ways to reduce response latency often associated with Cloud object stores and ways to simulate the hierarchy of a POSIX file system using a key-value object store. This work is based an on-going NASA EED2 project to enhance the Hyrax data server for operation in the Amazon Web Services Cloud.

Hyrax server↗

Flux Improvement based on Machine Learning for the CERES FluxByCldTyp Data Product

The NASA Clouds and the Earth's Radiant Energy System (CERES) product provides over 20 years of accurately observed top-of-the-atmosphere (TOA) and surface flux data record for climate monitoring and diagnostic studies. The interaction between clouds and radiation interaction is a key factor that dominate climate feedbacks but is not well understood. To further advance our understanding of the cloud-radiation interaction, a new CERES FluxByCldTyp (FBCT) product has been developed that contains radiative fluxes by cloud-type, which can provide more stringent constraints when validating models and reveal more insight into the interactions between clouds and climate. For CERES partly cloudy and multiple cloud-type footprints, the FBCT product utilizes Moderate Resolution Imaging Spectroradiometer (MODIS) narrow-band (NB) imager channel radiances partitioned by cloud-type within a CERES footprint to estimate the cloud-type broadband fluxes. The MODIS multi-channel derived broadband fluxes were compared with the CERES observed footprint fluxes and were found to be within 1% and 2.5% for LW and SW, respectively, as well as being mostly free of cloud property dependencies. The FBCT all-sky and clear-sky monthly averaged fluxes were found to be consistent with the CERES SSF1deg product. This study takes advantage of recent progress in machine learning (ML) field by applying deep neural network algorithm to improve fluxes based on MODIS NB radiances. The preliminary study shows ML produce are an improvement over the current FBCT Edition 4 NB2BB algorithm. Furthermore, unlike Ed4 NB2BB, the new ML method convert NB radiances directly to broadband fluxes. For future Ed5, new NB radiances are proposed and used by ML to improve fluxes calculation. Prelimary results show significant LW improvement.

Moguo Sun↗

International Satellite Cloud Climatology Project (ISCCP) Stage D2 Monthly Cloud Product - Revised Algorithm in Native (NAT) Data Format (ISCCP_D2_NAT)

Since 1983 an international group of institutions has collected and analyzed satellite radiance measurements from up to five geostationary and two polar orbiting satellites to infer the global distribution of cloud properties and their diurnal, seasonal and interannual variations. The primary focus of the first phase of the project (1983-1995) was the elucidation of the role of clouds in the radiation budget (top of the atmosphere and surface). In the second phase of the project (1995 onwards) the analysis also concerns improving understanding of clouds in the global hydrological cycle. [Location=TROPOSPHERE] [Temporal_Coverage: Start_Date=1983-07-01; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=280 Km; Longitude_Resolution=280 Km; Temporal_Resolution=Monthly].

CLOUD OPTICAL THICKNESS↗

Toward data assimilation of ship-induced aerosol–cloud interactions

Satellite imagery can detect temporary cloud trails or ship tracks formed from aerosols emitted from large ships traversing our oceans, a phenomenon that global climate models cannot directly reproduce. Ship tracks are observable examples of marine cloud brightening, a potential solar climate intervention that shows promise in helping combat climate change. In this paper, we demonstrate a simulation-based approach in learning the behavior of ship tracks based upon a novel stochastic emulation mechanism. Our method uses wind fields to determine the movement of aerosol–cloud tracks and uses a stochastic partial differential equation (SPDE) to model their persistence behavior. This SPDE incorporates both a drift and diffusion term which describes the movement of aerosol particles via wind and their diffusivity through the atmosphere, respectively. We first present our proposed approach with examples using simulated wind fields and ship paths. We then successfully demonstrate our tool by applying the approximate Bayesian computation method-sequential Monte Carlo for data assimilation.

54 ENVIRONMENTAL SCIENCES↗

Validation of Satellite-Based Objective Overshooting Cloud-Top Detection Methods Using CloudSat Cloud Profiling Radar Observations

Two satellite infrared-based overshooting convective cloud-top (OT) detection methods have recently been described in the literature: 1) the 11-mm infrared window channel texture (IRW texture) method, which uses IRW channel brightness temperature (BT) spatial gradients and thresholds, and 2) the water vapor minus IRW BT difference (WV-IRW BTD). While both methods show good performance in published case study examples, it is important to quantitatively validate these methods relative to overshooting top events across the globe. Unfortunately, no overshooting top database currently exists that could be used in such study. This study examines National Aeronautics and Space Administration CloudSat Cloud Profiling Radar data to develop an OT detection validation database that is used to evaluate the IRW-texture and WV-IRW BTD OT detection methods. CloudSat data were manually examined over a 1.5-yr period to identify cases in which the cloud top penetrates above the tropopause height defined by a numerical weather prediction model and the surrounding cirrus anvil cloud top, producing 111 confirmed overshooting top events. When applied to Moderate Resolution Imaging Spectroradiometer (MODIS)-based Geostationary Operational Environmental Satellite-R Series (GOES-R) Advanced Baseline Imager proxy data, the IRW-texture (WV-IRW BTD) method offered a 76% (96%) probability of OT detection (POD) and 16% (81%) false-alarm ratio. Case study examples show that WV-IRW BTD.0 K identifies much of the deep convective cloud top, while the IRW-texture method focuses only on regions with a spatial scale near that of commonly observed OTs. The POD decreases by 20% when IRW-texture is applied to current geostationary imager data, highlighting the importance of imager spatial resolution for observing and detecting OT regions.

Bedka, Kristopher M.↗

The Future of NASA Earth Science in the Commercial Cloud: Challenges and Opportunities

NASA produces a large volume and variety of data products that are used every day to support research, decision making, and education. The widespread use of NASA’s Earth Science data is enabled by NASA’s Earth Science Data System (ESDS) program, which oversees the archiving and distribution of these data and invests in the development of new data systems and tools. However, NASA’s current approach to Earth Science data distribution — based on distributed institutional archives with individual on-premises high-performance computing capabilities — faces some significant challenges, including massive increases in data volume from upcoming missions, a greater need for transdisciplinary science that synthesizes many different kinds of observations, and a push to make science more open, inclusive, and accessible. To address these challenges, NASA is aggressively migrating its Earth Science data and related tools and services into the commercial cloud. Migration of data into the commercial cloud can significantly improve NASA’s existing data system capabilities by (1) providing more flexible options for storage and compute (including rapid, as-needed access to state-of-the-art capabilities); (2) by centralizing and standardizing data access, which gives all of NASA’s institutional data centers access to all of each other’s datasets; and (3) by facilitating “analysis-in-place”, whereby users can bring their own computational workflows and tools to the data rather than having to maintain their own copies of NASA datasets. However, migration to the commercial cloud also poses some significant challenges, including (1) managing costs under a “pay-as-you-go” model; (2) incompatibility with existing tools and data formats with object-based storage and network access; (3) vendor lock-in; (4) challenges with data access for workflows that mix on-premise and cloud computing; and (5) standardization for highly diverse data as is present in NASA’s data archive. I conclude with two examples of recent NASA activities showcasing capabilities enabled by the commercial cloud: An interactive analysis and development platform for analyzing airborne imaging spectroscopy data, and a new collection of tools and services for data discovery, analysis, publication, and data-driven storytelling (Visualization, Exploration, and Data Analysis, VEDA).

Alexey N Shiklomanov↗

A 3-Year Climatology of Cloud and Radiative Properties Derived from GOES-8 Data Over the Southern Great Plains

While the various instruments maintained at the Atmospheric Radiation Measurement (ARM) Program Southern Great Plains (SGP) Central Facility (CF) provide detailed cloud and radiation measurements for a small area, satellite cloud property retrievals provide a means of examining the large-scale properties of the surrounding region over an extended period of time. Seasonal and inter-annual climatological trends can be analyzed with such a dataset. For this purpose, monthly datasets of cloud and radiative properties from December 1996 through November 1999 over the SGP region have been derived using the layered bispectral threshold method (LBTM). The properties derived include cloud optical depths (ODs), temperatures and albedos, and are produced on two grids of lower (0.5 deg) and higher resolution (0.3 deg) centered on the ARM SGP CF. The extensive time period and high-resolution of the inner grid of this dataset allows for comparison with the suite of instruments located at the ARM CF. In particular, Whole-Sky Imager (WSI) and the Active Remote Sensing of Clouds (ARSCL) cloud products can be compared to the cloud amounts and heights of the LBTM 0.3 deg grid box encompassing the CF site. The WSI provides cloud fraction and the ARSCL computes cloud fraction, base, and top heights using the algorithms by Clothiaux et al. (2001) with a combination of Belfort Laser Ceilometer (BLC), Millimeter Wave Cloud Radar (MMCR), and Micropulse Lidar (MPL) data. This paper summarizes the results of the LBTM analysis for 3 years of GOES-8 data over the SGP and examines the differences between surface and satellite-based estimates of cloud fraction.

Khaiyer, M. M.↗

Sampling, aggregation, and variance estimation for area, yield, and production in LACIE

An approximately 2% sampling error was achieved in LACIE by sampling only approximately 2% of the sampling frame. The sample design in the yardstick region for which historical data were available down to a substratum level to support missing data resulting from cloud cover provided the most accurate estimate possible. The implemented strategy provided data of sufficient quality and quantity to support required performance levels and also to satisfy the existing constraints. The allocation scheme appeared to provide the most efficient usage of the available data and gave segment coverage of major producing areas and thus improved the probability of an accurate estimate.

Hallum, C. R.↗

Seasat. Volume 4: Attitude determination

The Seasat project was a feasibility demonstration of the use of orbital remote sensing for global ocean observation. The satellite was launched in June 1978 and was operated successfully until October 1978. A massive electrical failure occurred in the power system, terminating the mission prematurely. The actual implementation of the Seasat Attitude Determination system and the contents of the attitude data files generated by that system are documented. The deviations from plan caused by the anomalous Sun interference with horizon sensors, inflight calibration of Sun sensor head 2 alignment and horizon sensor biomass, estimation of yaw interpolation parameters, Sun and horizon sensor error sources, and yaw interpolation accuracy are included. Examples are given of flight attitude data from all modes of the Orbital Attitude Control System, of the ground processing effects on attitude data, and of cold cloud effects on pitch, and roll data.

Treder, A. J.↗

Lightning observations from the Space Shuttle

Motion pictures were taken at night from the space shuttle that show lightning discharges spreading horizontally at speeds of .00001 m/sec for distances over 60 km. Tape recordings were made of the accompanying optical pulses detected with a photocell optical system. The observations show that lightning is often a mesoscale phenomenon that conveys large amounts of electric charge and energy derived from an extensive cloud system into a cloud-to-ground discharge. Several video tape recordings of lightning discharges were obtained on shuttle flights since the termination of the NOSL program. The size and location of the lightning illuminated cloud images is now being analyzed, and comparisons are made with meteorological data concerning the cloud system obtained from the McIDAS.

Vonnegut, B.↗

Cloud cover determination in polar regions from satellite imagery

The principal objectives of this project are: to develop suitable validation data sets to evaluate the effectiveness of the ISCCP operational algorithm for cloud retrieval in polar regions and to validate model simulations of polar cloud cover; to identify limitations of current procedures for varying atmospheric surface conditions, and to explore potential means to remedy them using textural classifiers: and to compare synoptic cloud data from a control run experiment of the Goddard Institute for Space Studies (GISS) climate model 2 with typical observed synoptic cloud patterns. Current investigations underway are listed and the progress made to date is summarized.

Barry, R. G.↗

New Multispectral Cloud Retrievals from MODIS

The Moderate Resolution Imaging Spectroradiometer (MODIS) was developed by NASA and launched onboard the Terra spacecraft on December 18, 1999. It achieved its final orbit and began Earth observations on February 24, 2000. MODIS scans a swath width sufficient to provide nearly complete global coverage every two days from a polar-orbiting, sun-synchronous, platform at an altitude of 705 km, and provides images in 36 spectral bands between 0.415 and 14.235 micrometers with spatial resolutions of 250 m (2 bands), 500 m (5 bands) and 1000 m (29 bands). These bands have been carefully selected to enable advanced studies of land, ocean, and atmospheric processes. In this paper I will describe the various methods being used for the remote sensing of cloud properties using MODIS data, focusing primarily on the MODIS cloud mask used to distinguish clouds, clear sky, heavy aerosol, and shadows on the ground, and on the remote sensing of cloud optical properties, especially cloud optical thickness and effective radius of cloud drops and ice crystals. Results will be presented of MODIS cloud properties both over the land and over the ocean, showing the consistency in cloud retrievals over various ecosystems used in the retrievals. The implications of this new observing system on global analysis of the Earth's environment will be discussed.

Platnick, Steven↗