SEARCH · Engineering Papers

Results for “cloud storage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

NASA NTRS2019

Opportunities for Accelerating Research in the Cloud

As the data holdings of the Earth Observation System Data and Information System expand over the next several years, the typical data analysis process of downloading data to local compute resources will become increasingly inefficient. However, cloud computing promises to mitigate that by allowing the user to process close to the data. These improvements will be obtained via a variety of mechanisms: 1 - improving the ability of data transformation services to reduce the data prior to analysis; 2 - providing cloud-native analysis capabilities for common analysis functions; and 3 - providing the ability to work directly with data in Web Object Storage.

data system↗

NASA NTRSDate not supplied

Lapse-Rate Feeback: The Key to Reconciling TOA and Surface Attributions of Surface Warming

The impact of climate feedbacks on surface warming is conventionally evaluated using a decomposition of the top-of-atmosphere (TOA) energy budget. Alternatively, the climate feedback analysis can also be carried out using the surface energy budget. However, the two perspectives do not provide the same interpretation of process contributions to surface warming, particularly when executing a spatial analysis. The TOA energy budget is equal to the sum of the surface and atmospheric energy budgets. Using the CMIP5 RCP 8.5 model projections, we show that the major discrepancies between the surface and TOA climate feedback attributions of surface warming are due to non-negligible changes in the atmospheric energy budget that differ from their counterparts at the surface. Individual radiative and non-radiative processes cause vertically non-uniform energy flux perturbations, in response to an external forcing, that naturally lead to a vertically non-uniform temperature change. The TOA lapse-rate feedback is the manifestation of these multiple processes that produce a vertically non-uniform warming response such that it accounts for the asymmetry between the changes in the atmospheric and surface energy budgets. Using the climate feedback-response analysis method, we can decompose the lapse-rate feedback into contributions by individual processes. The negative lapse-rate feedback in the tropics is due to greater moist convection and condensational heating along with ocean heat storage. On the other hand, the positive lapse-rate feedback in polar regions is primarily due to the surface albedo and water vapor feedbacks. Combining the process contributions that are hidden within the lapse-rate feedback with their respective direct impacts on the TOA energy budget allows for a very consistent picture of process contributions to surface warming and its inter-model spread as that given by the surface energy budget approach. With the modified approach, both perspectives indicate water vapor feedback is the largest contributor in the tropics, while surface albedo feedback is the greatest contributor in polar regions. Dynamics and ocean heat storage are the main suppressors of surface warming, except over Antarctica. Both perspectives show there is large inter-model uncertainty in the contributions of water vapor, clouds, albedo, and dynamics plus ocean heat storage.

Sergio A Sejas↗

NASA NTRS1978

Cloudiness and the radiation budget

The problem of obtaining data for quantification of the effects of clouds on radiation budget measurements is discussed. Areas considered include the relationship between observed cloud characteristics and model predicted characteristics and selection of an angular distribution function for conversion of scanning radiometer radiance to irradiance. Storage of meteorological satellite data related to cloud-radiation interactions is discussed.

Source record↗

NASA NTRS2019

Geonex: Land Surface Monitoring from a New Generation of Geostationary Sensors

The latest generation of geostationary satellites carry sensors such as the Advanced Baseline Imager (GOES-16/17) and the Advanced Himawari Imager (Himawari-8/9) that closely mimic the spatial and spectral characteristics of MODIS and VIIRS, useful for monitoring land surface conditions. The NASA Earth Exchange (NEX) team at Ames Research Center has embarked on a collaborative effort among scientists from NASA and NOAA exploring the feasibility of producing operational land surface products similar to those from MODIS/VIIRS. The team built a processing pipeline called GEONEX that is capable of converting raw geostationary data into routine products of Fires, surface reflectances, vegetation indices, LAI/FPAR, ET and GPP/NPP using algorithms adapted from both NASA/EOS and NOAA/GOES-R programs. The GEONEX pipeline has been deployed on Amazon Web Services cloud platform and it currently leverages near-realtime geostationary data hosted in AWS public datasets under a NOAA-AWS agreement. Initial analyses of various products from ABI/AHI sensors suggest that they are comparable to those from MODIS in representing the spatio-temporal dynamics of land conditions. Cloud computing offers a variety of options for deploying the GEONEX pipeline including choice CPUs, storage media, and automation. By making the GEONEX pipeline available on the cloud, we hope to engage a broad community of Earth scientists from around the world in utilizing this new source of data for Earth monitoring.

Nemani, Ramakrishna R.↗

NASA NTRS2019

Earth Observations from Geostationary Satellites

The latest generation of geostationary satellites carry sensors such as the Advanced Baseline Imager (GOES-16/17) and the Advanced Himawari Imager (Himawari-8/9) that closely mimic the spatial and spectral characteristics of MODIS and VIIRS, useful for monitoring land surface conditions. The NASA Earth Exchange (NEX) team at Ames Research Center has embarked on a collaborative effort among scientists from NASA and NOAA exploring the feasibility of producing operational land surface products similar to those from MODIS/VIIRS. The team built a processing pipeline called GeoNEX that is capable of converting raw geostationary data into routine products of Fires, surface reflectances, vegetation indices, LAI/FPAR, ET and GPP/NPP using algorithms adapted from both NASA/EOS and NOAA/GOES-R programs. The GeoNEX pipeline has been deployed on Amazon Web Services cloud platform and it currently leverages near-realtime geostationary data hosted in AWS public datasets under a NOAA-AWS agreement. Initial analyses of various products from ABI/AHI sensors suggest that they are comparable to those from MODIS in representing the spatio-temporal dynamics of land conditions. Cloud computing offers a variety of options for deploying the GeoNEX pipeline including choice CPUs, storage media, and automation. By making the GEONEX pipeline available on the cloud, we hope to engage a broad community of Earth scientists from around the world in utilizing this new source of data for Earth monitoring.

Earth↗

NASA NTRS2019

GeoNEX: Land Monitoring from a New Generation of Geostationary Sensors

GeoNEX↗

NASA NTRS1981

Cloud cover archiving on a global scale - A discussion of principles

Monitoring of climatic variability and climate modeling both require a reliable global cloud data set. Examination is made of the temporal and spatial variability of cloudiness in light of recommendations made by GARP in 1975 (and updated by JOC in 1978 and 1980) for cloud data archiving. An examination of the methods of comparing cloud cover frequency curves suggests that the use of the beta distribution not only facilitates objective comparison, but also reduces overall storage requirements. A specific study of the only current global cloud climatology (the U.S. Air Force's 3-dimensional nephanalysis) over the United Kingdom indicates that discussion of methods of validating satellite-based data sets is urgently required.

Henderson-Sellers, A.↗

NASA NTRS1988

Space shuttle natural environment analysis

Five major tasks are briefly outlined: development of detailed wind profile measurements for Kennedy Space Center (KSC) and Vandenberg Air Force Base (VAFB): development of software to construct meteorological data tapes for use in the STS Post Ascent Analysis; development of storage, access, and utilization codes for Global Cloud Cover data; development of software and meteorological data bases to establish launch delay risks at KSC and VAFB; and development of the meteorological tower 301 climatological data base at VAFB.

Batts, Wade↗

NASA NTRSDate not supplied

Breaking Barriers: Integrating Geo-Leo Aerosol Data with an Open-Source Approach

The scientific community is still examining the novel data from geostationary satellite observations and evaluating methods for effectively fusing the polar observations with various spatial and temporal resolutions. However, the merged data will present a significant ""Big Data"" challenge, including processing, storage, data discoverability, accessibility, and migration within cloud computing environments. We have developed an open-source package to fuse aerosol optical depths (AOD) products from six satellite sensors in the past four years (2019~2023), and this presentation will update our recent progress. Using this Python-based package, we produced a level 3 global (AOD) product in a quarter-degree spatial resolution every half-hour, fusing the Level 2 AOD data with the Dark Target aerosol retrieval algorithm from six satellites: three geostationary (GOES-16/17 and Himawari-8) with high temporal resolution, and three polar orbiting (TERRA/MODIS, AQUA/MODIS, and SNPP-VIIRS) with global coverage. By integrating these observations, the diurnal cycle of global AOD in this fused product can be characterized at local, regional, and global scales. Furthermore, we are committed to openness and transparency by providing our package and its associated functionalities as open-source. Our dedication to adhering to the FAIR, CARE, and TRUST principles ensures that our users can rely on the integrity and ethical standards of our work. For instance of Interoperability, this package fuses remote sensing products on demand into desired temporal and spatial domains. It can be run in a central processing unit (CPU) or a Graphics processing unit (GPU) mode. This package will empower researchers and practitioners to use satellite and sensor data efficiently in various applications and research.

Xiaohua Pan↗

NASA NTRS2017

Trade Study: Storing NASA HDF5/netCDF-4 Data in the Amazon Cloud and Retrieving Data Via Hyrax Server Data Server

This study explored three candidate architectures with different types of objects and access paths for serving NASA Earth Science HDF5 data via Hyrax running on Amazon Web Services (AWS). We studied the cost and performance for each architecture using several representative Use-Cases. The objectives of the study were: Conduct a trade study to identify one or more high performance integrated solutions for storing and retrieving NASA HDF5 and netCDF4 data in a cloud (web object store) environment. The target environment is Amazon Web Services (AWS) Simple Storage Service (S3). Conduct needed level of software development to properly evaluate solutions in the trade study and to obtain required benchmarking metrics for input into government decision of potential follow-on prototyping. Develop a cloud cost model for the preferred data storage solution (or solutions) that accounts for different granulation and aggregation schemes as well as cost and performance trades.We will describe the three architectures and the use cases along with performance results and recommendations for further work.

AWS cost↗

NASA NTRS1982

Infrared remote sensing of the vertical and horizontal distribution of clouds

An algorithm has been developed to derive the horizontal and vertical distribution of clouds from the same set of infrared radiance data used to retrieve atmospheric temperature profiles. The method leads to the determination of the vertical atmospheric temperature structure and the cloud distribution simultaneously, providing information on heat sources and sinks, storage rates and transport phenomena in the atmosphere. Experimental verification of this algorithm was obtained using the 15-micron data measured by the NOAA-VTPR temperature sounder. After correcting for water vapor emission, the results show that the cloud cover derived from 15-micron data is less than that obtained from visible data.

Chahine, M. T.↗

NASA NTRS2003

Observing the Global Water Cycle from Space

This paper presents an approach to measuring all major components of the water cycle from space. The goal of the paper is to explore the concept of using a sensor-web of satellites to observe the global water cycle. The details of the required measurements and observation systems are therefore only an initial approach and will undergo future refinement, as their details will be highly important. Key elements include observation and evaluation of all components of the water cycle in terms of the storage of water-in the ocean, air, cloud and precipitation, in soil, ground water, snow and ice, and in lakes and rivers-and in terms of the global fluxes of water between these reservoirs. For each component of the water cycle that must be observed, the appropriate temporal and spatial scales of measurement are estimated, along with the some of the frequencies that have been used for active and passive microwave observations of the quantities. The suggested types of microwave observations are based on the heritage for such measurements, and some aspects of the recent heritage of these measurement algorithms are listed. The observational requirements are based on present observational systems, as modified by expectations for future needs. Approaches to the development of space systems for measuring the global water cycle can be based on these observational requirements.

Hildebrand, Peter H.↗

NASA NTRS2004

Observing the Global Water Cycle from Space

This paper presents an approach to measuring all major components of the water cycle from space. Key elements of the global water cycle are discussed in terms of the storage of water-in the ocean, air, cloud and precipitation, in soil, ground water, snow and ice, and in lakes and rivers, and in terms of the global fluxes of water between these reservoirs. Approaches to measuring or otherwise evaluating the global water cycle are presented, and the limitations on known accuracy for many components of the water cycle are discussed, as are the characteristic spatial and temporal scales of the different water cycle components. Using these observational requirements for a global water cycle observing system, an approach to measuring the global water cycle from space is developed. The capabilities of various active and passive microwave instruments are discussed, as is the potential of supporting measurements from other sources. Examples of space observational systems, including TRMM/GPM precipitation measurement, cloud radars, soil moisture, sea surface salinity, temperature and humidity profiling, other measurement approaches and assimilation of the microwave and other data into interpretative computer models are discussed to develop the observational possibilities. The selection of orbits is then addressed, for orbit selection and antenna size/beamwidth considerations determine the sampling characteristics for satellite measurement systems. These considerations dictate a particular set of measurement possibilities, which are then matched to the observational sampling requirements based on the science. The results define a network of satellite instrumentation systems, many in low Earth orbit, a few in geostationary orbit, and all tied together through a sampling network that feeds the observations into a data-assimilative computer model.

Hildebrand, P. H.↗

NASA NTRS2012

Comets as Messengers from the Early Solar System - Emerging Insights on Delivery of Water, Nitriles, and Organics to Earth

The question of exogenous delivery of water and organics to Earth and other young planets is of critical importance for understanding the origin of Earth's volatiles, and for assessing the possible existence of exo-planets similar to Earth. Viewed from a cosmic perspective, Earth is a dry planet, yet its oceans are enriched in deuterium by a large factor relative to nebular hydrogen and analogous isotopic enrichments in atmospheric nitrogen and noble gases are also seen. Why is this so? What are the implications for Mars? For icy Worlds in our Planetary System? For the existence of Earth-like exoplanets? An exogenous (vs. outgassed) origin for Earth's atmosphere is implied, and intense debate on the relative contributions of comets and asteroids continues - renewed by fresh models for dynamical transport in the protoplanetary disk, by revelations on the nature and diversity of volatile and rocky material within comets, and by the discovery of ocean-like water in a comet from the Kuiper Belt (cf., Mumma & Charnley 2011). Assessing the creation of conditions favorable to the emergence and sustenance of life depends critically on knowledge of the nature of the impacting bodies. Active comets have long been grouped according to their orbital properties, and this has proven useful for identifying the reservoir from which a given comet emerged (OC, KB) (Levison 1996). However, it is now clear that icy bodies were scattered into each reservoir from a range of nebular distances, and the comet populations in today's reservoirs thus share origins that are (in part) common. Comets from the Oort Cloud and Kuiper Disk reservoirs should have diverse composition, resulting from strong gradients in temperature and chemistry in the proto-planetary disk, coupled with dynamical models of early radial transport and mixing with later dispersion of the final cometary nuclei into the long-term storage reservoirs. The inclusion of material from the natal interstellar cloud is probable, for comets formed in the outer solar system.

Mumma, Michael J.↗

NASA NTRS1986

Remote sensing of land-surface temperature from HIRS/MSU data

A relaxation algorithm which permits meteorological parameters to be obtained from satellite data, without a priori assumptions about the properties of the other unknowns in the field of view, was developed. Atmospheric temperature profiles, atmospheric humidity, cloud cover, cloud top height, cloud top temperature, sea-surface temperature, land-surface temperature, snow cover, and ice cover are derived. Simultaneous determination of atmospheric and surface thermal structure and the cloud distribution provides information on heat sources and sinks, storage rates, and transport phenomena in the atmosphere. Such information is critical in determining the driving mechanisms for motions in the atmosphere and oceans and in improving numerical weather prediction.

Chahine, M. T.↗

NASA NTRS2019

VISAGE - A Visualization and Exploration Framework for Environmental Data

Diverse airborne and ground-based environmental observations are important technologies for disaster assessment and response, as well as for the validation of environmental satellite observations and atmospheric models which can improve forecasts. The VISAGE (Visualization for Integrated Satellite, Airborne and Ground-based data Exploration) project is working to provide three-dimensional visualization and basic analytics capabilities for such datasets in an interactive user interface. The use of cloud-native, server less technologies for analysis optimized data storage will position VISAGE for integration with other technologies into a Data Analytic Center Framework.

Conover, Helen↗

NASA NTRSDate not supplied

Pyroscopegridding: Geo-Leo Aerosol Data Fusion (an Open-Source Package)

The retrieval of aerosol optical depths (AODs) from sun-synchronous polar orbiting satellites, such as MODISs, VIIRSs, OMI, TROPOMI, etc., has been widely adopted as a method for obtaining information regarding particulate matter (PM) and related atmospheric processes. However, the advent of recently launched geostationary satellites, such as GOES-16/17/18, Himawari-8/9, and Meteosat Third Generation (MTG), has led to an increased temporal resolution of AOD observations (order of 10 minutes), resulting in typically one or more images per hour during daylight hours, compared to the once-per-day observations obtained from LEO satellites. By integrating these observations, the diurnal cycle of global AOD can be characterized at local, regional, and global scales. The scientific community is still examining the novel data from geostationary satellite observations and evaluating methods for effectively merging these observations with differing spatial and temporal resolutions. This presents a significant ""Big Data"" challenge, encompassing not only data storage, but also data discoverability, accessibility, and migration within cloud computing environments. This study presents our attempts at fusing Level 2 aerosol data from six satellites, three of which are geostationary (GOES-16/17 and Himawari-8) and three of which are polar orbiting (TERRA/MODIS, AQUA/MODIS, and SNPP-VIIRS), using the Dark Target aerosol retrieval algorithm. The ability to fuse remote sensing products on demand into desired temporal and spatial domains empowers researchers and practitioners to more efficiently work with satellite and sensor data. It is our hope that through making our open-source package and accompanying functionality available, the scientific community will have improved access to aerosol data processing resources.

Jennifer Wei↗

NASA NTRS2012

Investigation into Cloud Computing for More Robust Automated Bulk Image Geoprocessing

Geospatial resource assessments frequently require timely geospatial data processing that involves large multivariate remote sensing data sets. In particular, for disasters, response requires rapid access to large data volumes, substantial storage space and high performance processing capability. The processing and distribution of this data into usable information products requires a processing pipeline that can efficiently manage the required storage, computing utilities, and data handling requirements. In recent years, with the availability of cloud computing technology, cloud processing platforms have made available a powerful new computing infrastructure resource that can meet this need. To assess the utility of this resource, this project investigates cloud computing platforms for bulk, automated geoprocessing capabilities with respect to data handling and application development requirements. This presentation is of work being conducted by Applied Sciences Program Office at NASA-Stennis Space Center. A prototypical set of image manipulation and transformation processes that incorporate sample Unmanned Airborne System data were developed to create value-added products and tested for implementation on the "cloud". This project outlines the steps involved in creating and testing of open source software developed process code on a local prototype platform, and then transitioning this code with associated environment requirements into an analogous, but memory and processor enhanced cloud platform. A data processing cloud was used to store both standard digital camera panchromatic and multi-band image data, which were subsequently subjected to standard image processing functions such as NDVI (Normalized Difference Vegetation Index), NDMI (Normalized Difference Moisture Index), band stacking, reprojection, and other similar type data processes. Cloud infrastructure service providers were evaluated by taking these locally tested processing functions, and then applying them to a given cloud-enabled infrastructure to assesses and compare environment setup options and enabled technologies. This project reviews findings that were observed when cloud platforms were evaluated for bulk geoprocessing capabilities based on data handling and application development requirements.

Brown, Richard B.↗