Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cloud storage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

A Concept of Operations for Earth Science Data Archive and Distribution in the Cloud

Science data systems can enable more comprehensive Earth system research by evolving to take advantage of advances in commercial computer technology services. Since their inception twenty five years ago, NASA's Earth Observing System Data and Information System (EOSDIS) Distributed Active Archive Centers (DAACs) have periodically evolved to utilize new technology and expand research using the exponential growth and diversity of Earth observations. Recently, with the advent of a maturing commercial compute services industry and upcoming high data volume missions such as the Surface Water and Ocean Topography (SWOT) mission and the NASA-Indian Space Research Organization Synthetic Aperture Radar (NISAR) mission, options were explored and a decision made to utilize commercial compute and storage services. This paper presents an overview of the concept of operations under development for the DAACs in the Cloud. We highlight the goals and expected advantages of utilizing Cloud services. We outline EOSDIS operations tenets and driving principles. A high-level view of EOSDIS system of systems target architecture serves as context for describing principle interactions. Concepts for key DAAC system and EOSDIS enterprise functions characterize automated end-to-end operations but mark nominal check and recovery points. Concepts are presented for managing Cloud resources, including organizational roles and responsibilities of the NASA project and DAAC personnel. Scenarios we use to further distinguish between what the system will do and what configuration and controls operators will have. Examples include interactions with data providers and data consumers with both in-cloud and on-premise facilities.

Moses, John F.↗
NASA NTRS2019

New Era, New Opportunity, Is GES DISC Ready for Big Data Challenge?

The new era of Big Data has opened doors for many new opportunities, as well as new challenges, for both Earth science research/application and data communities. As one of the twelve NASA data centers - Goddard Earth Sciences Data and Information Services Center (GES DISC), one of our great challenges has been how to help research/application community efficiently (quickly and properly) accessing, visualizing and analyzing the massive and diverse data in natural hazard research, management, or even prediction. GES DISC has archived over 2000 TB data on premises and distributed over 23,000 TB of data since 2010. Our data has been widely used in every phase of natural hazard management and research, i.e. long term risk assessment and reduction, forecasting and predicting, monitoring and detection, early warning, damage assessment and response. The big data challenge is not just about data storage, but also about data discoverability and accessibility, and even more, about data migration/mirroring in the cloud. This paper is going to demonstrate GES DISC’s efforts and approaches of evolving our overall Web services and powerful Giovanni (Geospatial Interactive Online Visualization ANd aNalysis Infrastructure) tool into further improving data discoverability and accessibility. Prototype works will also be presented.

Li, A.↗
NASA NTRS2020

Monitoring River Basin Development and Variation in Water Resources in Transboundary Imjin River in North and South Korea Using Remote Sensing

This paper presents methods of monitoring river basin development and water variability for the transboundary river in North and South Korea. River basin development, such as dams and water infrastructure in transboundary rivers, can be a potential factor of tensions between upstream and downstream countries since dams constructed upstream can adversely affect downstream riparians. However, because most of the information related to North Korea has been limited to the public, the information about dams constructed and their locations were inaccurate in many previous studies. In addition, water resources in transboundary rivers can be exploited as a political tool. Specifically, due to the unexpected water release from the Hwanggang Dam, upstream of the transboundary Imjin River in North and South Korea, six South Koreans died on 6 September 2009. The Imjin River can be used as a political tool by North Korea, and seven events were reported as water conflicts in the Imjin River from 2001 to 2016. In this paper, firstly, we have updated the information about the dams constructed over the Imjin River in North Korea using multi-temporal images with a high spatial resolution (15-30 cm) obtained from Google Earth. Secondly, we analyzed inter- and intra-water variability over the Hwanggang Reservoir using open-source images obtained from the Global Surface Water Explorer. We found a considerable change in water surface variability before and after 2008, which might result from the construction of the Hwanggang Dam. Thirdly, in order to further investigate intra-annual water variability, we present a method monitoring water storage changes of the Hwanggang Reservoir using the area-elevation curve (AEC), which was derived from multi-sensor Synthetic Aperture Radar (SAR) images (Sentinel-1A and -1B) and the Shuttle Radar Topography Mission (SRTM) Digital Elevation Model (DEM). Since many previous studies for estimating water storage change have depended on satellite altimetry dataset and optical images for deriving AEC, the method adopted in this study is the only application for such inaccessible areas since no altimetry ground track exists for the Hwanggang Reservoir and because clouds can block the study area for wet seasons. Moreover, this study has newly proven that unexpected water release can occur in dry seasons because the water storage in the Hwanggang Reservoir can be high enough to conduct a release that can be used as a geopolitical tool. Using our method, potential risks can be mitigated, not in response to a water release, but based on pre-event water storage changes in the Hwanggang Reservoir.

Kim, Donghwan↗
NASA NTRSDate not supplied

Multidimensional Data Aggregation in the Cloud with Application to Geostationary Satellite-based Air Quality Monitoring

Scientists use satellite data for studying Earth's systems, and the remote sensing data that these satellites collect are typically separated into files of a size small enough for efficient network transfer and storage. However, researchers usually prefer to analyze the data based on real-world dimensions like time, space, or elevation. To help with this, NASA's Atmospheric Science Data Center (ASDC) developed a new cloud-based tool that combines these smaller data chunks into larger, more useful datasets. The tool works on Network Common Data Form (netCDF4) and some HDF5 formatted files, and it is available as a service in NASA's Earthdata Cloud. In this presentation, we showcase this service using data from the Tropospheric Emissions: Monitoring of Pollution (TEMPO) instrument. By combining TEMPO's continuous observations over time, we create longer and more informative analysis-ready time series to facilitate the study of air quality patterns. Insights gained will provide a more comprehensive understanding of pollution sources, transport patterns, and their effects on the environment and human health.

Daniel Kaufman↗
NASA NTRS1973

Break-up characteristics of Chena River Basin

The author has identified the following significant results. While visually analyzing ERTS-1 data for August and September, 1972, it was found that lakes as small as 200 feet in diameter were visible on the imagery. An examination of the imagery for the Minto Lakes area shows that the lakes take on their darkest appearance in MSS band 6. The Tanana River which flows through this area appears quite light in band 5, quite dark in band 7, and is almost undetectable for band 6. The significance of these data are that potential surface storage could be measured for watersheds that have substantial numbers of lakes. This potential storage would be available to both spring runoff and summer precipitation. Caution must be shown because certain clouds cast a shadow that is similar to the lake appearance. The difference of the imagery for a lake and a river of the same band is due to the sediment load for the river. The Tanana River had a heavy glacial sediment load. The area of snow cover during the fall accumulation can be mapped in detail.

Carlson, R. F.↗
NASA NTRSDate not supplied

Open Source Application of Fusing Aerosol Products from GEO and LEO Satellites

Retrieving aerosol optical depths (AODs) from sun-synchronous polar orbiting (aka low earth orbit, LEO) satellites, such as MODISs, and VIIRSs, OMI, TROPOMI, etc, has become well-established as a tool for extracting information on particulate matter (PM) and related processes in the atmosphere. However, with recently launched geostationary satellites (GEO), such as GOES-16/17/18, and Himawari-8/9, and Meteosat Third Generation (MTG) they provide a much higher temporal resolution (order of 10 minutes), typically an image once or more per hour during daylight compared to LEO once per day. By combining these observations, we may be able to characterize the diurnal cycle of global AOD at the local, regional and global scale. While the science community is still exploring the new data from GEO observations, we have been thinking about how to properly combine/merge/fuse those data considering differences in their spatial and temporal resolutions. However, this poses a “Big Data” challenge. The big data challenge is not just about data storage, but also about data discoverability, and accessibility, and even more, about data migration/mirroring in the cloud-computing environment. This paper is merely showing some of the efforts and approaches we have attempted in fusing six satellites’ Level 2 aerosol data (three are from GEO (GOES-16/17 and Himawari-8), and the other three are from LEO (TERRA/MODIS, AQUA/MODIS, SNPP-VIIRS) from Dark Target (DT) aerosol retrieval algorithm. Having the on-demand capability of fusing remote sensing products onto the desired temporal and spatial domain enables researchers and application practitioners to better manipulate and work with satellite and sensor data. It is our hopeWe hope that by making such an open-source package, and the accompanying functionality, the scientific community will be granted easier access to aerosol data processing resources. The MEaSUREs Program (Making Earth System Data Records for Use in Research Environments) expands our understanding of the Earth's current system through atmospheric and surface measurements. In an effort to aid the scientific research component and improve open source methods, this project developed Python code for fusing six satellite Level 2 aerosol data (three are from geostationary satellites (GEO), and the other three are from low earth orbital satellites (LEO)) from Dark Target Aerosol Retrieval Algorithm.

Jennifer Wei↗
NASA NTRS2003

Interleaved Observation Execution and Rescheduling on Earth Observing Systems

Observation scheduling for Earth orbiting satellites solves the following problem: given a set of requests for images of the Earth, a set of instruments for acquiring those images distributed on a collecting of orbiting satellites, and a set of temporal and resource constraints, generate a set of assignments of instruments and viewing times to those requests that satisfy those constraints. Observation scheduling is often construed as a constrained optimization problem with the objective of maximizing the overall utility of the science data acquired. The utility of an image is typically based on the intrinsic importance of acquiring it (for example, its importance in meeting a mission or science campaign objective) as well as the expected value of the data given current viewing conditions (for example, if the image is occluded by clouds, its value is usually diminished). Currently, science observation scheduling for Earth Observing Systems is done on the ground, for periods covering a day or more. Schedules are uplinked to the satellites and are executed rigorously. An alternative to this scenario is to do some of the decision-making about what images are to be acquired on-board. The principal argument for this capability is that the desirability of making an observation can change dynamically, because of changes in meteorological conditions (e.g. cloud cover), unforeseen events such as fires, floods, or volcanic eruptions, or un-expected changes in satellite or ground station capability. Furthermore, since satellites can only communicate with the ground between 5% to 10% of the time, it may be infeasible to make the desired changes to the schedule on the ground, and uplink the revisions in time for the on-board system to execute them. Examples of scenarios that motivate an on-board capability for revising schedules include the following. First, if a desired visual scene is completely obscured by clouds, then there is little point in taking it. In this case, satellite resources, such as power and storage space can be better utilized taking another image that is higher quality. Second, if an unexpected but important event occurs (such as a fire, flood, or volcanic eruption), there may be good reason to take images of it, instead of expending satellite resources on some of the lower priority scheduled observations. Finally, if there is unexpected loss of capability, it may be impossible to carry out the schedule of planned observations. For example, if a ground station goes down temporarily, a satellite may not be able to free up enough storage space to continue with the remaining schedule of observations. This paper describes an approach for interleaving execution of observation schedules with dynamic schedule revision based on changes to the expected utility of the acquired images. We describe the problem in detail, formulate an algorithm for interleaving schedule revision and execution, and discuss refinements to the algorithm based on the need for search efficiency. We summarize with a brief discussion of the tests performed on the system.

Khatib, Lina↗
NASA NTRS2008

FPGA Coprocessor for Accelerated Classification of Images

An effort related to that described in the preceding article focuses on developing a spaceborne processing platform for fast and accurate onboard classification of image data, a critical part of modern satellite image processing. The approach again has been to exploit the versatility of recently developed hybrid Virtex-4FX field-programmable gate array (FPGA) to run diverse science applications on embedded processors while taking advantage of the reconfigurable hardware resources of the FPGAs. In this case, the FPGA serves as a coprocessor that implements legacy C-language support-vector-machine (SVM) image-classification algorithms to detect and identify natural phenomena such as flooding, volcanic eruptions, and sea-ice break-up. The FPGA provides hardware acceleration for increased onboard processing capability than previously demonstrated in software. The original C-language program demonstrated on an imaging instrument aboard the Earth Observing-1 (EO-1) satellite implements a linear-kernel SVM algorithm for classifying parts of the images as snow, water, ice, land, or cloud or unclassified. Current onboard processors, such as on EO-1, have limited computing power, extremely limited active storage capability and are no longer considered state-of-the-art. Using commercially available software that translates C-language programs into hardware description language (HDL) files, the legacy C-language program, and two newly formulated programs for a more capable expanded-linear-kernel and a more accurate polynomial-kernel SVM algorithm, have been implemented in the Virtex-4FX FPGA. In tests, the FPGA implementations have exhibited significant speedups over conventional software implementations running on general-purpose hardware.

Pingree, Paula J.↗
NASA NTRS2019

Air Traffic Management TestBed Simulation Architect: User's Guide

The Air Traffic Management (ATM) TestBed is a Platform as a Service that is being developed by the National Aeronautics and Space Administration (NASA) to help design, configure, integrate, run, and monitor air traffic simulations. The platform provides cloud services including back-end big-data analytics tools, on-demand computing resource management, data storage, and communication middleware. The ATM TestBed reduces the time to test concepts and technologies, supports interactions among various concepts such as human-in-the-loop and automation-in-the-loop simulations, and enables collaborative simulations by sharing technologies and tools in the ATM community. The Simulation Architect application provides a graphical user interface tool for designing traffic scenarios and simulations using blocks representing components and links representing message channels linking them. This guide describes a high-level user interface design of Simulation Architect and provides information for a new user to compose traffic scenarios and simulations.

Software User Guide↗
NASA NTRS2020

Air Traffic Management TestBed Traffic Viewer: Developer's Guide

The Air Traffic Management (ATM) TestBed is a Platform as a Service that is being developed by the National Aeronautics and Space Administration (NASA) to help design, configure, integrate, run, and monitor air traffic simulations. The platform is designed to provide cloud services including back-end, big-data analytics tools, on-demand computing resource management, data storage, and communication middleware. The ATM TestBed reduces the time to test concepts and technologies, supports interactions among various methods such as human-in-the-loop and automation-in-the-loop simulations, and enables collaborative simulations by sharing technologies and tools in the ATM community. The Traffic Viewer application provides a graphical user interface tool for visualizing real and simulated air traffic as well as airspace definition in two-dimensional space. This guide describes a high-level design and implementation of Traffic Viewer and provides information for a new developer or a user to add new capabilities by following the software design and leveraging existing capabilities.

Lai, Chok Fung↗
NASA NTRS2020

Air Traffic Management TestBed Data Exchange Model

The Air Traffic Management (ATM) TestBed is a Platform as a Service that is being developed by the National Aeronautics and Space Administration (NASA) to help design, configure, integrate, run, and monitor air traffic simulations. The platform is designed to provide cloud services including back-end, big-data analytics tools, on-demand computing resource management, data storage, and communication middleware. The ATM TestBed reduces the time to test concepts and technologies, supports interactions among various methods such as human-in-the-loop and automation-in-the-loop simulations, and enables collaborative simulations by sharing technologies and tools in the ATM community. In order to allow easier access to simulation components, TestBed provides a messaging support layer for connectivity using a consistent set of input/output interfaces. In addition, a standard data format is introduced to facilitate communication between the components. The data exchange model, supported in the messaging support layer, standardizes the format of the information to be exchanged among the components. This document describes the messaging data model currently developed in TestBed and provides data dictionaries for references to component developers as well as simulation engineers.

air traffic simulation↗
NASA NTRS2010

Proposed Use of the NASA Ames Nebula Cloud Computing Platform for Numerical Weather Prediction and the Distribution of High Resolution Satellite Imagery

The development of the Nebula Cloud Computing Platform at NASA Ames Research Center provides an open-source solution for the deployment of scalable computing and storage capabilities relevant to the execution of real-time weather forecasts and the distribution of high resolution satellite data to the operational weather community. Two projects at Marshall Space Flight Center may benefit from use of the Nebula system. The NASA Short-term Prediction Research and Transition (SPoRT) Center facilitates the use of unique NASA satellite data and research capabilities in the operational weather community by providing datasets relevant to numerical weather prediction, and satellite data sets useful in weather analysis. SERVIR provides satellite data products for decision support, emphasizing environmental threats such as wildfires, floods, landslides, and other hazards, with interests in numerical weather prediction in support of disaster response. The Weather Research and Forecast (WRF) model Environmental Modeling System (WRF-EMS) has been configured for Nebula cloud computing use via the creation of a disk image and deployment of repeated instances. Given the available infrastructure within Nebula and the "infrastructure as a service" concept, the system appears well-suited for the rapid deployment of additional forecast models over different domains, in response to real-time research applications or disaster response. Future investigations into Nebula capabilities will focus on the development of a web mapping server and load balancing configuration to support the distribution of high resolution satellite data sets to users within the National Weather Service and international partners of SERVIR.

Limaye, Ashutosh S.↗
NASA NTRS2003

Facile Generation and Storage of Polycyclic Aromatic Hydrocarbon Ions in Astrophysical Ices

In situ ultraviolet-visible absorption and emission studies of vacuum ultraviolet (VUV) irradiated water-rich, cosmic ice analogs containing polycyclic aromatic hydrocarbons (PAHs) are described. W V irradiation of 12 K water ices containing the PAHs naphthalene (H2O/C10H8 = 200) and 4-methylpyrene (H2O/C17H12 > 500) readily converts the PAHs into their cation form (PAH(+)). Under these conditions, PAH photoionization is the predominant reaction. These ions are trapped and stored in the ices at temperatures between 10 and 50 K, a temperature domain common to ices throughout interstellar clouds and the solar system. Unlike the approx.15% ionization typical after W V irradiation of PAHs isolated in rare-gas matrices, in water ice, PAH photoionization and storage proceed efficiently and almost quantitatively with a greater than 70% ionization yield. As the temperature is increased from 50 to 150 K, the PAH ion bands slowly diminish as the PAH ions ultimately react to form more complex organic species involving the water host. The chemical, spectroscopic, and physical properties of these ion-rich ices can be important in icy objects such as molecular clouds, comets, and planets. Several astrophysical applications are presented.

Gudipati, Murthy S.↗
NASA NTRS1987

Low cost, microcomputer-based interactive analysis system for direct-reception and archived remote sensing data

A hardware/software system has been developed for use in meteorological field experiments and by developing countries which need low-cost remote sensing data analysis capabilities. The system can directly receive satellite transmissions of the AVHRR, TOVS, Argos, GOES, GMS, and Meteosat systems. Also, the system can process computer tapes from Landsat. Received data are ingested directly into the computer's disk storage, eliminating the need for a wide-band analog tape drive. Data may be interpreted in terms of cloud imagery, cloudtop temperature, sea surface temperature, vegetation index, and temperature/humidity profiles with overlays of geographic boundaries and latitude/longitude grids. The image processing, enhancement functions, and modeling capabilities of the system are discussed.

Vermillion, Charles H.↗
NASA NTRSDate not supplied

TPSAS-NF1676L-10735-DND

The Clouds and the Earth's Radiant Energy System (CERES) project has now surpassed the 10-year mark, has combined rigorous calibration, improved scene identification, and multi-satellite data fusion to produce a climate-accuracy data set of global 1° gridded radiative surface and TOA fluxes, and cloud properties. CERES provides the climate community with four observed TOA flux products. The ERBE-like product uses the same algorithms as ERBE in order to be compared with the ERBE time period. The SSF product uses the improved scene identification and radiance to flux conversion. The SYN product uses GEO derived clouds and fluxes to provide diurnally complete TOA fluxes. The EBAF product provides net balanced fluxes tied to the ocean heat storage term. This product is suited for climate modelers estimating the global mean energy budget. Each successive CERES flux product applies the improvements over the previous product. This presentation will focus on the diurnal averaging improvements by the inclusion of imager radiances from 5 geostationary (GEO) satellites at 3-hourly intervals to estimate the flux in between CERES observations. The regional monthly mean flux differences based on SYN (CERES/GEO) and SSF (CERES-only) can exceed 20 Wm^-2. CERES shortwave and longwave fluxes have been rigorously validated and are key elements in evaluating the ability of climate models to predict both past and future climate states. The CERES normalization of GEO derived fluxes in order to maintain the CERES instrument calibration and are consistent globally within 0.1 Wm^-2, even if the GEO calibration is artificially altered by ±5%, twice the anticipated calibration error. The predicted GEO TOA fluxes normalized to Terra have been compared at Aqua times to Aqua flux observations, as well as with GERB hourly fluxes over the METEOSAT domain. Similarly ground based radiometers have been used to validate the CERES radiative transfer computed surface fluxes and have confirmed that the CERES/GEO fluxes have improved the computed surface flux product. Although the GEO based fluxes are of inferior quality then the CERES observed fluxes, they capture the diurnal signal more effectively than using constant meteorology between CERES measurements. The validation of the GEO derived fluxes and clouds will be shown.

D. R. Doelling↗
NASA NTRSDate not supplied

LAADS DAAC Migrates to the Cloud: Lessons Learned from Communicating About Earth Science Data on the Cloud

The Level-1 and Atmosphere Archive Distribution System (LAADS) Distributed Active Archive Center (DAAC) is migrating data to the cloud. As one of twelve DAACS supported by NASA’s Earth Science Data and Information System (ESDIS), LAADS is using moving away from on premise data storage facilities to migrating to Amazon Web Services, where the massive archive of data from the Moderate Imaging Spectroradiometer (MODIS) and the Visible Infrared Imaging Radiometer Suite (VIIRS) will be available for download and post-processing transformations online. The migration is happening in three phases and LAADS is concluding its beta testing period. This poster shows the lessons learned from communicating with a select group of users about how to effectively educate data users on using data in the cloud.

Tassia Owen↗
NASA NTRS2005

RF Stabilization for Storage of Antiprotons

Portable storage of antimatter is an important step in the experimental exploration of antimatter in propulsion applications. The High Performance Antiproton Trap (HiPAT) at NASA Marshall Space Flight Center is a Penning-Malmberg ion trap being developed to trap and store low energy antiprotons for a period of weeks. The antiprotons can then be transported for use in experiments. HiPAT is being developed and evaluated using normal matter, before an attempt is made to store and transport antiprotons. Stortd ions have inherent instabilities that limit the storage lifetime. RF stabilization at cyclotron resonance frequencies is demonstrated over a period of 6 days for normal matter ion clouds. A variety of particles have been stored, including protons, C+ ions, and H2+ ions. Cyclotron resonance frequencies are defined and experimental evidence presented to demonstrate excitation of cyclotron waves in the plasma for all three species of ions.

Pearson, J. Boise↗