Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Earth science data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Addressing and Presenting Quality of Satellite Data via Web-Based Services

With the recent attention to climate change and proliferation of remote-sensing data utilization, climate model and various environmental monitoring and protection applications have begun to increasingly rely on satellite measurements. Research application users seek good quality satellite data, with uncertainties and biases provided for each data point. However, different communities address remote sensing quality issues rather inconsistently and differently. We describe our attempt to systematically characterize, capture, and provision quality and uncertainty information as it applies to the NASA MODIS Aerosol Optical Depth data product. In particular, we note the semantic differences in quality/bias/uncertainty at the pixel, granule, product, and record levels. We outline various factors contributing to uncertainty or error budget; errors. Web-based science analysis and processing tools allow users to access, analyze, and generate visualizations of data while alleviating users from having directly managing complex data processing operations. These tools provide value by streamlining the data analysis process, but usually shield users from details of the data processing steps, algorithm assumptions, caveats, etc. Correct interpretation of the final analysis requires user understanding of how data has been generated and processed and what potential biases, anomalies, or errors may have been introduced. By providing services that leverage data lineage provenance and domain-expertise, expert systems can be built to aid the user in understanding data sources, processing, and the suitability for use of products generated by the tools. We describe our experiences developing a semantic, provenance-aware, expert-knowledge advisory system applied to NASA Giovanni web-based Earth science data analysis tool as part of the ESTO AIST-funded Multi-sensor Data Synergy Advisor project.

Leptoukh, Gregory↗

Cloud Giovanni: Reining in Costs and Improving Performance with Analytical Data Stores Using Scalable Serverless Architecture

Giovanni is the Geospatial Interactive Online Visualization ANd aNalysis Infrastructure developed at NASA GES DISC which provides a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science data. It receives large number of user requests each day for a variety of analysis and visualization services, which leads to the big data challenge of serving gradually increasing large data volumes with diverse statistical algorithms. We hereby propose a multi-dimensional accumulation method which provides fast and cost-efficient cloud analysis for diverse services including both area averaging and time averaging. This method involves the weighted volume integration over multiple variable dimensions (time and space), and is implemented in AWS using Athena providing serverless and highly scalable data analysis. Compared to the standard method, this approach dramatically reduced the computational time by order of magnitude with a minimal AWS cost incurred. For example, for a benchmark of 10-year area averaging over the 1x1 degree daily variable, the computational time was reduced from minutes to seconds, and the Athena cost is only $5 for 100,000 requests.

Zhang, Hailiang↗

Challenges in Obtaining and Visualizing Satellite Level 2 Data in GIS

Satellite data products are important for a wide variety of applications that can bring far-reaching benefits to the science community and the broader society. These benefits can best be achieved if the satellite data are well utilized and interpreted. Unfortunately, this is not always the case, despite the abundance and relative maturity of numerous satellite data products provided by NASA and other organizations. One way to help users better understand the satellite data is to provide data along with Images, including accurate pixel coverage area delineation, and science team recommended quality screening for individual geophysical parameters. However, there are challenges of visualizing remote sensed non-gridded products: (1) different geodetics of space-borne instruments (2) data often arranged in a long-track and a cross-track axes (3) spatially and temporally continuous data chunked into granule files: data for a portion (or all) of a satellite orbit (4) no general rule of resampling or interpolations to a grid (5) geophysical retrieval only based on pixel center location without shape information. In this presentation, we will unravel a new Goddard Earth Sciences Data and Information Services Center (GES DISC) Level 2 (L2) visualization on-demand service. The service's front end provides various visualization and data accessing capabilities, such as overlay and swipe of multiply variables and subset and download of data in different formats. The backend of the service consists of Open Geospatial Consortium (OGC) standard-compliant Web Mapping Service (WMS) and Web Coverage Service. The infrastructure allows inclusion of outside data sources served in OGC compliant protocols and allows other interoperable clients, such as ArcGIS clients, to connect to our L2 WCS/WMS.

GI↗

The Cumulus Ecosystem: Open Source and Beyond to Foster Collaboration

NASA’s Earth Observing System Data and Information System (EOSDIS) open source Cumulus software is designed as a common set of code and services that can be used to create a pipeline to deliver and manage earth science data in the cloud. Cumulus strives to create an ecosystem on the foundation of open source that unites those with shared problems and goals by encouraging users to contribute solutions back to the platform. Large parts of ingesting and managing data are common and much of what is created can be used by others. Our goal is to maximize collaboration and code reuse while allowing users to design a custom solution that meets their needs without having to take on extraneous functionality. In this talk we will describe how the Cumulus ecosystem works beyond just open source software. We will review the technology, the successes and challenges, and the evolution and future of Cumulus as an ecosystem.

Cumulus↗

Exploring NASA OMI Level 2 Data With Visualization

Satellite data products are important for a wide variety of applications that can bring far-reaching benefits to the science community and the broader society. These benefits can best be achieved if the satellite data are well utilized and interpreted, such as model inputs from satellite, or extreme events (such as volcano eruptions, dust storms, etc.).Unfortunately, this is not always the case, despite the abundance and relative maturity of numerous satellite data products provided by NASA and other organizations. Such obstacles may be avoided by allowing users to visualize satellite data as images, with accurate pixel-level (Level-2) information, including pixel coverage area delineation and science team recommended quality screening for individual geophysical parameters. We present a prototype service from the Goddard Earth Sciences Data and Information Services Center (GES DISC) supporting Aura OMI Level-2 Data with GIS-like capabilities. Functionality includes selecting data sources (e.g., multiple parameters under the same scene, like NO2 and SO2, or the same parameter with different aggregation methods, like NO2 in OMNO2G and OMNO2D products), user-defined area-of-interest and temporal extents, zooming, panning, overlaying, sliding, and data subsetting, reformatting, and reprojection. The system will allow any user-defined portal interface (front-end) to connect to our backend server with OGC standard-compliant Web Mapping Service (WMS) and Web Coverage Service (WCS) calls. This back-end service should greatly enhance its expandability to integrate additional outside data-map sources.

Level 2↗

Exploring NASA OMI Level 2 Data With Visualization

Satellite data products are important for a wide variety of applications that can bring far-reaching benefits to the science community and the broader society. These benefits can best be achieved if the satellite data are well utilized and interpreted, such as model inputs from satellite, or extreme events (such as volcano eruptions, dust storms,... etc.). Unfortunately, this is not always the case, despite the abundance and relative maturity of numerous satellite data products provided by NASA and other organizations. Such obstacles may be avoided by allowing users to visualize satellite data as "images", with accurate pixel-level (Level-2) information, including pixel coverage area delineation and science team recommended quality screening for individual geophysical parameters. We present a prototype service from the Goddard Earth Sciences Data and Information Services Center (GES DISC) supporting Aura OMI Level-2 Data with GIS-like capabilities. Functionality includes selecting data sources (e.g., multiple parameters under the same scene, like NO2 and SO2, or the same parameter with different aggregation methods, like NO2 in OMNO2G and OMNO2D products), user-defined area-of-interest and temporal extents, zooming, panning, overlaying, sliding, and data subsetting, reformatting, and reprojection. The system will allow any user-defined portal interface (front-end) to connect to our backend server with OGC standard-compliant Web Mapping Service (WMS) and Web Coverage Service (WCS) calls. This back-end service should greatly enhance its expandability to integrate additional outside data/map sources.

Aura↗

American Meteorological Society (AMS) - The Modern Era Retrospective-Analysis for Research and Applications (MERRA) Data and Accessibility

The AM Short Course on The Modern Era Retrospective-analysis for Research and Applications (MERRA) data and accessibility will be held on January 11, 2009 preceding the 89th Annual Meeting in Phoenix, Arizona. Preliminary programs, registration, hotel, and general information will be posted on the AMS Web site in mid-September 2008. Retrospective-analyses (or reanalyses) have been established as an important tool in weather and climate research over the last decade. As computer power increases, the data assimilation and modeling systems improve and become more advanced, the input data quality increases and so reanalyses become more reliable. In 2008, NASA Global Modeling and Assimilation Office began producing a new reanalysis called the Modem Era Retrospective-analysis for Research and Applications (MERRA). The initial data from the reanalysis has been made available to the community and should be complete through 30 years (1979-present) by Fall of 2009. MERRA has taken advantage of the advancement of computing resources to provide users more data than previously available. The native spatial resolution is nominally 1/2 degrees and the surface two dimensional data are one hourly frequency. In addition to the meteorological analysis data, complete mass, energy and momentum budget data and also stratospheric data are provided. The eventual data holdings will exceed 150Tb. In order to facilitate user accessibility to the data, it will be stored in online hard drives (not tape storage) and available through several portals. Subsetting tools will also be available to allow users to tailor their data requests. The goals of this short course are to provide hands on users of reanalyses instruction on MERRA systems and also interactive experience with the online data and access tools. The course is intended for students and research scientists who will be actively interested in accessing and applying MERRA data in their weather, climate or applications work. The course has three parts. There will be an overview of the MERRA system, the validation of the system and the native data format. Second, Instructors will provide examples of weather and climate data analysis using various software packages (primarily GrADS) as well as the online access tools for subsetting and download, as well as visualization (e.g. Giovanni and Google Earth). This will also include examples on changing the data format to fit user's preferences and also to regrid the data for comparisons to other reanalyses and observational data. Lastly, there will he time set aside for participants to have hands on access to the data and software while interacting with the instructors and other developers. The course convener is Dr. Michael Bosilovich, NASA GSFC Global Modeling and Assimilation Office (GMAO). He will be joined by several GMAO, Goddard Earth Science Data and information Services Center (GES DISC) and Software Integration and Visualization Office (SIVO) staff.

daSilva, Arlindo↗

Flying the Earth Observing Constellations

Prior to the launch of the Earth Observing System (EOS) Terra and Landsat-7 satellites in 1999, the Project Scientists for the two missions and the Earth Science Data and Information System (ESDIS) Project at the Goddard Space Flight Center signed an inter-project agreement document describing their plan to fly in loose formation, approximately 20 minutes within each other. In November 2000, a technology demonstration satellite, Earth Observer-1 (EO-1), was launched into the same orbit as that of Landsat-7 and Terra, with a goal of flying within a minute from Landsat-7. The SAC-C satellite, developed and operated by the government of Argentina, was launched along with EO-1, with a goal of flying near both Terra and Landsat-7. This formation enables the scientists to make use of the scientific synergy among the instruments on the different spacecraft. This group of satellites constitutes the morning constellation, which is led by the Landsat-7, which has a mean local time (MLT) at 10:00 a.m. In May 2002, the EOS Aqua satellite was launched into an orbit with an altitude of 705 km. and a 1:30 p.m. MLT. Two smaller satellites, CALIPSO (a joint U.S./French mission), and CloudSat (a joint NASA/Colorado State University/Air Force mission), plan to fly in tight formation, within 15 seconds of each other. In addition, CALIPSO and CloudSat also plan to be within 30 to 60 seconds of the Aqua satellite. A third satellite, PARASOL, managed by the French Space Agency, CNES, will be placed within a minute of the CALIPSO satellite. In 2004, the Aura satellite will be launched and phased in relation to the Aqua satellite, such that the instruments on Aura will be able to view the same mass of air no later than 8 minutes after the instruments on Aqua have observed it. Representatives from each mission are currently documenting a plan on how they will coordinate on-orbit operations. Why are all these satellites planning to fly as a constellation? The answer is that as a constellation. the scientists will be able to acquire science data not only from their specific instruments on a single satellite, but science data from the other satellites which will have been taken at approximately the same time, thus resulting in coordinated science observation data. This leads to better quality science. This paper describes how the mission design has been driven by the science requirements. The morning and the afternoon constellations present operational challenges, which had not previously been encountered. Operations planning must address not only how the satellites of each constellation operate safely together, but also, how the two constellations fly on the same orbits without interfering with each other as they downlink data to their respective ground stations. This paper describes the operations experience gained from the morning constellation and the planning for the afternoon constellation.

Kelly, Angelita C.↗

Collaborative Platforms Aid Emergency Decision Making

Terra. Aqua. Cloudsat. Landsat. NASA runs and partners in many missions dedicated to monitoring the Earth, and the tools used in these missions continuously return data on everything from shifts in temperature to cloud formation to pollution levels over highways. The data are of great scientific value, but they also provide information that can play a critical role in decision making during times of crisis. Real-time developments in weather, wind, ocean currents, and numerous other conditions can have a significant impact on the way disasters, both natural and human-caused, unfold. "NASA has long recognized the need to make its data from real-time sources compatible and accessible for the purposes of decision making," says Michael Goodman, who was Disasters Program manager at NASA Headquarters from 2009-2012. "There are practical applications of NASA Earth science data, and we d like to accelerate the use of those applications." One of the main obstacles standing in the way of eminently practical data is the fact that the data from different missions are collected, formatted, and stored in different ways. Combining data sets in a way that makes them useful for decision makers has proven to be a difficult task. And while the need for a collaborative platform is widely recognized, very few have successfully made it work. Dave Jones, founder and CEO of StormCenter Communications Inc., which consults with decision makers to prepare for emergencies, says that "when I talk to public authorities, they say, If I had a nickel for every time someone told me they had a common operating platform, I d be rich. But one thing we ve seen over the years is that no one has been able to give end users the ability to ingest NASA data sets and merge them with their own."

Source record↗

Challenges in Development of Online Visualization and Analysis Tools for Satellite Data

Over the years, various online visualization and analysis tools have been developed to facilitate satellite data access and help scientific users around the world to conduct research and develop applications (e.g., data product evaluation, what-if questions, etc.). For those who are new to satellite data products, using them can be a daunting task due to many obstacles in data processing such as data formats, complex data structures, special software packages, unfamiliar terminology, etc., especially when one is not sure whether a dataset is suitable for his/er research project. Even for experienced users, developing software for data processing and analysis can be a costly and time-consuming task. Online visualization tools can overcome many of these difficulties and allow users to focus on scientific questions. For example, Giovanni (the Geospatial Interactive Online Visualization and Analysis Infrastructure, https://giovanni.gsfc.nasa.gov), developed by the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), allows access over 1900 satellite and model variables in 82 measurement groups of 8 disciplines without downloading data and software. Main features include basic functions for data analysis and visualization, data provenance, output data in different formats (ASCII, NetCDF, GeoTIFF), and more. Over the years, ~1700 peer-reviewed publications in different disciplines have been benefited from Giovanni in research activities (e.g. initial investigation, what-if questions, product evaluation). Despite the success of online visualization and analysis tools, challenges and new opportunities still exist and more can be done with new requirements and technology. Examples are: a) how to increase the efficiency of dataset search by enhancing intuitive aspects; b) how to facilitate interdisciplinary research; c) how to provide data quality information; d) how to engage users to participate in data quality assessment; and more. NASA Earth Observing System Data and Information System (EOSDIS) satellite-based data products are processed at various levels ranging from Level 0 to Level 4. While most users use data products at higher levels (Level-3 and 4), products at lower levels are still important for case studies, algorithm development, ground validation, etc. In this presentation, we will use Giovanni as an example to present and discuss challenges and near-future opportunities for satellite data online visualization and analysis tools.

Liu, Zhong↗

TPSAS-NF1676L-35698-DND

The NASA Langley Atmospheric Science Data Center (ASDC) is using the Esri ArcGIS Platform to improve data discoverability, accessibility and interoperability to meet their diversified userbase. As a NASA Distributed Active Archive Center (DAAC), ASDC is actively working to provide their atmospheric datasets as ArcGIS Image Services by leveraging the ArcGIS multidimensional suite of tools. This presentation will provide a brief overview of the ArcGIS Platform implementation at ASDC, an overview of the ArcGIS collaboration occurring among DAACs, as well as NASA Earth Science data application with partnering projects like the Prediction Of Worldwide Energy Resources (POWER).

Matthew Tisdale↗

Ultra-Compact Ka-Band Parabolic Deployable Antenna for RADAR and Interplanetary CubeSats

Over the past several years, technology and launch opportunities for CubeSats have exploded, enabling a wide variety of missions. However, as instruments become more complex and CubeSats travel deeper into space, data communication rates become an issue. To solve this challenge, JPL has initiated a research and technology development effort to design a 0.5 meter Ka-band parabolic deployable antenna (KaPDA) which would stow in 1.5U (10 x 10 x 15 cu cm) and provide 42dB of gain (50% efficiency). A folding rib architecture and dual reflector Cassegrainian design was selected as it best balances RF gain and stowed size. The design implements an innovative telescoping waveguide and gas powered deployment. RF simulations show that after losses, the antenna would have over 42 dB gain, supported by preliminary test results. KaPDA would create opportunities for a host of new CubeSat missions by allowing high data rate communication which would enable using high fidelity instruments or venturing further into deep space, including potential interplanetary missions. Additionally KaPDA would provide a solution for other small antenna needs and the opportunity to obtain Earth science data. This paper discusses the design challenges encountered, the architecture of the solution, and the antennas expected performance capabilities.

Sauder, Jonathan↗

Exploring Anomalous PM 2.5 from Wildfires and Dust Storms using Data and Services at NASA GES DISC

The presence of fine particles in the atmosphere with a diameter of less than 2.5 µm, called particulate matter 2.5 (PM 2.5 ), poses a significant threat to human health as a criteria air pollutant. Fortunately, NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC) provides easy access to several PM 2.5 concentration products. These datasets include the reanalysis of global hourly and monthly aerosol components including PM 2.5 data from the Modern-Era Retrospective analysis for Research and Applications, version 2 (MERRA-2), as well as 3-hourly real-time ensemble forecasts of PM 2.5 from the Hazardous Air Quality Ensemble System (HAQES). The HAQES products are developed by the George Mason University Air Quality Laboratory as part of NASA's Health Air Quality Applied Science Team (HAQAST). The GES DISC is actively collaborating with scientists in the HAQAST program to further expand air quality data collections. Two new datasets are currently being archived: one is the machine learning-based global hourly PM 2.5 derived from MERRA-2; the other is the localized data (NO 2 , O 3 , and PM 2.5 ) time series derived from NASA's GEOS Composition Forecasting (GEOS-CF) system. In this presentation, we will explore the spatial patterns and long-distance transport characteristics of elevated PM 2.5 during extreme pollution events, such as the June 2023 Canadian wildfires, which are still active at the time of writing; and severe spring dust storms in 2023 over Asia. To gain comprehensive insights, we will utilize various PM 2.5 data in conjunction with satellite-observed aerosol data from TROPOspheric Monitoring Instrument (TROPOMI) on Sentinel-5P. The primary focus of this presentation will be to demonstrate effective use of data tools and services to visualize and explore extreme air pollution phenomena. Additionally, we will provide guidance on how users can download specific data of interest, facilitating further analysis and research in this critical area.

air quality↗

HDF-EOS Web Server

A shell script has been written as a means of automatically making HDF-EOS-formatted data sets available via the World Wide Web. ("HDF-EOS" and variants thereof are defined in the first of the two immediately preceding articles.) The shell script chains together some software tools developed by the Data Usability Group at Goddard Space Flight Center to perform the following actions: Extract metadata in Object Definition Language (ODL) from an HDF-EOS file, Convert the metadata from ODL to Extensible Markup Language (XML), Reformat the XML metadata into human-readable Hypertext Markup Language (HTML), Publish the HTML metadata and the original HDF-EOS file to a Web server and an Open-source Project for a Network Data Access Protocol (OPeN-DAP) server computer, and Reformat the XML metadata and submit the resulting file to the EOS Clearinghouse, which is a Web-based metadata clearinghouse that facilitates searching for, and exchange of, Earth-Science data.

Ullman, Richard↗

TDRS-1 Going Strong at 20

This video presents an overview of the first Tracking and Data Relay Satellite (TDRS-1) in the form of text, computer animations, footage, and an interview with its program manager. Launched by the Space Shuttle Challenger in 1983, TDRS-1 was the first of a network of satellites used for relaying data to and from scientific spacecraft. Most of this short video is silent, and consists of footage and animation of the deployment of TDRS-1, written and animated explanations of what TDRS satellites do, and samples of the astronomical and Earth science data they transmit. The program manager explains in the final segment of the video the improvement TDRS satellites brought to communication with manned space missions, including alleviation of blackout during reentry, and also the role TDRS-1 played in providing telemedicine for a breast cancer patient in Antarctica.

Source record↗

Investigating Access Performance of Long Time Series with Restructured Big Model Data

Data sets generated by models are substantially increasing in volume, due to increases in spatial and temporal resolution, and the number of output variables. Many users wish to download subsetted data in preferred data formats and structures, as it is getting increasingly difficult to handle the original full-size data files. For example, application research users such as those involved with wind or solar energy, or extreme weather events are likely only interested in daily or hourly model data at a single point (or for a small area) for a long time period, and prefer to have the data downloaded in a single file. With native model file structures, such as hourly data from NASA Modern-Era Retrospective analysis for Research and Applications Version-2 (MERRA-2), it may take over 10 hours for the extraction of parameters-of-interest at a single point for 30 years. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is exploring methods to address this particular user need. One approach is to create value-added data by reconstructing the data files. Taking MERRA-2 data as an example, we have tested converting hourly data from one-day-per-file into different data cubes, such as one-month, or one-year. Performance is compared for reading local data files and accessing data through interoperable services, such as OPeNDAP. Results show that, compared to the original file structure, the new data cubes offer much better performance for accessing long time series. We have noticed that performance is associated with the cube size and structure, the compression method, and how the data are accessed. An optimized data cube structure will not only improve data access, but also may enable better online analysis services

reanalysis↗

TOLNet’s FAIR Journey: Yesterday, Today, and Tomorrow

The Tropospheric Ozone Lidar Network (TOLNet) has generated over a decade of ozone vertical profile data products over North America and contributed to several air quality focused field studies. The science value of the TOLNet data has been demonstrated in numerous peer-reviewed publications on air quality and ozone relevant research. As the broad scientific community has moved towards adopting FAIR Principles to make data more findable, accessible, interoperable, and (re)usable, the TOLNet team has been consistently making data more FAIR. This effort has many challenges, partially reflecting on the FAIR principles being domain agnostic while the implementation needs to be domain specific. The FAIR principles declare the dependence on the community standards, domain-relevant metadata, and rich metadata. This presentation uses the TOLNet data and data system as an example to explore the best practices to implement FAIR principle. Particularly, we will examine the metadata and the “richness” to support findability and usability as well as machine-to-machine actionability via API. Last year, as part of our FAIR journey, we launched the TOLNet website (https://tolnet.larc.nasa.gov/) and the API (https://tolnet.larc.nasa.gov/api/). Part of this process included extracting and cataloging metadata across the entire TOLNet mission timeframe. This enabled users to search through the mission by various metadata criteria, improving the findability and accessibility. And computers could connect directly to the TOLNet API to extract both metadata and data, providing a level of interoperability never present before for TOLNet data. On top of that, all new TOLNet data is now automatically validated using the API to ensure it complies with GEOMS standards, aiding in reusability. It takes both technology and scientists working together to make progress. The next step is to evaluate the current TOLNet offerings against NASA’s Practical Guide for Open, Free & FAIR NASA Earth Science Data Products (https://doi.org/10.5067/DOC/ESCO/ESDSWG-0002V1).

TOLNet↗