Engineering Papers⌕ Search

Engineering topics

Shen, Suhung

Publications and source records attributed to Shen, Suhung.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

Near 40 Years MERRA-2 Data at NASA GES DISC -Opportunity and Challenge to Support Extremes Study

To the end of 2019, 40 years NASA climate reanalysis data sets from the Modern Era Retrospective-analysis for Research and Applications, Version 2 (MERRA-2) will be available at NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). MERRA-2 consists atmosphere, land, and ocean data, which may be used for the studies ranging from the short scale weather events to the large scale decadal vulnerabilities. The hourly products, such as precipitation, soil moisture, temperature, and aerosols etc., have been used widely to study extreme events.In supporting users from broad communities, GES DISC have developed various data access services, including subsetter for downloading only data of interest with preferred format; OPeNDAP - for machine-to-machine data access; and Giovanni- for online visualization and analysis, etc. A big challenge for extreme study is to downloading and processing long-term hourly or daily data. The data downloading performance is not very satisfied by many users with current services and the native archived data structure. Late June 2019, many people in Europe had experienced extreme heat waves. The temperatures in several countries exceeded 40°C (104°F). For example, MERRA-2 shows that the near surface daily maximum temperature of June 28 2019 over Marseille, a city in southern France, reached 41.1 °C (106°F), which is the record breaking temperature in the last 40 years. GES DISC is working together with domain science experts to improve the performance of long time series access, making analysis ready data sets in supporting application researches, such as extreme study. In this presentation, using Europe heat wave as an example, we will show prototype of the in developing service for finding extremes from near 40 years MERRA-2 data at a given location. MERRA-2 data can be accessed from NASA GES DISC(https://disc.gsfc.nasa.gov/ ) by search keyword "MERRA-2".

Shen, Suhung↗
NASA NTRS2019

Long Term Potential Evapotranspiration and Evapotranspiration Data and Services at NASA GES DISC

Recently, the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has released global land 3-hourly Potential Evapotranspiration and Supporting Forcing Data Version-1 (PET_PU_3H025.001), at 0.25x0.25 degree spatial resolution, spanning the 23 year period from 1984 to 2006. The Version-2 will be released in the near future, covering longer time period. This dataset was generated by Professor Justin Sheffield through NASA Making Earth System Data Records for Use in Research Environments (MEaSUREs) project. Potential evapotranspiration (PET) is a representation of the environmental demand for evapotranspiration (ET). ET and PET are important part of the global water cycle estimation, and are also critical to advance our understanding of the climate system. NASA GES DISC archives and distributes various global and regional ET datasets from several projects, for example, Land Data Assimilation System (LDAS), Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2), other MEaSUREs Projects, such as Land Surface Atmospheric Boundary Interaction Product by William Rossow; and SRB/GEWEX evapotranspiration (Penman-Monteith) by Eric F. Wood. In this presentation, we will overview all available PET and ET datasets and services at GES DISC. As examples, climatology and some seasonal characteristics of PET and selected ET will be shown. The data can be accessed from NASA GES DISC (https://disc.gsfc.nasa.gov/) by searching keyword "evapotranspiration".

Shen, Suhung↗
NASA NTRS2019

Using GES DISC Data to Study Kilauea Volcano of 2018

Kilauea volcano in Hawaii which erupted in early May 2018 injected massive amount of SO2 and ash into the atmosphere. The lava flow during the eruption destroyed many home and neighborhoods. The SO2 plume during the eruption of Kilauea volcano is analyzed from May to August 2018 using multiple satellite products such as Level 2 TROPspheric Monitoring Instrument (TROPOMI) and Level 3 Ozone Monitoring Instrument (OMI) from the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). GES DISC hosts multi-disciplinary Earth science data sets that can be used to analyze natural disasters, such as the Kilauea volcano. Additionally, GES DISC's Giovanni tool can be used to visualize these data. We acquired OMI through the subsetting function, which is processed by the GES DISC in-house developed backend software Level3/4 Regrider and Subsetter (L34RS) and TROPOMI using OPeNDAP.Data from the OMI OMSO2e product showed elevated levels of SO2 amounts during the eruption between May to August 2018. Similarly, ground-based stations at Hawaii Volcanoes National Park recorded higher SO2 concentrations during the same time period. This study uses wind direction from Modern-Era Retrospective analysis for Research and Applications, version 2 (MERRA-2) to analyze the transport and dispersion of SO2 plume and map lava flows from the volcano using thermal images from Visible Infrared Imaging Radiometer Suite (VIIRS). Furthermore, satellite observations combined with socioeconomic and public health data are used to analyze its impact in public health.

KC, Binita↗
NASA NTRS2019

Planetary Boundary Layer Height from AIRS, MERRA-2, and GPS Radio Occultation Data Products at NASA GES DISC, and Insights from Their Profiles Intercomparison

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) provides archive and distribution services for several data products in the Planetary Boundary Layer (PBL) category. As a new variable added to the Atmospheric Infrared Sounder (AIRS) Version 6 support product, the PBL height from AIRS is derived based on the gradients of the retrieved relative humidity profile, and provides the atmospheric pressure at the top of the PBL over the ocean. The GES DISC also hosts the Modern-Era Retrospective analysis for Research and Applications-2 (MERRA-2) product generated by the Goddard Earth Observing System Model Version 5 (GEOS-5) data assimilation system. The PBL height from MERRA-2 is based on the total eddy diffusion coefficient of heat. The monthly PBL height has been made available in the Giovanni system (Giovanni is a Web-based application developed by the GES DISC providing a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science remote sensing data). Recently, the GES DISC began serving the global PBL height climatology product derived from the COSMIC/FORMOSAT-3 and TerraSAR-X Global Positioning System (GPS) radio occultation (RO) measurements from June 2006 to December 2015. In a previous study, we presented the monthly PBL height data from AIRS and MERRA-2 and demonstrated the GES DISC services which support data intercomparison, such as access, plotting, sub-setting, regridding, and generation of a multi-year monthly mean. We also provided intercomparison results, and found that different PBL height definitions contributed to significant differences of PBL height values between AIRS and MERRA-2. In this work, we present the 10-year seasonal climatologies from the AIRS, MERRA-2 and GPS-RO. We also used the cross section and vertical profile services in Giovanni to display and analyze the vertical atmosphere structure over regions where the PBL height derived from the AIRS and MERRA-2 are quite different. The examination of the AIRS and MERRA-2 three-dimensional data found that the relative humidity profiles had larger differences than the temperature profiles. The MERRA-2 gives more details than the AIRS for the vertical distribution of the humidity.

Ding, Feng↗
NASA NTRS2019

Learning from GES DISC's MLS and OMI Data Users: Metrics Matter

It has been over 15 years since Aura research satellite launched in 2004 to observe the Earth's ozone layer, air quality, and climate from four different instruments - the High Resolution Dynamics Limb Sounder (HIRDLS), the Microwave Limb Sounder (MLS), the Ozone Monitoring Instrument (OMI), and the Tropospheric Emission Spectrometer (TES). Observations from the Aura mission have established a concrete understanding of the changing chemistry of our atmosphere.The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is the official archive and distribution center for the HIRDLS, MLS, and OMI instruments. This presentation will report metrics of data usage and services on these instruments. Key to GES DISC's mission to provide better data support is gaining a better understanding of our users' needs and behaviors as they discover, access and utilize these data. We will summarize the users' needs from these instruments based on user inquiry information collected over the Aura mission lifetime and present findings from this ensemble metrics.

Metrics↗
NASA NTRS2019

MERRA-2 Data and Analytic Services at NASA GES DISC for Climate Extremes Study

NASA's climate reanalysis datasets from the Modern Era Retrospective-analysis for Research and Applications, Version 2 (MERRA-2) contains numerous long-term atmosphere, land, and ocean data products from 1980-present. MERRA-2 datasets, such as precipitation, soil moisture, and temperature, have been used widely to study extreme events. The native archived MERRA-2 data files are day-file (hourly time interval) and month-file, containing up to 125 parameters in one file. Due to the large number of data files and volumes, it is challenging for users, especially the applications research community, to handle the original hourly data files for long time periods to analyze extreme events. In this presentation, we review MERRA-2 data for studies of extreme conditions, and demonstrate analytic services at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). One of the current operational services, 'subsetter', allows users to download only specific data of interest, i.e. data selected by parameter, region, and time period. New services are under development that will provide more 'on-the-fly' statistical calculations when downloading data; improve efficiency when accessing long time-series data. We will provide additional "How-to" resources that include step-by-step instructions on data access and usage. We have tested restructuring of day-files in an optimized data cube, which has significantly improved system performance for accessing long time-series. Overall performance is associated with cube size and structure, data compression method, and how the data are accessed. The optimized data cube structure will enable better online analytic services for statistical analysis and extreme events mining. To demonstrate the service, we use an extreme drought associated with the anomalous 2016 monsoon over southern Asia. This prototype time-series service may be augmented in the cloud infrastructure in the future.

data access↗
NASA NTRS2019

Planetary Boundary Layer Height from AIRS and MERRA-2 Products at NASA GES DISC, and Insights from Data Intercomparison

The Atmospheric Infrared Sounder (AIRS) is the hyperspectral infrared sounder onboard NASA's Aqua satellite, launched in 2002. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), in collaboration with NASA Sounder Team at JPL, provides processing, archiving, and distribution services for NASA sounders: the Aqua AIRS mission and the subsequent Suomi-National Polar-orbiting Partnership Cross-track Infrared Sounder (CrIS) mission. The Planetary Boundary Layer (PBL) Height is a new variable added in the AIRS Version 6 support product. It is derived based on gradients of the retrieved atmospheric thermodynamic profile, and gives the pressure at the top of PBL over the ocean. The GES DISC also provides services for the second Modern-Era Retrospective analysis for Research and Applications (MERRA-2) product generated by the Goddard Earth Observing System Model, Version 5 (GEOS-5) data assimilation system. The monthly PBL Height variable has been available in the Giovanni system, which is a Web-based application developed by the GES DISC providing a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science remote sensing data. In this work, we will present the monthly PBL Height data from AIRS and MERRA-2 and the services to support data intercomparison, such as access, plotting, subsetting, re-gridding, and generation of a multi-year monthly mean. We will also show intercomparison results, and evaluate whether (over the ocean) AIRS can observe PBL features similar to the reanalysis product at monthly and longer-term scales.

AIRS↗
NASA NTRS2019

NASA GES DISC's Customized Services for Climatology and Meteorology

At the NASA Goddard Earth Sciences (GES) Data and Information Service Center (DISC), we have archived and distributed more than 2,400 Earth science data products, from different missions or projects containing more than 100 M data files/granules with a total volume size nearly 2 PB that broadly serve user needs in science areas such as Atmospheric Composition, Water & Energy Cycles and Climate Variability. To date, GES DISC has developed many pertinent services to facilitate the usage of data products by our research communities, represented by approximately 24,000 registered users. We are facing the big data with increasingly archival volume and data types, moreover, we also encounter increasing users' demands and the demands are more diversified. It is still a challenge for us to better understand exactly what our users' needs are, even after developing more than 70 services, including well-known online tools such as Giovanni and MERRA subsetter. In this presentation, we will try to address how we can accommodate the users' needs from two applicational user communities, Air Quality and Wind Energy, from data or service discovery to guide them properly utilize the data and services to fit their needs.

customizable services for climate and meteorology↗
NASA NTRS2018

Satellite and Reanalysis Air Quality Data and Services at NASA GES DISC for Public Health Study

Outbreaks of infectious diseases and health can be influenced by airborne and water-borne pollutants. Furthermore, air and water quality are associated with climate variability, industrialization, land use and land cover change, and water resource management. It is therefore crucial to understand environment-disease connections with existing long-term observed and modeled data, particularly for development of early warning systems for infectious disease outbreaks. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) (https://disc.gsfc.nasa.gov) archives large volumes of global environment data that are useful for research and applications regarding environmental factors and public health. Examples of air quality measurements are: Daily satellite remotely sensed data, including Aerosol Index (AI), O3, SO2, CO, and NO2 from Aura/OMI (October 2014 to present), and OMPS-NPP (January 2012 to present, currently research data products only) Hourly and monthly reanalysis modeled data, including PM2.5, O3, CO, SO2, BC, dust, AOD, and aerosol types from MERRA-2 (January 1980 to present) Examples of surface meteorology and land surface measurements are: hourly, daily, and monthly satellite precipitation from TRMM (December 1997 to March 2015) 30-minute and monthly satellite precipitation from GPM (March 2014 to present); Hourly and monthly modeled surface meteorology and land surface condition from MERRA-2 (January 1980 to present) and land surface assimilation models (January 1948 to present), including precipitation, surface temperature, relative humidity, wind, and soil moisture.This presentation will give an overview of relevant environmental data at the NASA GES DISC. Through a number of use cases, such as dust events and active fires, we will introduce data services that assist in finding the right data, enable visualization and analysis of the data online, and allow downloading of data in user-preferred format.

remote sensing data↗
NASA NTRS2018

Restructuring Big Data to Improve Data Access and Performance in Analytic Services Making Research More Efficient for the Study of Extreme Weather Events and Application User Communities

By developing and enhancing various services and tools, the GES DISC provides users with the capability to access and visualize data, and to make comparisons of data from multiple sensor and models via a number of cross-discipline projects. Discovering Data via Faceted Web Interface Web interface to data products and services Search and Download mechanisms Dataset Landing Pages Accessing Data through Interoperable Services: GDS – GrADS Data Server OPeNDAP - Open-source Project for a Network Data Access Protocol WMS – OGC service GIS connector – allowing IS tools to access data easier (coming soon) HTTPS -- direct online access Downloading Data Basics: Subset and egridding Service – Parameter, Spatial, Time, Vertical, Mean averaging, format conversion, and regridding for L3/L4 gridded data Swath Data Subsetter – Parameter, spatial subset of L2 /L1 data. Visualizing Data Online: Giovanni –Visualization and Analysis L3/L4 gridded data AIRS NRT Viewer – AIRS near-real-time DQVis – L2 data quality visualization

data cube↗
NASA NTRS2018

Studying Diurnal Variations of Aerosols with NASA MERRA-2 Reanalysis Data

Aerosols play an important role in atmospheric dynamics, climate variations, and Earth's energy cycle by altering the radiation balance in the atmosphere through interaction with clouds, providing fertilizer for forests and canopy, and as a supply of iron to the ocean over long time periods. Studies suggest that much of the feedback between dust aerosols and dynamics is associated with diurnal and synoptic scale variability. However, the lack of sub-daily resolution of aerosols from satellite observations makes it difficult to study the diurnal characteristics, especially over tropical and subtropical regions. Investigation of this topic utilizes over 37 years of simulated global aerosol products from NASA atmospheric reanalysis, in the second Modern-Era Retrospective analysis for Research and Applications (MERRA-2) data set, available from NASA Goddard Earth Science Data and Information Services Center (GES DISC). MERRA-2 covers the period 1980-present, and is continuing as an ongoing climate analysis. Aerosol assimilation is included throughout the period, using data from MODIS, MISR, AERONET, and AVHRR (in the pre-EOS period). The aerosols are assimilated using the MERRA-2 aerosol model, which interacts directly with radiation parameterization, and is radiatively coupled with atmospheric model dynamics in the Goddard Earth Observing System Model, Version 5 (GEOS-5). Hourly, monthly, and monthly diurnal data are available at spatial resolution of 0.5o x 0.625o (latitude x longitude). By using MERRA-2 hourly and monthly diurnal products, different aerosol diurnal variabilities are observed over North America, Africa, Asia, and Australia, that may be due to different meteorological conditions and aerosol sources. The presentation will also provide an overview of MERRA-2 data services at GES DISC, such as how to find and download data, and how to quickly visualize and analyze data online with Giovanni.

aerosol↗
NASA NTRS2018

Application of Aura OMI L2G Products Compared with NASA MERRA-2 Assimilation

The Ozone Monitoring Instrument (OMI) is one of the instruments aboard NASA's Aura satellite. It measures ozone total column and vertical profile, aerosols, clouds, and trace gases including NO2, SO2, HCHO, BrO, and OClO using absorption in the ultraviolet electromagnetic spectrum (280 - 400 nm). OMI Level-2G (L2G) products are based on the pixel-level OMI granule satellite measurements stored within global 0.25 deg. X 0.25 deg. grids, therefore they conserve all the Level 2 (L2) spatial and temporal details for 24 hours of scientific data in one file. The second Modern-Era Retrospective analysis for Research and Applications (MERRA-2) is NASA's atmospheric reanalysis, using an upgraded version of Goddard Earth Observing System Model, version 5 (GEOS-5) data assimilation system. MERRA-2 includes aerosol data reanalysis and improved representations of stratospheric ozone, compared with its predecessor MERRA, in both instantaneous and time-averaged collections. It is found that simply comparing satellite Level-3 products might cause biases, due to lack of detailed temporal and original retrieval information. It is therefore preferable to inter-compare or implement satellite derived physical quantities directly with/to model assimilation with as high temporal and spatial resolutions as possible. This study will demonstrate utilization of OMI L2G daily aerosol and ozone products by comparing them with MERRA-2 hourly aerosol/ozone simulations, matched in both space and time aspects. Both OMI and MERRA-2 products are accessible online through NASA Goddard Earth Sciences Data Information Services Center (GES DISC, https://disc.gsfc.nasa.gov/).

OMI L2G products↗
NASA NTRS2017

Investigating Access Performance of Long Time Series with Restructured Big Model Data

Data sets generated by models are substantially increasing in volume, due to increases in spatial and temporal resolution, and the number of output variables. Many users wish to download subsetted data in preferred data formats and structures, as it is getting increasingly difficult to handle the original full-size data files. For example, application research users such as those involved with wind or solar energy, or extreme weather events are likely only interested in daily or hourly model data at a single point (or for a small area) for a long time period, and prefer to have the data downloaded in a single file. With native model file structures, such as hourly data from NASA Modern-Era Retrospective analysis for Research and Applications Version-2 (MERRA-2), it may take over 10 hours for the extraction of parameters-of-interest at a single point for 30 years. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is exploring methods to address this particular user need. One approach is to create value-added data by reconstructing the data files. Taking MERRA-2 data as an example, we have tested converting hourly data from one-day-per-file into different data cubes, such as one-month, or one-year. Performance is compared for reading local data files and accessing data through interoperable services, such as OPeNDAP. Results show that, compared to the original file structure, the new data cubes offer much better performance for accessing long time series. We have noticed that performance is associated with the cube size and structure, the compression method, and how the data are accessed. An optimized data cube structure will not only improve data access, but also may enable better online analysis services

reanalysis↗
NASA NTRS2017

GES DISC Data Recipes in Jupyter Notebooks

The Earth Science Data and Information System (ESDIS) Project manages twelve Distributed Active Archive Centers (DAACs) which are geographically dispersed across the United States. The DAACs are responsible for ingesting, processing, archiving, and distributing Earth science data produced from various sources (satellites, aircraft, field measurements, etc.). In response to projections of an exponential increase in data production, there has been a recent effort to prototype various DAAC activities in the cloud computing environment. This, in turn, led to the creation of an initiative, called the Cloud Analysis Toolkit to Enable Earth Science (CATEES), to develop a Python software package in order to transition Earth science data processing to the cloud. This project, in particular, supports CATEES and has two primary goals. One, to transition data recipes created by the Goddard Earth Science Data and Information Service Center (GES DISC) into an interactive and educational environment using JupyterNotebooks. Two, to acclimate Earth scientists to cloud computing. To accomplish these goals, we create JupyterNotebooks to compartmentalize the different steps of data analysis and help users obtain and parse data from the command line. We also develop a Docker container, comprised of Jupyter Notebooks, Python dependencies, and command line tools, and configure it into an easy-to-deploy package. The end result is an end-to-end product that simulates the use case of end users working in the cloud computing environment.

discoverability↗
NASA NTRS2017

Online Visualization and Value Added Services of MERRA-2 Data at GES DISC

NASA climate reanalysis datasets from MERRA-2, distributed at the Goddard Earth Sciences Data and Information Services Center (GES DISC), have been used in broad research areas, such as climate variations, extreme weather, agriculture, renewable energy, and air quality, etc. The datasets contain numerous variables for atmosphere, land, and ocean, grouped into 95 products. The total archived volume is approximately 337 TB ( approximately 562K files) at the end of October 2017. Due to the large number of products and files, and large data volumes, it may be a challenge for a user to find and download the data of interest. The support team at GES DISC, working closely with the MERRA-2 science team, has created and is continuing to work on value added data services to best meet the needs of a broad user community. This presentation, using aerosol over Asia Monsoon as an example, provides an overview of the MERRA-2 data services at GES DISC, including: How to find the data? How many data access methods are provided? What are the best data access methods for me? How do download the subsetted (parameter, spatial, temporal) data and save in preferred spatial resolution and data format? How to visualize and explore the data online? In addition, we introduce a future online analytic tool designed for supporting application research, focusing on long-term hourly time-series data access and analysis.

Shen, Suhung↗
NASA NTRS2017

The Diverse Data, User Driven Services and the Power of Giovanni at NASA GES DISC

This presentation provides an overview of remote sensing and model data at GES (Goddard Earth Sciences) DISC (Data and Information Services Center); Overview of data services at GES DISC (Registration with NASA data system; Searching and downloading data); Giovanni (Geospatial Interactive Online VisualizationANd aNalysis Infrastructure): online data exploration tool; and NASA Earth Data and Information System.

model↗
NASA NTRS2017

A-Train Datalist - A New GES DISC Service to Allow One-Stop Shopping for A-Train Data

The currently available services at the Goddard Earth Sciences Data Information Services Center (GES DISC) only allow users to select variables from a single data set at a time. Because entire variables from a data set are often displayed, user selection of variables of interest can be overwhelming. At the American Geophysical Union (AGU) 2016 Fall Meeting, GES DISC unveiled a new service called Datalist: a collection of predefined or user-defined data variables from one or more archived data sets. Our science support team has been curating Datalists and providing added value to the user community.Originally known as Afternoon Constellation, A-Train includes six currently on polar-orbiting Earth observation satellites: OCO-2, GCOM-W1, Aqua, CALIPSO, CloudSat, and Aura, which travel a few minutes apart from each other. This constellation arrangement has enabled coordinated science observations further forming comprehensive pictures of Earth weather and climate that are readily for use in crucial studies such as climate change.GES DISC Datalists are based on the software architecture of the new GES DISC website (also unveiled at the AGU 2016 Fall Meeting). The GES DISC science support team has created a Datalist to support the A-Train Data Depot (ATDD). Using pre-defined Datalist should hopefully save users significant effort in their data searches.

A-Train data ordering↗