Engineering Papers⌕ Search

Engineering topics

Suhung Shen

Publications and source records attributed to Suhung Shen.

16 records
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Publishing Variables Archived at GES DISC to Earth System Grid Federation (ESGF)

We present a straightforward and low-cost approach to publish variables archived at NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) to the Earth System Grid Federation (ESGF). An ESGF publication requires a single standard-name variable aggregated over time to facilitate data inter-comparison. It also contains significant metadata to enable searching in ESGF. We look up standard names on high demand in ESGF search history, and using OPeNDAP and NcML technologies we aggregate the corresponding variables available in the GES DISC archive with augmented metadata required by CMIP6 and obs4MIPs Data Specification version 2.1. At this writing 10 variables from a standard product of the Atmospheric Infrared Sounder along with the Tech Notes are published in ESGF by NASA Center for Climate Simulation (NCCS). Users can view, analyze, and subset remotely, and download these aggregated variables via links in any ESGF node after searching. We plan to work on and publish more variables and data from different NASA missions and experiments in our archive.

Fan Fang↗
NASA NTRSDate not supplied

Updates of MERRA-2 Data and Services at NASA GES DISC

Over40 years of NASA climate reanalysis datasets from the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) are available at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). In addition to being used in traditional weather and climate research, MERRA-2 is also widely used in application studies of, e.g., wind and solar energy, air quality and health, food and drought, and heat waves. Two new MERRA-2 datasets were recently added at the GES DISC: (1) climate statistics derived fromMERRA-2 daily data to assist in the analysis of extreme temperature and precipitation events and of large-scale meteorological patterns from 1980 to the present and (2) gridded satellite and conventional observations processed in the MERRA-2 system, along with key statistics derived from the data assimilation, to help better understand how the quality of observations directly affect there analysis data. The GES DISC focuses its efforts on continually improving existing data services and to develop new data tools to satisfy various user communities. The newly added features include the following: Time series service: This is a new service for MERRA-2 data, which enables the easy and fast access of long-term hourly or daily time series at a location for popular parameters. The data is saved in a single le in Ascii format with a user- friendly structure. New analytic functions in the subsetter interface: Options for downloading daily minimum and maximum values have been added into the subsetter interface, in addition to the existing daily mean option, for all MERRA-2 and MERRA sub-daily products. Data format conversion to GeoTIFF has been implemented. New variables in Giovanni: Most monthly variables have been integrated into Giovanni, GESDISC’s online visualization and analysis tool. Due to the large data volume, hourly variables were selected based on user requests. More online information: New MERRA-2 documentation has been added: Data How-To, Data in Action, and FAQ. This presentation overviews two new MERRA-2 datasets and illustrates the new features of data services through a number of case studies. MERRA-2 data and services can be found at: https://disc.gsfc.gov/datasets?

Data management↗
NASA NTRSDate not supplied

Australian Bushfire in 2020: Accessing MERRA-2 Data in GES DISC Remotely through OPeNDAP & Calculating Statistics with Python3

The evolution and transport of thick haze from the 2020 Australian bushfire is tracked using the NASA Modern-Era Retrospective analysis for Research and Applications version 2 (MERRA-2) data archived at the NASA GES DISC data center. The MERRA-2 provides global data at 0.5 x 0.625 spatial resolution since the year 1980. In this use case, with xarray, a python3 library, we remotely accessed the hourly aerosol optical depth (AOD) and PM2.5 data through the OpeNDAP service provided by GES DISC. We also derived weekly data from hourly ones.

Xiaohua Pan↗
NASA NTRSDate not supplied

What (and How) MERRA-2 Reanalysis Data are Used in Applied Sciences

The Modern Era Retrospective-analysis for Research and Applications, Version 2 (MERRA-2) is the global atmospheric data reanalysis for the satellite era produced by NASA’s Global Modeling and Assimilation Office (GMAO), using the Goddard Earth Observing System Model (GEOS)version 5.12.4. The data are officially distributed by the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). MERRA-2 data have been widely used by the Earth sciences and application community. Since MERRA-2 data were released in early 2016, the number of registered data users has grown steadily from 1,252 in 2016 to 6477 in 2020. By the end of October 2021, ~16 petabytes (over 360 million files) of data have been distributed to more than 18,900 users. Searching in Google Scholar (https://scholar.google.com/), we have found over 7,000 articles, published between January 2017 and May 2021, involving the use ofMERRA-2 data. The figure shows the numbers for various application areas in which theMERRA-2 data have been used, covering almost all of the application areas defined in NASA Applied Sciences (http://appliedsciences.nasa.gov). The largest number of articles are found in disaster research, with the subcategories ordered in flood, wildfires, hurricanes and cyclones, and other forms of severe weather. In this presentation, we will discuss the preliminary findings from a review of the selected literature that uses MERRA-2 data in applied sciences. The current analytic and interoperable data services at GES DISC are listed, such as the on-the-fly subset and analysis service, NASA Giovanni; THREDDS Data Server(TDS); and Python Jupyter notebooks. In addition, we will introduce two new services for supporting the open sciences: My Dashboard and Related Publications.

data management↗
NASA NTRSDate not supplied

Study the Vertical Structure and Transportation of the Extreme African Dust Storms using MERRA-2 Data

The Modern-Era Retrospective Analysis for Research and Application, Version 2 (MERRA-2) provides the first long-term global reanalysis to assimilate space-based observations of aerosols and represents their interactions with other physical processes in the climate system. In this study, we have examined the variations of atmospheric aerosols for the last 20 years since 2002 using the sub-daily MERRA-2 data and found seven extreme African dust storms that were transported westward across the Atlantic Ocean from the Sahara, crossing 70o-80oW. In particular, the well-known ‘Godzilla’ dust storm occurred in June 2020, and its dust cloud, with the highest-on-record aerosol optical depths, was transported toward the Americas. This storm greatly degraded air quality over large areas of the Caribbean Basin and the United States. The air quality index reached unhealthy levels for sensitive groups in more than ten U.S. states. In our study, the vertical structure and transport characteristics of the dust layers during this extreme dust event are investigated. The geopotential height and temperature were found anomalously low (around 600 hPa) over the Atlantic Ocean off northwest Africa before the June 2020 dust storm. This anomalous circulation pattern was persistent for more than 12 days starting from around May 30, breaking the regular easterly waves that transport dust from the Sahara Desert to the west. To verify the data quality, daily MERRA-2 PM2.5 data were calculated and compared with PM2.5 observations from the U.S. Environmental Protection Agency (EPA) at several selected ground stations in Florida. We provide this case study to illustrate how to effectively use various MERRA-2 data services at Goddard Earth Sciences Data and Information Services Center (GES DISC) where MERRA-2 data are archived, hoping to help data users in exploring their own topics of interest using data services at GES DISC.

data management, reanalysis↗
NASA NTRSDate not supplied

Characterizing Wildfires in Western US.: A Cloud-based Case Study for Interdisciplinary Research using NASA Resources

This presentation will demonstrate a case study of interdisciplinary research done in the Amazon Web Services (AWS) cloud platform, in addition to in the local machine. We conduct data analysis next to data by leveraging various cloud-based data in NASA Earthdata Cloud, which are distributed by different missions/NASA Distributed Active Archive Centers (DAACs), and cloud computing resources at NASA. For instance, we directly access multiple datasets stored in the AWS Simple Storage Service (S3) buckets using a Python Jupyter notebook through a JupyterHub interface hosted in AWS (without having to download data), and conduct data analysis next to data in the cloud. We will also show how to share the research results following Open Source policy. This case study characterizes the change in wildfire events in the western United States during the past 20 years. In particular, we focus on the wildfires in California in 2021, one of the most severe wildfire years occurring in the most recent 20 years in California. We will analyze the possible causes of wildfires, such as drought conditions and climate variability, and examine the impacts of wildfires on air quality and atmospheric composition, and on land cover. We will examine the data distributed by the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), including aerosols and meteorological data from the NASA Modern-Era Retrospective analysis for Research and Applications version 2 (MERRA-2), precipitation from the Global Precipitation Measurement (GPM) and Global Precipitation Climate Project (GPCP), and aerosol index from Ozone Monitoring Instrument (OMI). We also utilize the data distributed by the Physical Oceanography (PO) DAAC, such as Sea Surface Temperature (SST) data from the Group for High Resolution Sea Surface Temperature (GHRSST), and the data distributed by Land Processes (LP) DAAC, such as Normalized Difference Vegetation Index (NDVI).

Xiaohua Pan↗
NASA NTRSDate not supplied

The NASA Merra-2 Reanalysis Products: Data and Tools Used for Aerosol and Air Quality Studies

The NASA Modern-Era Retrospective analysis for Research and Applications Version 2 (MERRA-2) is atmospheric reanalysis data spanning 1980 to present. It has been produced by the NASA Global Modeling and Assimilation Office (GMAO) and is distributed by the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). MERRA-2 data includes 100 collections of Earth system variables, mainly from the atmospheric model, such as aerosol fields and meteorological fields, radiation fields, and aerosol fields, guided by the assimilation of as many as six million observations every six hours. MERRA-2 has been one of the most popular datasets from NASA and is widely used in interdisciplinary research and applications, with increasing numbers of new users. For example, at least 7000 users accessed MERRA-2 data at GES DISC in the year 2021, ~1000 more users than in the year 2020. In this presentation, we will introduce the MERRA-2 datasets associated with aerosol and air quality studies and use a wildfire case study to demonstrate the data tools developed at GES DISC to analyze and visualize MERRA-2 data, such as Giovanni and the level 3 and level 4 subsetter, and Jupyter Python notebook. We will also update the status of cloud migration of the MERRA-2 data to Amazon Web Services (AWS).

Xiaohua Pan↗
NASA NTRSDate not supplied

Exploring Anomalous PM 2.5 from Wildfires and Dust Storms using Data and Services at NASA GES DISC

The presence of fine particles in the atmosphere with a diameter of less than 2.5 µm, called particulate matter 2.5 (PM 2.5 ), poses a significant threat to human health as a criteria air pollutant. Fortunately, NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC) provides easy access to several PM 2.5 concentration products. These datasets include the reanalysis of global hourly and monthly aerosol components including PM 2.5 data from the Modern-Era Retrospective analysis for Research and Applications, version 2 (MERRA-2), as well as 3-hourly real-time ensemble forecasts of PM 2.5 from the Hazardous Air Quality Ensemble System (HAQES). The HAQES products are developed by the George Mason University Air Quality Laboratory as part of NASA's Health Air Quality Applied Science Team (HAQAST). The GES DISC is actively collaborating with scientists in the HAQAST program to further expand air quality data collections. Two new datasets are currently being archived: one is the machine learning-based global hourly PM 2.5 derived from MERRA-2; the other is the localized data (NO 2 , O 3 , and PM 2.5 ) time series derived from NASA's GEOS Composition Forecasting (GEOS-CF) system. In this presentation, we will explore the spatial patterns and long-distance transport characteristics of elevated PM 2.5 during extreme pollution events, such as the June 2023 Canadian wildfires, which are still active at the time of writing; and severe spring dust storms in 2023 over Asia. To gain comprehensive insights, we will utilize various PM 2.5 data in conjunction with satellite-observed aerosol data from TROPOspheric Monitoring Instrument (TROPOMI) on Sentinel-5P. The primary focus of this presentation will be to demonstrate effective use of data tools and services to visualize and explore extreme air pollution phenomena. Additionally, we will provide guidance on how users can download specific data of interest, facilitating further analysis and research in this critical area.

air quality↗
NASA NTRSDate not supplied

Have Heat Waves Become More Intense and Frequent in North America in the Past 40 Years?

Extreme events, especially heat waves, have seemingly become more frequent and intense in the past decades worldwide, likely associated with global warming. This study uses the extreme detection indices product derived from the NASA Modern-Era Retrospective analysis for Research and Applications version 2 (MERRA-2) data to address whether heat waves have become more intense and frequent in North America in the past 40 years. We also examine in-depth the recent heat wave in June 2023 in Canada and the associated drought and wildfire events and compare them with previous years. We use additional data products in this study for cross-validation, including surface temperature from Phase 2 of the North American Land Data Assimilation System (NLDAS 2.0) and Atmospheric Infrared Sounder (AIRS) version 7, with a shorter data latency, only a few days. In addition, we will demonstrate how to efficiently conduct long-term time-series data analysis, which involves a large volume of data, using data services developed at NASA GES DISC, such as Giovanni, datarod, and Thematic Real-time Environmental Distributed Data Services (THREDDS) Data Server (TDS). These services can be used to visualize and explore extreme events, and to download only the data that is of interest.

Xiaohua Pan↗
NASA NTRSDate not supplied

Open Science Approach to Analyze Climate-Crop Relationships in the US Leveraging GES DISC and Galaxy Workflows

Understanding the intricate relationship between climate variability and agricultural production is crucial for ensuring food security. This study investigates the impact of climate parameters, such as temperature, precipitation, and soil moisture, on major US crop yields. Adopting an open science approach, the study analyzes the impact of climate on agricultural production in the United States. The Galaxy workflow engine serves as the primary tool for integrating climate data from the Goddard Earth Sciences Data and Information Services Center (GES DISC), retrieved via the Giovanni system, with yield statistics from the United States Department of Agriculture’s National Agricultural Statistics Service (USDA NASS). Extensions for reading, preprocessing, and analyzing external data have been developed, enabling the creation of workflows within the Galaxy platform. The development of a reproducible workflow allows for the calculation of seasonal climate averages, which are then assessed for their correlation with crop yields. This methodology ensures the replicability of the research, promoting transparency and collaboration in the scientific community. Correlational and regression analyses have been applied to different sub-zones and crops. The findings from this research offer valuable insights into the relationship between climate parameters and crop yields. These insights contribute to a deeper understanding of climate-crop relationships, providing a solid foundation for informed decision-making in the agricultural sector. The high correlation values indicate a significant relationship between climate parameters and crop yields, underscoring the importance of considering climate factors in agricultural planning and policymaking. This research also exemplifies the power of open science in advancing our understanding of complex environmental and agricultural phenomena. By leveraging open data and services, it provides a robust and replicable framework for future studies in this critical field.

Open science↗
NASA NTRSDate not supplied

Efficient Access to MERRA-2 Reanalysis Data from the Cloud Archives

The Modern-Era Retrospective analysis for Research and Applications, Version (MERRA-2) dataset is now available in the AWS West Region-2 cloud. The free data downloading policy remains unchanged. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) offers cloud services such as OPeNDP subsetting, and time series services. This presentation will showcase use cases that testing the procedures and find the most efficiency workflows to access and process the data for finding climate extremes. The use cases include a) accessing and processing data directly in the cloud S3 bucket without downloading it, and b) downloading subset data to process on the user’s local system.

data access, cloud computing, climate extremes↗
NASA NTRSDate not supplied

Cloud-Based Time Series Analysis of Extremes: Use Cases and Applications

"Extreme weather events, such as hurricanes, tornadoes, floods, droughts, heatwaves, and blizzards, can cause widespread damage, disrupting ecosystems, agricultural production, and economies. The frequency and intensity of these events have been increasing, likely due to climate change, raising concerns and the need for more accurate analysis and predictions. NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC) has migrated its long-term historical datasets, including precipitation data from MERRA-2 reanalysis, GLDAS land data assimilation, and IMERG satellite observations, to the cloud. This cloud-stored data enables scientists and researchers to utilize cloud computing for advanced modeling and forecasting of extreme weather events, eliminating the need to download large datasets. In this presentation, we will provide an overview of the cloud-based data and services managed by GES DISC; demonstrate methods for accessing and analyzing time series data stored in the cloud; and compare results across various datasets to address critical questions related to extreme precipitation. We will present use cases including: 1. Determining the average total precipitation in California during January and February from 2000 to 2024, and identifying anomalous precipitation in 2021. 2. Calculating the 10, 20, 50, and 100-year return periods for maximum daily rainfall based on 25 years of historical precipitation data (2000-2024) for Maryland.

time series↗