Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Earth science data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Robust Matching of Wavelet Features for Sub-Pixel Registration of Landsat Data

For many Earth and Space Science applications, automatic geo-registration at sub-pixel accuracy has become a necessity. In this work, we are focusing on building an operational system, which will provide a sub-pixel accuracy registration of Landsat-5 and Landsat-7 data. The input to our registration method consists of scenes that have been geometrically and radiometrically corrected. Such pre-processed scenes are then geo-registered relative to a database of Landsat chips. The method assumes a transformation composed of a rotation and a translation, and utilizes rotation- and translation-invariant wavelets to extract image features that are matched using statistically robust feature matching and a generalized Hausdorff distance metric. The registration process is described and results on four Landsat input scenes of the Washington, D.C. area are presented.

LeMoigne, Jacqueline↗

Dynamically Downscaled (WRF) 1km, Hourly Meteorological Conditions 1987-2020. East/Taylor Watersheds

This dataset contains meteorological output from the Weather Research and Forecasting (WRF) version 3.8.1. This dataset has been created to 1) investigate hydrometeorological processes impacting the East River and water-delivery to the Critical Zone, and 2) provide meteorological forcing data for distributed Earth-science modeling applications in the East River watershed. Variables have a 1 kilometer spatial resolution and hourly temporal resolution and encompass a rectangular region encompassing the East and Taylor River watersheds, Colorado, near the town of Crested Butte. WRF was forced using Climate Forecast System Reanalysis (CFSR) lateral boundary conditions. Each .zip file contains one "water year" of data (October 1 -- September 30; i.e. water year 2017 starts October 1, 2016 and ends September 30, 2017). Each zip folder contains 12 netcdf (.nc) files containing one month of hourly data each and are approximately 250mb. Model timestamps are in UTC time.The files contain the following data variables:EAST_MASK: binary mask of the watershed regionTAYLOR_MASK: binary mask of the watershed regionGLW downwelling longwave radiation (w/m2)HR_PRCP: Hourly Precipitation Rate (mm/hr). Includes all hydrometeors (solid+liquid). HFX NoahMP LSM total grid-cell modelled sensible heat flux (w/m2) [positive towards atmosphere]LH NoahMP LSM total grid-cell modelled latent heat flux (w/m2) [positive towards atmosphere; can be converted to ET]PSFC Surface Barometric Pressure (hPa)Q2 Two-meter specific humidity (kg/kg)SWDOWN Downwelling shortwave solar radiation (w/m2)SWNORM Terrain-normal downwelling shortwave radiation (w/m2)T2 Two-meter air temperature (deg K)U10 10-m U-component of wind velocity (m/s)V10 10m V-component of wind velocity (m/s)XLAT Latitude of grid-center point XLONG Longitude of grid-center point XTIME Model timestamp, **in UTC**

54 ENVIRONMENTAL SCIENCES↗

NASA Scientific Data Purchase Project: From Collection to User

NASA's Scientific Data Purchase (SDP) project is currently a $70 million operation managed by the Earth Science Applications Directorate at Stennis Space Center. The SDP project was developed in 1997 to purchase scientific data from commercial sources for distribution to NASA Earth science researchers. Our current data holdings include 8TB of remote sensing imagery consisting of 18 products from 4 companies. Our anticipated data volume is 60 TB by 2004, and we will be receiving new data products from several additional companies. Our current system capacity is 24 TB, expandable to 89 TB. Operations include tasking of new data collections, archive ordering, shipment verification, data validation, distribution, metrics, finances, customer feedback, and technical support. The program has been included in the Stennis Space Center Commercial Remote Sensing ISO 9001 registration since its inception. Our operational system includes automatic quality control checks on data received (with MatLab analysis); internally developed, custom Web-based interfaces that tie into commercial-off-the-shelf software; and an integrated relational database that links and tracks all data through operations. We've distributed nearly 1500 datasets, and almost 18,000 data files have been downloaded from our public web site; on a 10-point scale, our customer satisfaction index is 8.32 at a 23% response level. More information about the SDP is available on our Web site.

Nicholson, Lamar↗

SeaWiFS Technical Report Series: Satellite Primary Productivity Data and Algorithm Development: A Science Plan for Mission to Planet Earth - Volume 42

Two issues regarding primary productivity, as it pertains to the Sea-viewing Wide Field-of-view Sensor (SeaWiFS) Program and the National Aeronautics and Space Administration (NASA) Mission to Planet Earth (MTPE) are presented in this volume. Chapter 1 describes the development of a science plan for deriving primary production for the world ocean using satellite measurements, by the Ocean Primary Productivity Working Group (OPPWG). Chapter 2 presents discussions by the same group, of algorithm classification, algorithm parameterization and data availability, algorithm testing and validation, and the benefits of a consensus primary productivity algorithm.

Falkowski, Paul G.↗

Aurora Detection From Nighttime Lights for Earth and Space Science Applications

This research leverages data from the Day/Night Band (DNB) of the Visible Infrared Imaging Radiometer (VIIRS) instrument onboard the Suomi National Polar-orbiting Partnership (S-NPP) satellite. We demonstrate the value of mining the VIIRS DNB for aurora and describe our use of unsupervised machine learning to create a binary mask for aurora occurrence. This mask can be used to flag aurora-contaminated observations for NASA's nighttime lights products for Earth science applications. The identification of auroral regions can also be used for Space Weather applications, for example, for comparison with aurora forecast model and with other satellite- or ground-based aurora observations. The DNB is a broadband channel that is sensitive to wavelengths from 500 to 900 nm, which covers most of the visible light spectrum, and as the name implies, captures light even at night with a sensitivity at the nanowatt level. This band is suitable for aurora observations since the light emitted by the aurora tends to be dominated by emissions from atomic oxygen, resulting in a greenish glow at a wavelength of 557.7 nm, especially at an altitude of 110 km. This study compares the global nighttime derived aurora regions for 17 and 18 March with the NOAA Space Weather Prediction Center's (SWPC) probability product for the St. Patrick's Day geomagnetic storm in 2015. VIIRS sensors are slated to be added to the next generation of polar-orbiting operational satellites. Our novel automated approach to aurora identification opens up an efficient way to leverage this unique data source.

Aurora↗

The NASA Earth Science Program and Small Satellites

Earth's changing environment impacts every aspect of life on our planet and climate change has profound implications on society. Studying Earth as a single complex system is essential to understanding the causes and consequences of climate change and other global environmental concerns. NASA's Earth Science Division (ESD) shapes an interdisciplinary view of Earth, exploring interactions among the atmosphere, oceans, ice sheets, land surface interior, and life itself. This enables scientists to measure global and climate changes and to inform decisions by Government, other organizations, and people in the United States and around the world. The data collected and results generated are accessible to other agencies and organizations to improve the products and services they provide, including air quality indices, disaster prediction and response, agricultural yield projections, and aviation safety. ESD's Flight Program provides the spacebased observing systems and supporting infrastructure for mission operations and scientific data processing and distribution that support NASA's Earth science research and modeling activities. The Flight Program currently has 21 operating Earth observing space missions, including the recently launched Global Precipitation Measurement (GPM) mission, the Orbiting Carbon Observatory-2 (OCO-2), the Soil Moisture Active Passive (SMAP) mission, and the International Space Station (ISS) RapidSCAT and Cloud-Aerosol Transport System (CATS) instruments. The ESD has 22 more missions and instruments planned for launch over the next decade. These include first and second tier missions from the 2007 Earth Science Decadal Survey, Climate Continuity missions to assure availability of key climate data sets, and small-sized competitively selected orbital missions and instrument missions of opportunity belonging to the Earth Venture (EV) Program. Small satellites (~500 kg or less) are critical contributors to these current and future satellite missions. Some examples are the aforementioned Orbiting Carbon Observatory-2 (OCO-2), the Gravity Recovery and Climate Experiment Follow On (GRACE FO), and the Cyclone Global Navigation Satellite System (CYGNSS) microsatellite constellation. Small satellites also support ESD in space validation and risk reduction of enabling technologies (components and systems). The status of the ESD Flight Program and the role of small satellites will be discussed.

Earth Science Prog & Small Sat↗

The Suomi National Polar-Orbiting Partnership (SNPP): Continuing NASA Research and Applications

The Suomi National Polar-orbiting Partnership (SNPP) satellite was successfully launched into a polar orbit on October 28, 2011 carrying 5 remote sensing instruments designed to provide data to improve weather forecasts and to increase understanding of long-term climate change. SNPP provides operational continuity of satellite-based observations for NOAA's Polar-orbiting Operational Environmental Satellites (POES) and continues the long-term record of climate quality observations established by NASA's Earth Observing System (EOS) satellites. In the 2003 to 2011 pre-launch timeframe, NASA's SNPP Science Team assessed the adequacy of the operational Raw Data Records (RDRs), Sensor Data Records (SDRs), and Environmental Data Records (EDRs) from the SNPP instruments for use in NASA Earth Science research, examined the operational algorithms used to produce those data records, and proposed a path forward for the production of climate quality products from SNPP. In order to perform these tasks, a distributed data system, the NASA Science Data Segment (SDS), ingested RDRs, SDRs, and EDRs from the NOAA Archive and Distribution and Interface Data Processing Segments, ADS and IDPS, respectively. The SDS also obtained operational algorithms for evaluation purposes from the NOAA Government Resource for Algorithm Verification, Independent Testing and Evaluation (GRAVITE). Within the NASA SDS, five Product Evaluation and Test Elements (PEATEs) received, ingested, and stored data and performed NASA's data processing, evaluation, and analysis activities. The distributed nature of this data distribution system was established by physically housing each PEATE within one of five Climate Analysis Research Systems (CARS) located at either at a NASA or a university institution. The CARS were organized around 5 key EDRs directly in support of the following NASA Earth Science focus areas: atmospheric sounding, ocean, land, ozone, and atmospheric composition products. The PEATES provided the system level interface with members of the NASA SNPP Science Team and other science investigators within each CARS. A sixth Earth Radiation Budget CARS was established at NASA Langley Research Center (NASA LaRC) to support instrument performance, data evaluation, and analysis for the SNPP Clouds and the Earth's Radiant Budget Energy System (CERES) instrument. Following the 2011 launch of SNPP, spacecraft commissioning, and instrument activation, the NASA SNPP Science Team evaluated the operational RDRs, SDRs, and EDRs produced by the NOAA ADS and IDPS. A key part in that evaluation was the NASA Science Team's independent processing of operational RDRs and SDRs to EDRs using the latest NASA science algorithms. The NASA science evaluation was completed in the December 2012 to April 2014 timeframe with the release of a series of NASA Science Team Discipline Reports. In summary, these reports indicated that the RDRs produced by the SNPP instruments were of sufficiently high quality to be used to create data products suitable for NASA Earth System science and applications. However, the quality of the SDRs and EDRs were found to vary greatly when considering suitability for NASA science. The need for improvements in operational algorithms, adoption of different algorithmic approaches, greater monitoring of on-orbit instrument calibration, greater attention to data product validation, and data reprocessing were prominent findings in the reports. In response to these findings, NASA, in late 2013, directed the NASA SNPP Science Team to use SNPP instrument data to develop data products of sufficiently high quality to enable the continuation of EOS time series data records and to develop innovative, practical applications of SNPP data. This direction necessitated a transition of the SDS data system from its pre-launch assessment mode to one of full data processing and production. To do this, the PEATES, which served as NASA's data product testing environment during the prelaunch and early on-orbit periods, were transitioned to Science Investigator-led Processing Systems (SIPS). The distributed data architecture was maintained in this new system by locating the SIPS at the same institutions at which the CARS and PEATES were located. The SIPS acquire raw SNPP instrument Level 0 (i.e. RDR) data over the full SNPP mission from the NOAA ADS and IDPS through the NASA SDS Data Distribution and Depository Element (SD3E). The SIPS process those data into NASA Level 1, Level 2, and global, gridded Level 3 standard products using peer-reviewed algorithms provided by members of the NASA Science Team. The SIPS work with the NASA SNPP Science Team in obtaining enhanced, refined, or alternate real-time algorithms to support the capabilities of the Direct Readout Laboratory (DRL). All data products, algorithm source codes, coefficients, and auxiliary data used in product generation are archived in an assigned NASA Distributed Active Archive Center (DAAC).

remote sensing↗

High Angular Resolution Imaging of Solar Radio Bursts from the Lunar Surface

Locating low frequency radio observatories on the lunar surface has a number of advantages, including positional stability and a very low ionospheric radio cutoff. Here, we describe the Radio Observatory on the lunar Surface for Solar studies (ROLSS), a concept for a low frequency, radio imaging interferometric array designed to study particle acceleration in the corona and inner heliosphere. ROLSS would be deployed during an early lunar sortie or by a robotic rover as part of an unmanned landing. The preferred site is on the lunar near side to simplify the data downlink to Earth. The prime science mission is to image type II and type III solar radio bursts with the aim of determining the sites at and mechanisms by which the radiating particles are accelerated. Secondary science goals include constraining the density of the lunar ionosphere by measuring the low radio frequency cutoff of the solar radio emissions or background galactic radio emission, measuring the flux, particle mass, and arrival direction of interplanetary and interstellar dust, and constraining the low energy electron population in astrophysical sources. Furthermore, ROLSS serves a pathfinder function for larger lunar radio arrays. Key design requirements on ROLSS include the operational frequency and angular resolution. The electron densities in the solar corona and inner heliosphere are such that the relevant emission occurs below 10 M Hz, essentially unobservable from Earth's surface due to the terrestrial ionospheric cutoff. Resolving the potential sites of particle acceleration requires an instrument with an angular resolution of at least 2 deg at 10 MHz, equivalent to a linear array size of approximately one kilometer. The major components of the ROLSS array are 3 antenna arms, each of 500 m length, arranged in a Y formation, with a central electronics package (CEP) at their intersection. Each antenna arm is a linear strip of polyimide film (e.g., Kapton(TradeMark)) on which 16 single polarization dipole antennas are located by depositing a conductor (e.g., silver). The arms also contain transmission lines for carrying the radio signals from the science antennas to the CEP. Operations would consist of data acquisition during the lunar day, with data downlinks to Earth one or more times every 24 hours.

MacDowall, Robert J.↗

Automating the Processing of Earth Observation Data

NASA s vision for Earth science is to build a "sensor web": an adaptive array of heterogeneous satellites and other sensors that will track important events, such as storms, and provide real-time information about the state of the Earth to a wide variety of customers. Achieving this vision will require automation not only in the scheduling of the observations but also in the processing of the resulting data. To address this need, we are developing a planner-based agent to automatically generate and execute data-flow programs to produce the requested data products.

Golden, Keith↗

The NASA Earth Observing System (EOS) Terra and Aqua Mission Moderate Resolution Imaging Spectroradiometer (MODIS: Science and Applications

The Moderate Resolution Imaging Spectroradiometer (MODIS) on the Earth Observing System (EOS) Terra Mission began to produce data in February 2000. The EOS Aqua mission was launched successfully May 4,2002 with another MODIS on it and "first light" observations occurred on June 24,2002. The Terra MODIS is in a sun-synchronous orbit going north to south in the daylight portion of the orbit crossing the equator at about 1030 hours local time. The Aqua spacecraft operates in a sun-synchronous orbit going south to north in the daylight portion of the orbit crossing the equator at approximately 1330 hours local time. The spacecraft, instrument, and data systems for both MODIS instruments are performing well and are producing a wide variety of data products useful for scientific and applications studies in relatively consistent fashion extending from November 2000 to the present. Within the approximately 40 MODIS data products, several are new and represent powerful and exciting capabilities such the ability to provide observations over the globe of fire occurrences, microphysical properties of clouds and sun-stimulated fluorescence from phytoplankton in the surface waters of the ocean. The remainder of the MODIS products exceeds or, at a minimum, matches the capabilities of products from heritage sensors such as, for example, the Advanced Very High Resolution Radiometer (AVHRR). Efforts are underway to provide data sets for the greater Earth science community and to improve access to these products at the various Distributed Active Archive Centers (DAAC's) or through Direct Broadcast (DB) stations.

Salomnson, Vincent V.↗

Comparison of the MODIS and VIIRS Thermal Emissive Band Radiometric Calibration

Moderate Resolution Imaging Spectroradiometer (MODIS) and Visible Infrared Imaging Radiometer Suite (VIIRS) are major instruments for Earth science observations.Nearly 40 MODIS scientific products and a wide range of VIIRS environmental data records are produced using their global observations. The consistency of the MODIS and VIIRS calibrated data is important for the study of Earth science. This article assesses the calibration consistency of the Aqua MODIS and VIIRS thermal emissive band (TEB) data. To remove the impact of the mismatched relative spectral response (RSR) on the comparisons, the simultaneous nadir observation data from the cross-track infrared sounder (CrIS) and the infrared atmospheric sounding interferometer (IASI) are used as references in two different methods to independently verify the consistency. The comparisons of the MODIS and VIIRS TEB calibrated data show that the brightness temperature (BT) differences for comparable bands between MODIS and VIIRS are in general within 0.2 K for BT larger than 230 K. The differences of all comparable MODIS and VIIRS TEBs are consistent over time. MODIS measurements agree better with N20 VIIRS than with Suomi National Polar-orbiting Partnership (S-NPP) VIIRS. The S-NPP VIIRS measurements are higher than N20 VIIRS, within 0.1 Kfor long-wave infrared (LWIR) bands and 0.3 K for band M13.

Calibration↗

Applications of the massively parallel machine, the MasPar MP-1, to Earth sciences

The computational workload of upcoming NASA science missions, especially the ground data processing for the Earth Observing System, is projected to be quite large (in the 50 to 100 gigaFLOPS range) and corespondingly very expensive to perform using conventional supercomputer systems. High performance, general purpose massively parallel computer systems such as the MasPar MP-1 are being investigated by NASA as a more cost effective alternative. Massively parallel systems are targeted for accelerated development and maturation by NASA's upcoming five-year High Performance Computing and Communications Program. A summary of the broad range of applications currently running on the MP-1 at NASA/Goddard are presented in this paper along with descriptions of the parallel algorithmic techniques employed in five applications that have bearing on Earth sciences.

Fischer, James R.↗

FAIR data infrastructure and tools for AI-assisted streamflow prediction

Focal Area(s) Areas: We discuss how the integration of AI into Earth Science models can impact streamflow predictions at both the science and data levels. Doing so, we address cross-cutting needs related to the goal of making data FAIR (Findable, Accessible, Interoperable, and Re-usable [1]) for seamless use with Artificial Intelligence/Machine Learning (AI/ML) in Earth System Science at DOE. A novel idea is that AI/ML itself can help with the FAIR data goal and address issues in targeted areas e.g. missing data, data quality and reduction. In addition, the interpretability of results obtained with new AI methods is poised to impact broader scientific challenges in hydrology..

54 ENVIRONMENTAL SCIENCES↗

Enhancing Dataset Discovery and Usage Tracking in Earth Sciences: Integrating Knowledge Graphs and Large Language Models

NASA's Data Active Archive Centers (DAACs) have played a crucial role in supporting a wide range of applied research in Earth and Environmental sciences. To date, over 20,000 publications have been collected, citing more than 3,000 NASA Earth science datasets. We present an innovative approach that links datasets and collected publications through a knowledge graph (KG). This KG enables the tracking of dataset citations throughout the dataset's lifecycle, revealing patterns of dataset usage across various applied research areas. We fine-tuned the pre-trained NASA IMPACT INDUS-Base Retriever Large Language Model (LLM) using a set of labeled publication abstracts. Our results indicate that 87% of the publications were classified into one of twenty applied research areas, while the remaining 13% were categorized into non-applied research areas. The classified publications linked to datasets are used to discover datasets by users interested in specific applied research and by dataset providers to determine dataset usage for applications.

open-source↗

Simulating Atmospheric Processes in Earth System Models and Quantifying Uncertainties With Deep Learning Multi‐Member and Stochastic Parameterizations

Abstract Deep learning is a powerful tool to represent subgrid processes in climate models, but many application cases have so far used idealized settings and deterministic approaches. Here, we develop stochastic parameterizations with calibrated uncertainty quantification to learn subgrid convective and turbulent processes and surface radiative fluxes of a superparameterization embedded in an Earth System Model (ESM). We explore three methods to construct stochastic parameterizations: (a) a single Deep Neural Network (DNN) with Monte Carlo Dropout; (b) a multi‐member parameterization; and (c) a Variational Encoder Decoder with latent space perturbation. We show that the multi‐member parameterization improves the representation of convective processes, especially in the planetary boundary layer, compared to individual DNNs. The respective uncertainty quantification illustrates that methods (b) and (c) are advantageous compared to a dropout‐based DNN parameterization regarding the spread of convective processes. Hybrid simulations with our best‐performing multi‐member parameterizations remained challenging and crash within the first days. Therefore, we develop a pragmatic partial coupling strategy relying on the superparameterization for condensate emulation. Partial coupling reduces the computational efficiency of hybrid Earth‐like simulations but enables model stability over 5 months with our multi‐member parameterizations. However, our hybrid simulations exhibit biases in thermodynamic fields and differences in precipitation patterns. Despite this, the multi‐member parameterizations enable improvements in reproducing tropical extreme precipitation compared to a traditional convection parameterization. Despite these challenges, our results indicate the potential of a new generation of multi‐member machine learning parameterizations leveraging uncertainty quantification to improve the representation of stochasticity of subgrid effects.

Behrens, Gunnar [Deutsches Zentrum für Luft‐ und R↗

Land and Cryosphere Products from Suomi NPP VIIRS: Overview and Status

The Visible Infrared Imaging Radiometer Suite (VIIRS) instrument was launched in October 2011 as part of the Suomi National Polar-Orbiting Partnership (S-NPP). The VIIRS instrument was designed to improve upon the capabilities of the operational Advanced Very High Resolution Radiometer and provide observation continuity with NASA's Earth Observing System's Moderate Resolution Imaging Spectroradiometer (MODIS). Since the VIIRS first-light images were received in November 2011, NASA- and NOAA-funded scientists have been working to evaluate the instrument performance and generate land and cryosphere products to meet the needs of the NOAA operational users and the NASA science community. NOAA's focus has been on refining a suite of operational products known as Environmental Data Records (EDRs), which were developed according to project specifications under the National Polar-Orbiting Environmental Satellite System. The NASA S-NPP Science Team has focused on evaluating the EDRs for science use, developing and testing additional products to meet science data needs, and providing MODIS data product continuity. This paper presents to-date findings of the NASA Science Team's evaluation of the VIIRS land and cryosphere EDRs, specifically Surface Reflectance, Land Surface Temperature, Surface Albedo, Vegetation Indices, Surface Type, Active Fires, Snow Cover, Ice Surface Temperature, and Sea Ice Characterization. The study concludes that, for MODIS data product continuity and earth system science, an enhanced suite of land and cryosphere products and associated data system capabilities are needed beyond the EDRs currently available from the VIIRS.

Land Surface↗

A Guide to Using GitHub for Developing and Versioning Data Standards and Reporting Formats

Abstract Data standardization combined with descriptive metadata facilitate data reuse, which is the ultimate goal of the Findable, Accessible, Interoperable, and Reusable (FAIR) principles. Community data or metadata standards are increasingly created through an approach that emphasizes collaboration between various stakeholders. Such an approach requires platforms for collaboration on the development process that centers on sharing information and receiving feedback. Our objective in this study was to conduct a systematic review to identify data standards and reporting formats that use version control for developing data standards and to summarize common practices, particularly in earth and environmental sciences. Out of 108 data standards and reporting formats identified in our review, 32 used GitHub as the version control platform, and no other platforms were used. We found no universally accepted methodology for developing and publishing data standards. Many GitHub repositories did not use key features that could help developers to gather user feedback, or to create and revise standards that build on previous work. We provide guidance for community‐driven standard development and associated documentation on GitHub based on a systematic review of existing practices.

54 ENVIRONMENTAL SCIENCES↗