Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Climate Model Evaluation using New Datasets from the Clouds and the Earth's Radiant Energy System (CERES)

There are some in the science community who believe that the response of the climate system to anthropogenic radiative forcing is unpredictable and we should therefore call off the quest . The key limitation in climate predictability is associated with cloud feedback. Narrowing the uncertainty in cloud feedback (and therefore climate sensitivity) requires optimal use of the best available observations to evaluate and improve climate model processes and constrain climate model simulations over longer time scales. The Clouds and the Earth s Radiant Energy System (CERES) is a satellite-based program that provides global cloud, aerosol and radiative flux observations for improving our understanding of cloud-aerosol-radiation feedbacks in the Earth s climate system. CERES is the successor to the Earth Radiation Budget Experiment (ERBE), which has widely been used to evaluate climate models both at short time scales (e.g., process studies) and at decadal time scales. A CERES instrument flew on the TRMM satellite and captured the dramatic 1998 El Nino, and four other CERES instruments are currently flying aboard the Terra and Aqua platforms. Plans are underway to fly the remaining copy of CERES on the upcoming NPP spacecraft (mid-2010 launch date). Every aspect of CERES represents a significant improvement over ERBE. While both CERES and ERBE measure broadband radiation, CERES calibration is a factor of 2 better than ERBE. In order to improve the characterization of clouds and aerosols within a CERES footprint, we use coincident higher-resolution imager observations (VIRS, MODIS or VIIRS) to provide a consistent cloud-aerosol-radiation dataset at climate accuracy. Improved radiative fluxes are obtained by using new CERES-derived Angular Distribution Models (ADMs) for converting measured radiances to fluxes. CERES radiative fluxes are a factor of 2 more accurate than ERBE overall, but the improvement by cloud type and at high latitudes can be as high as a factor of 5. Diurnal cycles are explicitly resolved by merging geostationary satellite observations with CERES and MODIS. Atmospheric state data are provided from a frozen version of the Global Modeling and Assimilation Office- Data Assimilation System at the NASA Goddard Space Flight Center. In addition to improving the accuracy of top-of-atmosphere (TOA) radiative fluxes, CERES also produces radiative fluxes at the surface and at several levels in the atmosphere using radiative transfer modeling, constrained at the TOA by CERES (ERBE was limited to the TOA). In all, CERES uses 11 instruments on 7 spacecraft all integrated to obtain climate accuracy in TOA to surface fluxes. This presentation will provide an overview of several new CERES datasets of interest to the climate community (including a new adjusted TOA flux dataset constrained by estimates of heat storage in the Earth system), show direct comparisons between CERES ad ERBE, and provide a detailed error analysis of CERES fluxes at various time and space scales. We discuss how observations can be used to reduce uncertainties in cloud feedback and climate sensitivity and strongly argue why we should NOT "call off the quest".

Loeb, Norman G.↗

The SPoRT-WRF: Evaluating the Impact of NASA Datasets on Convective Forecasts

The Short-term Prediction Research and Transition Center (SPoRT) is a collaborative partnership between NASA and operational forecasting entities, including a number of National Weather Service offices. SPoRT transitions real-time NASA products and capabilities to its partners to address specific operational forecast challenges. One challenge that forecasters face is applying convection-allowing numerical models to predict mesoscale convective weather. In order to address this specific forecast challenge, SPoRT produces real-time mesoscale model forecasts using the Weather Research and Forecasting (WRF) model that includes unique NASA products and capabilities. Currently, the SPoRT configuration of the WRF model (SPoRT-WRF) incorporates the 4-km Land Information System (LIS) land surface data, 1-km SPoRT sea surface temperature analysis and 1-km Moderate resolution Imaging Spectroradiometer (MODIS) greenness vegetation fraction (GVF) analysis, and retrieved thermodynamic profiles from the Atmospheric Infrared Sounder (AIRS). The LIS, SST, and GVF data are all integrated into the SPoRT-WRF through adjustments to the initial and boundary conditions, and the AIRS data are assimilated into a 9-hour SPoRT WRF forecast each day at 0900 UTC. This study dissects the overall impact of the NASA datasets and the individual surface and atmospheric component datasets on daily mesoscale forecasts. A case study covering the super tornado outbreak across the Ce ntral and Southeastern United States during 25-27 April 2011 is examined. Three different forecasts are analyzed including the SPoRT-WRF (NASA surface and atmospheric data), the SPoRT WRF without AIRS (NASA surface data only), and the operational National Severe Storms Laboratory (NSSL) WRF (control with no NASA data). The forecasts are compared qualitatively by examining simulated versus observed radar reflectivity. Differences between the simulated reflectivity are further investigated using convective parameters along with model soundings to determine the impacts of the various NASA datasets. Additionally, quantitative evaluation of select meteorological parameters is performed using the Meteorological Evaluation Tools model verification package to compare forecasts to in situ surface and upper air observations.

Zavodsky, Bradley↗

Comparison Between NPP-VIIRS Aerosol Data Products and the MODIS AQUA Deep Blue Collection 6 Dataset Over Land

Aerosols are small particles suspended in the atmosphere and have a variety of natural and man-made sources. Knowledge of aerosol optical depth (AOD), which is a measure of the amount of aerosol in the atmosphere, and its change over time, is important for multiple reasons. These include climate change, air quality (pollution) monitoring, monitoring hazards such as dust storms and volcanic ash, monitoring smoke from biomass burning, determining potential energy yields from solar plants, determining visibility at sea, estimating fertilization of oceans and rainforests by transported mineral dust, understanding changes in weather brought upon by the interaction of aerosols and clouds, and more. The Suomi-NPP satellite was launched late in 2011. The Visible Infrared Imaging Radiometer Suite (VIIRS) aboard Suomi-NPP is being used, among other things, to determine AOD. This study compares the VIIRS dataset to ground-based measurements of AOD, along with a state-of-the-art satellite AOD dataset (the new version of the Moderate Resolution Imaging Spectrometer Deep Blue algorithm) to assess its reliability. The Suomi-NPP satellite was launched late in 2011, carrying several instruments designed to continue the biogeophysical data records of current and previous satellite sensors. The Visible Infrared Imaging Radiometer Suite (VIIRS) aboard Suomi-NPP is being used, among other things, to determine aerosol optical depth (AOD), and related activities since launch have been focused towards validating and understanding this new dataset through comparisons with other satellite and ground-based products. The operational VIIRS AOD product is compared over land with AOD derived from Moderate Resolution Imaging Spectrometer (MODIS) observations using the Deep Blue (DB) algorithm from the forthcoming Collection 6 of MODIS data

Sayer, Andrew M.↗

A High-Resolution Merged Wind Dataset for DYNAMO: Progress and Future Plans

In order to support research on optimal data assimilation methods for the Cyclone Global Navigation Satellite System (CYGNSS), launching in 2016, work has been ongoing to produce a high‐resolution merged wind dataset for the Dynamics of the Madden Julian Oscillation (DYNAMO) field campaign, which took place during late 2011/early 2012. The winds are produced by assimilating DYNAMO observations into the Weather Research and Forecasting (WRF) three‐dimensional variational (3DVAR) system. Data sources from the DYNAMO campaign include the upper‐air sounding network, radial velocities from the radar network, vector winds from the Advanced Scatterometer (ASCAT) and Oceansat‐2 Scatterometer (OSCAT) satellite instruments, the NOAA High Resolution Doppler Lidar (HRDL), and several others. In order the prep them for 3DVAR, significant additional quality control work is being done for the currently available TOGA and SMART‐R radar datasets, including automatically dealiasing radial velocities and correcting for intermittent TOGA antenna azimuth angle errors. The assimilated winds are being made available as model output fields from WRF on two separate grids with different horizontal resolutions ‐ a 3‐km grid focusing on the main DYNAMO quadrilateral (i.e., Gan Island, the R/V Revelle, the R/V Mirai, and Diego Garcia), and a 1‐km grid focusing on the Revelle. The wind dataset is focused on three separate approximately 2‐week periods during the Madden Julian Oscillation (MJO) onsets that occurred in October, November, and December 2011. Work is ongoing to convert the 10‐m surface winds from these model fields to simulated CYGNSS observations using the CYGNSS End‐To‐End Simulator (E2ES), and these simulated satellite observations are being compared to radar observations of DYNAMO precipitation systems to document the anticipated ability of CYGNSS to provide information on the relationships between surface winds and oceanic precipitation at the mesoscale level. This research will improve our understanding of the future utility of CYGNSS for documenting key MJO processes.

Lang, Timothy J.↗

Statistical Analysis of Large Simulated Yield Datasets for Studying Climate Effects

Many studies have been carried out during the last decade to study the effect of climate change on crop yields and other key crop characteristics. In these studies, one or several crop models were used to simulate crop growth and development for different climate scenarios that correspond to different projections of atmospheric CO2 concentration, temperature, and rainfall changes (Semenov et al., 1996; Tubiello and Ewert, 2002; White et al., 2011). The Agricultural Model Intercomparison and Improvement Project (AgMIP; Rosenzweig et al., 2013) builds on these studies with the goal of using an ensemble of multiple crop models in order to assess effects of climate change scenarios for several crops in contrasting environments. These studies generate large datasets, including thousands of simulated crop yield data. They include series of yield values obtained by combining several crop models with different climate scenarios that are defined by several climatic variables (temperature, CO2, rainfall, etc.). Such datasets potentially provide useful information on the possible effects of different climate change scenarios on crop yields. However, it is sometimes difficult to analyze these datasets and to summarize them in a useful way due to their structural complexity; simulated yield data can differ among contrasting climate scenarios, sites, and crop models. Another issue is that it is not straightforward to extrapolate the results obtained for the scenarios to alternative climate change scenarios not initially included in the simulation protocols. Additional dynamic crop model simulations for new climate change scenarios are an option but this approach is costly, especially when a large number of crop models are used to generate the simulated data, as in AgMIP. Statistical models have been used to analyze responses of measured yield data to climate variables in past studies (Lobell et al., 2011), but the use of a statistical model to analyze yields simulated by complex process-based crop models is a rather new idea. We demonstrate herewith that statistical methods can play an important role in analyzing simulated yield data sets obtained from the ensembles of process-based crop models. Formal statistical analysis is helpful to estimate the effects of different climatic variables on yield, and to describe the between-model variability of these effects.

climate↗

Long Term Cloud Property Datasets From MODIS and AVHRR Using the CERES Cloud Algorithm

Cloud properties play a critical role in climate change. Monitoring cloud properties over long time periods is needed to detect changes and to validate and constrain models. The Clouds and the Earth's Radiant Energy System (CERES) project has developed several cloud datasets from Aqua and Terra MODIS data to better interpret broadband radiation measurements and improve understanding of the role of clouds in the radiation budget. The algorithms applied to MODIS data have been adapted to utilize various combinations of channels on the Advanced Very High Resolution Radiometer (AVHRR) on the long-term time series of NOAA and MetOp satellites to provide a new cloud climate data record. These datasets can be useful for a variety of studies. This paper presents results of the MODIS and AVHRR analyses covering the period from 1980-2014. Validation and comparisons with other datasets are also given.

Minnis, Patrick↗

Explore Earth Science Datasets for STEM with the NASA GES DISC Online Visualization and Analysis Tool, Giovanni

The NASA Goddard Earth Sciences (GES) Data and Information Services Center(DISC) is one of twelve NASA Science Mission Directorate (SMD) Data Centers that provide Earth science data, information, and services to users around the world including research and application scientists, students, citizen scientists, etc. The GESDISC is the home (archive) of remote sensing datasets for NASA Precipitation and Hydrology, Atmospheric Composition and Dynamics, etc. To facilitate Earth science data access, the GES DISC has been developing user-friendly data services for users at different levels in different countries. Among them, the Geospatial Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni, http:giovanni.gsfc.nasa.gov) allows users to explore satellite-based datasets using sophisticated analyses and visualization without downloading data and software, which is particularly suitable for novices (such as students) to use NASA datasets in STEM (science, technology, engineering and mathematics) activities. In this presentation, we will briefly introduce Giovanni along with examples for STEM activities.

precipitation↗

The Quick Fire Emissions Dataset (QFED): Documentation of Versions 2.1, 2.2 and 2.4: Technical Report Series on Global Modeling and Data Assimilation - Volume 38

Biomass burning is an important source of particulates and trace gases and a major element of the terrestrial carbon cycle. Well constrained emissions from vegetation fires are needed to model direct and indirect effects of biomass burning aerosols, to model homogeneous and heterogeneous chemistry in the atmosphere, and to perform credible Earth system analysis, and climate and air pollution studies. To improve the performance of NASA Goddard Earth Observing System Model (GEOS) in the areas of atmospheric constituent modeling with a focus on biomass burning we developed the Quick Fire Emissions Dataset (QFED). The QFED emissions are based on the fire radiative power (top-down) approach and draw on the cloud correction method developed in the Global Fire Assimilation System (GFAS). Location and fire radiative power of fires are obtained from the Moderate Resolution Imaging Spectroradiometer (MODIS) Level 2 fire products (MOD14 and MYD14) and the MODIS Geolocation products (MOD03 and MYD03). QFED strengths are high spatial and temporal resolutions and near-real time availability. Daily mean emissions are available at 0.3125 times 0.25 degrees and in recent versions also at 0.1 times 0.1 degrees. QFED provides emissions of black carbon, organic carbon, sulfur dioxide, carbon monoxide, carbon dioxide, PM2.5, ammonia, nitrogen oxides, methyl ethyl ketone, propylene, ethane, propane, n- and i-butane, acetaldehyde, formaldehyde, acetone and methane. Two QFED product systems are maintained by the NASA Global Modeling and Assimilation Office (GMAO): one that produces near real-time daily emissions used operationally in the GEOS-5 Data Assimilation System, and one that produces an extended historical dataset with daily emissions from March 2000 to the present. The historical dataset also provides monthly mean and monthly climatological emissions.

Koster, Randal D.↗

Google Dataset Search and CMR

Searching for earth science data from scratch has, traditionally, been a non-trivial process. Using commercial search engines a starting point, it has not been trivial to locate information and services related to a science users needs. The advent of Google Dataset Search has improved that process. CMR has leveraged the schema.org dataset feature to provide semantic markup on our collection landing pages that are used by Google Dataset Search to provide results that map directly to a scientist's needs and provide an intuitive gateway in to the NASA Earthdata environment.

CMR↗

Google Dataset Search and CMR

Searching for earth science data from scratch has, traditionally, been a non-trivial process. Using commercial search engines a starting point, it has not been trivial to locate information and services related to a science users needs. The advent of Google Dataset Search has improved that process. CMR has leveraged the schema.org dataset feature to provide semantic markup on our collection landing pages that are used by Google Dataset Search to provide results that map directly to a scientist's needs and provide an intuitive gateway in to the NASA Earthdata environment.

Discovery↗

High Spectral Resolution Datasets of in Situ Aquatic Inherent and Apparent Optical Properties

Light emerging from natural water bodies and measured by remote sensing radiometers contains information about the local type and concentrations of phytoplankton, non-algal particles and colored dissolved organic matter in the underlying waters. An increase in spectral resolution in forthcoming satellite and airborne remote sensing missions is expected to lead to new or improved capabilities to characterize aquatic ecosystems. Such upcoming missions include NASA’s Plankton, Aerosol, Cloud, ocean Ecosystem PACE Mission; the NASA Surface Biology and Geology observable mission; and NASA Airborne Visible / Infrared Imaging Spectrometer (AVIRIS) - Next Generation airborne missions. In anticipation of these missions, we present a dataset of geographically diverse, quality-controlled, high spectral resolution inherent and apparent optical property (IOP/AOP) aquatic data. The data are intended to be of use to increase our understanding of aquatic optical properties, to develop aquatic remote sensing data product algorithms, and to perform calibration and validation activities for forthcoming aquatic-focused imaging spectrometry missions. The dataset is comprised of contributions from several investigators and investigating teams collected over a range of geographic areas and water types, including inland water, estuaries and oceans. Specific in situ measurements include particulate absorption, particulate attenuation, non-algal particulate or detritus absorption, colored dissolved organic matter absorption, phytoplankton absorption, total absorption, total attenuation, particulate backscattering, total backscatter, remote sensing reflectance, and irradiance reflectance. The dataset can be downloaded from PANGAEA: (https://www.pangaea.de/TBD ).

K A Casey↗

Microstructure Segmentation with Deep Learning Encoders Pre-Trained on a Large Microscopy Dataset

This study examined the improvement of microscopy segmentation accuracy by transfer learning from a large dataset of microscopy images called MicroNet. Many neural network encoder architectures, including VGG, Inception, and ResNet, were trained on over 100,000 labelled microscopy images from 54 classes. These pre-trained encoders were then embedded into multiple segmentation architectures including U-Net and DeepLabV3+ to evaluate segmentation performance on newly created benchmark microscopy datasets. Compared to ImageNet pre-training, models pre-trained on MicroNet generalized better to out-of-distribution micrographs taken under different imaging and sample conditions and were more accurate with less training data. When training with only a single Ni-superalloy image, pre-training on MicroNet produced a 72.2 percent reduction in relative segmentation error. These results suggest that transfer learning from large in-domain datasets generate models with learned feature representations that are more useful for downstream tasks and will likely improve any microscopy image analysis technique that can leverage pre-trained encoders.

machine learning↗

Scaling photosynthetic function and CO2 dynamics from leaf to canopy level for maize – dataset combining diurnal and seasonal measurements of vegetation fluorescence, reflectance and vegetation indices with canopy gross ecosystem productivity

Recent advances in leaf fluorescence measurements and canopy proximal remote sensing currently enable the non-destructive collection of rich diurnal and seasonal time series, which are required for monitoring vegetation function at the temporal and spatial scales relevant to the natural dynamics of photosynthesis. Remote sensing assessments of vegetation function have traditionally used actively excited foliar chlorophyll fluorescence measurements, canopy optical reflectance data and vegetation indices (VIs), and only recently passive solar induced chlorophyll fluorescence (SIF) measurements. In general, reflectance data are more sensitive to the seasonal variations in canopy chlorophyll content and foliar biomass, while fluorescence observations more closely relate to the dynamic changes in plant photosynthetic function. With this dataset we link leaf level actively excited chlorophyll fluorescence, canopy proximal reflectance and SIF, with eddy covariance measurements of gross ecosystem productivity (GEP). The dataset was collected during the 2017 growing season on maize, using three automated systems (i.e., Monitoring Pulse-Amplitude-Modulation fluorimeter, Moni-PAM; Fluorescence Box, FloX; and from eddy covariance tower). The data were quality checked, filtered and collated to a common 30 minutes timestep. We derived vegetation indices related to canopy functioning (e.g., Photochemical Reflectance Index, PRI; Normalized Difference Vegetation Index, NDVI; Chlorophyll Red-edge, Clre) to investigate how SIF and VIs can be coupled for monitoring vegetation photosynthesis. The raw datasets and the filtered and collated data are provided to enable new processing and analyses.

Petya Campbell↗

AI4MARS: A Dataset for Terrain-Aware Autonomy on Mars

Deep learning has quickly become a necessity for selfdriving vehicles on Earth. In contrast, the self-driving vehicles on Mars, including NASA’s latest rover, Perseverance, which is planned to land on Mars in February 2021, are still driven by classical machine vision systems. Deep learning capabilities, such as semantic segmentation and object recognition, would substantially benefit the safety and productivity of ongoing and future missions to the red planet. To this end, we created the first large-scale dataset, AI4Mars, for training and validating terrain classification models for Mars, consisting of ~326K semantic segmentation full image labels on 35K images from Curiosity, Opportunity, and Spirit rovers, collected through crowdsourcing. Each image was labeled by ~10 people to ensure greater quality and agreement of the crowdsourced labels. It also includes ~1.5K validation labels annotated by the rover planners and scientists from NASA’s MSL (Mars Science Laboratory) mission, which operates the Curiosity rover, and MER (Mars Exploration Rovers) mission, which operated the Spirit and Opportunity rovers. We trained a DeepLabv3 model on the AI4Mars training dataset and achieved over 96% overall classification accuracy on the test set. The dataset is made publicly available.1

Ono, Hiro↗

Microstructure Segmentation With Deep Learning Encoders Pre-Trained on a Large Microscopy Dataset

This study examined the improvement of microscopy segmentation intersection over union accuracy by transfer learning from a large dataset of microscopy images called MicroNet. Many neural network encoder architectures were trained on over 100,000 labeled microscopy images from 54 material classes. These pre-trained encoders were then embedded into multiple segmentation architectures including UNet and DeepLabV3+ to evaluate segmentation performance on created benchmark microscopy datasets. Compared to ImageNet pre-training, models pre-trained on MicroNet generalized better to out-of-distribution micrographs taken under different imaging and sample conditions and were more accurate with less training data. When training with only a single Ni-superalloy image, pre-training on MicroNet produced a 72.2% reduction in relative intersection over union error. These results suggest that transfer learning from large in-domain datasets generate models with learned feature representations that are more useful for downstream tasks and will likely improve any microscopy image analysis technique that can leverage pre-trained encoders.

machine learning↗

Making Dataset Quality Information FAIR: Supporting Open-Source Science and Enhancing (Re)Use and Trustworthiness of Scientific Data

- Quality information should be documented and readily shared within and across domains. - Sharing of dataset quality information supports open science and trustworthiness of scientific data. - Dataset quality is more than data quality. - Quality tends to be domain-specific and context-dependent. - Community guidelines provide practical steps towards FAIR dataset quality information.

Ge Peng↗

Recommendations on Funding Mission Operations and Historical Datasets

The Heliophysics Low Cost Access to Space (H-LCAS) and Flight Opportunities in Research and Technology (H-FORT) grant budgets primarily fund the development and construction of instrumentation. A side effect of this approach is that mission operations, including data collection and data processing, tend to be severely under budget (or unfunded). In order to satisfy the requirements of modern missions, we recommend a new funding source for mission operations. This funding source is increasingly vital going forward as new missions collect exponentially more data compared to past missions. Similarly, to take full advantage of underutilized historical datasets, we recommend adding another funding source to analyze these valuable datasets. Without these funding sources, mission datasets will, in the best case, be significantly underdeveloped and underutilized, and more likely, will fall dramatically short of their required scope.

Mykhaylo Shumko↗

The Multiplatform Precipitation Feature (MPF) Database: Synthesizing Satellite and Ground-Based Precipitation and Lightning Datasets for Convective Studies

NASA’s Lightning Imaging Sensor (LIS) and the Global Precipitation Measurement (GPM) mission have contributed a wealth of data toward global lightning and precipitation studies, respectively. Combining lightning and precipitation datasets leverages their unique insights into deep convective processes that inform about characteristics of convection and its intensity. Recent efforts to synthesize the LIS and GPM datasets prepare the opportunity for unprecedented large-scale, value-added multiplatform analyses of convection. This data synthesis proof-of-concept study elaborates on the creation of a database of reflectivity-based multiplatform precipitation features (MPFs) that capture a combination of information extracted from spatiotemporally coincident lightning and precipitation data within individual storm features. The space-based GPM Dual-frequency Precipitation Radar (DPR) provides a record of precipitation data, while the GPM Validation Network (VN) additionally incorporates ground-based polarimetric Doppler radar data to provide microphysical and kinematic context to DPR data. The LIS instrument onboard the International Space Station has contributed lightning observations since 2017. MPFs encapsulating information from these datasets are created from isolated regions of filtered, smoothed DPR reflectivity data to which ellipses are fit. Each MPF includes feature location, size, and eccentricity information as well as summary reflectivity characteristics. They also include summaries of precipitation microphysics and derived three-dimensional wind available from ground-based radar data. LIS data provides standard lightning characteristics such as flash count and density to each MPF as well as other informative metrics such as flash area and radiance. Each MPF file includes information about the original data from which the MPF and its characteristics were determined, allowing end-user reconstruction of the ellipse and deeper “level I” analysis of captured data. This database of VN-LIS MPFs enables broad statistical analysis of the relationships between the microphysical, kinematic, and electrical properties of convection. Preliminary results from a demonstration of the database will be described as well as ongoing efforts and avenues for future work.

Lightning↗