Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Climate Model Diagnostic Analyzer

The comprehensive and innovative evaluation of climate models with newly available global observations is critically needed for the improvement of climate model current-state representation and future-state predictability. A climate model diagnostic evaluation process requires physics-based multi-variable analyses that typically involve large-volume and heterogeneous datasets, making them both computation- and data-intensive. With an exploratory nature of climate data analyses and an explosive growth of datasets and service tools, scientists are struggling to keep track of their datasets, tools, and execution/study history, let alone sharing them with others. In response, we have developed a cloud-enabled, provenance-supported, web-service system called Climate Model Diagnostic Analyzer (CMDA). CMDA enables the physics-based, multivariable model performance evaluations and diagnoses through the comprehensive and synergistic use of multiple observational data, reanalysis data, and model outputs. At the same time, CMDA provides a crowd-sourcing space where scientists can organize their work efficiently and share their work with others. CMDA is empowered by many current state-of-the-art software packages in web service, provenance, and semantic search.

cloud computing↗

Re-Organizing Earth Observation Data Storage to Support Temporal Analysis of Big Data

The Earth Observing System Data and Information System archives many datasets that are critical to understanding long-term variations in Earth science properties. Thus, some of these are large, multi-decadal datasets. Yet the challenge in long time series analysis comes less from the sheer volume than the data organization, which is typically one (or a small number of) time steps per file. The overhead of opening and inventorying complex, API-driven data formats such as Hierarchical Data Format introduces a small latency at each time step, which nonetheless adds up for datasets with O(10^6) single-timestep files. Several approaches to reorganizing the data can mitigate this overhead by an order of magnitude: pre-aggregating data along the time axis (time-chunking); storing the data in a highly distributed file system; or storing data in distributed columnar databases. Storing a second copy of the data incurs extra costs, so some selection criteria must be employed, which would be driven by expected or actual usage by the end user community, balanced against the extra cost.

data storage↗

GES DISC Datalist Improves Earth Science Data Discoverability

At American Geophysical Union(AGU) 2016 Fall Meeting, Goddard Earth Sciences Data Information Services Center (GES DISC) unveiled a novel way to access data: Datalist. Currently, datalist is a collection of predefined data variables from one or more archived datasets, curated by our subject matter expert (SME). Our science support team has curated a predefined Hurricane Datalist and received very positive feedback from the user community. Datalist uses the same architecture our new website uses and have the same look and feel as other datasets on our web site. and also provides a one-stop shopping for data, metadata, citation, documentation, visualization and other available services. Since the last AGU Meeting, we have further developed a few new datalists corresponding to the Big Earth Data Initiative (BEDI) Societal Benefit Areas and A-Train data. We now have four datalists: Hurricane, Wind Energy, Greenhouse Gas and A-Train. We have also started working with our User Working Group members to create their favorite datalists and working with other DAAC to explore the possibility to include their products in our datalists that may also lead to a future of potential federated (cross-DAAC) datalists. Since our datalist prototype effort was a success, we are planning to make datalist operational. It's extremely important to have a common metadata model to support datalist, this will also be the foundation of federated datalist. We mapped our datalist metadata model to the unpublished UMM(Universal Metadata Model)-Var (Variable) (June version) and found that the UMM-var together with UMM-C (Collection) and possible UMM-S (Service) will meet our basic requirements. For example: Dataset shortname, and version are already specified in UMM-C, variable name, long name, units, dimensions are all specified in UMM-Var. UMM-Var also facilitates Science Keywords to allow tagging at variable level and Characteristics for optional variable characteristics. Measurements is useful for grouping of the variables and Set is promising to define datalist. And finally, the UMM-Service model to specify the available services for the variable will be very beneficial. In summary, UMM-Var, UMM-C and UMM-S are the basis of federated datalist and the development and deployment of datalist will contribute to the evolution of the UMM.

datalist↗

Limiting Data Friction by Reducing Data Download Using Spatiotemporally Aligned Data Organization Through STARE

Current data processing practice limits the volume and variety of relevant geoscience data that can practically be applied to important problems. File archives in centralized data centers are the principal means by which Earth Science data are accessed. This approach, however, requires laborious search, retrieval, and eventual customization/adaptation for the data to be used. Such fractionation makes it even more difficult to share outcomes, i.e. research artifacts and data products, hampering reusability and repeatability, since end users generally have their own research agenda and preferences as well as scarce resources. Thus, while finding and downloading data files from central data centers are already costly for end users working in their own field, using data products from other disciplines rapidly becomes prohibitive. This curtails scientific productivity, limits avenues of study, and endangers quality and reproducibility. The Spatio-Temporal Adaptive Resolution Encoding (STARE) is a unifying scheme that facilitates the indexing, access, and fusion of diverse Earth Science data. STARE implements an innovative encoding of geo-spatiotemporal information, originally developed for aligning datasets with diverse spatiotemporal characteristics in an array database. The spatial component of STARE recursively quadfurcates a root polyhedron, producing a hierarchical scheme for addressing geographic locations and regions. The temporal component of STARE uses conventional date-time units as an indexing hierarchy. The additional encoding of spatial and temporal resolution information in STARE enables comparisons and conditional selections across diverse datasets. Moreover, spatiotemporal set-operations, e.g. union and intersection, are mapped to efficient integer operations with STARE. Applied to existing data models (point, grid, spacecraft swath) and corresponding granules, STARE indexes provide a streamlined description usable as geo-spatiotemporal metadata. When coupled with large scale, distributed hardware and software, STARE-based data access reduces pre-analysis data preparation costs by offering a convenient means to align different datasets spatiotemporally without specialized effort in parallel computing or distributed data management.

Kuo, Kwo-Sen↗

A Method for Snow Reanalysis: The Sierra Nevada (USA) Example

This work presents a state-of-the art methodology for constructing snow water equivalent (SWE) reanalysis. The method is comprised of two main components: (1) a coupled land surface model and snow depletion curve model, which is used to generate an ensemble of predictions of SWE and snow cover area for a given set of (uncertain) inputs, and (2) a reanalysis step, which updates estimation variables to be consistent with the satellite observed depletion of the fractional snow cover time series. This method was applied over the Sierra Nevada (USA) based on the assimilation of remotely sensed fractional snow covered area data from the Landsat 5-8 record (1985-2016). The verified dataset (based on a comparison with over 9000 station years of in situ data) exhibited mean and root-mean-square errors less than 3 and 13 cm, respectively, and correlation greater than 0.95 compared with in situ SWE observations. The method (fully Bayesian), resolution (daily, 90-meter), temporal extent (31 years), and accuracy provide a unique dataset for investigating snow processes. This presentation illustrates how the reanalysis dataset was used to provide a basic accounting of the stored snowpack water in the Sierra Nevada over the last 31 years and ultimately improve real-time streamflow predictions.

Bayesian↗

NeMO-Net The Neural Multi-Modal Observation Training Network for Global Coral Reef Assessment

In the past decade, coral reefs worldwide have experienced unprecedented stresses due to climate change, ocean acidification, and anthropomorphic pressures, instigating massive bleaching and die-off of these fragile and diverse ecosystems. Furthermore, remote sensing of these shallow marine habitats is hindered by ocean wave distortion, refraction and optical attenuation, leading invariably to data products that are often of low resolution and signal-to-noise (SNR) ratio. However, recent advances in UAV and Fluid Lensing technology have allowed us to capture multispectral 3D imagery of these systems at sub-cm scales from above the water surface, giving us an unprecedented view of their growth and decay. Exploiting the fine-scaled features of these datasets, machine learning methods such as MAP, PCA, and SVM can not only accurately classify the living cover and morphology of these reef systems (below 8 error), but are also able to map the spectral space between airborne and satellite imagery, augmenting and improving the classification accuracy of previously low-resolution datasets.We are currently implementing NeMO-Net, the first open-source deep convolutional neural network (CNN) and interactive active learning and training software to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology. NeMO-Net will be built upon the QGIS platform to ingest UAV, airborne and satellite datasets from various sources and sensor capabilities, and through data-fusion determine the coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. To achieve this, we will exploit virtual data augmentation, the use of semi-supervised learning, and active learning through a tablet platform allowing for users to manually train uncertain or difficult to classify datasets. The project will make use of Pythons extensive libraries for machine learning, as well as extending integration to GPU and High-End Computing Capability (HECC) on the Pleiades supercomputing cluster, located at NASA Ames. The project is being supported by NASAs Earth Science Technology Office (ESTO) Advanced Information Systems Technology (AIST-16) Program.

Remote Sensin↗

Global Satellite Observations for Smart Cities

The smart city approach requires collection of interdisciplinary data and information from multiple sources and integration with modern technologies to provide a new and cost-effective way for researchers and decision makers to study and manage cities. In this book chapter, we introduce NASA satellite-based global and regional observations with emphasis on the hydrologic cycle (e.g., precipitation, wind, temperature, soil moisture) for smart cities. These products, consisting of both near-real-time and historical datasets, are publicly available free of charge and can be used for global and regional research and applications. Examples of using these datasets in smart cities are included. The chapter is organized as follows, first, a brief overview of NASA global satellite-based data products, followed by data services and tools, two examples of using satellite-based datasets in megacities, and finally summary and future plans.

hydrology↗

Spatial Variations in Titan's Atmospheric Temperature: ALMA and Cassini Comparisons from 2012 to 2015

Submillimeter emission lines of carbon monoxide (CO) in Titan's atmosphere provide excellent probes of atmospheric temperature due to the molecule's long chemical lifetime and stable, well constrained volume mixing ratio. Here we present the analysis of 4 datasets obtained with the Atacama Large Millimeter/Submillimeter Array (ALMA) in 2012, 2013, 2014, and 2015 that contain strong CO rotational transitions. Utilizing ALMA's high spatial resolution in the 2012, 2014, and 2015 observations, we extract spectra from 3 separate regions on Titan's disk using datasets with beam sizes ranging from 0.35 ×0.28'' to 0.39 ×0.34''. Temperature profiles retrieved by the NEMESIS radiative transfer code are compared to Cassini Composite Infrared Spectrometer (CIRS) and radio occultation science results from similar latitude regions. Disk-averaged temperature profiles stay relatively constant from year to year, while small seasonal variations in atmospheric temperature are present from 2012 to 2015 in the stratosphere and mesosphere ( approx. 100-500 km) of spatially resolved regions. We measure the stratopause (320 km) to in- crease in temperature by 5 K in northern latitudes from 2012 to 2015, while temperatures rise throughout the stratosphere at lower latitudes. We observe generally cooler temperatures in the lower stratosphere ( approx. 100 km) than those obtained through Cassini radio occultation measurements, with the notable exception of warming in the northern latitudes and the absence of previous instabilities; both of these results are indicators that Titan's lower atmosphere responds to seasonal effects, particularly at higher latitudes. While retrieved temperature profiles cover a range of latitudes in these observations, deviations from CIRS nadir maps and radio occultation measurements convolved with the ALMA beam-footprint are not found to be statistically significant, and discrepancies are often found to be less than 5 K throughout the atmosphere. ALMA's excellent sensitivity in the lower stratosphere (60-300 km) provides a highly complementary dataset to contemporary CIRS and radio science observations, including altitude regions where both of those measurement sets contain large uncertainties. The demonstrated utility of CO emission lines in the submillimeter as a tracer of Titan's atmospheric temperature lays the groundwork for future studies of other molecular species -particularly those that exhibit strong polar abundance enhancements or are pressure-broadened in the lower atmosphere, as temperature profiles are found to consistently vary with latitude in all three years by up to 15 K.

Thelen, Alexander E.↗

GeneLab: "Omics" Data Systems for Spaceflight and Simulated Spaceflight Environment

NASA's GeneLab Data System is a repository that hosts multi-omics datasets generated by biological experiments flown onboard the International Space Station. Strategies regarding how GeneLab envisions the involvement of the scientific community and the public at large will be discussed, and current and future capabilities of the system will be described. Information describing how scientists can participate in analyzing the current datasets on plants, microbes, invertebrates or mammals will be provided, and initial findings from the current datasets will be discussed during this presentation. Anyone interested in genomics, transcriptomics, epigenomics and proteomics, and systems biology, or who is curious to understand how space modifies living organisms should attend.

Omics↗

A Statistical Study of Solar Particle Events in Flux and Dose

The high-energy protons from solar energetic particle (SEP) events present a hazard to space systems: damage to science instruments/electronics/materials or to astronauts. A reliable estimate of the high-energy proton environment is critical to assure mission success. Important characteristics of an SEP event are fluence, peak flux, energy spectrum, time to reach the peak flux, time to reach peak dose, and properties of the cumulative dose profile after an event starts. All of these characteristics are important to understand in order to design space missions properly for both robotic and human missions. Because of the unpredictable and sporadic nature of SEP events, statistical models are often used to represent the SEP parameters described above. In a study by Jun et al. (2007), the statistics of event fluences, durations, and time intervals between events were investigated using the then available historical SEP dataset obtained from the instruments onboard the IMP-8 spacecraft. Since then, a more comprehensive SEP dataset based off of IMP-8 and GOES called Reference Data Set Version 2.0 (RDSv2.0) has become available covering the SEP events up to Year 2015 under a framework of the European Space Agency's (ESA's) Solar Energetic Particle Environment Modelling (SEPEM) project (Jiggens et al., 2018). The main objectives of this statistical study of SEP events are two-fold: First, the statistics of peak fluxes, event fluences, durations, and time intervals will be re-visited by using RDSv2.0; Second, the statistical analyses of flux and dose timing will be performed using the same dataset RDSv2.0. The results of this study will address the statistical properties of all key parameters for designing a spacecraft or a human mission where the SEP environment is an important consideration.

Whitman, K.↗

GeneLab: Omics Database for Spaceflight Experiments

Motivation - To curate and organize expensive spaceflight experiments conducted aboard space stations and maximize the scientific return of investment, while democratizing access to vast amounts of spaceflight related omics data generated from several model organisms. Results - The GeneLab Data System (GLDS) is an open access database containing fully coordinated and curated "omics" (genomics, transcriptomics, proteomics, metabolomics) data, detailed metadata and radiation dosimetry for a variety of model organisms. GLDS is supported by an integrated data system allowing federated search across several public bioinformatics repositories. Archived datasets can be queried using full-text search (e.g., keywords, Boolean and wildcards) and results can be sorted in multifactorial manner using assistive filters. GLDS also provides a collaborative platform built on GenomeSpace for sharing files and analyses with collaborators. It currently houses 172 datasets and supports standard guidelines for submission of datasets, MIAME (for microarray), ENCODE Consortium Guidelines (for RNA-seq) and MIAPE Guidelines (for proteomics).

omics↗

Multi-Model Mean Nitrogen and Sulfur Deposition from the Atmospheric Chemistry and Climate Model Intercomparison Project (ACCMIP): Evaluation of Historical and Projected Future Changes

We present multi-model global datasets of nitrogen and sulfate deposition covering time periods from 1850 to 2100, calculated within the Atmospheric Chemistry and Climate Model Intercomparison Project (ACCMIP). The computed deposition fluxes are compared to surface wet deposition and ice core measurements.We use a new dataset of wet deposition for 2000-2002 based on critical assessment of the quality of existing regional network data. We show that for present day (year 2000 ACCMIP time slice), the ACCMIP results perform similarly to previously published multi-model assessments. For this time slice, we find a multimodel mean deposition of approximately 50 Tg(N) yr−1 from nitrogen oxide emissions, 60 Tg(N) yr−1 from ammonia emissions, and 83 Tg(S) yr−1 from sulfur emissions. The analysis of changes between 1980 and 2000 indicates significant differences between model and measurements over the United States but less so over Europe. This difference points towards a potential misrepresentation of 1980 NH3 emissions over North America. Based on ice core records, the 1850 deposition fluxes agree well with Greenland ice cores, but the change between 1850 and 2000 seems to be overestimated in the Northern Hemisphere for both nitrogen and sulfur species. Using the Representative Concentration Pathways (RCPs) to define the projected climate and atmospheric chemistry related emissions and concentrations, we find large regional nitrogen deposition increases in 2100 in Latin America, Africa and parts of Asia under some of the scenarios considered. Increases in South Asia are especially large, and are seen in all scenarios, with 2100 values more than double their 2000 counterpart in some scenarios and reaching >1300 mg(N)m−2 yr−1 averaged over regional to continental-scale regions in RCP 2.6 and 8.5, 30-50% larger than the values in any region currently (circa 2000). However, sulfur deposition rates in 2100 are in all regions lower than in 2000 in all the RCPs. The new ACCMIP multimodel deposition dataset provides state-of-the-science, consistent and evaluated time slice (spanning 1850-2100) global gridded deposition fields for use in a wide range of climate and ecological studies.

Lamarque, J.-F.↗

How to Leverage the Power of SAR Observations for Forest Monitoring Systems

Earth observations from Synthetic Aperture Radar (SAR) can provide unique observations related to forest structure and condition. Furthermore, SAR has many potential applications in forest monitoring systems, particularly where clouds have impeded optical observations. Currently, there is a reliable, freely-available, provision of SAR datasets, such as Sentinel-1, and there are plans to have more observations in the near- future (NISAR, BIOMASS). Given SAR’s enhanced earth observation characteristics, there is broad interest in using SAR datasets for decision support systems, such as deforestation early warning systems. However, applications of SAR are still underutilized. What is preventing users from using SAR data in their decision support systems? This study documents the experiences and lessons learned from the SERVIR network on the main limitations of incorporating SAR datasets into existing forest monitoring systems. This research also focuses on the major technical and scientific barriers we experience and best practices to address them. The results of this study are part of the SERVIR- SilvaCarbon collaboration. The primary goal of this collaboration is to build capacity in the applied use of SAR for forest monitoring and biomass estimation. The products of this effort aim to start closing the gap between SAR-science and forest applications. We will also present results to generate applied-ready knowledge for SAR.

SAR↗

Estimation of Seasonal Snow Water Equivalent Using Landsat Observations

This work presents a methodology for estimating seasonal snow water equivalent (SWE) from the use of remotely sensed Visible and Near Infrared observations from the Landsat mission. The method is comprised of two main components: (1) a coupled land surface model and snow depletion curve model, which is used to generate an ensemble of predictions of SWE and snow cover area for a given set of (uncertain) inputs, and (2) a reanalysis step, which updates estimation variables to be consistent with the satellite observed depletion of the fractional snow cover time series. This method was applied over the Sierra Nevada (USA) based on the assimilation of remotely sensed fractional snow covered area data over the Landsat 5-8 record (1985-2016). The verified dataset (based on a comparison with over 9000 station years of in situ data) exhibited mean and root-mean-square errors less than 3 and 13 cm, respectively, and correlations with in situ SWE observations of greater than 0.95. The method (fully Bayesian), resolution (daily, 90-meter), temporal extent (32 years), and accuracy provide a unique dataset for investigating snow processes. In particular, this presentation illustrates how the reanalysis dataset was used to provide climatology of the seasonal snowfall accumulation rates, distributions, and variability over the last three decades.

SWE↗

An Update on GPM and TRMM Data Services at NASA GES DISC

The Goddard Earth Sciences (GES) Data and Information Services Center (DISC) is home to data archives of the NASA-JAXA Global Precipitation Measurement (GPM), the Tropical Rainfall Measuring Mission (TRMM), and other NASA missions and projects. To maximize the use of NASA data products in scientific research and applications as well as for societal benefits, we provide data and information services that make datasets easy to find and use through simplification of data access for users at all levels around the world. Over the years, user-friendly data services have been developed at GES DISC, including data subsetting, format conversion, online visualization and analysis (i.e. Giovanni), user support system, etc. We routinely analyze questions, feedback, and use cases from users and algorithm developers around the world as well as best practices and new technology to improve existing services and formulate new data services. Interaction between users and algorithm developers is an important process for identifying issues in products, collecting user requirements, and improving product quality and usability. Staff members regularly communicate with algorithm developers with user questions and concerns through conferences and workshops. We publish peer-reviewed papers and articles in major Earth science journals and book chapters to describe NASA global and regional precipitation datasets and services with examples. News articles about GPM and TRMM datasets associated with significant events are regularly posted in the GES DISC Web portal and social media. We also actively participate in training activities. In this presentation, we present our latest activities about GPM and TRMM data services, data/service metrics, and future plans at GES DISC.

Liu, Z.↗

Uncertainties in Evapotranspiration Estimates over West Africa

An evapotranspiration (ET) ensemble composed of 36 land surface model (LSM) experiments and four diagnostic datasets (GLEAM, ALEXI, MOD16, and FLUXNET) is used to investigate uncertainties in ET estimate over five climate regions in West Africa. Diagnostic ET datasets show lower uncertainty estimates and smaller seasonal variations than the LSM-based ET values, particularly in the humid climate regions. Overall, the impact of the choice of LSMs and meteorological forcing datasets on the modeled ET rates increases from north to south. The LSM formulations and parameters have the largest impact on ET in humid regions, contributing to 90% of the ET uncertainty estimates. Precipitation contributes to the ET uncertainty primarily in arid regions. The LSM-based ET estimates are sensitive to the uncertainty of net radiation in arid region and precipitation in humid region. This study serves as support for better determining water availability for agriculture and livelihoods in Africa with earth observations and land surface models.

land surface model↗

HZETRN Radiation Transport Validation Using Balloon-Based Experimental Data

The deterministic radiation transport code HZETRN (High charge (Z) and Energy TRaNsport) was developed by NASA to study the effects of cosmic radiation on astronauts and instrumentation shielded by various materials. This work presents an analysis of computed differential flux from HZETRN compared with measurement data from three balloon-based experiments over a range of atmospheric depths, particle types, and energies. Model uncertainties were quantified using an interval-based validation metric that takes into account measurement uncertainty both in the flux and the energy at which it was measured. Average uncertainty metrics were computed for the entire dataset as well as subsets of the measurements (by experiment, particle type, energy, etc.) to reveal any specific trends of systematic over- or under-prediction by HZETRN. The distribution of individual model uncertainties was also investigated to study the range and dispersion of errors beyond just single scalar and interval metrics. The differential fluxes from HZETRN were generally well-correlated with balloon-based measurements; the median relative model difference across the entire dataset was determined to be 30%. The distribution of model uncertainties, however, revealed that the range of errors was relatively broad, with approximately 30% of the uncertainties exceeding ± 40%. The distribution also indicated that HZETRN systematically under-predicts the measurement dataset as a whole, with approximately 80% of the relative uncertainties having negative values. Instances of systematic bias for subsets of the data were also observed, including a significant underestimation of alpha particles and protons for energies below 2.5 GeV/u. Muons were found to be systematically over-predicted at atmospheric depths deeper than 50 g/cm(sup 2) but under-predicted for shallower depths. Furthermore, a systematic under-prediction of alpha particles and protons was observed below the geomagnetic cutoff, suggesting that improvements to the light ion production cross sections in HZETRN should be investigated.

James E Warner↗

CoSMIR Performance During the GPM Olympex Campaign

The airborne Conical Scanning Millimeter-wave Imaging Radiometer (CoSMIR) participated in the Global Precipitation Measurement (GPM) Olympic Mountains Experiment (OLYMPEX) from November to December 2015 with great success. With similar channels as the GPM Microwave Imager (GMI) at 89-183 GHz, CoSMIR served as a proxy for GMI by flying onboard the DC-8 aircraft for a total of 17 science flights, collecting over 72 hours of observations. The high-quality, calibrated brightness temperature dataset is the result of several improvements made to CoSMIR prior to OLYMPEX to make the instrument more reliable. This paper describes these improvements and gives a detailed summary of the CoSMIR measurements obtained from OLYMPEX. CoSMIR experienced minor performance issues during the campaign, most of which were not excessive and only resulted in a loss of approximately four hours of data for the entire campaign. Performance issues are discussed and shown how they were mitigated to achieve a quality dataset. Comparisons of CoSMIR and GMI observations are presented to show that the CoSMIR measurements agree well with GMI. The CoSMIR dataset is publicly available as part of the OLYMPEX data suite and can reliably be used in GPM algorithm development and related studies.

Airborne radiometer↗