SEARCH · Engineering Papers

Results for “data publication and archiving”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

All sources NASA NTRS DOE OSTI

NASA NTRS2010

Photometric Analysis in the Kepler Science Operations Center Pipeline

We describe the Photometric Analysis (PA) software component and its context in the Kepler Science Operations Center (SOC) Science Processing Pipeline. The primary tasks of this module are to compute the photometric flux and photocenters (centroids) for over 160,000 long cadence (~thirty minute) and 512 short cadence (~one minute) stellar targets from the calibrated pixels in their respective apertures. We discuss science algorithms for long and short cadence PA: cosmic ray cleaning; background estimation and removal; aperture photometry; and flux-weighted centroiding. We discuss the end-to-end propagation of uncertainties for the science algorithms. Finally, we present examples of photometric apertures, raw flux light curves, and centroid time series from Kepler flight data. PA light curves, centroid time series, and barycentric timestamp corrections are exported to the Multi-mission Archive at Space Telescope [Science Institute] (MAST) and are made available to the general public in accordance with the NASA/Kepler data release policy.

photocenter↗

NASA NTRS2019

Developing a Machine-Learning-Based Processing Framework for Twitter and Other Crowdsourced Data

Crowdsourced data streams such as Twitter and other social media are important sources of real-time and historical global information for Earth science applications. At the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), we have been exploring the Twitter data stream for its potential in augmenting the validation program of NASA's Global Precipitation Measurement (GPM) mission. To realize this potential, we need to increase the information density and enhance the quality of filtered precipitation tweets. We have implemented various components of a machine learning (ML)-based processing infrastructure for crowdsourced data that outputs, in this instance, useful and usable information derived from precipitation tweets. We have test enriched the Twitter stream with higher quality active tweets from those knowingly contributing to our effort and from existing crowdsourced programs (e.g., mPING, CoCoRaHS). We have experimented with various algorithms for processing tweets, including NaÃ ve Bayes, Convolutional Neural Network (CNN), Hierarchical Attention Network (HAN), and semi-supervised learning (with tri-training). Our current work focuses on (1) automated review of Earth science-related publications to determine relationships between discipline research needs and ML algorithms; (2) investigating Sequential Generative Adversarial Network (SeqGAN) for processing precipitation tweets for anomaly detection; and (3) managing crowdsourced data in a way that is compatible with existing NASA satellite data archives and using the data for ML applications. Key results include (1) network visualization of NLP-processed publications in various Earth science disciplines; (2) difference between GPM-linked, generated tweets and collected actual tweets that is small for GPM-determined light to moderate rain cases and high for GPM-determined heavy rain cases; and (3) identification of MongoDB for storing raw tweets and Zarr format for gridded tweets (compatible with GPM data). Our results have taken us a step closer to an operational ML-based tweet processing infrastructure and have already demonstrated that tweet-derived precipitation information is potentially useful for validation of Earth science satellite data.

Teng, William↗

NASA NTRSDate not supplied

Quantitative Highlights of 20 years Aqua Data Archive and Data Usage

NASA’s Aqua satellite carries six Earth-observing instruments Atmospheric Infrared Sounder (AIRS), Advanced Microwave Scanning Radiometer for EOS (AMSR-E), Advanced Microwave Sounding Unit (AMSU), Clouds and the Earth’s Radiant Energy System (CERES), Humidity Sounder for Brazil (HSB) and Moderate Resolution Imaging Spectroradiometer (MODIS). Currently only four of six instruments are collecting data, two instruments that stopped transmitting data are AMSR-E that suffered a major anomaly in October 2011 and was powered off in March 2016 while as HSB failed in February 2003. NASA’s Earth Science Data and Information System (ESDIS) Project makes these data, along with derived products, available to worldwide data users. Since the launch of Aqua on May 4, 2002, more than 10,000 data products have been archived and distributed by NASA-funded Distributed Active Archive Centers (DAACs) that are part of NASA’s Earth Observing System Data and Information System (EOSDIS). At the end of the 2021 Fiscal Year with over 100,000 orbits data, about 1,000 Aqua data products constituted almost 16.5 % of the entire EOSDIS data archive volume (8.6 PB out of approximately 55.2 PB), and 7.5 PB of Aqua data were distributed to over half-a-million public users worldwide. By categorizing the Aqua data products and their distribution, we can get a quantitative assessment of Aqua data usage. NASA’s ESDIS Project has collected archive, distribution, and user information from EOSDIS data users since February 2000. These metrics are available through the ESDIS Metrics System (EMS). EMS information is stored in a relational database from which quantitative metrics of Aqua data use can be retrieved and analyzed. The purposes of this study are to: 1) perform a comprehensive investigation of the 20-year trend in the archive and distribution of Aqua data products; 2) identify and characterize data product usage over the last 20 years; and 3) identify and characterize the global user community for these data. In addition to revealing how Aqua data use has evolved over time, the results of this study provide insights on identifying the various user communities for different kinds of Earth science data products. Also, because of the enormous quantity of data handled by EOSDIS DAACs, the study provides guidance of the requirements for future data systems that will be needed to effectively and efficiently handle the ever-increasing amounts of Earth science data produced by future (and ongoing) Earth science missions.

Lalit Wanchoo↗

NASA NTRS2020

Perspectives on Data Reproducibility and Replicability in Paleoclimate and Climate Science

This paper summarizes the current state of reproducibility and replicability in the fields of climate and paleoclimate science, including brief histories of their development and applications in climate science, new and recent approaches towards improvement of reproducibility and replicability, and challenges. Recommendations for addressing those challenges include: development of searchable, auto-updated, interlinked, multi-archive public paleoclimate repositories for raw and processed digital datasets; cross-center standardized code base cases, improved data storage techniques, and a focus on replicability for climate simulation storage and access; and support of the development and community awareness of findable, accessible, interoperable and reusable (FAIR) principles by funding agencies and publishers. This paper is largely based on the May 2018 presentations of a panel of researchers to the Committee on Reproducibility and Replicability in Science, part of the National Academies of Science, Engineering, and Medicine. The commentary and recommendations made here are in alignment with those of its Consensus Study Report on Reproducibility and Replicability in Science (2019).

data repositories↗

DOE OSTI2021

OC6 Phase Ib: Floating Wind Component Experiment for Difference-Frequency Hydrodynamic Load Validation

A new validation campaign was conducted at the W2 Harold Alfond Ocean Engineering Laboratory at the University of Maine to investigate the hydrodynamic loading on floating offshore wind substructures, with a focus on the low-frequency contributions that tend to drive extreme and fatigue loading in semisubmersible designs. A component-level approach was taken to examine the hydrodynamic loads on individual parts of the semisubmersible in isolation and then in the presence of other members to assess the change in hydrodynamic loading. A variety of wave conditions were investigated, including bichromatic waves, to provide a direct assessment of difference-frequency wave loading. An assessment of the impact of wave uncertainty on the loading was performed, with the goal of enabling validation with this dataset of numerical models with different levels of fidelity. The dataset is openly available for public use and can be downloaded from the U.S. Department of Energy Data Archive and Portal.

17 WIND ENERGY↗

NASA NTRSDate not supplied

Compositional Analysis of Titan’s Atmosphere Using Spitzer Infrared Spectrograph Data

We present, for the first time, infrared spectra from the Spitzer Space Telescope’s Infrared Spectrograph (IRS) (2004-2008) of Titan in both the short wavelength-low resolution(SL, R=60~127,5.13-14.29 μm) and short wavelength-high resolution channels (SH, R=600, 9.89-19.51 μm) showing the emissions of CH4, C2H4, C2H2, C2H6, HCN, CO2, HC3N, C3H4, C4H2, and C3H8. Spitzer IRS data has been used to measure atmospheric composition of various Solar System bodies, including Neptune [1] and Uranus [2],[3]. Although Spitzer took multiple dedicated observations of Titan, none of the results have been modeled before. We conduct our own investigation of these datasets and search for new results. We retrieve temperature and gas composition profiles and compare the results obtained for Titan to those of the Cassini Composite Infrared Spectrometer (CIRS) and the Infrared Space Observatory Short Wavelength Spectrometer [4], and comment on the effect of spectral resolution on retrieved information content. We conclude by recommending gaps in current spectroscopic knowledge of molecular bands that could be addressed by theoretical and laboratory study to aid future astronomical studies of Titan, for example the James Webb Space Telescope (JWST) and the Stratospheric Observatory for Infrared Astronomy (SOFIA) Acknowledgments: Data analyzed in this project is public available online on the Spitzer Heritage Archive (sha.ipac.caltech.edu). This research has made use of the NASA/IPAC Infrared Science Archive, which is funded by the National Aeronautics and Space Administration and operated by the California Institute of Technology.

Titan↗

NASA NTRS2017

Development and Validation of The SMAP Enhanced Passive Soil Moisture Product

Since the beginning of its routine science operation in March 2015, the NASA SMAP observatory has been returning interference-mitigated brightness temperature observations at L-band (1.41 GHz) frequency from space. The resulting data enable frequent global mapping of soil moisture with a retrieval uncertainty below 0.040 cu m/cu m at a 36 km spatial scale. This paper describes the development and validation of an enhanced version of the current standard soil moisture product. Compared with the standard product that is posted on a 36 km grid, the new enhanced product is posted on a 9 km grid. Derived from the same time-ordered brightness temperature observations that feed the current standard passive soil moisture product, the enhanced passive soil moisture product leverages on the Backus-Gilbert optimal interpolation technique that more fully utilizes the additional information from the original radiometer observations to achieve global mapping of soil moisture with enhanced clarity. The resulting enhanced soil moisture product was assessed using long-term in situ soil moisture observations from core validation sites located in diverse biomes and was found to exhibit an average retrieval uncertainty below 0.040 cu m/cu m. As of December 2016, the enhanced soil moisture product has been made available to the public from the NASA Distributed Active Archive Center at the National Snow and Ice Data Center.

SMAP Enhanced↗

NASA NTRS2024

Bridging the Gap: Enhancing Prominence and Provenance of NASA Datasets in Research Publications

Attribution of datasets that were used to generate research results described in peer-reviewed publications to the original source of these datasets (which are often archived at NASA Earth Science data centers) has been very challenging. Even though the data citation standard of citing datasets as research artifacts and citing them with Digital Object Identifiers (DOIs) was introduced over a decade ago, most authors do not properly reference the data used in their studies and merely mention them in the text. The lack of proper citations of datasets makes the peer-reviewed publication less transparent, imperils reproducibility, and impedes open science. We offer an open-source publication management methodology and a tool that can help to enhance usage-based data discovery, prominence, and provenance of the data; reproducibility of the research results; and potentially increase the return on investment on NASA-funded research.

open-source↗

DOE OSTI2023

NDMAS: Data storage, visualization, analysis, delivery, and more

Slides representing Nuclear Data Management and Analysis System (NDMAS) Data for properly preserving our publicly funded data, including DOE Public Access Plan and the users of NDMAS. From Capture, Storage, Delivery & Analysis, Archival, and Qualification of Fuel fabrication, PIE, ART Experiment monitoring and operations, and processes for recording work and for looking ahead.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA NTRS2018

The SMAP Mission Combined Active-Passive Soil Moisture Product at 9 Km and 3 Km Spatial Resolutions

The NASA Soil Moisture Active Passive (SMAP) mission was launched on January 31st, 2015. The spacecraft was to provide high-resolution (3 km and 9 km) global soil moisture estimates at regular intervals by combining for the first time L-band radiometer and radar observations. On July 7th, 2015, a component of the SMAP radar failed and the radar ceased operation. However, before this occurred the mission was able to collect and process ~2.5 months of the SMAP high-resolution active-passive soil moisture data (L2SMAP) that coincided with the Northern Hemisphere's vegetation green-up and crop growth season. In this study, we evaluate the SMAP high-resolution soil moisture product derived from several alternative algorithms against in situ data from core calibration and validation sites (CVS), and sparse networks. The baseline algorithm had the best comparison statistics against the CVS and sparse networks. The overall unbiased root-mean-square-difference is close to the 0.04 cu. m/cu. m the SMAP mission requirement. A 3 km spatial resolution soil moisture product was also examined. This product had an unbiased root-mean-square-difference of ~0.053 cu. m/cu. m. The SMAP L2SMAP product for ~2.5 months is now validated for use in geophysical applications and research and available to the public through the NASA Distributed Active Archive Center (DAAC) at the National Snow and Ice Data Center (NSIDC). The L2SMAP product is packaged with the geo-coordinates, acquisition times, and all requisite ancillary information. Although limited in duration, SMAP has clearly demonstrated the potential of using a combined L-band radar-radiometer for proving high spatial resolution and accurate global soil moisture.

high resolution soil moisture↗

NASA NTRS2010

Presearch Data Conditioning in the Kepler Science Operations Center Pipeline

We describe the Presearch Data Conditioning (PDC) software component and its context in the Kepler Science Operations Center (SOC) pipeline. The primary tasks of this component are to correct systematic and other errors, remove excess flux due to aperture crowding, and condition the raw flux light curves for over 160,000 long cadence (~thirty minute) and 512 short cadence (~one minute) targets across the focal plane array. Long cadence corrected flux light curves are subjected to a transiting planet search in a subsequent pipeline module. We discuss the science algorithms for long and short cadence PDC: identification and correction of unexplained (i.e., unrelated to known anomalies) discontinuities; systematic error correction; and excess flux removal. We discuss the propagation of uncertainties from raw to corrected flux. Finally, we present examples of raw and corrected flux time series for flight data to illustrate PDC performance. Corrected flux light curves produced by PDC are exported to the Multi-mission Archive at Space Telescope [Science Institute] (MAST) and will be made available to the general public in accordance with the NASA/Kepler data release policy.

Twicken, Joseph D.↗

NASA NTRS1992

Quality control of EUVE databases

The publicly accessible databases for the Extreme Ultraviolet Explorer include: the EUVE Archive mailserver; the CEA ftp site; the EUVE Guest Observer Mailserver; and the Astronomical Data System node. The EUVE Performance Assurance team is responsible for verifying that these public EUVE databases are working properly, and that the public availability of EUVE data contained therein does not infringe any data rights which may have been assigned. In this poster, we describe the Quality Assurance (QA) procedures we have developed from the approach of QA as a service organization, thus reflecting the overall EUVE philosophy of Quality Assurance integrated into normal operating procedures, rather than imposed as an external, post facto, control mechanism.

John, L. M.↗

NASA NTRS2020

Satellite-based remote sensing data set of global surface water storage change from 1992 to 2018

The recent availability of freely and openly available satellite remote sensing products has enabled the implementation of global surface water monitoring at a level not previously possible. Here we present a global set of satellite-derived time series of surface water storage variations for lakes and reservoirs for a period that covers the satellite altimetry era. Our goals are to promote the use of satellite-derived products for the study of large inland water bodies and to set the stage for the expected availability of products from the Surface Water and Ocean Topography (SWOT) mission, which will vastly expand the spatial coverage of such products,expected from 2021 on. Our general strategy is to estimate global surface water storage changes (1V) in large lakes and reservoirs using a combination of paired water surface elevation (WSE) and water surface area (WSA)extent products. Specifically, we use data produced by multiple satellite altimetry missions (TOPEX/Poseidon,Jason-1, Jason-2, Jason-3, and Envisat) from 1992 on, with surface extent estimated from Terra/Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) from 2000 on. We leverage relationships between elevation and surface area (i.e., hypsometry) to produce estimates of 1 Veven during periods when either of the variables was not available. This approach is successful provided that there are strong relationships between the two variables during an overlapping period. Our target is to produce time series of1Vas well as of WSE and WSA fora set of 347 lakes and reservoirs globally for the 1992–2018 period. The data sets presented and their respective algorithm theoretical basis documents are publicly available and distributed via the Physical Oceanography Dis-tributed Active Archive Center (PO DAAC; https://podaac.jpl.nasa.gov/, last access: 13 May 2020) of NASA’sJet Propulsion Laboratory. Specifically, the WSE data set is available at https://doi.org/10.5067/UCLRS-GREV2(Birkett et al., 2019), the WSA data set is available at https://doi.org/10.5067/UCLRS-AREV2 (Khandelwal and Kumar, 2019), and the 1V data set is available at https://doi.org/10.5067/UCLRS-STOV2 (Tortini et al., 2019).The records we describe represent the most complete global surface water time series available from the launch of TOPEX/Poseidon in 1992 (beginning of the satellite altimetry era) to the near present. The production of long-term, consistent, and calibrated records of surface water cycle variables such as in the data set presented here is of fundamental importance to baseline future SWOT products

Riccardo Tortini↗

NASA NTRSDate not supplied

Data Democratization: Challenges and Opportunities

Democratizing Earth data is one of the challenges many organizations around the world face in order to maximize the use of their Earth data for research, applications, education, and societal benefits. For example, at the NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC), over 1600 global and regional datasets in several NASA Earth science focus areas, including atmospheric composition, water and energy cycles, and climate variability, are archived and distributed to the public. Giovanni, the Geospatial Interactive Online Visualization and Analysis Infrastructure, was developed by GES DISC to facilitate data access and exploration, especially for novice users of Earth science. With Giovanni, users can analyze and visualize over 2000 Earth science variables (e.g., precipitation, aerosol, surface wind) without downloading data, software, the expert understanding of data formats and structures, and coding skills, lowering the barrier to data analysis/comparison by preprocessing and accessing to the data. Results of data analysis and visualization can be accessed in several popular formats (e.g., NetCDF, CSV). As a result of Giovanni's efforts, more than 3000 referral papers have been published in various fields. In spite of this, Giovanni is still difficult to use for some users. For instance, if one searches for "precipitation," it will return over 150 related variables. The question is, which one to use? Furthermore, variables from different data providers (e.g., satellites and models) are named differently with different units, further confusing users, especially those outside the communities. Data democratization is complex and multifaceted. Challenges include service and data discovery, user experiences, visualization, data quality, trustworthiness, and more. In this presentation, we will examine Giovanni as an example of challenges and opportunities in developing data democratization services.

data democratization↗

DOE OSTI2024

ARM Aerial Facility (AAF) Merged Value-Added Product Report for Historical G-1 Field Campaigns

For 30 years, the U.S. Department of Energy (DOE) Office of Science supported an instrumented Grumman Gulfstream-1 (G-1) aircraft for atmospheric field campaigns. Data from the final decade of G-1 operations were archived by the Atmospheric Radiation Measurement (ARM) user facility Data Center (ADC) and made publicly available at no cost to all registered users. To ensure a consistent data format and to improve the accessibility of the ARM airborne data, an integrated data set was recently developed covering the final six years of G-1 operations (2013 to 2018). The integrated data set includes data collected from 236 flights (766.4 hours). Four of the seven field campaigns were based in the U.S. One campaign collected data from the wildfires in the U.S. Pacific Northwest and agricultural burns in the lower Mississippi River valley as part of the Biomass Burning Observation Project (BBOP) in 2013. In 2015, the ARM Cloud Aerosol Precipitation Experiment provided data on atmospheric rivers and associated aerosol-cloud interactions that produce heavy precipitation on the U.S. west coast during the early spring. Research data from Airborne Carbon Measurements-V (ACME-V), collected during the summer of 2015, gave scientists insight into trends and variability of trace gases in the atmosphere over the North Slope of Alaska to improve arctic climate models. In the early summer and autumn of 2016, the Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) campaign provided an extensive data set geared toward coupled processes that affect the life cycle of shallow clouds through the interaction among aerosol, cloud, land surface, and ecosystems. In 2014 (March and October), the airborne sampling moved outside of the U.S. to the city of Manaus in central Amazonia, Brazil, where residential and industrial emissions were extensively characterized by flights of the G-1. The GoAmazon2014/15 aircraft campaign data are being integrated with aquatic and terrestrial ecosystem measurements to quantify anthropogenic perturbations to a usually pristine tropical environment. Another international airborne mission was carried out in the Eastern North Atlantic region. The Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) campaign saw the G-1 aircraft fly from Terceira Island in the Azores during the summer of 2017 and the winter of 2018. The campaign studied both seasons to measure key aerosol and cloud processes under various meteorological and cloud conditions with different aerosol sources. Then the G-1 deployed to the Sierras de Córdoba range in central Argentina from October to November 2018 for the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) campaign to study orographic convective cloud interactions with their surrounding environment. These comprehensive datastreams provide much-needed insight into spatiotemporal variability of thermodynamic quantities, aerosol and cloud states, and properties for addressing essential science questions in Earth system process studies.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

ARM Aerial Facility (AAF) Merged Value-Added Product Report for Historical G-1 Field Campaigns

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Application of Multi-Criteria Decision Analysis Techniques for Informing Select Agent Designation and Decision Making

The Centers for Disease Control and Prevention (CDC) Select Agent Program establishes a list of biological agents and toxins that potentially threaten public health and safety, the procedures governing the possession, utilization, and transfer of those agents, and training requirements for entities working with them. Every 2 years the Program reviews the select agent list, utilizing subject matter expert (SME) assessments to rank the agents. In this study, we explore the applicability of multi-criteria decision analysis (MCDA) techniques and logic tree analysis to support the CDC Select Agent Program biennial review process, applying the approach broadly to include non-select agents to evaluate its generality. We conducted a literature search for over 70 pathogens against 15 criteria for assessing public health and bioterrorism risk and documented the findings for archiving. The most prominent data gaps were found for aerosol stability and human infectious dose by inhalation and ingestion routes. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for accuracy, particularly for pathogens with very few known cases, or where proxy data (e.g., from animal models or similar organisms) were used to address data gaps. Analysis of results obtained from a two-dimensional plot of weighted scores for difficulty of attack (i.e., exposure and production criteria) vs. consequences of an attack (i.e., consequence and mitigation criteria) provided greater fidelity for understanding agent placement compared to a 1-to-n ranking and was used to define a region in the upper right-hand quadrant for identifying pathogens for consideration as select agents. A sensitivity analysis varied the numerical weights attributed to various properties of the pathogens to identify potential quantitative (x and y) thresholds for classifying select agents. The results indicate while there is some clustering of agent scores to suggest thresholds, there are still pathogens that score close to any threshold, suggesting that thresholding “by eye” may not be sufficient. The sensitivity analysis indicates quantitative thresholds are plausible, and there is good agreement of the analytical results with select agent designations. A second analytical approach that applied the data using a logic tree format to rule out pathogens for consideration as select agents arrived at similar conclusions.

60 APPLIED LIFE SCIENCES↗

NASA NTRS2001

Simultaneous Spectral and Timing Observations of Accreting Neuron Stars

The goal of this proposal was to perform simultaneous x-ray spectral and millisecond timing observations of accreting neutron stars to further our understanding of their accretion dynamics and in the hope of using these systems as probes of the physics of strong gravitational fields. Observations of the neutron star binaries 4U0614+091, 4U1728-34, 4U1820-30, and Cyg X-2 were carried out with RXTE and BeppoSAX, ASCA, and Chandra (not all simultaneously). In addition, archival data were analyzed for 4U0614+091 and 4U1820-30. This investigation led to publication of three papers in peer-reviewed journals. These are listed below. In addition, the results were presented at several meetings including the two poster presentations listed below. Dr. Santina Piraino visited SAO for 4 months during 2000 to collaborate on analysis of the data from NAG5-8408 and NAG5-9104.

Kaaret, P.↗