Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “community data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

NASA GES DISC New Data Service and Data Management for the Air Quality Community

President Obama's Big Data Research and Development Initiative seeks to improve our ability to acquire knowledge and discover insights into large and complex collections of digital data. The Big Earth Data Initiative (BEDI) Invests in standardizing and optimizing the collection, management and delivery of U.S. Government's civil Earth observation data.

air pollution↗

Big Data Challenges at the Community Coordinated Modeling Center (CCMC)

Like other research centers, the Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) at NASA Goddard Space Flight Center (GSFC) is also experiencing the big data challenges. CCMC hosts over 80 space weather models for Runs On Request (ROR), Continuous Runs and Instant Runs simulation services for the research community. In addition, CCMC has started to support simulation output onboarding in response to the Open Science initiative. Overall, we have accumulated over petabytes of simulation output data and are rapidly growing. In this presentation, we will discuss our data and storage challenges. We will present our attempts to address our challenges and any associated lessons learned. CCMC uses Apache Airflow to ensure data transfer is consistent. We will give a brief overview on how we leverage Apache Airflow to enhance our environment.

space weather↗

The LCLStream Ecosystem for Multi-Institutional Dataset Exploration

We describe a new end-to-end experimental data streaming framework designed from the ground up to support new types of applications – AI training, extremely high-rate X-ray time-of-flight analysis, crystal structure determination with distributed processing, and custom data science applications and visualizers yet to be created. Throughout, we use design choices merging cloud microservices with traditional HPC batch execution models for security and flexibility. This project makes a unique contribution to the DOE Integrated Research Infrastructure (IRI) landscape. By creating a flexible, API-driven data request service, we address a significant need for high-speed data streaming sources for the X-ray science data analysis community. With the combination of data request API, mutual authentication web security framework, job queue system, high-rate data buffer, and complementary nature to facility infrastructure, the LCLStreamer framework has prototyped and implemented several new paradigms critical for future generation experiments.

Rogers, David [ORNL] (ORCID:0000000251871768)↗

The ARM Data System and Archive

Every observationally based research program needs a way to collect data from instruments, convert the data from its raw format into a more usable format, apply quality control, process it into higher-order data products, store the data, and make the data available to its scientific community. This data flow is illustrated pictorially in Fig. 11-1. These are the basic requirements of any scientific data system, and ARM’s data system would have to address these requirements and more. This research provides one view of the development of the ARM data system, which includes the ARM Data Archive, and some of the notable decisions that were made along the way.

97 MATHEMATICS AND COMPUTING↗

Wind-tunnel blockage and actuation systems test of a two-dimensional scramjet inlet unstart model at Mach 6

The present study examines the wind-tunnel blockage and actuation systems effectiveness in starting and forcibly unstarting a two-dimensional scramjet inlet in the NASA Langley 20-Inch Mach 6 Tunnel. The intent of the overall test program is to study (both experimentally and computationally) the dynamics of the inlet unstart; however, prior to the design and fabrication of an expensive, instrumented wind-tunnel model, it was deemed necessary first to examine potential wind-tunnel blockage issues related to model sizing and to examine the adequacy of the actuation systems in accomplishing the start and unstart. The model is equipped with both a moveable cowl and aft plug. Windows in the inlet sidewalls allow limited optical access to the internal shock structure; schlieren video was used to identify inlet start and unstart. A chronology of each actuation sequence is provided in tabular form along with still frames from the schlieren video. A pitot probe monitored the freestream conditions throughout the start/unstart process to determine if there was a blockage effect due to the model start or unstart. Because the purpose of this report is to make the phase I (blockage and actuation systems) data rapidly available to the community, the data is presented largely without analysis of the internal shock interactions or the unstart process. This series of tests indicated that the model was appropriately sized for this facility and identified operability limits required first to allow the inlet to start and second to force the unstart.

Holland, Scott D.↗

A Quality Screening Service for Remote Sensing Data

NASA provides a wide variety of Earth-observing satellite data products to a diverse community. These data are annotated with quality information in a variety of ways, with the result that many users struggle to understand how to properly account for quality when dealing with satellite data. To address this issue, a Data Quality Screening Service (DQSS) is being implemented for a number of datasets. The DQSS will enable users to obtain data files in which low-quality pixels have been filtered out, based either on quality criteria recommended by the science team or on the user s particular quality criteria. The objective is to increase proper utilization of this critical quality data in science data analysis of satellite data products.

Lynnes, Christopher↗

Newly Released TRMM Version 7 Products, Other Precipitation Datasets and Data Services at NASA GES DISC

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is home of global precipitation product archives, in particular, the Tropical Rainfall Measuring Mission (TRMM) products. TRMM is a joint U.S.-Japan satellite mission to monitor tropical and subtropical (40 S - 40 N) precipitation and to estimate its associated latent heating. The TRMM satellite provides the first detailed and comprehensive dataset on the four dimensional distribution of rainfall and latent heating over vastly undersampled tropical and subtropical oceans and continents. The TRMM satellite was launched on November 27, 1997. TRMM data products are archived at and distributed by GES DISC. The newly released TRMM Version 7 consists of several changes including new parameters, new products, meta data, data structures, etc. For example, hydrometeor profiles in 2A12 now have 28 layers (14 in V6). New parameters have been added to several popular Level-3 products, such as, 3B42, 3B43. Version 2.2 of the Global Precipitation Climatology Project (GPCP) dataset has been added to the TRMM Online Visualization and Analysis System (TOVAS; URL: http://disc2.nascom.nasa.gov/Giovanni/tovas/), allowing online analysis and visualization without downloading data and software. The GPCP dataset extends back to 1979. Version 3 of the Global Precipitation Climatology Centre (GPCC) monitoring product has been updated in TOVAS as well. The product provides global gauge-based monthly rainfall along with number of gauges per grid. The dataset begins in January 1986. To facilitate data and information access and support precipitation research and applications, we have developed a Precipitation Data and Information Services Center (PDISC; URL: http://disc.gsfc.nasa.gov/precipitation). In addition to TRMM, PDISC provides current and past observational precipitation data. Users can access precipitation data archives consisting of both remote sensing and in-situ observations. Users can use these data products to conduct a wide variety of activities, including case studies, model evaluation, uncertainty investigation, etc. To support Earth science applications, PDISC provides users near-real-time precipitation products over the Internet. At PDISC, users can access tools and software. Documentation, FAQ and assistance are also available. Other capabilities include: 1) Mirador (http://mirador.gsfc.nasa.gov/), a simplified interface for searching, browsing, and ordering Earth science data at NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). Mirador is designed to be fast and easy to learn; 2)TOVAS; 3) NetCDF data download for the GIS community; 4) Data via OPeNDAP (http://disc.sci.gsfc.nasa.gov/services/opendap/). The OPeNDAP provides remote access to individual variables within datasets in a form usable by many tools, such as IDV, McIDAS-V, Panoply, Ferret and GrADS; 5) The Open Geospatial Consortium (OGC) Web Map Service (WMS) (http://disc.sci.gsfc.nasa.gov/services/wxs_ogc.shtml). The WMS is an interface that allows the use of data and enables clients to build customized maps with data coming from a different network.

Liu, Zhong↗

Knowledge Discovery from Massive Healthcare Claims Data

The role of big data in addressing the needs of the present healthcare system in US and rest of the world has been echoed by government, private, and academic sectors. There has been a growing emphasis to explore the promise of big data analytics in tapping the potential of the massive healthcare data emanating from private and government health insurance providers. While the domain implications of such collaboration are well known, this type of data has been explored to a limited extent in the data mining community. The objective of this paper is two fold: first, we introduce the emerging domain of big"healthcare claims data to the KDD community, and second, we describe the success and challenges that we encountered in analyzing this data using state of art analytics for massive data. Specically, we translate the problem of analyzing healthcare data into some of the most well-known analysis problems in the data mining community, social network analysis, text mining, and temporal analysis and higher order feature construction, and describe how advances within each of these areas can be leveraged to understand the domain of healthcare. Each case study illustrates a unique intersection of data mining and healthcare with a common objective of improving the cost-care ratio by mining for opportunities to improve healthcare operations and reducing hat seems to fall under fraud, waste,and abuse.

healthcare fraud↗

TPSAS-NF1676L-18315-DND

NASA used towers until 2009 for gathering community noise data. It was thought that the integration of the data into the metrics masked the reflection issues. We now use narrow band data for research and when evaluating community noise. Reflections are visible in narrow band and 1/3 octave tower data.

Charlotte Whitfield↗

Templates for developing and versioning data standards and reporting formats using GitHub

This data package contains three templates that can be used for creating README files and Issue Templates, written in the markdown language, that support community-led data reporting formats. We created these templates based on the results of a systematic review (see related references) that explored how groups developing data standard documentation use the Version Control platform GitHub, to collaborate on supporting documents. Based on our review of 32 GitHub repositories, we make recommendations for the content of README Files (e.g., provide a user license, indicate how users can contribute) and so 'README_template.md' includes headings for each section. The two issue templates we include ('issue_template_for_all_other_changes.md' and 'issue_template_for_documentation_change.md') can be used in a GitHub repository to help structure user-submitted issues, or can be modified to suit the needs of data standard developers. We used these templates when establishing ESS-DIVE's community space on GitHub (https://github.com/ess-dive-community) that includes documentation for community-led data reporting formats. We also include file-level metadata 'flmd.csv' that describes the contents of each file within this data package. Lastly, the temporal range that we indicate in our metadata is the time range during which we searched for data standards documented on GitHub.

54 ENVIRONMENTAL SCIENCES↗

Columbia River Surface Water and Pore Water Unaligned FTICR-MS Data Associated with “Using Community Assembly Metrics from Metacommunity Ecology to Understand Environmental Metabolomes”

Surface water and pore water samples were collected at five sites along a shoreline transect of the Columbia River, southeastern WA, USA in 2017. This dataset is comprised of (1) high resolution characterization of dissolved organic matter via 12 Tesla Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) analyzed through the Environmental Molecular Sciences Laboratory (EMSL; https://www.pnnl.gov/environmental-molecular-sciences-laboratory) and (2) a metadata csv file. The FTICR-MS files are .xml, and the data package includes instructions for using Formularity (https://omics.pnl.gov/software/formularity) and an R script to process the data based on the user’s specific needs. The data are associated with the publication “Using community assembly metrics from metacommunity ecology to understand environmental metabolomes” that will be published in Nature Communications (Danczak et al.). The study aimed to investigate gaps in understanding the spatiotemporal organization of environmental metabolomes to improve the ability to predict ecosystem function. Associated sequencing data will be published via NCBI. The access information for NCBI and the publication DOI will be added to this abstract when they are available. Please use the data package’s DOI to cite the data package. We ask that you acknowledge the U.S. Department of Energy (DOE) Biological and Environmental Research (BER) Subsurface Biogeochemical Research (SBR) program when using the data. All data are free to be used for any purpose, such as for manuscripts, presentations, and grant proposals. There is no obligation to include data package authors as co-authors.

54 ENVIRONMENTAL SCIENCES↗

Data publication with the structural biology data grid supports live analysis

Access to experimental X-ray diffraction image data is fundamental for validation and reproduction of macromolecular models and indispensable for development of structural biology processing methods. Here, we established a diffraction data publication and dissemination system, Structural Biology Data Grid (SBDG; data.sbgrid.org), to preserve primary experimental data sets that support scientific publications. Data sets are accessible to researchers through a community driven data grid, which facilitates global data access. Our analysis of a pilot collection of crystallographic data sets demonstrates that the information archived by SBDG is sufficient to reprocess data to statistics that meet or exceed the quality of the original published structures. SBDG has extended its services to the entire community and is used to develop support for other types of biomedical data sets. In conclusion, it is anticipated that access to the experimental data sets will enhance the paradigm shift in the community towards a much more dynamic body of continuously improving data analysis.

59 BASIC BIOLOGICAL SCIENCES↗

ARM Climate Modeling Best Estimate Data - A new data product for climate modelers

This paper provides an overview of a new data product, named the Climate Modeling Best Estimate (CMBE) dataset, developed by the U.S. Department of Energy (DOE)’s Atmospheric Radiation Measurement (ARM) Program in order to better serve the need of climate model developers and encourage greater use of ARM data by modelers. The CMBE dataset contains those quantities that are often used in model evaluation and reflect unique ARM measurements of clouds and radiation (e.g., cloud occurrence, liquid water path, and surface radiative fluxes) from the highest quality data that ARM has for many years. The data are averaged over one hour period, which is comparable to a typical temporal resolution used in climate model output. They are currently available at five ARM Climate Research Facility (ACRF) sites located at the Southern Great Plains, North Slope of Alaska, and Tropic Western Pacific, and can be obtained from the ACRF data archive. The long-term continuous ARM data provide invaluable information to improve our understanding of the interaction between clouds and radiation and a solid observational basis for model validation and improvement. This paper shows some examples to demonstrate its unique values in studies of cloud processes, climate variability and change, and climate modeling. Plans for future enhancements of the CMBE product are also discussed.

54 ENVIRONMENTAL SCIENCES↗

Heuristics for Relevancy Ranking of Earth Dataset Search Results

As the Variety of Earth science datasets increases, science researchers find it more challenging to discover and select the datasets that best fit their needs. The most common way of search providers to address this problem is to rank the datasets returned for a query by their likely relevance to the user. Large web page search engines typically use text matching supplemented with reverse link counts, semantic annotations and user intent modeling. However, this produces uneven results when applied to dataset metadata records simply externalized as a web page. Fortunately, data and search provides have decades of experience in serving data user communities, allowing them to form heuristics that leverage the structure in the metadata together with knowledge about the user community. Some of these heuristics include specific ways of matching the user input to the essential measurements in the dataset and determining overlaps of time range and spatial areas. Heuristics based on the novelty of the datasets can prioritize later, better versions of data over similar predecessors. And knowledge of how different user types and communities use data can be brought to bear in cases where characteristics of the user (discipline, expertise) or their intent (applications, research) can be divined. The Earth Observing System Data and Information System has begun implementing some of these heuristics in the relevancy algorithm of its Common Metadata Repository search engine.

science data management↗

Relevancy Ranking of Satellite Dataset Search Results

As the Variety of Earth science datasets increases, science researchers find it more challenging to discover and select the datasets that best fit their needs. The most common way of search providers to address this problem is to rank the datasets returned for a query by their likely relevance to the user. Large web page search engines typically use text matching supplemented with reverse link counts, semantic annotations and user intent modeling. However, this produces uneven results when applied to dataset metadata records simply externalized as a web page. Fortunately, data and search provides have decades of experience in serving data user communities, allowing them to form heuristics that leverage the structure in the metadata together with knowledge about the user community. Some of these heuristics include specific ways of matching the user input to the essential measurements in the dataset and determining overlaps of time range and spatial areas. Heuristics based on the novelty of the datasets can prioritize later, better versions of data over similar predecessors. And knowledge of how different user types and communities use data can be brought to bear in cases where characteristics of the user (discipline, expertise) or their intent (applications, research) can be divined. The Earth Observing System Data and Information System has begun implementing some of these heuristics in the relevancy algorithm of its Common Metadata Repository search engine.

science data management↗

Achieving Global Consensus on Acceptable Sound Levels for Overland Supersonic Flight

The National Aeronautics and Space Administration has made a commitment to deliver to the International Civil Aviation Organization’s Committee on Aviation Environmental Protection (ICAO CAEP) data defining community response to sounds from supersonic aircraft designed such that their sonic boom is replaced with a soft “thump” sound. The dataset will be a correlation of public perceptions of these sounds to the corresponding acoustic levels. The data will support efforts to develop international standards for permissible noise from supersonic overflight. NASA is planning and preparing for a series of community overflight tests with the X-59, a unique research aircraft capable of generating the “sonic thump”. NASA will begin these tests in 2024. With an eye toward achieving global consensus for noise standards, NASA’s goal is that the community response data be as broadly representative of the response of the international population as possible. As such, NASA is engaging the international regulatory and research communities in both the planning and execution of these tests, through status briefings at ICAO CAEP-sponsored meetings and through workshops with international participation. As part of this outreach NASA held a virtual workshop in December 2021 focused on strategies and considerations for estimating noise exposure levels and conducting surveys to characterize community annoyance levels relative to the “thump” sounds. This paper will present an overview of NASA’s effort, with a focus on the plans and technical goals for the community response tests. In addition, results of the recent workshop will be briefed, including considerations and approaches for ensuring broad representativeness of results and approaches for estimation of the sound levels across the test community. Participant feedback from both the workshop and previous engagements will be discussed, along with how it is being addressed in NASA’s ongoing planning efforts.

Supersonic Flight↗

Systems Performance Analyses of Alaska Wind-Diesel Projects; Selawik, Alaska (Fact Sheet)

This fact sheet summarizes a systems performance analysis of the wind-diesel project in Selawik, Alaska. Data provided for this project include community load data, wind turbine output, diesel plant output, thermal load data, average wind speed, average net capacity factor, optimal net capacity factor based on Alaska Energy Authority wind data, average net wind penetration, and estimated fuel savings.

17 WIND ENERGY↗

Systems Performance Analyses of Alaska Wind-Diesel Projects; Kasigluk, Alaska (Fact Sheet)

This fact sheet summarizes a systems performance analysis of the wind-diesel project in Kasigluk, Alaska. Data provided for this project include community load data, average wind turbine output, average diesel plant output, thermal load data, average net capacity factor, average net wind penetration, estimated fuel savings, and wind system availability.

17 WIND ENERGY↗