Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “community data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,729 records · Page 96

NASA's astrophysics archives at the National Space Science Data Center

NASA maintains an archive facility for Astronomical Science data collected from NASA's missions at the National Space Science Data Center (NSSDC) at Goddard Space Flight Center. This archive was created to insure the science data collected by NASA would be preserved and useable in the future by the science community. Through 25 years of operation there are many lessons learned, from data collection procedures, archive preservation methods, and distribution to the community. This document presents some of these more important lessons, for example: KISS (Keep It Simple, Stupid) in system development. Also addressed are some of the myths of archiving, such as 'scientists always know everything about everything', or 'it cannot possibly be that hard, after all simple data tech's do it'. There are indeed good reasons that a proper archive capability is needed by the astronomical community, the important question is how to use the existing expertise as well as the new innovative ideas to do the best job archiving this valuable science data.

Vansteenberg, M. E.↗

Detailed Statistical Models of Host-Based Data for Detection of Malicious Activity

The cybersecurity research community has focused primarily on the analysis and automation of intrusion detection systems by examining network traffic behaviors. Expanding on this expertise, advanced cyber defense analysis is turning to host-based data to use in research and development to produce the next generation network defense tools. The ability to perform deep packet inspection of network traffic is increasingly harder with most boundary network traffic moving to HTTPS. Additionally, network data alone does not provide a full picture of end-to-end activity. These are some of the reasons that necessitate looking at other data sources such as host data. We outline our investigation into the processing, formatting, and storing of the data along with the preliminary results from our exploratory data analysis. In writing this report, it is our goal to aid in guiding future research by providing foundational understanding for an area of cybersecurity that is rich with a variety of complex, categorical, and sparse data, with a strong human influence component. Including suggestions for guiding potential directions for future research.

97 MATHEMATICS AND COMPUTING↗

ROOT: A C++ framework for petabyte data storage, statistical analysis and visualization

ROOT is an object-oriented C++ framework conceived in the high-energy physics (HEP) community, designed for storing and analyzing petabytes of data in an efficient way. Any instance of a C++ class can be stored into a ROOT file in a machine-independent compressed binary format. In ROOT the TTree object container is optimized for statistical data analysis over very large data sets by using vertical data storage techniques. These containers can span a large number of files on local disks, the web or a number of different shared file systems. In order to analyze this data, the user can chose out of a wide set of mathematical and statistical functions, including linear algebra classes, numerical algorithms such as integration and minimization, and various methods for performing regression analysis (fitting). In particular, the RooFit package allows the user to perform complex data modeling and fitting while the RooStats library provides abstractions and implementations for advanced statistical tools. Multivariate classification methods based on machine learning techniques are available via the TMVA package. A central piece in these analysis tools are the histogram classes which provide binning of one- and multi-dimensional data. Results can be saved in high-quality graphical formats like Postscript and PDF or in bitmap formats like JPG or GIF. The result can also be stored into ROOT macros that allow a full recreation and rework of the graphics. Users typically create their analysis macros step by step, making use of the interactive C++ interpreter CINT, while running over small data samples. Once the development is finished, they can run these macros at full compiled speed over large data sets, using on-the-fly compilation, or by creating a stand-alone batch program. Finally, if processing farms are available, the user can reduce the execution time of intrinsically parallel tasks - e.g. data mining in HEP - by using PROOF, which will take care of optimally distributing the work over the available resources in a transparent way.

99 GENERAL AND MISCELLANEOUS↗

Unraveling the Threads of Environmental Justice in Critical Mineral Extraction: A Framework for Regionalized Life Cycle Data

As we transition to a more sustainable energy system, the extraction and processing of critical minerals becomes increasingly important. However, these industries often raise concerns about environmental and social impacts, particularly in disadvantaged communities. To address these concerns, our research focuses on regionalizing environmental life cycle data to connect it with communities affected by mineral extraction. A framework was developed for collecting life cycle background data that supports the Justice40 Toolset, a market-based approach to evaluating net benefits and costs of critical mineral material recovery pathways. A goal was to alleviate public skepticism around mineral extraction processes, including secondary and unconventional feedstocks, by highlighting both environmental and social impacts. To achieve this, computational analysis and geospatial data science techniques were employed, such as within-scale and across-scale methods and proxy dataset usage. By doing so, we were able to develop a framework for identifying and disaggregating data down to regions small enough to support Justice40 goals. Our approach not only provides valuable tools fo insight into the environmental implications of mineral extraction but also helps policymakers evaluate the social impacts on local communities. This research contributes to a more just and equitable transition to a sustainable energy system, ensuring that marginalized voices are heard in decision-making process.

Davis, Tyler [NETL Site Support Contractor, Nation↗

Environmental and Social Justice Considerations in a Circular Economy

A consideration of environmental justice (EJ) and social justice (SJ) is critical to minimize the impacts of technology deployment on local communities. SJ and EJ impacts occur in specific geographic locations but can cover a wide range of effects (e.g., air pollution, access to clean water, jobs, wages, and education), making it challenging to determine which metrics are appropriate to evaluate and which data are required for qualitative or quantitative analysis. This issue is only exacerbated when the technology in question is at an early technology readiness level (TRL) without community specific data. Here, we present a framework for evaluating the human health, local environment, and job implications of processes that are at early to middle TRLs. Using a case study on enzymatic polyethylene terephthalate (PET) recycling (middle TRL), we demonstrate how to qualitatively and quantitatively assess these EJ and SJ metrics for a circular economy context and how to communicate the results in a manner beneficial to both researchers and local communities.

circular economy↗

AXAF FITS standard for ray trace interchange

A standard data format for the archival and transport of x-ray events generated by ray trace models is described. Upon review and acceptance by the Advanced X-ray Astrophysics Facility (AXAF) Software Systems Working Group (SSWG), this standard shall become the official AXAF data format for ray trace events. The Flexible Image Transport System (FITS) is well suited for the purposes of the standard and was selected to be the basis of the standard. FITS is both flexible and efficient and is also widely used within the astronomical community for storage and transfer of data. In addition, software to read and write FITS format files are widely available. In selecting quantities to be included within the ray trace standard, the AXAF Mission Support team, Science Instruments team, and the other contractor teams were surveyed. From the results of this survey, the following requirements were established: (1) for the scientific needs, each photon should have associated with it: position, direction, energy, and statistical weight; the standard must also accommodate path length (relative phase), and polarization. (2) a unique photon identifier is necessary for bookkeeping purposes; (3) a log of individuals, organizations, and software packages that have modified the data must be maintained in order to create an audit trail; (4) a mechanism for extensions to the basic kernel should be provided; and (5) the ray trace standard should integrate with future AXAF data product standards.

Hsieh, Paul F.↗

Near 40 Years MERRA-2 Data at NASA GES DISC -Opportunity and Challenge to Support Extremes Study

To the end of 2019, 40 years NASA climate reanalysis data sets from the Modern Era Retrospective-analysis for Research and Applications, Version 2 (MERRA-2) will be available at NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). MERRA-2 consists atmosphere, land, and ocean data, which may be used for the studies ranging from the short scale weather events to the large scale decadal vulnerabilities. The hourly products, such as precipitation, soil moisture, temperature, and aerosols etc., have been used widely to study extreme events.In supporting users from broad communities, GES DISC have developed various data access services, including subsetter for downloading only data of interest with preferred format; OPeNDAP - for machine-to-machine data access; and Giovanni- for online visualization and analysis, etc. A big challenge for extreme study is to downloading and processing long-term hourly or daily data. The data downloading performance is not very satisfied by many users with current services and the native archived data structure. Late June 2019, many people in Europe had experienced extreme heat waves. The temperatures in several countries exceeded 40°C (104°F). For example, MERRA-2 shows that the near surface daily maximum temperature of June 28 2019 over Marseille, a city in southern France, reached 41.1 °C (106°F), which is the record breaking temperature in the last 40 years. GES DISC is working together with domain science experts to improve the performance of long time series access, making analysis ready data sets in supporting application researches, such as extreme study. In this presentation, using Europe heat wave as an example, we will show prototype of the in developing service for finding extremes from near 40 years MERRA-2 data at a given location. MERRA-2 data can be accessed from NASA GES DISC(https://disc.gsfc.nasa.gov/ ) by search keyword "MERRA-2".

Shen, Suhung↗

The Value of Being a Trustworthy Repository

Today, NASA's Earth Observing System Data and Information System (EOSDIS), a system ofactive archives is attaching the CoreTrustSeal to its websites signifying that it merits theconfidence of its user community. But what value does being a trustworthy repository impart to auser? What does it mean to the owners and operators of repositories? What will it mean in thefuture? EOSDIS was started in the 1990s based on a framework of discipline-oriented, geographicallydistributed centers of expertise, named Distributed Active Archive Centers (DAACs). The functionof EOSDIS is to collect Earth Science data sensor measurements (principally those created andneeded by NASA) and manage the data and many derived digital products. EOSDIS providesmany services, including processing, curating, documenting, disseminating, and enabling datadiscovery as well as efficient use of the data. The EOSDIS has been operational over 25 years andmany lessons have been learned relative to the TRUST principles. During the tenure of EOSDIS,many changes have occurred as we have increased the size of the collection from gigabytes totens of petabytes and the distribution of the data to millions of users. We have had severalstages of system evolution that have improved EOSDIS in order to meet both stakeholder andcustomer expectations. This type of evolution is an on-going process to ensure that ourrepositories remain trustworthy. It is also important that our own community of data managersand system engineers add value in being trustworthy. This paper will discuss approaches to change within a large system of Earth Science data and services, while remaining a trustworthyrepository.

Behnke, Jeanne↗

An Application of Multivariate Statistical Analysis for Query-Driven Visualization

Driven by the ability to generate ever-larger, increasingly complex data, there is an urgent need in the scientific community for scalable analysis methods that can rapidly identify salient trends in scientific data. Query-Driven Visualization (QDV) strategies are among the small subset of techniques that can address both large and highly complex datasets. This paper extends the utility of QDV strategies with a statistics-based framework that integrates non-parametric distribution estimation techniques with a new segmentation strategy to visually identify statistically significant trends and features within the solution space of a query. In this framework, query distribution estimates help users to interactively explore their query's solution and visually identify the regions where the combined behavior of constrained variables is most important, statistically, to their inquiry. Our new segmentation strategy extends the distribution estimation analysis by visually conveying the individual importance of each variable to these regions of high statistical significance. We demonstrate the analysis benefits these two strategies provide and show how they may be used to facilitate the refinement of constraints over variables expressed in a user's query. We apply our method to datasets from two different scientific domains to demonstrate its broad applicability.

97 MATHEMATICS AND COMPUTING↗

Petascale Data Storage Institute (PDSI) Final Report

Petascale computing infrastructures for scientific discovery make petascale demands on information storage capacity, performance, concurrency, reliability, availability, and manageability. The Petascale Data Storage Institute focuses on the data storage problems found in petascale scientific computing environments, with special attention to community issues such as interoperability, community buy-in, and shared tools. The Petascale Data Storage Institute is a collaboration between researchers at Carnegie Mellon University, National Energy Research Scientific Computing Center, Pacific Northwest National Laboratory, Oak Ridge National Laboratory, Sandia National Laboratory, Los Alamos National Laboratory, University of Michigan, and the University of California at Santa Cruz. Because the Institute focuses on low level files systems and storage systems, its role in improving SciDAC systems was one of supporting application middleware such as data management and system-level performance tuning.

97 MATHEMATICS AND COMPUTING↗

Improved Microbial Community Characterization of 16S rRNA via Metagenome Hybridization Capture Enrichment

Environmental microbial diversity is often investigated from a molecular perspective using 16S ribosomal RNA (rRNA) gene amplicons and shotgun metagenomics. While amplicon methods are fast, low-cost, and have curated reference databases, they can suffer from amplification bias and are limited in genomic scope. In contrast, shotgun metagenomic methods sample more genomic regions with fewer sequence acquisition biases, but are much more expensive (even with moderate sequencing depth) and computationally challenging. Here, we develop a set of 16S rRNA sequence capture baits that offer a potential middle ground with the advantages from both approaches for investigating microbial communities. These baits cover the diversity of all 16S rRNA sequences available in the Greengenes (v. 13.5) database, with no sequence having <78% sequence identity to at least one bait for all segments of 16S. The use of our baits provide comparable results to 16S amplicon libraries and shotgun metagenomic libraries when assigning taxonomic units from 16S sequences within the metagenomic reads. We demonstrate that 16S rRNA capture baits can be used on a range of microbial samples (i.e., mock communities and rodent fecal samples) to increase the proportion of 16S rRNA sequences (average > 400-fold) and decrease analysis time to obtain consistent community assessments. Furthermore, our study reveals that bioinformatic methods used to analyze sequencing data may have a greater influence on estimates of community composition than library preparation method used, likely due in part to the extent and curation of the reference databases considered. Thus, enriching existing aliquots of shotgun metagenomic libraries and obtaining modest numbers of reads from them offers an efficient orthogonal method for assessment of bacterial community composition.

59 BASIC BIOLOGICAL SCIENCES↗

The pilot climate data system

The Pilot Climate Data System (PCDS) is an interactive scientific information management system for locating, obtaining, manipulating, and displaying climate-research data. The PCDS was developed to manage a large collection of data of interest to the National Aeronautics and Space Administration's (NASA) research community and currently provides such support for approximately twenty data sets. In order to provide the PCDS capabilities, NASA's Goddard Space Flight Center (NASA/GSFC) has integrated the capabilities of several general-purpose software packages with specialized software for reading and reformatting the supported data sets. These capabilities were integrated in a manner which allows the PCDS to be easily expanded, either to provide support for additional data sets or to provide additional functional capabilities. This also allows the PCDS to take advantage of new technology as it becomes available, since parts of the system can be replaced with more powerful components without significantly affecting the user interface.

Reph, M. G.↗

Data generated during the 2018 LAPSE-RATE campaign: an introduction and overview

Unmanned aircraft systems (UASs) offer innovative capabilities for providing new perspectives on the atmosphere, and therefore atmospheric scientists are rapidly expanding their use, particularly for studying the planetary boundary layer. In support of this expansion, from 14 to 20 July 2018 the International Society for Atmospheric Research using Remotely piloted Aircraft (ISARRA) hosted a community flight week, dubbed the Lower Atmospheric Profiling Studies at Elevation – a Remotely-piloted Aircraft Team Experiment (LAPSE-RATE; de Boer et al., 2020a). This field campaign spanned a 1-week deployment to Colorado's San Luis Valley, involving over 100 students, scientists, engineers, pilots, and outreach coordinators. These groups conducted intensive field operations using unmanned aircraft and ground-based assets to develop comprehensive datasets spanning a variety of scientific objectives, including a total of nearly 1300 research flights totaling over 250 flight hours. This article introduces this campaign and lays the groundwork for a special issue on the LAPSE-RATE project. The remainder of the special issue provides detailed overviews of the datasets collected and the platforms used to collect them. All of the datasets covered by this special issue have been uploaded to a LAPSE-RATE community set up at the Zenodo data archive (https://zenodo.org/communities/lapse-rate/, last access: 3 December 2020).

47 OTHER INSTRUMENTATION↗

The Mock LISA Data Challenges: History, Status, Prospects

This slide presentation reviews the importance for the Mock LISA Data Challenges (MLDC). Laser Interferometer Space Antenna (LISA) is a gravitational wave (GW) observatory that will return data such that data analysis is integral to the measurement concept. Further rationale of the MLDC are to kickstart the development of a LISA data-analysis computational infrastructure, and to encourage, track, and compare progress in LISA data-analysis development in the open community. The MLDCs is a coordinated, voluntary effort in GW community, that will periodically issue datasets with synthetic noise and GW signals from sources of undisclosed parameters; increasing difficulty. The challenge participants return parameter estimates and descriptions of search methods. Some of the challenges and the resultant entries are reviewed. The aim is to show that LISA data analysis is possible, and to develop new techniques, using multiple international teams for the development of LISA core analysis tools

data analysis↗

D2U: Data Driven User Emulation for the Enhancement of Cyber Testing, Training, and Data Set Generation

Whether testing intrusion detection systems, conducting training exercises, or creating data sets to be used by the broader cybersecurity community, realistic user behavior is a critical component of a cyber range. Existing methods either rely on network level data or replay recorded user actions to approximate real users in a network. Our work is the first to produce generative models trained on actual user data (sequences of application usage) collected on endpoints. Once trained to the user's behavioral data, these models can generate novel sequences of actions %that appear to come from the same distribution as the training data. These sequences of actions are then fed to our custom software via configuration files, which replicate those behaviors on end devices. Notably, our models are platform agnostic and could generate behavior data for any emulation software package. In this paper we present our model generation process, software architecture, and an initial evaluation of the fidelity of our models. Our software is currently deployed in a cyber range to help evaluate the efficacy of defensive cyber technologies. We suggest additional ways that the cyber community as a whole can benefit from more realistic user behavior emulation. The data used to train our model, as well as sample configuration files produced by the model, are available at [redacted].

Oesch, T↗

Using KBase to Assemble and Annotate Prokaryotic Genomes

The DOE Systems Biology Knowledgebase is an open–access bioinformatics software and data platform for analyzing plants, microbes, and their communities. KBase enables scientists to create, execute, collaborate on, and share reproducible analyses of their biological data in the context of public data and private collaborator data. For microbiologists researching prokaryotes, KBase offers analysis tools for performing quality control and assessment of Next–Generation Sequencing reads, de novo assembly, genome annotation, and tools for analyzing structural and functional features of genomes. As a result, this unit demonstrates an example workflow for taking a comparative and iterative approach to assembly and annotation of prokaryotic genomes using KBase that can be used by microbiologists seeking to perform isolate analysis in a rapid and reproducible fashion.

59 BASIC BIOLOGICAL SCIENCES↗

Preliminary Assessment of JERS-1 SAR to Discriminating Boreal Landscape Features for the Boreal Forest Mapping Project

This paper presents an overview of the JERS-1 North American Boreal Forest Mapping Project and a preliminary assessment of JERS-1 SAR imagery for application to discriminating features applicable to boreal landscape processes. The present focus of the JERS-1 North American Boreal Forest Mapping Project is the production of continental scale wintertime and summertime SAR mosaics of the North American boreal forest for distribution to the science community. As part of this effort, JERS-1 imagery has been collected over much of Alaska and Canada during the 1997-98 winter and 1998 summer seasons. To complete the mosaics, these data will be augmented with data collected during previous years. These data will be made available to the scientific community via CD ROM containing these and similar data sets compiled from companion studies of Asia and Europe. Regional landscape classification with SAR is important for the baseline information it will provide about distribution of woodlands, positions of treeline, current forest biomass, distribution of wetlands, and extent of major rivercourses. As well as setting the stage for longer term change detection, comparisons across several years provides additional baseline information about short-term landscape change. Rapid changes, including those driven by fire, permafrost heat balance, flooding, and insect outbreaks can dominate boreal systems. We examine JERS-1 imagery covering selected sites in Alaska and Canada to assess quality and applicability to such relevant ecological and hydrological issues. The data are generally of high quality and illustrate many potential applications. A texture-based classification scheme is applied to selected regions to assess the applicability of these data for distinguishing distribution of such landcover types as wetland, tundra, woodland and forested landscapes.

McDonald, Kyle↗

Vibroacoustic Response Data of Stiffened Panels and Cylinders

NASA has collected vibroacoustic response data on a variety of complex, aerospace structures to support research into numerical modeling of such structures. This data is being made available to the modeling community to promote the development and validation of analysis methods for these types of structures. Existing data from two structures is described, as well as plans for a data set from a third structure. The first structure is a 1.22 m by 1.22 m stiffened aluminum panel, typical of a commercial aircraft sidewall section. The second is an enclosed, stiffened aluminum cylinder, approximately 3.66 m long and 1.22 m in diameter, constructed to resemble a small aircraft fuselage with no windows and a periodic structure. The third structure is a filament-wound composite cylinder with composite stiffeners. Numerous combinations of excitation and response variables were measured on the structures, including: shaker excitation; diffuse acoustic field; velocity response from a laser vibrometer; intensity scans; and point acceleration.

Cabell, Randolph↗