Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metadata”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

The Imperial Valley Dark Fiber Project: Toward Seismic Studies Using DAS and Telecom Infrastructure for Geothermal Applications

We report that the Imperial Valley is a seismically active basin occupying the southern end of the Salton trough, an area of rapid extension, high heat flow, and abundant geothermal resources. This report describes an ongoing large-scale distributed acoustic sensing (DAS) recording study acquiring high-density seismic data on an array between Calipatria and Imperial, California. This 27 km array, operating on dark fiber since 9 November 2020, has recorded a wealth of local seismic events as well as ambient noise. The goal of the broader Imperial Valley Dark Fiber project is to evaluate passive DAS as a tool for geothermal exploration and monitoring. This report is intended to provide installation information, noise characteristics, and metadata for future studies utilizing the data set. Because of the relatively small number of basin-scale DAS studies that have been conducted to date, we also provide a range of lessons learned during the deployment to assist future researchers exploring this acquisition strategy.

15 GEOTHERMAL ENERGY↗
DOE OSTI2023

PubDAS: A PUBlic Distributed Acoustic Sensing Datasets Repository for Geosciences

During the past few years, distributed acoustic sensing (DAS) has become an invaluable tool for recording high-fidelity seismic wavefields with great spatiotemporal resolutions. However, the considerable amount of data generated during DAS experiments limits their distribution with the broader scientific community. Such a bottleneck inherently slows down the pursuit of new scientific discoveries in geosciences. Here, we introduce PubDAS—the first large-scale open-source repository where several DAS datasets from multiple experiments are publicly shared. PubDAS currently hosts eight datasets covering a variety of geological settings (e.g., urban centers, underground mines, and seafloor), spanning from several days to several years, offering both continuous and triggered active source recordings, and totaling up to ~90 TB of data. Here this article describes these datasets, their metadata, and how to access and download them. Some of these datasets have only been shallowly explored, leaving the door open for new discoveries in Earth sciences and beyond.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

NATCARB

The National Carbon Sequestration Database (NATCARB) is a geographic information system (GIS)-based tool for viewing carbon capture, use and storage (CCUS) potential across the United States. Through a graphical user interface, NATCARB displays locations and associated metadata about stationary CO2 sources and potential geologic sinks. Users can access, query and model, analyze, display, and download CO2 storage resource data.

Atlas↗
DOE OSTI2018

Oklahoma Wellbore Rasters

Seven raster surfaces generated from wellbore information that are thought to influence fluid and or gas migration in the subsurface. Wellbore information was originally retrieved from the IHS Energy Group (current as of April 2015), which is a proprietary, commercial database containing information for most oil and gas wells in the U.S. Processing of wellbore information into gridded cells was performed to provide a graphic solution to overcome the problem of displaying proprietary well data. No proprietary data are displayed or included in the cell maps. These rasters were developed to serve as inputs to the SIMPA (Spatially Weighted Multivariate Probabilistic Assessment) tool. Each raster surface is a derivative product of wellbore dataset. Each raster represents a single wellbore attribute or combination of attributes that speak to the following wellbore characteristics: number of recompletions, year spud, year abandoned, year completed, number of abandoned wells, hole direction, switch from production to injection. The original wellbore information, retrieved from the IHS Energy Group, are in the form of points – these derivative rasters aggregate point attributes to approximately 1,000-meter resolution grid cells. Each raster only includes cells that contain wellbores with the characteristics represented in each surface (i.e. if the wellbores in a given cell have no year abandoned data, the cell is not included in the raster). Since the raster cells combine data from multiple points in many cases, methods such as the average, minimum, and count are used to summarize the information in each cell. The specific operations used to develop each raster are detailed in its metadata.

Abandoned↗
DOE OSTI2019

Oklahoma structural complexity data

Zipped file contains raster data (TIF) files and thumbnail image (PNG) files associated with modeling known and predicting structural complexity (SC) for the state of Oklahoma, two SIMPA simulation files (.SIJN) and two README (.txt) files to run both the known SC and proxy SC models using the SIMPA tool, and a "Source data catalog.xlsx" file that provides information on the source data and how it was used to represent each raster Note: Metadata including processing steps can be viewed in ESRI's ArcCatalog software

raster↗
DOE OSTI2021

Datasets for DOE 2021 Communities LEAP Pilot

This submission offers data aligned to each of the four eligibility criteria outlined in the United States Department of Energy (DOE) 2021 Communities LEAP (Local Energy Action Program) Pilot. Please visit the LEAP website (https://www.energy.gov/communitiesLEAP/communities-leap) to learn more about LEAP and gain additional contextual information for how these data may be used. The data provided in the file approximates how the eligibility criteria apply at the census tract level across the United States (U.S.). The excel file available for download provides information pertaining to each of the four criteria outlined (average energy burden, percent low income, historic fossil energy communities) for all census tracts within the 50 U.S. States, the District of Columbia (D.C.), and Puerto Rico. The tabs within the excel file provide a file description, a summary data table (a simplified, easy to use presentation of the four eligibilities criteria), metadata (description, source, and other pertinent details for all variables provided), and a full, detailed data table. Please note that while these data are provided at the census tract level, census tracts do not necessarily have the same physical boundaries as a community but were used as they provide the closest proxy based on publicly available information collected using an empirically robust method. U.S. territories are not listed but are eligible to apply to Communities LEAP. As stated in the Opportunity Announcement, applying communities should describe how they meet the eligibility criteria in their application even if these data do not specifically show that they are eligible.

Communities↗
DOE OSTI2023

Carbon Storage Technical Viability Approach (CS TVA) Database

The Carbon Storage Technical Viability Approach (CS TVA) database was developed to support the implementation of the CS TVA Matrix to a national data availability assessment for technically viable carbon storage. This database leverages the efforts of multiple adjacent and overlapping databases by non-redundantly combining the databases into a single database along with additionally providing tags facilitating the CS TVA. The non-redundant aspect of the database permits an accurate assessment of the concentration of available data, aiding in spatial and categorical data gaps analysis relative to the individual CS TVA Matrix Components. Version 2.0 of the database is an expansion of Version 1.0. Version 2.0 was created to include additional data gathered to fill gaps in the existing data set. Downloading the CS TVA v2.0 database will result in two separate databases, the version 1.0 original .gdb, and a second addendum .gdb with the new data gathered, together these two databases make up v2.0. Please see the ReadMe file below for full details, metadata information, use disclaimer, and attributions.

Coal↗
DOE OSTI2023

The catalog-to-cosmology framework for weak lensing and galaxy clustering for LSST

We present TXPipe, a modular, automated and reproducible pipeline for ingesting catalog data and performing all the calculations required to obtain quality-assured two-point measurements of lensing and clustering, and their covariances, with the metadata necessary for parameter estimation. The pipeline is developed within the Rubin Observatory Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC), and designed for cosmology analyses using LSST data. In this paper, we present the pipeline for the so-called 3x2pt analysis -- a combination of three two-point functions that measure the auto- and cross-correlation between galaxy density and shapes. We perform the analysis both in real and harmonic space using TXPipe and other LSST-DESC tools. We validate the pipeline using Gaussian simulations and show that it accurately measures data vectors and recovers the input cosmology to the accuracy level required for the first year of LSST data under this simplified scenario. We also apply the pipeline to a realistic mock galaxy sample extracted from the CosmoDC2 simulation suite (Korytov et al. 2019). TXPipe establishes a baseline framework that can be built upon as the LSST survey proceeds. Furthermore, the pipeline is designed to be easily extended to science probes beyond the 3x2pt analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Science Capsule - Capturing the Data Life Cycle

The data generated from scientific workflows often become unusable due to the lack or incompleteness of information required for processing and analyzing the data. Reproducibility of scientific data and workflows facilitates efficient processing and analyses. A key to enabling reproducibility is to capture the end-to-end workflow life cycle, and any contextual metadata and provenance.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2023

Curifactory: A research experiment manager

Curifactory is a command line tool and framework for organizing Python experiment code, configuration parameters, and results. It is an opinionated and lightweight approach to workflow management infrastructure and is primarily intended to support researchers conducting experiments on one machine. This software was developed to support the reproducibility of results for several data science projects in the Nuclear Nonproliferation Division at Oak Ridge National Laboratory. Curifactory is intended to be a general framework and is not specific to machine learning or data science. It can aid in any field in which experiments are primarily computation-based studies and can be implemented in Python (e.g., high-energy physics, astronomy, computational chemistry). Here, the design emphasizes the automated caching of intermediate data analysis artifacts to speed up development involving computationally intensive tasks. It also allows for data provenance and experiment reproduction. Individual experiment runs are tracked through logs and their output reports, and entire copies of a run with all cached data and metadata can be exported for others to run using Curifactory on another machine. Curifactory experiments can either be integrated into a project from the beginning or can be written on top of an existing codebase without needing significant modification. A few important views of the Curifactory library can be seen in Figure 1.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

xCDAT: A Python Package for Simple and Robust Analysis of Climate Data

xCDAT (Xarray Climate Data Analysis Tools) is an open-source Python package that extends Xarray (Hoyer & Hamman, 2017) for climate data analysis on structured grids. xCDAT streamlines analysis of climate data by exposing common climate analysis operations through a set of straightforward APIs. Some of xCDAT’s key features include spatial averaging, temporal averaging, and regridding. These features are inspired by the Community Data Analysis Tools (CDAT) library (Dean N. Williams et al., 2009) (D. N. Williams, 2014) (Doutriaux et al., 2019) and leverage powerful packages in the Xarray ecosystem including xESMF (Zhuang et al., 2023), xgcm (Abernathey et al., 2022), and CF xarray (Cherian et al., 2023). To ensure general compatibility across various climate models, xCDAT operates on datasets that are compliant with the Climate and Forecast (CF) metadata conventions (Hassell et al., 2017).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Making digital objects FAIR in high energy physics: An implementation for Universal FeynRules Output (UFO) models

Research in the data-intensive discipline of high energy physics (HEP) often relies on domain-specific digital contents. Reproducibility of research relies on proper preservation of these digital objects. This paper reflects on the interpretation of principles of Findability, Accessibility, Interoperability, and Reusability (FAIR) in such context and demonstrates its implementation by describing the development of an end-to-end support infrastructure for preserving and accessing Universal FeynRules Output (UFO) models guided by the FAIR principles. UFO models are custom-made python libraries used by the HEP community for Monte Carlo simulation of collider physics events. Our framework provides simple but robust tools to preserve and access the UFO models and corresponding metadata in accordance with the FAIR principles.

Neubauer, Mark S.↗
DOE OSTI2023

Codebase release 2.0 for UFOManager

Research in the data-intensive discipline of high energy physics (HEP) often relies on domain-specific digital contents. Reproducibility of research relies on proper preservation of these digital objects. This paper reflects on the interpretation of principles of Findability, Accessibility, Interoperability, and Reusability (FAIR) in such context and demonstrates its implementation by describing the development of an end-to-end support infrastructure for preserving and accessing Universal FeynRules Output (UFO) models guided by the FAIR principles. UFO models are custom-made python libraries used by the HEP community for Monte Carlo simulation of collider physics events. Our framework provides simple but robust tools to preserve and access the UFO models and corresponding metadata in accordance with the FAIR principles.

Neubauer, Mark S.↗
DOE OSTI2024

Practical procedures for sensor quality assessment

Sensors are increasingly deployed for process monitoring and control. These produce on-line measurements at a high frequency, in parallel with low-frequency laboratory measurements. Compared to laboratory practices, sensor data quality assessment and control practices are far less structured at most utilities. This leads to inaccurate sensor data with unknown uncertainty factors.This chapter shows how to establish standard operating procedures (SOPs) to support sensor data quality assessment and control and subsequent maintenance actions by producing relevant sensor metadata. Furthermore, SOPs are provided for the most commonly used wastewater quality sensors, inspired by utility and academic best practices. This chapter builds on definitions provided in Chapter 3 and provides additional definitions specifically related to sensors maintenance. Chapter 6 complements the methods in this chapter, which are based on reference measurements, with data-analytical techniques.

Alferes, Janelcy↗
DOE OSTI2024

Analytical methods for online data quality assessment

This chapter provides a comprehensive overview of the main steps for algorithmic sensor signal quality assessment, which can enhance the decision-making process for water resource recovery facility (WRRF) operation and optimization. It introduces the concept of redundancy as the basis for data quality assessment. It also explains the typical data processing pipeline, which consists of preliminary analysis, data pre-processing, and specific algorithmic approaches. Each of these processes is presented and discussed in three separate sections. Importantly, this chapter introduces the main approaches for data quality assessment, provides guidelines for selecting the most suitable one and the key performance indicators to evaluate them and explains how to collect metadata through such an algorithmic approach.

Aguado, Daniel↗
DOE OSTI2012

Digitization Best Practices [Poster]

This project involved performing tests and documenting results to determine best practices for digitizing older print documents. The digitization process is complicated, especially when original documents exhibit non-standard fonts and are faded. Tests focused on solutions to improve high quality scanning, increase OCR accuracy, and efficiently use embedded metadata. Results are summarized. From the test results on the right sides, we know that when we plan to digitize documents, we should balance Quantity and Quality based on our expectation, and then make final decision for the digitization process.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2012

SPE3 Far-field Quicklook

The purpose of this report is to provide an overview of the seismic data collected during the SPE3 chemical shot. Farfield seismic data includes data collected at distances of more than 100 m from the shot and instruments deployed for the experiments. This report does not address infrasound, remote sensing, or seismic data collected by regional permanent stations. The primary goal is a fast data check before extensive analysis. The SPE3 shot was conducted on July 24, 2012 (DOY 206) at the SPE test site and in the same borehole as SPE1 and SPE2 (table 1). Data processing at LLNL primarily used mini-­seed data volumes downloaded from the UNR server along with associated metadata. This is in contrast to earlier shots, where LLNL data was based on reformatted Reftek data. Sensor deployment was similar to previous shots, with a few changes. Parts of lines 1 (13, 14, 15, 16), 3 (23,26,36), and 5 (1-­12) were recorded by telemetry as well as to disk, which provided immediate access to the data. A small array (6 station) geophone array was deployed southeast of the shot near AF9 to measure particle motions. A new rotational sensor (ATA ARS-­16) was deployed at station L3-­20.

58 GEOSCIENCES↗
DOE OSTI2012

Analyzing and visualizing next generation climate data (Final Report)

The project "Analyzing and visualizing next generation climate data" adds block-structured (mosaic) grid support, parallel processing, and 2D/3D curvilinear interpolation to the open-source UV-CDAT climate data analysis tool. Block structured grid support complies to the Gridspec extension submitted to the Climate and Forecast metadata conventions. It contains two parts: aggregation of data spread over multiple mosaic tiles (M-SPEC) and aggregation of temporal data stored in different files (F-SPEC). Together, M-SPEC and F-SPEC allow users to interact with data stored in multiple files as if the data were in a single file. For computational expensive tasks, a flexible, multi-dimensional, multi-type distributed array class allows users to process data in parallel using remote memory access. Both nodal and cell based interpolation is supported; users can choose between different interpolation libraries including ESMF and LibCF depending on the their particular needs.

54 ENVIRONMENTAL SCIENCES↗