SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Presentation conducted at the 11th Annual International AMS Tech Exchange in Spiez, Switzerland addressing the next generation algorithms require metadata and contextual data not currently recorded and/or digitized. Need to develop more robust and interchangability to perform more complex tasks for a wider range of international users.
This dataset contains stream discharge and temperature data for water years 2019 to 2025 from the East and Taylor Watersheds in Colorado, United States. This data was collected to understand hydrological processes occurring in the East River and Taylor River Watersheds, Colorado, which is part of the Lawrence Berkeley National Laboratory Watershed Function Scientific Focus Area. Data includes instantaneous observed discharge using salt dilution and acoustic doppler velocimeter techniques, raw pressure transducer downloaded data, sub-hourly temperature as well as corrected water level and associated stream discharge and mean daily values. Notes on water level corrections, rating curve development and metadata provided. A rating curve is the translation of depth to streamflow. The rating curve can be used as a quantitative measure of the “quality of the data.” Data within this dataset is formatted using ESS-DIVE’s Hydrological Monitoring Reporting Format. This data package contains (1) a zip file (Stream_Discharge_Data_WY19-WY25.zip) containing stream discharge and temperature data organized by location; (2) an InstallationMethods file (InstallationMethods.csv) describing metadata about the installation; (3) a file-level metadata (flmd.csv) file that lists each file contained in the dataset with associated metadata; (4) a data dictionary (dd.csv) file that contains terms/column_headers used throughout the files along with a definition, units, and data type; (5) a locations metadata file (locations.csv); (6) and a sensor metadata file (sensors.csv). All data files are in non-proprietary formats (csv, png, or pdf formats). Please contact Rosemary Carroll, Curtis Beutler, or Austin Shirley for any support in accessing the files. Update on 2023-05-12: Additional data from WYs 2021 and 2022 were added. Additionally, the dataset was converted using ESS-DIVE’s Hydrological Monitoring Reporting Format. Data files were reformatted to match reporting format guidance, new metadata files were added, and files were converted from excel to CSV. Update on 2025-05-16: Additional data from WYs 2022 (for locations not previously included), 2023, and 2024 were added. An additional descriptive PDF (WFSFA_Streamflow_Hydrograph_Disclaimer.pdf) was added. Metadata files were updated to reflect the addition of new data and locations. Update on 2026-05-18: Additional data from WY 2025 were added, including a new location Upper Trail Creek (TR-TCG2). Metadata files were updated to reflect the addition of new data.
Sensors are increasingly deployed for process monitoring and control. These produce on-line measurements at a high frequency, in parallel with low-frequency laboratory measurements. Compared to laboratory practices, sensor data quality assessment and control practices are far less structured at most utilities. This leads to inaccurate sensor data with unknown uncertainty factors.This chapter shows how to establish standard operating procedures (SOPs) to support sensor data quality assessment and control and subsequent maintenance actions by producing relevant sensor metadata. Furthermore, SOPs are provided for the most commonly used wastewater quality sensors, inspired by utility and academic best practices. This chapter builds on definitions provided in Chapter 3 and provides additional definitions specifically related to sensors maintenance. Chapter 6 complements the methods in this chapter, which are based on reference measurements, with data-analytical techniques.
This data package includes a time series of water level and temperature measurements from October 2018 to December 2021 in groundwater and surface water from the Slate River floodplain outside Crested Butte, CO, a focus field site for the SLAC Floodplain Hydro-Biogeochemistry SFA. The data was generated as part of the work targeting the overarching research question for the SLAC SFA: How do ubiquitous subsurface interfaces mediate molecular-scale biogeochemical processes and groundwater quality in floodplains and watersheds? The data were recorded by pressure transducers were installed in four types of piezometers: 1) a network of gravel bed ("GB") drive-point piezometers with a 6-inch screen interval installed all at ~330 cm below ground surface. 2) a network of piezometers screened across the water table, used to measure evapotranspiration ("ET") using the White method. Each of these piezometers is screened along almost its entire length.3) a suite nested piezometers used the measure the vertical hydraulic gradient ("VHG") across the fines-cobble interface. Each of these piezometers uses a 6-inch screen length.4) a group of piezometers scattered across the boundaries of the floodplain, used to monitor boundary conditions ("BC") flowing into and out of the floodplain. With the exception of "SR-BD-WT", each of these piezometers is screened along its entire length. Within the data package, "FLMD.csv" describes file-level metadata and "dd.csv" defines column headers and universal terms across the dataset. The data package includes 11 "*data.csv" files, one for each piezometer type for each calendar year. Because piezometers have been added over time, not every sensor has data dating back to Oct 2018. Each "*data.csv" file has a corresponding "*_InstallationMethods.csv" file that describes the location, elevation, screen depth, sediment type and sensor metadata for each piezometer and pressure transducer.
This data package includes a time-series of field measurements from March to October 2021 in groundwater and surface water from the Slate River floodplain in Crested Butte, CO, a focus field site for the SLAC Floodplain Hydro-Biogeochemistry SFA. The data was generated as part of the work targeting the overarching research question for the SLAC SFA: How do ubiquitous subsurface interfaces mediate molecular-scale biogeochemical processes and groundwater quality in floodplains and watersheds? The data package includes 5 data files, one for each measured variable: specific conductivity, pH, dissolved oxygen, water temperature and alkalinity. All measurements were recorded in the field immediately after water sampling. Groundwater samples were extracted from a network of installed rhizons (Rhizosphere Research Products, part no. 19.60.21F, 0.6 micrometer mesh size) and piezometer wells within the floodplain. In addition to the data files, there is a terminology file explaining the terms used, a file level metadata file, and a sensor file with metadata about the sensors used.All files are in csv format.
This data package includes a time-series of field measurements from May to September 2022 in groundwater and surface water from the Slate River and East River floodplains in Crested Butte, CO, a focus field site for the SLAC Floodplain Hydro-Biogeochemistry SFA. The data was generated as part of the work targeting the overarching research question for the SLAC SFA: How do ubiquitous subsurface interfaces mediate molecular-scale biogeochemical processes and groundwater quality in floodplains and watersheds? The data package includes 5 data files, one for each measured variable: specific conductivity, pH, dissolved oxygen, water temperature and alkalinity. All measurements were recorded in the field immediately after water sampling. Groundwater samples were extracted from a network of installed rhizons (Rhizosphere Research Products, part no. 19.60.21F, 0.6 micrometer mesh size) and piezometer wells within the floodplain. In addition to the data files, there is a terminology file explaining the terms used, a file level metadata file, and a sensor file with metadata about the sensors used.All files are in csv format.
This data package includes a time-series of field measurements from May to October 2020 in groundwater and surface water from the Slate River floodplain in Crested Butte, CO, a focus field site for the SLAC Floodplain Hydro-Biogeochemistry SFA. The data was generated as part of the work targeting the overarching research question for the SLAC SFA: How do ubiquitous subsurface interfaces mediate molecular-scale biogeochemical processes and groundwater quality in floodplains and watersheds? The data packade includes 6 data files, one for each measured variable: specific conductivity, pH, dissolved oxygen, water temperature, alkalinity and sulfide. All measurements were recorded in the field immediately after water sampling. Groundwater samples were extracted from a network of installed rhizons (Rhizosphere Research Products, part no. 19.60.21F, 0.6 micrometer mesh size) and piezometer wells within the floodplain. In addition to the data files, there is a terminology file explaining the terms used, a file level metadata file, and a sensor file with metadata about the sensors used.All files are in csv format.
Explore the source record for details and available documents.
Here, energy-related behaviors of occupants constitute a key factor influencing building performance; accordingly, the measured occupant data can support the objective assessment of the indoor environment and energy performance of buildings, which can inform building design and operational decisions. Existing data schemas focus on metadata of sensors, meters, physical equipment, and IoT devices in buildings; however, they are limited in representing the metadata of occupant data, including occupants' presence in spaces, movement between spaces, interactions with building systems or IoT devices, and preference of indoor environmental needs. To address this gap, an extension to the widely adopted metadata schema, Brick, is proposed to represent the contextual, behavioral, and demographic information of occupants. The proposed extension includes four parts: (1) a new “Occupant” class to represent occupants' demography and energy related behavioral patterns, (2) new subclasses under the Equipment class to represent envelope system and personal thermal comfort devices, (3) new subclasses under the Point class to represent occupant sensing and status, and (4) new auxiliary properties for occupant interactable equipment to represent the level of controllability for each piece of equipment by occupants. The extension is implemented in the Brick schema and has been tested using multiple occupant datasets from the ASHRAE Global Occupant Database. The extension enables Brick schema to capture diverse types of occupant sensing data and their metadata for FAIR data research and applications.
Building information modeling (BIM) has been widely adopted for representing and exchanging building data across disciplines during building design and construction. However, BIM's use in the building operation phase is limited. With the increasing deployment of low-cost sensors and meters, as well as affordable digital storage and computing technologies, growing volumes of data have been collected from buildings, their energy services systems, and occupants. Such data are crucial to help decision makers understand what, how, and when energy is consumed in buildings—a critical step to improving building performance for energy efficiency, demand flexibility, and resilience. However, practical analyses and use of the collected data are very limited due to various reasons, including poor data quality, ad-hoc representation of data, and lack of data science skills. To unlock value from building data, there is a strong need for a toolchain to curate and represent building information and performance data in common standardized terminologies and schemas, to enable interoperability between tools and applications. This study selected and reviewed 24 data tools based on common use cases of data across the building life cycle, from design to construction, commissioning, operation, and retrofits. The selected data tools are grouped into three categories: (1) data dictionary or terminology, (2) data ontology and schemas, and (3) data platforms. The data are grouped into ten typologies covering most types of data collected in buildings. This study resulted in five main findings: (1) most data representation tools can represent their intended data typologies well, such as Green Button for smart meter data and Brick schema for metadata of sensors in buildings and HVAC systems, but none of the tools cover all ten types of data; (2) there is a need for data schemas to represent the basis of design data and metadata of occupant data; (3) standard terminologies such as those defined in BEDES are only adopted in a few data tools; (4) integrating data across various stages in the building life cycle remains a challenge; and (5) most data tools were developed and maintained by different parties for different purposes, their flexibility and interoperability can be improved to support broader use cases. Finally, recommendations for future research on building data tools are provided for the data and buildings community based on the FAIR principles to make data Findable, Accessible, Interoperable, and Reusable.
Regions with remote and complex terrain experience spatially varying streamflow patterns, but are often poorly sampled due to difficult access. This data package includes streamflow measurements collected using low-visibility and low-impact installations at four sites on the Tuolumne River in Yosemite National Park, for water years 2002 to 2021. The resulting data set offers a unique opportunity to explore hydrologic processes in complex terrain.This data package contains half-hourly recordings of unvented pressure, vented pressure, and water temperature are measured and used to estimate discharge and stage height. Discharge flags provide insight into data anomalies. This dataset is formatted in accordance with ESS-Dive's Hydrologic Monitoring and File Level Metadata Formats. It contains the following files:1) Folder containing four csv files of time series streamflow measurements (unvented pressure, vented pressure, estimated discharge, water temperature, stage height, and discharge flag) from four locations on the Tuolumne River2) Data dictionary (dd.csv) containing units, definitions, human readable column names, and data type for all column headers throughout the dataset3) File-level metadata (FLMD.csv) containing metadata for files contained in the dataset4) Installation methods (InstallationMethods.csv) containing metadata on sensor installation
This dataset was used to assess the potential of a Distributed Temperature Profiling System developed and presented in the article named "A Distributed Temperature Profiling System for Vertically and Laterally Dense Acquisition of Soil and Snow Temperature" and submitted to Cryosphere. There are three comma-delimited data files (.csv). Each of them contains snow or soil temperature with times (UTC) in the first column and temperature at various vertical distance from the ground surface (positive means in air/snow) or below the ground surface (negative means in soil). The measurements were acquired every 15 minutes. Data collected at the East River, Colorado site with two probes: 1) measuring air/snow temperature from 1.1 m above the ground surface to the ground surface (with 5 or 10 cm spacing between sensors) and 2) measuring soil temperature from the ground surface to 0.7 m depth (with 5 or 10 cm spacing between sensors). Data collected at the Teller road (mile 27) site near Nome, Alaska with one probe: measuring soil temperature from 5 cm above the ground surface to 1.05 m depth (with 5 or 10 cm spacing between sensors). Additional metadata included in *.csv and *.pdf files. NGEE Arctic Project Summary: The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
This report provides a comprehensive overview of metadata to describe sensor signals in wastewater treatment plants and methods to obtain such metadata. In this introduction, we explain the original motivation behind the MetaCO task group. This includes a description of historical challenges (data volume, data velocity) for which mature technology is now available, and newer challenges, which relate to data structure (data variety) and data quality (veracity). We conclude the chapter with an expression of gratitude to all involved.
A key barrier to applying any smart technology to a building is the requirement of locating and connecting to the necessary resources among the thousands of sensing and control points, i.e., the metadata mapping problem. Existing solutions depend on exhaustive manual annotation of sensor metadata --- a laborious, costly, and hardly scalable process. To reduce the amount of manual effort required, this paper presents a multi-oracle selective sampling framework to leverage noisy labels from information sources with unknown reliability such as existing buildings, which we refer to as weak oracles, for metadata mapping. This framework involves an interactive process, where a small set of sensor instances are progressively selected and labeled for it to learn how to aggregate the noisy labels as well as to predict sensor types. Two key challenges arise in designing the framework, namely, weak oracle reliability estimation and instance selection for querying. To address the first challenge, we develop a clustering-based approach for weak oracle reliability estimation to capitalize on the observation that weak oracles perform differently in different groups of instances. For the second challenge, we propose a disagreement-based query selection strategy to combine the potential effect of a labeled instance on both reducing classifier uncertainty and improving the quality of label aggregation. We evaluate our solution on a large collection of real-world building sensor data from 5 buildings with more than 11,000 sensors of 18 different types. The experiment results validate the effectiveness of our solution, which outperforms a set of state-of-the-art baselines.
The Intelligent Data Management (IDM) project at NASA/Goddard Space Flight Center has prototyped an Intelligent Information Fusion System (IIFS), which automatically ingests metadata from remote sensor observations into a large catalog which is directly queryable by end-users. The greatest challenge in the implementation of this catalog was supporting spatially-driven searches, where the user has a possible complex region of interest and wishes to recover those images that overlap all or simply a part of that region. A spatial data management system is described, which is capable of storing and retrieving records of image data regardless of their source. This system was designed and implemented as part of the IIFS catalog. A new data structure, called a hypercylinder, is central to the design. The hypercylinder is specifically tailored for data distributed over the surface of a sphere, such as satellite observations of the Earth or space. Operations on the hypercylinder are regulated by two expert systems. The first governs the ingest of new metadata records, and maintains the efficiency of the data structure as it grows. The second translates, plans, and executes users' spatial queries, performing incremental optimization as partial query results are returned.
This paper introduces a database of 34 field-measured building occupant behavior datasets collected from 15 countries and 39 institutions across 10 climatic zones covering various building types in both commercial and residential sectors. This is a comprehensive global database about building occupant behavior. The database includes occupancy patterns (i.e., presence and people count) and occupant behaviors (i.e., interactions with devices, equipment, and technical systems in buildings). Brick schema models were developed to represent sensor and room metadata information. The database is publicly available, and a website was created for the public to access, query, and download specific datasets or the whole database interactively. The database can help to advance the knowledge and understanding of realistic occupancy patterns and human-building interactions with building systems (e.g., light switching, set-point changes on thermostats, fans on/off, etc.) and envelopes (e.g., window opening/closing). With these more realistic inputs of occupants’ schedules and their interactions with buildings and systems, building designers, energy modelers, and consultants can improve the accuracy of building energy simulation and building load forecasting.
This chapter aims to provide a comprehensive overview of metadata types that may be useful during system design, optimization, and automation. Metadata are grouped into three main categories: (a) metadata describing signal generation, (b) metadata describing signal quality, and (c) contextual information in the form of annotations. Each of these categories is introduced and explained in three separate sections. Importantly, this chapter mainly answers what is considered metadata. To a lesser degree, recommendations are made regarding the selection of metadata for long-term storage. Chapter 4 will explain where and how to store metadata. Chapters 5 and 6 explain how to collect certain metadata through dedicated sensor validation tests (Chapter 5) or algorithmic analysis (Chapter 6).
Healthy seismoacoustic sensors and accurate metadata are critical to all the science objectives of both the Source Physics Experiment (SPE) Rock Valley Direct Comparison (RV/DC) and LowYield Physics Experiment-1 (LYNM PE-1). Both projects share similar seismoacoustic stations. We provide a plan on how to move forward with waveform data quality assessments (QA) to the working groups. The identification of stations with instrument response errors will be useful to researchers using amplitudes to study source effects and Earth attenuation. The data QA can also be useful for field technicians to help identify and correct problem sites.