Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metadata”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Report for the ASCR Workshop on the Management and Storage of Scientific Data

The purpose of this workshop is to identify priority research directions in the area of data management for high-performance and scientific computing above and beyond HPC’s traditional "the parallel file system is the data-management system" model. Supporting the breadth of the DOE mission, including the explosion of AI uses and the growing needs of experimental and observational science, motivates revisiting our assumptions about data management. There are many facets of this topic to explore including: (1) Interfaces for accessing data that resides on traditional persistent storage as well as memory devices; (2) Storage-system architecture design that supports scientific workflows on varied hierarchical storage and networking devices; (3) Devising metadata management infrastructure to support FAIR principles (Findability, Accessibility, Interoperability, and Reusability); (4) Capturing provenance information about scientific data; (5) Utilizing AI to learn I/O patterns of emerging workloads for efficient data management; (6) Providing data management support for AI and complex workflows; and (7) Understanding the overlap between traditional storage systems and I/O (SSIO) efforts and data management. While the program committee has identified these topics as important areas for discussion, we welcome position papers from the community that propose additional topics of interest for discussion at the workshop. The workshop agenda will include breakout sessions for discussing these and selected topic areas to inform priority research directions for data management for high-performance and scientific computing.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A High-Throughput Computing Infrastructure to Generate Custom, Open Community Geothermal Datasets

The most significant challenge facing geothermal research, development, and deployment is a lack of comprehensive datasets describing the geological and economical properties of North America. Automated knowledge base construction, the process of designing algorithms to analyze text and images to programmatically build new datasets, is one possible solution to this problem. The xDD library of full-text scientific articles (https://xdd.wisc.edu) is one of the largest collections of open and controlled-access scientific documents available for knowledge base construction in the world, but it has been underutilized by experts in geothermal research. The xDD development team attributed the lack of engagement by software developers and geothermal researchers to two perceived shortcomings of the system. First, the workflow for obtaining data from xDD for local development and testing of data mining applications was unnecessarily abstruse and required significant manual intervention by xDD systems administrators. Second, although xDD already held articles from a broad cross-section of scientific literature with an emphasis on the geosciences, it did not have an explicit set of geothermal research documents that could serve as the nucleus of a geothermal data mining application. To address these issues, the Automated Data Extraction PlaTform (ADEPT) was proposed to extend the data distribution capabilities of the xDD system. The ADEPT extension added the following four key features to xDD: 1) integration of National Geothermal Data System (NGDS) documents into the xDD library to provide an explicitly geothermally-themed collection; 2) improved RESTful (i.e., https-protocol driven) web services for external partners to access xDD data for machine learning application development; 3) a web platform for end-users and xDD administrators to coordinate the development of data mining applications from the initial step of browsing available documents to the final stage of deploying a production-quality machine learning application on high-throughput computing infrastructure; and 4) the development of demonstration data mining applications to illustrate the new workflow to potential collaborators. A total of 21,674 geothermal documents from NGDS were fully ingested into the xDD library and the associated metadata is publicly available through the xDD web services; furthermore, the ADEPT web platform is now publicly accessible and fully live at https://xdd.wisc.edu/adept/.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

Data Report: TurboWave I and II Data Release

The TurboWave I and II infrasound campaigns were conducted to examine short term variability in acoustic propagation at local and regional distances. The tests were conducted in nearly co-located regions at the Energetic Materials Research and Testing Center in Socorro, NM between 2019 and 2020 and recorded across a variety of acoustic microbarometer sensors. This report details the waveform data recorded from the experiment and coincides with data archival at the Incorporated Research Institutions for Seismology. The report includes a description of the experiment along with the types of data and instruments. The data release includes raw waveform data as well as metadata information.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Waveform Data Quality Assessment

Healthy seismoacoustic sensors and accurate metadata are critical to all the science objectives of both the Source Physics Experiment (SPE) Rock Valley Direct Comparison (RV/DC) and LowYield Physics Experiment-1 (LYNM PE-1). Both projects share similar seismoacoustic stations. We provide a plan on how to move forward with waveform data quality assessments (QA) to the working groups. The identification of stations with instrument response errors will be useful to researchers using amplitudes to study source effects and Earth attenuation. The data QA can also be useful for field technicians to help identify and correct problem sites.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Analysis of Conservation Voltage Reduction under Inverter-Based VAR-Support [Slides]

Conservation voltage reduction (CVR) is a common technique used by utilities to strategically reduce demand during peak periods. As penetration levels of distributed generation (DG) continue to rise and advanced inverter capabilities become more common, it is unclear how the effectiveness of CVR will be impacted and how CVR interacts with advanced inverter functions. In this work, we investigated the mutual impacts of CVR and DG from photovoltaic (PV) systems (with and without autonomous Volt-VAR enabled). The analysis was conducted on an actual utility dataset, including a feeder model, measurement data from smart meters and intelligent reclosers, and metadata for more than 30 CVR events triggered by the utility over the year. The installed capacity of the modeled PV systems represented 66% of peak load, but reached instantaneous penetrations reached up to 2.5x the load consumption over the year. While the objectives of CVR and autonomous Volt-VAR are opposed to one another, this study found that their interactions were mostly inconsequential since the CVR events occurred when total PV output was low.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Utility-Scale Solar, 2022 Edition: Empirical Trends in Deployment, Technology, Cost, Performance, PPA Pricing, and Value in the United States [Slides]

Berkeley Lab’s “Utility-Scale Solar, 2022 Edition” provides an overview of key trends in the U.S. market, with a focus on 2021. Highlights of this year’s update include: -A record of nearly 12.5 GWAC of new utility-scale PV capacity came online in 2021, bringing cumulative installed capacity to more than 51.3 GWAC across 44 states. -90% of all new utility-scale PV capacity added in 2021 uses single-axis tracking. -Median installed project costs declined to $\$1.35$/WAC (or $\$1.02$/WDC) in 2021. -Project-level capacity factors vary widely, from 9% to 35% (on an AC basis), with a sample median of 24%. The report explores drivers of this variation. -Utility-scale PV’s LCOE fell to $\$33$/MWh in 2021 ($\$27$/MWh if factoring in the federal investment tax credit, or ITC). -PPA prices have largely followed the decline in solar’s LCOE over time, but have recently stagnated and even moved slightly higher. Prices from a sample of recent contracts average around $\$20$/MWh (levelized) in the West and $\$30-40$/MWh elsewhere in the continental US. In 2021, solar’s average market value (defined in the report to include only energy and capacity value) rose by 55% to $\$47$/MWh and exceeded average wholesale prices in 13 of the 17 balancing authorities analyzed. -Adding battery storage is one way to increase the value of solar. Our public data file tracks metadata and PPA prices from 67 PV+battery hybrid projects that are already online or that have secured offtake arrangements. -At the end of 2021, there were at least 674 GW of utility-scale solar power capacity within the interconnection queues across the nation, 284 GW of which include batteries. For more information, and to explore related interactive data visualizations, go to utilityscalesolar.lbl.gov.

14 SOLAR ENERGY↗
DOE OSTI2021

Waste Compliance and Tracking System (WCATS) Version 3 Requirements Document

This document describes the end-user requirements for the Waste Compliance and Tracking System (WCATS) project in accordance with the WCATS Software Quality Management Plan, EPC-WMP-WCATSPLAN-001. The WCATS application shall support the generation, characterization, processing, and shipment of LANL radioactive, hazardous, and industrial waste. Regulatory drivers include RCRA hazardous waste, DOT shipping, NNSA nuclear material control and accountability, DOE nuclear safety, TSDF permit, and transuranic waste certification requirements. The system will utilize a task-based architecture that supports the spectrum of treatment, storage, disposal, administrative, and characterization based unit operations necessary to manage waste from cradle to grave. The application design shall readily accommodate new facilities, processes, workflow, signature requirements, and so forth, via end-user established metadata. WCATS will provide support for representing waste storage and disposal facilities, buildings, rooms, and grid layouts (x, y, z) to support waste and radioactive material inventory management. Nuclear material at risk (MAR), DOE hazard rating (e.g., Category II facility) compliance per DOE-STD-1027, and permit inventory requirements will be configurable for any storage or disposal facility, or waste operation, and the system will automatically evaluate and enforce those requirements. In addition, the application will support the characterization and management of the entire range of hazardous and radioactive wastes (TRU, MTRU, LLW, MLLW, hazardous waste, etc.) that might be colocated or processed at a permitted facility. Some capabilities not found in traditional systems include user-defined tank systems for liquid waste, user-defined work paths (i.e., sequence of operations), and an equipment subsystem for tracking the calibration, maintenance, and inspection of tools used to process waste, such as torque wrenches, scales, pH probes, etc. The application incorporates a desktop and mobile user interface as shown in Figure 1. The mobile interface supports field operations, such as waste item characterization, intra-facility transfers, internal and external audits, and shipment preparation and receipt.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

FAIRification, Quality Assessment, and Missingness Pattern Discovery for Spatiotemporal Photovoltaic Data

The ongoing growth of the photovoltaic market has pushed the demand for power forecasting and performance evaluation for a huge population of PV power plants. Through access to a large number of time series data sets from different power plants, we have found common issues that impede the modeling process. Namely, the time series data are hard to transfer between groups due to differences in variable nomenclature, and the quality of the data sets can vary. We address the issue of variable nomenclature by FAIRifying spatiotemporal PV time series data. Through the creation of a solar power plant ontology, we propose standards for the naming and structure of metadata used to describe the data from these power plants. Using the structure from this ontology, we have developed both R and Python packages for the automation of the FAIRification process. We have also developed an R package that automates the analysis of the quality of a data set through the designation of letter grades. With access to large time series data sets across many power plants, we can utilize spatiotemporal coherence between the sites in order to improve the quality of our data. To solve the issue of data missingness, we propose the use of Spatiotemporal-GNN autoencoders to detect and impute missing values from a data set by utilizing data from power plants nearby.

14 SOLAR ENERGY↗
DOE OSTI2023

An Approach to Data Management Planning for Protected Data Projects

This report describes what is required in a data management plan for data that needs to be protected in some fashion. Here we provide an overview of what a data manager should consider, including the data ingestion and various extract-transform-load processes, metadata considerations and documentation, to what might need to be accounted for in the event of data loss. In addition, this report includes two appendices: forms that, when filled out, make the user compliant with DOE data management requirements as well as additional requirements for handling protected data at ORNL.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2023

Data Archive and Portal (DAP) Platform for Solid Phase Processing Technologies

The scale and speed of data generated by modern scientific experiments have constantly challenged the research community to store, curate, manage and optimally use it to drive scientific discoveries. In this work, we have developed a data archive and portal (DAP) platform including analytics capabilities to collect, curate, and manage data and metadata stream for solid phase processing (SPP) techniques. We successfully hosted around ~347K files of data related to processing parameters, microscopic images, and spectroscopic data related to solid phase processing. The DAP platform for SPP will establish an enduring capability to support machine learning and grow collaboration at the intersection of materials science and data science.

36 MATERIALS SCIENCE↗
DOE OSTI2023

ASC Data Science Infrastructure Project June 2023 [Slides]

Data Science Infrastructure (DSI) Project offers a standardized but flexible way of storing data and associated metadata to support AI/ML and data intensive scientific workflows: Establish requirements via use case interviews; Develop DSI framework to support flexible, secure, and accessible data stores tailored to researcher needs; Augment existing institutional frameworks for code management, performance testing and file indexing via automated DSI interfaces; Deploy DSI framework to support key use cases in collaboration with domain scientists.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

DSI Python API Demo May 2023 [Slides]

Data Science Infrastructure (DSI) is developing searchable databases and workflows for simulation and experimental data derived from ASC clients. Short term goal: Make data easily accessible through metadata indexing and querying while respecting data permissions. Longer term goal: Use this data for data science activities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Utility-Scale Solar, 2023 Edition: Empirical Trends in Deployment, Technology, Cost, Performance, PPA Pricing, and Value in the United States [Slides]

Berkeley Lab’s “Utility-Scale Solar, 2023 Edition” presents analysis of empirical plant-level data from the U.S. fleet of ground-mounted photovoltaic (PV), PV+battery, and concentrating solar-thermal power (CSP) plants with capacities exceeding 5 MWAC (PV plants of 5 MWAC or less, including residential rooftop systems, are covered separately in Berkeley Lab’s companion annual report, Tracking the Sun). Highlights of this year’s update include: -10.4 GWAC of new utility-scale PV capacity came online in 2022, bringing cumulative installed capacity to more than 61.7 GWAC across 46 states. -94% of all new utility-scale PV capacity added in 2022 uses single-axis tracking. -Median installed project costs declined to $\$1.32$/WAC (or $\$1.07$/WDC) in 2022. -Plant-level capacity factors vary widely, from 9% to 35% (on an AC basis), with a sample median of 24%. The report explores drivers of this variation. -Utility-scale PV’s LCOE fell to $\$39$/MWh in 2022 ($\$29$/MWh if factoring in the federal investment tax credit, or ITC). -PPA prices have largely followed the decline in solar’s LCOE over time, but have recently stagnated and even moved slightly higher. Prices from a sample of recent contracts average around $\$20-30$/MWh (levelized) in the West and $\$30-40$/MWh elsewhere in the continental US. -In 2022, solar’s average market value (defined in the report to include only energy and capacity value) rose by 40% to $\$71$/MWh and exceeded average wholesale prices in 4 of the 7 ISOs/RTOs and 11 of 18 other balancing authorities analyzed. -Adding battery storage is one way to increase the value of solar. Our public data file tracks metadata and PPA prices from ~100 PV+battery hybrid projects that are already online or that have secured offtake arrangements. -the end of 2022, there were at least 947 GW of utility-scale solar power capacity within the interconnection queues across the nation, 456 GW of which include batteries. For more information, and to explore related interactive data visualizations, go to utilityscalesolar.lbl.gov.

14 SOLAR ENERGY↗
DOE OSTI2023

Assessment of Existing OpenStudio Measures: Reviews, Interviews, and Future Developments

OpenStudio Measure development is continuously in progress and greatly propelled by the collaborative efforts within the building energy modeling community. To ensure the widespread adoption and benefit of OpenStudio Measures, developers must understand the current status of Measure development and the needs of OpenStudio Measure users. The first step involves a comprehensive review of existing content to prevent redundancy and gain insights into how OpenStudio Measures are used in the building energy modeling community. This knowledge can then be integrated into the Measure development process, and the expertise of practitioners and OpenStudio Measure users can be leveraged to shape future Measures. Numerous OpenStudio Measures have been created and shared on the Building Component Library (BCL). The BCL is an open-source repository housing various OpenStudio-related resources, including building component blocks, descriptive metadata, and Measures describing modifications to building energy models. The OpenStudio Measures in BCL encompass a wide range of energy conservation Measures from basic lighting power reduction to complex HVAC model transformation. They also enable users to generate customized reports and facilitate the integration of energy simulation with other analytical processes. This report presents review of 272 currently available OpenStudio Measures in BCL. The OpenStudio Measures were reviewed by category and subcategory. These Measures are summarized by their functionalities and keywords. To gain insights into how OpenStudio Measures are used in building energy modeling community, interviews were conducted. A total of 12 interview responses were collected from 6 individuals in the industry and 6 individuals in academia. The knowledge acquired from reviewing the existing Measures and interview results will be integrated into the Measure development process, and the expertise of practitioners and OpenStudio Measure users will be leveraged to shape future Measures.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Requirements for Cataloging Hanford Geophysical Datasets

Environmental management activities at the Hanford Site produce extensive data about site conditions, contaminants, cleanup, and more. Managing and archiving that data requires a high degree of collaboration among site contractors and a high level of awareness by project managers and staff. Part of that effort is developing a Hanford Environmental Information and Data Index (HEIDI) to organize the data and maximize its value by making it findable and available for reuse. The objective is to catalog the disparate data sets collected to address the evolving needs of planning, executing, and documenting cleanup over several decades up to the present day, including links to active data sources when available. A properly implemented data catalog makes finding environmental datasets related to an area or theme a routine, reliable process, without requiring the searcher to have special knowledge that a data set exists and where it may be stored. In this project, a working group, including the U.S. Department of Energy, the Hanford Site contractors, and Pacific Northwest National Laboratory staff, identified needs and requirements for handling complex site data. Geophysical data was chosen as a test case because it can be large and complex and often involves multiple processing steps to extract the information incorporated into deliverables. The ability to document those steps was one of the requirements identified for the catalog. In addition to developing requirements, other activities included selecting a metadata schema and initial testing with the objective of determining whether the workflow and capabilities of selected data catalog software platforms were sufficient to implement and impose the identified requirements. This initial testing involved running the default catalog instance using the software platform of interest and altering the configuration to achieve each requirement, if possible. Where configuration alone was insufficient, the possibility of modifying the software by changing the code was examined, but not implemented. A follow-on task is planned to reprogram the code as necessary to implement requirements in a prototype catalog.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Global horizontal spectral irradiance and module spectral response measurements: an open dataset for PV research

This report describes the creation process and final content of a spectral irradiance dataset for Albuquerque, New Mexico accompanied by a set of spectral response measurements for modules deployed at the same location. The spectral irradiance measurements were made using horizontally mounted spectroradiometers; therefore, they represent global horizontal irradiance. The dataset combines non-continuous spectroradiometer and weather measurements from a two-year period into a single calendar year. The data files are accompanied by extensive metadata as well as example calculations and graphs to demonstrate the potential uses of this database. The spectral response measurements were carried out by the National Renewable Energy Laboratory using 12 commercial silicon modules types that are undergoing long-term evaluation at Sandia National Laboratories in Albuquerque.

14 SOLAR ENERGY↗
DOE OSTI2023

The 2021 Blind PVPMC Modeling Intercomparison

This document provides the instructions for participating in the 2021 blind photovoltaic (PV) modeling intercomparison organized by the PV Performance Modeling Collaborative (PVPMC). It describes the system configurations, metadata, and other information necessary for the modeling exercise. The practical details of the validation datasets are also described. The datasets were published online in open access in April 2023, after completing the analysis of the results.

14 SOLAR ENERGY↗
DOE OSTI2024

Data Visualization: Augmented Reality

In recent years, there has been an increasing interest in developing new technologies for automated characterization and visualization of condition monitoring data. Augmented Reality (AR) is a technology that is being developed to improve such data visualization. Augmented reality has been defined as a technology that merges virtual and physical components in real-time, and in three dimensions. Wearable, commercially-available AR devices allow onsite engineers and technicians to perform inspection tasks with significantly more available information such as comparisons of past and present sensor and imager data, onsite data analysis and result displays, and various forms of metadata including technical drawings, previous inspection reports and maintenance histories, operation manuals, codes and standards, and holograms representing data analysis results superimposed onto the in situ monitored system.

42 ENGINEERING↗