SEARCH · Engineering Papers

Results for “Metadata”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Leaf demography spectra, February 2017, PA-SLZ: Panama

This dataset contains leaf reflectance spectra of sunlit canopy leaves from trees at the San Lorenzo Protected Area (PA-SLZ), Panama. Spectra were measured with a full-spectrum (350 -2500 nm) spectroradiometer with a leaf clip attachment. Leaves previously documented in a demography survey were targeted, and each leaf spectrum is paired with species identification, relative leaf position on each branch and estimated leaf age in days. Leaves were measured from the following species: Apeiba membranacea, Carapa guianensis, Guatteria dumetorum, Miconia borealis, Tachigali versicolor, Terminalia amazonia, Tocoyena pittieri and Vochysia ferruginea Unprocessed spectral data are included as SVC *.sig files, and metadata, including sample details, are presented in *.xlsx files. Leaf reflectance spectra of sunlit canopy leaves from trees at the San Lorenzo Protected Area (PA-SLZ), Panama. Spectra were measured with a full-spectrum (350 -2500 nm) spectroradiometer with a leaf clip attachment. Leaves previously documented in a demography survey were targeted, and each leaf spectrum is paired with species identification, relative leaf position on each branch and estimated leaf age in days. Leaves were measured from the following species: Apeiba membranacea, Carapa guianensis, Guatteria dumetorum, Miconia borealis, Tachigali versicolor, Terminalia amazonia, Tocoyena pittieri and Vochysia ferruginea Unprocessed spectral data are included as SVC *.sig files, and metadata, including sample details, are presented in *.xlsx files.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

LAI, EVI, NDVI, and kNDVI in 23 pantropical forests affected by 21 cyclones

Statement of purpose: Cyclones alter the function and composition of tropical forests, making effects of intensifying cyclones on carbon-rich forests a critical topic of study. Here, we quantified cyclone-induced damage and recovery of 21 cyclone disturbances affecting 23 pantropical forest sites between 1988-2017 utilizing leaf area index (LAI), enhanced vegetation index (EVI), normalized difference vegetation index (NDVI), and transformed NDVI (kNDVI) values from Google Earth Engine. Field observations collected in a meta-analysis (Bomfim et al., 2022, in review) were used to ground-truth and test effects of soil resource availability and disturbance factors on damage and recovery. This meta-analysis also served as the basis to begin vegetation index extraction, utilizing unique site and date combinations, from tropical forests effect by cyclone disturbances. We began collecting NDVI (5km resolution) from the NOAA Climate Data Record (CDR) of AVHRR Normalized Difference Vegetation Index (NDVI), Version 5 data product (Vermote, 2019) for all case studies included, 42. Next, we began extracting Landsat data from Landsat 4, 5, and 8, courtesy of the U.S. Geological Survey, in search of higher resolution data. We selected a 3 by 3 Landsat pixel area, leading to a 90m resolution data extraction. The specific imagery used includes Landsat 4 USGS Landsat 4 TM Collection 1 Tier 1 TOA (top of atmosphere) Reflectance, Landsat 5 USGS Landsat 5 TM (thematic mapper) Collection 1 Tier 1 TOA Reflectance, and Landsat 8 USGS Landsat 8 Collection 1 Tier 1 TOA Reflectance. Within Google Earth Engine, we selected the date and location (latitude and longitude), calculated NDVI, kNDVI, and EVI utilizing Landsat bands (see metadata_NGEE-tropics_cyclones), and extracted post- and pre-cyclone values for each case study to calculate cyclone-induced change in the vegetative index. Due to limited spatial resolution of Landsat remote sensing data, MODIS products were investigated next. First, the MOD13Q1.006 Terra Vegetation Indices 16-Day Global 250m product was used to extract 250m EVI and NDVI (Didan, 2015) and then the MCD15A3H.006 MODIS Leaf Area Index/FPAR 4-Day Global 500m product product was used to extract LAI 500m (Myneni et al., 2015). Pre- and post-cyclone values, change in the vegetative index, and standard deviation for all values are included in the main csv (see case_study_data.csv) for all vegetative indices collected, including LAI 500m, EVI 250m, NDVI 250m, NDVI 90m, kNDVI 90m, EVI 90m, and NDVI 5km. Lastly, recovery values were calculated utilizing a standardization method (see metadata_NGEE-tropics_cyclones) and recovery values for MODIS (see MODIS_recovery.csv) and Landsat (Landsat_recovery.csv) data are included.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Leaf gas exchange and fitted parameters, two sites in Panama, 2022

Photosynthetic CO2 response curves (ACi curves), light response curves (AQ curves), dark adapted dark respiration, conductance curves, and survey measurements for leaves measured in the Parque Natural Metropolitano (PNM) and Gamboa, Panama, from January to April 2022 are presented. Measurements were made on leaves from 46 different tree, shrub and liana species, from sunlit canopy and understory locations. Leaf area index from 8 vertical profiles at PNM are also included. The aim of this measurement campaign was three-fold: (i) to improve our understanding of the vertical variation in leaf-level water use efficiency; (ii) to develop an understanding of the sensitivity of stomata to changes in environmental conditions, especially light, humidity, and temperature; (iii) to improve models which can predict leaf traits from leaf contact spectral measurements. All the gas exchange data and metadata are presented in .csv files and complete instrument output are included in .zip folders. Data and metadata meet the ESS-DIVE leaf-level gas exchange reporting format requirements. The protocol details are provided as pdf documents. In addition to gas exchange data reported here these samples were also used for measurement of leaf optical properties, carbon and nitrogen content, and leaf mass per unit leaf area (LMA). These data can be cross linked using the unique sample ID and are provided in separate data packages.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

G-LiHT Campaign Leaf Carbon and Nitrogen Content, Mar2017: Puerto Rico

Measurements of leaf carbon and nitrogen content collected from 68 tropical tree species. Data includes leaves collected from fully sunlit and shaded canopy strata as well as leaves for young, mature, old and senescent leaf ages. Data for each sample includes the relative age estimate, leaf canopy position and sample number. This data was collected as part of the 2017 NGEE-Tropics / NASA G-LiHT airborne campaign. This data package includes processed data for leaf carbon and nitrogen content (*.csv). Metadata files include data description (_dd.csv) for tabular data, site information (*.csv), sampling protocol (*.pdf) and the NGEE-Tropics FRAMES e-field log and file submission metadata (*.xlsx). See related datasets for sample details including photographs, leaf-level reflectance and transmittance spectra, leaf mass per area (LMA) and water content.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Distributed heterogeneous compute infrastructure for the study of additive manufacturing systems

We present the current status of a large-scale computing framework to address the need of the multidisciplinary effort to study chemical dynamics. Specifically, we are enabling scientists to process and store experimental data, run large-scale computationally expensive high-fidelity physical simulation, and analyze these results using the state-of-the-art data analytics tools, machine learning, and uncertainty quantification methods using heterogeneous computing resources, such as CPU and GPU cluster. The framework can integrate or abstract out multiple domains based on roles. In order to develop this framework, we have leveraged an existing framework coupled with in-house heterogeneous computing resources. We present the results of using this framework on a single metadata triggered workflow to accelerate an additive manufacturing use case.

heterogeneous computing, hpc, workflows, reproduci↗

DOE OSTI2025

HP-FLEX: Field demonstration of the semantics-driven configuration of a Model Predictive Control system to make heat pumps flexible

Model Predictive Control (MPC) has demonstrated significant potential for optimizing building operations and enabling demand flexibility. However, the widespread adoption of MPC is hindered by complex manual configuration and commissioning processes that must be conducted by control experts working alongside building operators. These challenges drive up costs and reduce scalability, particularly when technical human resources and building automation systems are limited, such as in small and medium commercial buildings (SMCBs). This paper demonstrates how semantic standards, specifically ASHRAE 223P, can accelerate the adoption of MPC applications for load flexibility in SMCBs. The authors present a replicable control framework, titled “HP-FLEX” that leverages a building’s semantic model to bootstrap the required data configuration for an MPC controller developed for optimizing heat pump systems as flexible grid resources. The semantic model helps streamline the deployment workflow, particularly for site setup, data/control commissioning, and model setup. This integration enhances portability, transferability, and scalability of the HP-FLEX MPC, which has been developed to support MPC-based supervisory HVAC controllers in SMCBs. Additionally, the paper details the required building and thermostat metadata information to enable the HP-FLEX MPC based on field demonstrations. The new workflow was tested in a small commercial building located in California, U.S., and demonstrated a load shifting performance of 9% based on a dynamic pricing signal that varies by the hour. This work provides a practical pathway for transitioning sophisticated building applications from custom to standardized semantic representations, supporting the broader adoption of advanced control strategies like MPC. The framework also establishes a foundation for evolving metadata requirements as applications mature while maintaining compatibility with industry standards.

Paul, Lazlo↗

DOE OSTI2024

Introduction

This report provides a comprehensive overview of metadata to describe sensor signals in wastewater treatment plants and methods to obtain such metadata. In this introduction, we explain the original motivation behind the MetaCO task group. This includes a description of historical challenges (data volume, data velocity) for which mature technology is now available, and newer challenges, which relate to data structure (data variety) and data quality (veracity). We conclude the chapter with an expression of gratitude to all involved.

Aguado, Daniel↗

DOE OSTI2024

Conclusions and outlook

In this chapter, we provide notes on the state of metadata collection and organization practices and reflect on the achievements of the MetaCO task group. We also include an utility perspective on how to use this report in daily data management practice and a short guide is provided to show how metadata practices can be initiated. The chapter, and the report, is concluded within an outlook, sketching future progress and opportunities on the horizon.

Aguado, Daniel↗

DOE OSTI2015

Resource Discovery for Extreme Scale Collaboration (RDESC) Final Report - RPI/TWC - Year 3

The amount of data produced in the practice of science is growing rapidly. Despite the accumulation and demand for scientific data, relatively little is actually made available for the broader scientific community. We surmise that the root of the problem is the perceived difficulty to electronically publish scientific data and associated metadata in a way that makes it discoverable. We propose to exploit Semantic Web technologies and practices to make (meta)data discoverable and easy to publish. We share our experiences in curating metadata to illustrate both the flexibility of our approach and the pain of discovering data in the current research environment. We also make recommendations by concrete example of how data publishers can provide their (meta)data by adding some limited, additional markup to HTML pages on the Web. With little additional effort from data publishers, the difficulty of data discovery/access/sharing can be greatly reduced and the impact of research data greatly enhanced.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2017

Developing the User Experience for a Next Generation Nuclear Fuel Cycle Simulator (NGFCS)

This project made substantial progress on its original aim for providing a modern user experience for nuclear fuel cycle analysis while also creating a robust and functional next- generation fuel cycle simulator. The Cyclus kernel experienced a dramatic clari cation of its interfaces and data model, becoming a full- edged agent-based framework, with strong support for third party developers of novel archetypes. The most important contribution of this project to the the development of Cyclus was the introduction of tools to facilitate archetype development. These include automated code generation of routine archetype components, metadata annotations to provide re ection and rich description of each data member's purpose, and mechanisms for input validation and output of complex data. A comprehensive social science investigation of decision makers' interests in nuclear fuel cycles, and speci cally their interests in nuclear fuel cycle simulators (NFCSs) as tools for understanding nuclear fuel cycle options, was conducted. This included document review and analysis, stakeholder interviews, and a survey of decision makers. This information was used to study the role of visualization formats and features in communicating information about nuclear fuel cycles. A exible and user-friendly tool was developed for building Cyclus analysis models, featuring a drag-and-drop interface and automatic input form generation for novel archetypes. Cycic allows users to design fuel cycles from arbitrary collections of facilities for the rst time, with mechanisms that contribute to consistency within that fuel cycle. Interacting with some of the metadata capabilities introduced in the above-mentioned tools to support archetype development, Cycic also automates the generation of user input forms for novel archetypes with little to no special knowledge required by the archetype developers. Translation of the fundamental metrics of Cyclus into more interesting quantities is accomplished in the Cymetric python package. This package is speci cally designed to support the introduction of new metrics by building upon existing metrics. This concept allows for multiple dependencies and encourages building complex metrics out of incremental transformations to those prior metrics. New archetype developers can contribute their own archetype-speci c metric using the same capability. A simple demonstration of this capability focused on generating time-dependent cash ows for reactor deployment that could then be analyzed in di erent ways. Cyclist, a dedicated application for exploration of Cyclus results, was developed. It's primary capabilities at this stage are best-suited to experienced fuel cycle analysts, but it provides a basic platform for simpler visualizations for other audiences. An important part of its interface is the ability to uidly examine di erent slices of what is fundamentally a ve-dimensional sparse data set. A drag-and-drop interface simpli es the process of selecting which data is displayed in the plot as well as which dimensions are being used for

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2019

Regional Feedstock Partnership 2019 Workshop Report

The U.S. Department of Energy (DOE) and the Sun Grant Initiative began the Regional Feedstock Partnership (RFP) in 2007 primarily to address information gaps associated with sustainably and reliably producing a billion-tons of biomass annually by the year 2030 for the U.S. bioenergy industry. The culmination of these efforts were reported in the Sun Grant/DOE Regional Feedstock Partnership Final Technical Report. The same biomass resources used to support these yield and sustainability efforts included analytical characterization data representing biomass quality. Considerable effort has been put into collection, harmonization, and archival of the analytical data, metadata, and physical samples associated with the thousands of samples collected from the RFP field trials. This data provides a unique opportunity to understand the impacts of agronomic and forest production practices, as well as environmental factors, on biomass material attributes relevant to bioenergy production. To more efficiently develop these relationships, this workshop was held to bring together the experts who conducted the RFP field trials and the biomass attribute data analysts. The objectives of the workshop included the following: • Enable face-to-face interactions with field trial experts, allowing for insights into the species and field trials themselves that are not obvious looking at data alone • Fill in metadata and analytical gaps from the RFP for future analyses • Share results from analysis of RFP biomass properties for each species along with associated field experiment observations/results • Discuss the potential to develop biomass quality maps • Discuss preparation of peer-reviewed publications for each species • Discuss outlines for a comprehensive summary report on the evaluation of RFP biomass material attributes for quality determination, focusing on the results of peer-reviewed publications and analysis of compiled RFP biomass attribute datasets

09 BIOMASS FUELS↗

DOE OSTI2019

A simple json format for storing and exchanging code calculation and experimental results

Calculation codes and code systems give their results in a plethora of different formats and/or files. For instance, MCNP gives a user the MCNP specific output file, the mctal file, the ptrac file, etc. while PARTISN has a PARTISN specific output file and a number of binary files with various kinds of information about the calculation. However, the results we are interested in are always the same. These can be single values such as the effective multiplication factor k eff or the effective delayed neutron fraction β eff . It can be histogram data (such as particle spectra, reaction rates, sensitivity profiles, etc.) or even pointwise data (for example the nuclide composition as a function of time, etc.). It is also worthwhile to note that this would also apply to experimental data that we may wish to compare with as well. Calculation and experimental results can basically be split into two components: attributes (or metadata) and the actual result itself. Attributes represent information about the result that are not necessarily required for its’ interpretation but that are still good to have. Often, these attributes are what we will want to filter results on. This means that these attributes are often the answer to specific questions we may have about the result. The following is a non exhaustive list of such basic questions: what type of result is it: e.g. the effective multiplication factor k eff , the effective delayed neutron fraction β eff , etc.; which case does it relate to: e.g. a specific ICSBEP case such as PU-MET-FAST-001-001; which code and version produced this result: e.g. MCNP 6.2, etc.; which nuclear data library was used to obtain the result: e.g. ENDF/B-VIII.0 or JEFF 3.3; which nuclide and reaction does it apply to (for reaction rates and sensitivity profiles); which volume in the geometry was it calculated in? The second component of the calculation or experimental result is the actual numerical data of the result. It is this data that we want to compare, exchange, plot, interpret, etc. It consists of values with optional uncertainties and units. It also includes the underlying structure (if any structure is required to interpret the result). Depending on the type of result, it may be a single value (e.g. the effective multiplication factor), an array of values (e.g. a reaction rate or particle spectrum) or even a multidimensional array. In order to exchange results between different organisations, for instance for benchmarking, people often resort to spreadsheets or custom text files that need to be filled out. While this approach works well if little information is to be exchanged, it can become cumbersome when dealing with large amounts of data (like for instance particle spectra for thousands of cases). In addition, such an approach does not always capture the metadata we may be interested in to allow for automated processing of these files. The purpose of this report is to propose a standardised json structure to store any type of result and present an associated python interface to interact with these results directly. For such a structure to be useful, it must fulfill a specific set of functional requirements that we try to meet with this proposal. The format must allow for the calculation result to stand by itself. This means that we should not have to look in multiple places to be able to understand it. For example, if the result relates to a particle spectrum, the group structure in which the result is given should be stored with it. The format should be code agnostic. This means that we do not need to know where it came from to understand it. The format should be result type agnostic. This means that the format must be generic enough so that we can even use it for results we have not thought of yet. The format should be relatively easy to interact with through different scripting or programming languages (i.e. the machine interface) while still providing a clean structure that can be used directly by any human.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Distributed Resources for the Earth System Grid Federation (ESGF) Advanced Management (DREAM). Final Report

Distributed Resources for the Earth System Grid Federation (ESGF) Advanced Management (DREAM) is a proposed system that will enable data from an infinite number of diverse sources to be organized and accessed from anywhere using any handheld or other computer device. The approach offers a powerful roadmap for the creation and integration of a unified knowledge base of an entire ecosystem, including its many geophysical, geographical, social, political, agricultural, energy, transportation, and cyber aspects. The resulting aggregation of data has the potential to generate an informational universe of unprecedented size that has never before been possible due to the prohibitive costs, managerial complexity, and technical barriers associated with ever-changing exponential-growth data flows. We envision that DREAM will accelerate discovery by enabling climate researchers, among other types of researchers, to manage, analyze, and visualize data from earth-scale measurements and simulations. DREAM’s success will be built on proven components that leverage existing services and resources. A key building block for DREAM will be the ESGF, chaired by Dean N. Williams. Expanding on the existing ESGF, the project will ensure that the access, storage, movement, and analysis of the large quantities of data that are processed and produced by diverse science projects can be dynamically distributed with proper resource management. Much of the Office of Science data is currently generated by multiple stand-alone facilities. DREAM can collect data accumulated from these facilities and incorporate it into a fully integrated network accessible from anywhere in the world. The result is a completely new paradigm shift for data management, analysis, and visualization enabling researchers to: Manage their calculations, data, tools, and research results; Ensure that all data are sharable, reproducible and (re)usable—accompanied by appropriate metadata describing its provenance, syntax, and semantics at creation; Advance application performance by selectively adapting APIs and services in response to scientific requirements and architectural complexities; and Provide scalable interactive resource management—navigate data and metadata at multiple levels, provide architecture-aware data integration, analysis and visualization tools. We will engage closely with DOE, NASA, and NOAA science groups working at the leading edge of computing. These engagements—in domains such as biology, climate, and hydrology—will allow us to advance disciplinary science goals and inform our development of technologies that can accelerate discovery across DOE more broadly. We will advertise and promote our technologies via dedicated workshops, tutorials, and sessions at conferences, stand-alone events with broad inter-disciplinary invitation, and engagements with leadership facilities.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Research Software Engineering Efforts for DataFlow: FY2021 Developments

DataFlow is a web application that helps scientific data to flow from one source location to another destination location. DataFlow helps scientists easily capture scientific metadata associated with an experiment and transmit both metadata and experimental data to a designated, centralized data storage resource. This report describes the software engineering efforts and architecture of the project for the fiscal year 2021 developments. We hope it effectively communicates findings from our work, challenges we have overcome, and how we will continue our development of DataFlow in the future.

42 ENGINEERING↗

DOE OSTI2021

Open Data for Nuclear Explosion Monitoring (NEM) [Slides]

The data sources tend to have the highest quality data and metadata, particularly for more recent data sets. Early data from sources such as IRIS tend to have some metadata issues.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

DOE OSTI2021

PVInsight (Final Technical Report)

Data generated from real-world photovoltaic (PV) systems represent significant opportunities for the industry–from digital operations and maintenance to real-time planning and forecasting. However, these data also come with substantial, unique challenges. A particular challenge is the analysis of unlabeled PV performance data, which we define as time-series measurements of real power production (or sometimes current or voltage) that do not have corresponding meteorological measurements (irradiance, temperature, etc.) or system configuration information (sometimes called system metadata). These challenges are amplified in the distributed rooftop sector, in which data quality, completeness, and metadata can be very poor.

14 SOLAR ENERGY↗

DOE OSTI2024

Automating the Analysis of Large Language Models Responses through Zero-Shot Question Answering

Recent advancements in Large Language Models (LLMs) have shown significant potential in various applications, yet their evaluation, particularly in zero-shot question answering scenarios, remains a challenging task. In this study, our objective was to explore precision metrics for Large Language Models (LLM) and design and implement a software pipeline to automatically evaluate LLMs' outputs under zero-shot question answering. Zero-shot question answering involves a model providing answers to questions about topics it hasn't seen during training. It leverages the principles of zero-shot learning by relying on semantic understanding and generalization from related knowledge. The data used was metadata from medical databases on congenital heart disease. We explored eleven LLM metrics and selected three for our evaluation: BLEU, BERTScore, and MoverScore. BLEU calculates a score based on the overlap of n-grams (contiguous sequences of n items, typically words) between the machine-generated translation and the reference translations. Higher BLEU scores indicate better correspondence between the machine-generated and human-generated translations. BERTScore is a metric used to evaluate the quality of machine-generated text by measuring the similarity of token embeddings produced by BERT (Bidirectional Encoder Representations from Transformers) between the generated text and reference text. MoverScore is a metric that quantifies the dissimilarity between the distributions of word embeddings from machine-generated text and reference text, emphasizing semantic similarity over exact token overlap. We also introduced HBKI, a composite metric summarizing these approaches. We tested five models —GPT-3, Llama-2, Gemini 1.5 Pro, Solar 10.7B, and Mixtral-8x7b. Our software pipeline, designed and implemented using Object-Oriented Programming principles, allows users to customize the selection and extraction of features for topics of interest in their own research. Our results show that MoverScore delivered the most precise evaluation of the LLM's outputs, while Mixtral-8x7b achieved the best overall performance in extracting metadata from the databases.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

User Guide for BLADE_LC_processor.py

BLADE_LC_processor.py is an optional script within the BLADE (Bolide Light-curve Analysis and Discrimination Explorer) open-source software package. It converts per-event light curve CSVs plus a metadata table into maps, plots, a per-sample trajectory file, and an aggregate summary. It anchors each trajectory at peak brightness, assumes constant speed and entry angle across the event, and propagates altitude and ground track relative to that anchor. The script converts the input azimuth internally to a travel bearing for the map and trajectory. Outputs include event folders with figures and a consolidated CSV containing start, peak, and end altitudes and all original metadata, sorted newest to oldest. For further background, users are referred to the foundational publication: Silber, E. A., Sawal, V. (2025), “BLADE: An Automated Framework for Classifying Light Curves from the Center for Near-Earth Object Studies Fireball Database,” The Astronomical Journal, doi: 10.3847/1538-3881/adeb55.

97 MATHEMATICS AND COMPUTING↗