SEARCH · Engineering Papers

Results for “Data Curation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Apollo Next Generation Sample Analysis (ANGSA): an Apollo Participating Scientist Program to Prepare the Lunar Sample Community for Artemis

As a first step in preparing for the return of samples from the Moon by the Artemis Program, NASA initiated the Apollo Next Generation Sample Analysis Program (ANGSA). ANGSA was designed to function as a low-cost sample return mission and involved the curation and analysis of samples previously returned by the Apollo 17 mission that remained unopened or stored under unique conditions for 50 years. These samples include the lower portion of a double drive tube previously sealed on the lunar surface, the upper portion of that drive tube that had remained unopened, and a variety of Apollo 17 samples that had remained stored at -27 °C for approximately 50 years. ANGSA constitutes the first preliminary examination phase of a lunar “sample return mission” in over 50 years. It also mimics that same phase of an Artemis surface exploration mission, its design included placing samples within the context of local and regional geology through new orbital observations collected since Apollo and additional new “boots-on-the-ground” observations, data synthesis, and interpretations provided by Apollo 17 astronaut Harrison Schmitt. ANGSA used new curation techniques to prepare, document, and allocate these new lunar samples, developed new tools to open and extract gases from their containers, and applied new analytical instrumentation previously unavailable during the Apollo Program to reveal new information about these samples. Most of the 90 scientists, engineers, and curators involved in this mission were not alive during the Apollo Program, and it had been 30 years since the last Apollo core sample was processed in the Apollo curation facility at NASA JSC. There are many firsts associated with ANGSA that have direct relevance to Artemis. ANGSA is the first to open a core sample previously sealed on the surface of the Moon, the first to extract and analyze lunar gases collected in situ, the first to examine a core that penetrated a lunar landslide deposit, and the first to process pristine Apollo samples in a glovebox at -20 °C. All the ANGSA activities have helped to prepare the Artemis generation for what is to come. The timing of this program, the composition of the team, and the preservation of unopened Apollo samples facilitated this generational handoff from Apollo to Artemis that sets up Artemis and the lunar sample science community for additional successes.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2015

Comprehensive Non-Destructive Conservation Documentation of Lunar Samples Using High-Resolution Image-Based 3D Reconstructions and X-Ray CT Data

Established contemporary conservation methods within the fields of Natural and Cultural Heritage encourage an interdisciplinary approach to preservation of heritage material (both tangible and intangible) that holds "Outstanding Universal Value" for our global community. NASA's lunar samples were acquired from the moon for the primary purpose of intensive scientific investigation. These samples, however, also invoke cultural significance, as evidenced by the millions of people per year that visit lunar displays in museums and heritage centers around the world. Being both scientifically and culturally significant, the lunar samples require a unique conservation approach. Government mandate dictates that NASA's Astromaterials Acquisition and Curation Office develop and maintain protocols for "documentation, preservation, preparation and distribution of samples for research, education and public outreach" for both current and future collections of astromaterials. Documentation, considered the first stage within the conservation methodology, has evolved many new techniques since curation protocols for the lunar samples were first implemented, and the development of new documentation strategies for current and future astromaterials is beneficial to keeping curation protocols up to date. We have developed and tested a comprehensive non-destructive documentation technique using high-resolution image-based 3D reconstruction and X-ray CT (XCT) data in order to create interactive 3D models of lunar samples that would ultimately be served to both researchers and the public. These data enhance preliminary scientific investigations including targeted sample requests, and also provide a new visual platform for the public to experience and interact with the lunar samples. We intend to serve these data as they are acquired on NASA's Astromaterials Acquisistion and Curation website at http://curator.jsc.nasa.gov/. Providing 3D interior and exterior documentation of astromaterial samples addresses the increasing demands for accessability to data and contemporary techniques for documentation, which can be realized for both current collections as well as future sample return missions.

Blumenfeld, E. H.↗

DOE OSTI2026

From natural language to control signals: a conceptual framework for semantic channel finding in complex experimental infrastructure

Modern experimental platforms such as particle accelerators, fusion devices, telescopes, and industrial process control systems expose tens to hundreds of thousands of control and diagnostic channels, accumulated over decades of hardware evolution. Operators and AI systems alike depend on informal expert knowledge, inconsistent naming conventions, and scattered documentation to locate the signals required for monitoring, troubleshooting, and automated control, creating a persistent bottleneck for reliability, scalability, and emerging language-model-driven interfaces. We formalize semantic channel finding, the task of mapping natural-language intent to concrete control-system signals, as a general problem in complex experimental infrastructure, and introduce a four-paradigm conceptual framework to guide architecture selection based on facility-specific data regimes. The paradigms span (i) direct in-context lookup over small, curated channel dictionaries, (ii) constrained hierarchical navigation through structured trees, (iii) interactive agent exploration using iterative reasoning and tool-based database queries, and (iv) ontology-grounded semantic search that decouples channel meaning from facility-specific naming conventions. We demonstrate the practical feasibility of each paradigm through proof-of-concept implementations at four operational facilities spanning two orders of magnitude in scale: from compact free-electron lasers to large synchrotron light sources, operating under diverse control-system architectures ranging from clean hierarchical naming schemes to legacy environments with decades of heterogeneous conventions. Where evaluated against expert-curated operational queries, these instantiations achieve 90%–97% accuracy, validating the framework’s applicability across real-world deployment scenarios. To accelerate adoption across the broader scientific and industrial control-system community, we release open-source, plug-and-play implementations of all three interactive paradigms-direct lookup, hierarchical navigation, and middle-layer exploration-within the Osprey framework, together with tools for channel database generation, interactive testing, and minimal-configuration deployment. This work establishes semantic channel finding as a foundational capability for human-centric and agentic AI interfaces at large-scale facilities, providing both a systematic framework for architecture design and practical resources to enable adoption without building custom infrastructure from scratch.

channel finding↗

DOE OSTI2025

Intelligent Sampling of Extreme-Scale Turbulence Datasets for Accurate and Efficient Spatiotemporal Model Training

With the end of Moore’s law and Dennard scaling, efficient training increasingly requires rethinking data volume. Can we train better models with significantly less data via intelligent subsampling? To explore this, we develop SICKLE, a sparse intelligent curation framework for efficient learning, featuring a novel maximum entropy (MaxEnt) sampling approach, scalable training, and energy benchmarking. We compare MaxEnt with random and phase-space sampling on large direct numerical simulation (DNS) datasets of turbulence. Evaluating SICKLE at scale on Frontier, we show that subsampling as a preprocessing step can, in many cases, improve model accuracy and substantially lower energy consumption, with observed reductions of up to 38×.

Brewer, Wes [ORNL] (ORCID:0000000236393956)↗

DOE OSTI2024

MIBiG 4.0: advancing biosynthetic gene cluster curation through global collaboration

Specialized or secondary metabolites are small molecules of biological origin, often showing potent biological activities with applications in agriculture, engineering and medicine. Usually, the biosynthesis of these natural products is governed by sets of co-regulated and physically clustered genes known as biosynthetic gene clusters (BGCs). To share information about BGCs in a standardized and machine-readable way, the Minimum Information about a Biosynthetic Gene cluster (MIBiG) data standard and repository was initiated in 2015. Since its conception, MIBiG has been regularly updated to expand data coverage and remain up to date with innovations in natural product research. Here, we describe MIBiG version 4.0, an extensive update to the data repository and the underlying data standard. In a massive community annotation effort, 267 contributors performed 8304 edits, creating 557 new entries and modifying 590 existing entries, resulting in a new total of 3059 curated entries in MIBiG. Particular attention was paid to ensuring high data quality, with automated data validation using a newly developed custom submission portal prototype, paired with a novel peer-reviewing model. MIBiG 4.0 also takes steps towards a rolling release model and a broader involvement of the scientific community. MIBiG 4.0 is accessible online at https://mibig.secondarymetabolites.org/.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

BETO 2021 Peer Review - Electrocatalytic CO2 Utilization

The goal of the ChemCatBio DataHub project is to accelerate the catalyst and process development cycle by developing transformational tools for prediction and collaboration in catalyst R&D. The project is currently focused on the development of the Catalyst Property Database (CPD), a free and public resource released in September 2020. The CPD was designed to advance the state of the art for application of computational data. When computational data, such as computed reaction energetics, is used in catalyst design, it is almost always generated by the researchers seeking to use it, even if similar data has been published previously. One barrier to data reuse that results in this duplication of effort is the difficult process of finding and applying published data, which can be slow, error-prone, and manual. The CPD seeks to overcome these challenges by creating a centralized, searchable database of quality catalyst property data. At present, the CPD contains computed adsorption energies for intermediates along catalytic pathways. During FY21 and FY22, development of the CPD continues with a focus on external users and meeting their requirements. A batch upload capability, training and curation procedures, user interviews, and a demonstration of the CPD's utility in accelerating catalyst research are planned. Overall, the Data Hub project and CPD aim to reduce the time and cost of catalyst research by harnessing the power of data in catalyst discovery.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2021

BETO 2021 Peer Review - ChemCatBio Data Hub 2.6.2.500

The goal of the ChemCatBio DataHub project is to accelerate the catalyst and process development cycle by developing transformational tools for prediction and collaboration in catalyst R&D. The project is currently focused on the development of the Catalyst Property Database (CPD), a free and public resource released in September 2020. The CPD was designed in response to the observation that when data, such as computed reaction energetics, is used in catalyst design, it is almost always generated by the researchers seeking to use it, even if similar data has been published previously. One barrier to data reuse that results in this duplication of effort is the difficult process of finding and applying published data, which can be slow, error-prone, and manual. The CPD seeks to overcome these challenges by creating a centralized, searchable database of quality catalyst property data. At present, the CPD contains computed adsorption energies for intermediates along catalytic pathways. During FY21 and FY22, development of the CPD continues with a focus on external users and meeting their requirements. A batch upload capability, training and curation procedures, user interviews, and a demonstration of the CPD's utility in accelerating catalyst research are planned. Overall, the Data Hub project and CPD aim to reduce the time and cost of catalyst research by harnessing the power of data in catalyst discovery.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2020

Data Repository for Power system Open models With Evolving Resources (DR POWER) (Final Scientific/Technical Report)

Pacific Northwest National Laboratory (PNNL) and the National Rural Electric Cooperative Association (NRECA) created a Data Repository for Power system Open models With Evolving Resources (DR POWER) to establish, curate, and evolve open-access power grid models and scenarios, and measurements and observations, collectively referred to as datasets. Existing open-access datasets are inadequate (too small and not representative of the complexity of the modern grid, and scattered all over the world wide web) for the investigation and benchmarking of the advanced optimization methods needed for next-generation grids. Open-access datasets are static and inadequate in other aspects: they do not provide format transformation tools; there is missing information needed for advanced applications; hard to cite; no model evolution history; difficult to update current collections; and little to no community involvement and feedback. Overall, the current landscape is hindering model evolution and benchmarking standards needed for transformational approaches to be developed, tested, and accepted by the power modeling community.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

The Zooplankton International Geospatial (ZIG) dataset: A global repository of spatiotemporal freshwater zooplankton community composition data to support ecological research

Zooplankton play critical roles in aquatic ecosystem function and food webs. Nevertheless, global syntheses of their abundance and community dynamics are challenging due to methodological differences across monitoring programs, taxonomic inconsistencies, and a lack of standardized metadata. To reconcile these challenges, we assembled, curated, validated, and harmonized the Zooplankton International Geospatial (ZIG) dataset, which includes co-located and contemporaneous zooplankton, water chemistry, and limnological data from 307 lakes and reservoirs. ZIG includes waterbodies from each major lake thermal region and range in size from 0.8-2,805,8600 hectares. Temporal coverage for individual waterbodies ranges between 1-60 years of data (median = 4 years) with sampling from once annually to weekly. ZIG is publicly available and can be used to understand freshwater biodiversity change and its drivers at unprecedented scales, and we consider it to be a cornerstone for future investigations of freshwater biology, chemistry, and ecology.

Figary, Stephanie [Cornell University, Ithaca, NY]↗

DOE OSTI2020

Interactive Metadata Integration with Brick

Many different digital representations of a building are produced over the course of its lifecycle. While these representations individually contain metadata required to support different stages of the building's lifecycle, they are largely not interoperable due to differences in structure, syntax and semantics. This impedes the development and deployment of data-driven applications providing fault detection and diagnosis, virtual metering or optimal control. [4] introduces a new platform for the continuous curation of a unified, Brick [1]-based metadata model that can be maintained throughout the building lifecycle. In this demonstration, we present a live proof-of-concept implementation of the platform with support for several metadata representations in the context of a simulated building lifecycle.

Fierro, Gabe↗

DOE OSTI2024

PhysBERT: A text embedding model for physics scientific literature

The specialized language and complex concepts in physics pose significant challenges for information extraction through Natural Language Processing (NLP). Central to effective NLP applications is the text embedding model, which converts text into dense vector representations for efficient information retrieval and semantic analysis. In this work, we introduce PhysBERT, the first physics-specific text embedding model. Pre-trained on a curated corpus of 1.2 × 106 arXiv physics papers and fine-tuned with supervised data, PhysBERT outperforms leading general-purpose models on physics-specific tasks, including the effectiveness in fine-tuning for specific physics subdomains.

Hellert, Thorsten (ORCID:0000000227970926)↗

DOE OSTI2023

TranSyT , an innovative framework for identifying transport systems

The importance and rate of development of genome-scale metabolic models have been growing for the last few years, increasing the demand for software solutions that automate several steps of this process. However, since TRIAGE’s release, software development for the automatic integration of transport reactions into models has stalled. Here, in this paper, we present the Transport Systems Tracker (TranSyT). Unlike other transport systems annotation software, TranSyT does not rely on manual curation to expand its internal database, which is derived from highly curated records retrieved from the Transporters Classification Database and complemented with information from other data sources. TranSyT compiles information regarding transporter families and proteins, and derives reactions into its internal database, making it available for rapid annotation of complete genomes. All transport reactions have GPR associations and can be exported with identifiers from four different metabolite databases. TranSyT is currently available as a plugin for merlin v4.0 and an app for KBase.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

2024 Buildings Technology Baseline: Dataset Documentation

The Buildings Technology Baseline is a curated and regularly updated dataset of current and projected performance, retail, and installed price data for all major building energy technologies needed to enable cost/benefit analyses. Building technology analyses require an up-to-date understanding of installation costs and cost-effectiveness of key building energy efficiency technologies. The dataset was assembled by Guidehouse during fiscal year 2024. Data was gathered from the 2024 National Residential Efficiency Measures Database (NREMDB), the 2023 Energy Information Administration Updated Buildings Sector Appliance and Equipment Costs and Efficiencies ("EIA Building Data Report"), DOE Lighting Market Model, the 2023 RSMeans database, and the 2020 Grid-Interactive Efficient Building Technology Cost, Performance, and Lifetime Characteristics ("GEB Data Report"), Lawrence Berkeley National Laboratory, various literature, as well as new data from online retailers, stakeholder interviews, and contractor databases in 2023 and 2024. The dataset has been reviewed by subject matter experts at NREL and DOE. The 2024 dataset release is intended to be a starting point for interested users to provide feedback. This database is not intended to provide specific cost estimates for a specific project. The cost estimates do not include any rebates or tax incentives that may be available for the measures. Rather, it is meant to help determine which measures may be more cost-effective. The National Renewable Energy Laboratory (NREL) makes every effort to ensure accuracy of the data; however, NREL does not assume any legal liability or responsibility for the accuracy or completeness of the information.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2026

AI-Ready Data Pilot Project Report

The proliferation of artificial intelligence in scientific research has created an urgent need to define "AI-ready data" for researchers and, more importantly, provide resources to help them produce AI-ready data. At Pacific Northwest National Laboratory, we conducted a pilot study with three data scientists evaluating three CSV datasets from different scientific domains, followed by semi-structured interviews capturing assessment practices. Our findings reveal that AI-readiness evaluation is intuition-based, with practitioners asking "How fast can I go from raw data to my machine learning pipeline?" Data scientists consistently prioritized workflow efficiency, human interpretability, and quality stewardship signals. From these insights, we developed a practical evaluation framework comprising data requirements, metadata standards, and validation tests that provides actionable criteria for producing and curating AI-ready datasets, addressing the gap between theoretical understanding and practical implementation.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1986

Stratospheric dust collections: Valuable resources for space and atmospheric scientists

The stratospheric collection at the Johnson Space Center Curatorial Facility offers a unique opportunity to study well-documented, individual particles (or groups of particles) from a wide variety of sources. The nature of the collection and curation process, as well as the timeliness of some sampling periods, ensures that all data obtained from stratospheric particles is a valuable resource for scientists from a wide range of disciplines. A few samples of the uses of these stratospheric dust collections are outlined. An understanding of global parameters at a particular point in time in the stratosphere can be obtained from a study of complete collection surfaces. For example, an accurate assessment of particle concentration over a wide range of sizes was experimentally determined for the stratospheric cloud formed one month after the eruption of El Chichon. Additional studies on the El Chichon cloud over a six-month period showed that volcanic ash settles out of the stratosphere at a rate determined primarily by particle shape and density. Another study during a volcanically quiescent period has shown that total particle number density during the summer of 1981 was approx. 2.7 x 10(-1) cm(-3), for particles 1 micron diameter. However, 95% of these particles were 5 micrometers diameter. With the above classification scheme, an estimate of micrometeorite number density at 20km altitude can also be made. Continuation of these types of studies, for shorter collection periods at regular intervals, can provide important experimental data on the contributions of orbital debris, rocket firings and transient events on the total stratospheric particle budget.

Mackinnon, I. D. R.↗

NASA NTRS2020

Using X-Ray Computed Tomography to Image Apollo Drive Tube 73002

The Apollo missions collected 382 kg of rock, regolith, and core samples from six locations on the nearside of the Moon. Today, just over 84% by mass of the Apollo collection remains in pristine condition within the curation facility at Johnson Space Center. Most Apollo samples have been well characterized, however there are several types of samples that have remained wholly or largely unstudied since their return, and/or that have been curated under special conditions. These sample types are: (1) unopened samples sealed under vacuum on the Moon; (2) unopened (but unsealed) drive tubes; (3) Apollo 17 samples frozen shortly after their return; and (4) Apollo 15 samples opened and stored in a helium atmosphere since their return. Last summer, NASA solicited proposals for the Apollo Next Generation Sample Analysis Program (ANGSA), and 9 teams were selected to study: (1) unsealed, unopened drive tube 73002; (2) sealed, unopened drive tube 73001 (paired with 73002); and (3) a subset of the frozen and He-purged samples [1]. The first sample opened as part of the ANGSA program was drive tube 73002. This is a 30 cm long, 4 cm diameter drive tube collected on a landslide deposit near Lara Crater at the Apollo 17 landing site. It was part of a 60 cm long double drive tube collected, and the bottom half of the tube (73001) was sealed under vacuum on the Moon [2]. Prior to opening sample 73002, the sample was imaged with a high resolution Xray Computed Tomography (XCT) scan of the entire tube. Additional XCT scans have been made of “large” clasts removed from the core as part of the dissection process [3]. Here we present a first look at the XCT data from 73002, and talk about the utility of the scans as part of the curation process, including the potential for future science returns from the high resolutions scans.

Zeigler, R. A.↗

NASA NTRSDate not supplied

Using X-Ray Computed Tomography to Image Apollo Drive Tube 73002

The Apollo missions collected 382 kg of rock, regolith, and core samples from six locations on the nearside of the Moon. Today, just over 84% by mass of the Apollo collection remains in pristine condition within the curation facility at Johnson Space Center. Most Apollo samples have been well characterized, however there are several types of samples that have remained wholly or largely unstudied since their return, and/or that have been curated under special conditions. These sample types are: (1) unopened samples sealed under vacuum on the Moon; (2) unopened (but unsealed) drive tubes; (3) Apollo 17 samples frozen shortly after their return; and (4) Apollo 15 samples opened and stored in a helium atmosphere since their return. NASA solicited proposals for the Apollo Next Generation Sample Analysis Program (ANGSA), and 9 teams were selected to study: (1) unsealed, unopened drive tube 73002; (2) sealed, unopened drive tube 73001 (paired with 73002); and (3) a subset of the frozen and He-purged samples [1]. The first sample opened as part of the ANGSA program was drive tube 73002. This was originally a ~30 cm long, 4 cm diameter drive tube collected on a landslide deposit near Lara Crater at the Apollo 17 landing site. It was part of a ~60 cm long double drive tube collected, and the bottom half of the tube (73001) was sealed under vacuum on the Moon [2]. Prior to opening sample 73002, the sample was imaged with a high resolution X-ray Computed Tomography (XCT) scan of the entire tube. Additional XCT scans have been made of “large” clasts removed from the core as part of the dissection process [3]. Here we present the whole tube and close-up XCT data from 73002, and talk about the utility of the scans as part of the curation process, including the potential for future science returns from the high resolutions scans.

R A Zeigler↗

DOE OSTI2022

Combinatorial Evaluation of Physical Feature Engineering, Classical Machine Learning, and Deep Learning Models for Synchrophasor Data at Scale

A major objective of the project was to train and evaluate the effectiveness of multiple event and anomaly detection, identification and classification deep temporal learning models for processing of real-time phasor measurement unit (PMU) data streams. A vast dataset, consisting of two years of phasor measurements from all three U.S. Interconnections, was curated and released by the Department of Energy (DOE) through Pacific Northwest National Laboratory (PNNL). The dataset also included an event log that provided event times and types (e.g. generator trips, line trips, planned service events, transformer operations, etc.). Our analysis of this dataset addressed six (6) of the eleven (11) research priorities identified in Funding Opportunity Announcement (FOA) DE-FOA-0001861 “Big Data Analysis of Synchrophasor Data” (FOA 1861). Rather than being limited to pre-determined specific algorithms, this project relied on the uniquely structured, highly performant underlying time series database capabilities of the PredictiveGrid platform to assess the vast dataset utilizing a wide variety of algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗