Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Curation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

CPGminer: An Interactive Dashboard to Explore the Genomic Features and Taxonomy of Complete Prokaryotic Genomes

Prokaryotes, the earliest forms of life on Earth, play crucial roles in global biogeochemical processes in virtually all ecosystems. The ever-increasing amount of prokaryotic genome sequencing data provides a wealth of information to examine fundamental and applied questions through systematic genome comparison. Genomic features, such as genome size and GC content, and taxonomy-centric genomic features of complete prokaryotic genomes (CPGs) are crucial for various fields of microbial research and education, yet they are often overlooked. Additionally, creating systematically curated datasets that align with research concerns is an essential yet challenging task for wet-lab researchers. In this study, we introduce CPGminer, a user-friendly tool that allows researchers to quickly and easily examine the genomic features and taxonomy of CPGs and curate genome datasets. We also provide several examples to demonstrate its practical utility in addressing descriptive questions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Mondo: integrating disease terminology across communities

Precision medicine aims to enhance diagnosis, treatment, and prognosis by integrating multimodal data at the point of care. However, challenges arise due to the vast number of diseases, differing methods of classification, and conflicting terminological coding systems and practices used to represent molecular definitions of disease. This lack of interoperability artificially constrains the potential for diagnosis, clinical decision support, care outcome analysis, as well as data linkage across research domains to support the development or repurposing of therapeutics. There is a clear and pressing need for a unified system for managing disease entities⁠—including identifiers, synonyms, and definitions. To address these issues, we created the Mondo disease ontology—a community-driven, open-source, unified disease classification system that harmonizes diverse terminologies into a consistent, computable framework. Mondo integrates key medical and biomedical terminologies, including Online Mendelian Inheritance in Man (OMIM), Orphanet, Medical Subject Headings (MeSH), National Cancer Institute Thesaurus (NCIt), and more, to provide a comprehensive and accurate representation of disease concepts with fully provenanced and attributed links back to the sources. Mondo can be used as the handle for curation of gene–disease associations utilized in diagnostic applications, research applications such as computational phenotyping, and in clinical coding systems in clinical decision support by pointing the clinician to the numerous knowledge resources linked to the Mondo identifier. Mondo's community-centric approach, stewarded by the Monarch Initiative's expertise in ontologies, ensures that the ontology remains adaptable to the evolving needs of biomedical research and clinical communities, as well as the knowledge providers.

biomedical informatics↗
DOE OSTI2022

Physics-Informed Neural Network Modeling of Li-Ion Batteries: Preprint

Li-ion batteries (LIB) are a promising solution to enable storage of intermittent energy sources due to their high energy density. However, LIBs are known to significantly degrade after about 1000 charge-discharge cycles. LIBs degrade following different degradation modes and at a rate that depends on the operating conditions (external temperature, load). To plan the installation of batteries, appropriate understanding and prediction capabilities of their lifecycle is needed. High-fidelity numerical models of LIBs such as the pseudo-two-dimensional (P2D) model have been shown to accurately represent the charge-discharge-cycle of an LIB given ac- curate choice of the physical parameters. Given the large number of P2D parameters, adjusting them using forward runs is intractable. This work describes the development of a physics-informed neural network (PINN) as a surrogate substitute of the P2D model that captures parameter dependence. The PINN is advantageous as it needs little to no data, and can naturally encode the dependence of every model parameter. Here, a specific training procedure is adopted to efficiently cover parameter space, handle model stiffness and enforce boundary conditions. The trained PINN is validated against numerical solutions of the P2D model, and its applicability to battery degradation modeling is discussed.

battery degradation↗
DOE OSTI2025

Improving Cyber Situational Understanding

Effective cybersecurity operations require the ability to analyze large amounts of information to assess security risks and formulate defensive strategies against adversaries. This has become more complex in recent years as the sprawl and interconnectivity of devices grows through implementation of virtualization, cloud computing, and Internet of Things (IoT). The amount of data and analysis required for effective cybersecurity command and control decisions far exceeds humans’ capacity to perform manually. We characterize the analysis problem as cyber situational understanding. The research presented to improve cyber situational understanding focuses on vulnerability analysis and threat intelligence. Regarding vulnerabilities, entities must analyze and plan work for between thousands and tens of thousands of software vulnerabilities annually. Entities heavily use network firewalls to limit vulnerability exposure. As a result, some of these vulnerabilities permit exposure to adversarial exploitation, whereas others are inaccessible and therefore present negligible risk of exploitation. Distinguishing between high and low risk software vulnerabilities requires a deep understanding of the vulnerability, network firewall protection, and characteristics of the targeted device. This problem is solved by extracting network service features from vulnerability data features using both machine-learning and natural language processing. Then, the network firewall topology is parsed to determine which vulnerabilities are reachable by adversaries. Ultimately, a state-based safety analysis ascertains which vulnerabilities are unsafe. A related vulnerability analysis problem occurs in cybersecurity operations when associating an entity’s hardware and software assets to public vulnerability databases. Assets often reveal hardware and software through installation artifacts and network service identification, and entities store these artifacts in inventory databases. However, software and hardware vendors apply a standard Common Platform Enumeration (CPE) naming convention when publicly reporting vulnerabilities. Associating these two datasets often requires many hours to days of manual inspection. The proposed solution automates the mapping approach of human analysts using fuzzy matching techniques, natural language processing, and, ultimately, machine learning to present a small set of recommendations for mapping the two datasets. The result significantly reduces human analysis time and reduces the occurrence of false positives in vulnerability notifications. Finally, cyber threat intelligence (CTI) requires associating cyber observable artifacts, such as IP addresses, URIs, and file hashes, with cyber threat tactics, techniques, and procedures. Unfortunately, most CTI data is compartmentalized across multiple organizations and cannot be shared due to the legal and reputational risk with cyber threat being associated with the entity. The approach to solving this problem inovlves using a distributed ledger with anonymous token spending and authentication. This allows a consortium of semi-trusted entities to share the workload of curating CTI for a threat sharing community’s cooperative benefit.

Huff, Philip↗
DOE OSTI2025

Acoustic Rocket Signatures Collected by Smartphones

Rockets generate complex acoustic signatures that can be detected over a thousand kilometers from their source. While many far-field acoustic rocket signatures have been collected and released to the public, very few signatures collected at distances less than 100 km are available. This work presents a curated and annotated dataset of acoustic signatures of 243 rocket launches collected by a network of smartphones stationed at distances between 10 and 70 km from the launch sites, resulting in 1089 individual recordings. Due to the frequency dependence of atmospheric attenuation and the relatively short propagation distances, higher-frequency features not preserved in most publicly available data are observed. The signals are time-aligned to allow for different segments of the signal (ignition, launch, trajectory, chronology) to be more easily examined and compared. Initial analysis of the features of these rocket launch stages is performed, observed features are compared to those found in the existing literature, and comparisons between signals from launches of different rocket types are made. The dataset is annotated and made available to the public to aid future analysis of the characteristics and source mechanisms of rocket acoustics as well as applications such as rocket detection and classification models.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Informing Plant Asset Reliability and Availability Through AI-Driven Analysis of Operator Logs

The availability and reliability of nuclear power plant (NPP) structures, systems, and components (SSCs) are critical parameters for NPP safety. Tracking these parameters is necessary but costly and labor-intensive, requiring the collection and evaluation of SSC event data such as shutdowns, startups, and failures. To show how these events are needed for the parameters an example is given: one measure of reliability is based on the number of equipment failure events and the number of run hours (i.e., the time from a startup event to a shutdown event). Here, this work investigates using artificial intelligence (AI) to mine NPP operator log entry texts for SSC event data. Four AI approaches were explored for identifying these events, including natural language processing (NLP) methods, generative AI, generative AI combined with NLP, and topic modeling. A key challenge addressed with all four approaches is the brevity of operator log entries. Among these four a neural network–based NLP method was shown to be the most promising for this application, achieving F1 scores of 86.0% for shutdowns, 92.2% for startups, and 80.4% for failures on a subject-matter-expert-curated dataset from NPP operator logs, compared to a baseline of 66.6% for a random classifier. This shows that NLP methods can perform better than generative AI. Additionally, the NLP methods combined with generative AI were shown to perform better than generative AI alone. Generative AI was most successful at providing the background information for the NLP methods to use. This work demonstrates the potential to use AI to automate parameter collection from NPP operator log entries and other records.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Uncertainty quantification in multivariable regression for material property prediction with Bayesian neural networks

With the increased use of data-driven approaches and machine learning-based methods in material science, the importance of reliable uncertainty quantification (UQ) of the predicted variables for informed decision-making cannot be overstated. UQ in material property prediction poses unique challenges, including multi-scale and multi-physics nature of materials, intricate interactions between numerous factors, limited availability of large curated datasets, etc. In this work, we introduce a physics-informed Bayesian Neural Networks (BNNs) approach for UQ, which integrates knowledge from governing laws in materials to guide the models toward physically consistent predictions. To evaluate the approach, we present case studies for predicting the creep rupture life of steel alloys. Experimental validation with three datasets of creep tests demonstrates that this method produces point predictions and uncertainty estimations that are competitive or exceed the performance of conventional UQ methods such as Gaussian Process Regression. Additionally, we evaluate the suitability of employing UQ in an active learning scenario and report competitive performance. The most promising framework for creep life prediction is BNNs based on Markov Chain Monte Carlo approximation of the posterior distribution of network parameters, as it provided more reliable results in comparison to BNNs based on variational inference approximation or related NNs with probabilistic outputs.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Hyporheic zone, river, and groundwater metagenome resolved genomes and rpS3 genes in East River Watershed, Colorado USA Summer 2020, 2021

Here we present metagenome assembled genomes (MAGs) for the bacterial and archaeal communities from water filter collected across 8 locations along the East River Watershed, CO, and 1 nearby groundwater well. The purpose was to look for connectivity and similarities across the network and to see the impact of the groundwater. As a part of Lawrence Berkeley National Laboratory (LBNL) Watershed Science Focus Area (SFA), we assessed community composition and strain similarities between the sites and we also compared it to previous metagenomic studies within the watershed looking at floodplain (Matheus Carnevali et al. 2021) and hillslope (Lavy et al. 2019) microbiomes. Here we present metagenome assembled genomes (MAGs) for the bacterial and archaeal communities from filters across 8 locations during August 2020 and July 2021. This resulted in 32 samples. The groundwater sample was sequenced at UC Berkley's QB3. The other 31 samples were sequenced at University of Maryland. Metagenomes were assembled using four autobinners and the best bins were selected using dasTool. The genomes were dereplicated at 95% with dRep and the subset of winning genomes were manually curated based on visual inspection of taxonomic profile, GC content, coverage, and a set of 51 bacterial single copy genes (BSCG), and 38 archaeal signal copy genes (ASCG). The dataset includes a zip file of 311 genomes (HZ_River_SW_MAGS_Dereplicated_95.zip). The dataset additionally includes a zipped file of ribosomal protein small subunit 3 (rpS3) proteins from the hyporheic zone and river data (rpS3_Proteins_HZ_River.zip), a metadata file used to register associated samples with IGSNs (International Generic Sample Numbers) (samples.csv), a location metadata file (locations.csv). This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

DNA↗
DOE OSTI2026

nf-core/proteinfamilies: a scalable pipeline for the generation of protein families

The growth of metagenomics-derived amino acid sequence data has transformed our understanding of protein function, microbial diversity, and evolutionary relationships. However, the vast majority of these proteins remain functionally uncharacterized. Grouping the millions of such uncharacterized sequences with the few experimentally characterized ones allows the transfer of annotations, while the inspection of conserved residues with multiple sequence alignments can provide clues to function, even in the absence of existing functional information. To address the challenges associated with this data surge and the need to group sequences, we present a scalable, open-source, parametrizable Nextflow pipeline (nf-core/proteinfamilies) that generates nascent protein families or assigns new proteins to existing families. The computational benchmarks demonstrated that resource usage scales approximately linearly with input size, and the biological benchmarks showed that the generated protein families closely resemble manually curated families in widely used databases.

Nextflow↗
DOE OSTI2025

Machine learned potential for high-throughput phonon calculations of metal—organic frameworks

Metal–organic frameworks (MOFs) are highly porous and versatile materials studied extensively for applications such as carbon capture and water harvesting. However, computing phonon-mediated properties in MOFs, like thermal expansion and mechanical stability, remains challenging due to the large number of atoms per unit cell, making traditional Density Functional Theory (DFT) methods impractical for high-throughput screening. Recent advances in machine learning potentials have led to foundation atomistic models, such as MACE-MP-0, that accurately predict equilibrium structures but struggle with phonon properties of MOFs. In this work, we developed a workflow for computing phonons in MOFs within the quasi-harmonic approximation with a fine-tuned MACE model, MACE-MP-MOF0. The model was trained on a curated dataset of 127 representative and diverse MOFs. The fine-tuned MACE-MP-MOF0 improves the accuracy of phonon density of states and corrects the imaginary phonon modes of MACE-MP-0, enabling high-throughput phonon calculations with state-of-the-art precision. The model successfully predicts thermal expansion and bulk moduli in agreement with DFT and experimental data for several well-known MOFs. These results highlight the potential of MACE-MP-MOF0 in guiding MOF design for applications in energy storage and thermoelectrics.

Elena, Alin Marin↗
DOE OSTI2025

Exascale workflow applications and middleware: An ExaWorks retrospective

Exascale computers offer transformative capabilities to combine data-driven and learning-based approaches with traditional simulation applications to accelerate scientific discovery and insight. However, these software combinations and integrations are difficult to achieve due to the challenges of coordinating and deploying heterogeneous software components on diverse and massive platforms. Here, we present the ExaWorks project, which addresses many of these challenges. We developed a workflow Software Development Toolkit (SDK), a curated collection of workflow technologies that can be composed and interoperated through a common interface, engineered following current best practices, and specifically designed to work on HPC platforms. ExaWorks also developed PSI/J, a job management abstraction API, to simplify the construction of portable software components and applications that can be used over various HPC schedulers. The PSI/J API is a minimal interface for submitting and monitoring jobs and their execution state across multiple and commonly used HPC schedulers. We also describe several leading and innovative workflow examples of ExaWorks tools used on DOE leadership platforms. Furthermore, we discuss how our project is working with the workflow community, large computing facilities, and HPC platform vendors to address the requirements of workflows sustainably at the exascale.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Cric searchable image database as a public platform for conventional pap smear cytology data

Amidst the current health crisis and social distancing, telemedicine has become an important part of mainstream of healthcare, and building and deploying computational tools to support screening more efficiently is an increasing medical priority. The early identification of cervical cancer precursor lesions by Pap smear test can identify candidates for subsequent treatment. However, one of the main challenges is the accuracy of the conventional method, often subject to high rates of false negative. While machine learning has been highlighted to reduce the limitations of the test, the absence of high-quality curated datasets has prevented strategies development to improve cervical cancer screening. The Center for Recognition and Inspection of Cells (CRIC) platform enables the creation of CRIC Cervix collection, currently with 400 images (1,376 × 1,020 pixels) curated from conventional Pap smears, with manual classification of 11,534 cells. This collection has the potential to advance current efforts in training and testing machine learning algorithms for the automation of tasks as part of the cytopathological analysis in the routine work of laboratories.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

A Curated Dataset of Regional Meteor Events with Simultaneous Optical and Infrasound Observations (2006–2011)

We present a curated, openly accessible dataset of 71 regional meteor events simultaneously recorded by optical and infrasound instrumentation between 2006 and 2011. These events were captured during an observational campaign using the all-sky cameras of the Southern Ontario Meteor Network and the co-located Elginfield Infrasound Array. Each entry provides optical trajectory measurements, infrasound waveforms, and atmospheric specification profiles. The integration of optical and acoustic data enables robust linkage between observed acoustic signals and specific points along meteor trajectories, offering new opportunities to examine shock wave generation, propagation, and energy deposition processes. This release fills a critical observational gap by providing the first validated, openly accessible archive of simultaneous optical–infrasound meteor observations that supports trajectory reconstruction, acoustic propagation modeling, and energy deposition analyses. By making these data openly available in a structured format, this work establishes a durable reference resource that advances reproducibility, fosters cross-disciplinary research, and underpins future developments in meteor physics, atmospheric acoustics, and planetary defense.

astrometry↗
DOE OSTI2023

Targeted curation of the gut microbial gene content modulating human cardiovascular disease

Despite the promise of the gut microbiome to predict human health, few studies expose the molecular-scale processes underpinning such forecasts. We mined over 200,000 gut-derived genomes from cultivated and uncultivated microbial lineages to inventory the gut microorganisms and their gene content that control trimethylamine-induced cardiovascular disease. We assigned an atherosclerotic profile to the 6,341 microbial genomes that encoded metabolisms associated with heart disease, creating the Methylated Amine Gene Inventory of Catabolism database (MAGICdb). From microbiome gene expression data sets, we demonstrate that MAGICdb enhanced the recovery of disease-relevant genes and identified the most active microorganisms, unveiling future therapeutic targets. From the feces of healthy and diseased subjects, we show that MAGICdb predicted cardiovascular disease status as effectively as traditional lipid blood tests. This functional microbiome catalog is a public, exploitable resource, designed to enable a new era of microbiota-based therapeutics and diagnostics

metatranscriptomics↗
DOE OSTI2022

Curation of a list of chemicals in biosolids from EPA National Sewage Sludge Surveys & Biennial Review Reports

Section 405(d) of the Clean Water Act requires the US Environmental Protection Agency to review sewage sludge regulations every two years to identify any additional pollutants that may occur in biosolids and to set regulations for pollutants identified in biosolids if sufficient scientific evidence shows they may harm human health or the environment. To date, EPA has conducted eight biennial reviews to identify chemical and microbial pollutants and three national sewage sludge surveys to identify pollutants and obtain concentration data for chemicals found in biosolids. Prior to 2021, there was inconsistent reporting of chemicals identified and EPA did not cumulatively track chemicals in biosolids. Through the efforts presented here, EPA produced a list of 726 chemicals and structure-based classes found in biosolids based on biennial reviews and national sewage sludge surveys. Summary statistics of concentration data are also reported for the 484 chemicals found in the three national sewage sludge surveys. The creation of the Biosolids List supports EPA in assessing the potential risk of chemical pollutants found in biosolids.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Identifying Disinformation Using Rhetorical Devices in Natural Language Models

Foreign disinformation campaigns are strategically organized, extended efforts using disinformation – false or misleading information deliberately placed by an adversary – to achieve some goal. Disinformation campaigns pose severe threats to our nation’s security by misinforming decision makers and negatively influencing their actions when they are operating on limited amounts of evidence. Current efforts rely on subject matter experts to manually identify disinformation, or on computers and traditional natural language processing algorithms to identify patterns in data to calculate the probability that something is disinformation or not. While both have their merits and successes, subject matter experts are unable to keep up with the high volumes of global information and traditional natural language algorithms do not do well in identifying “why” something is disinformation or not. Our hypothesis is that we can identify disinformation by looking at the way someone speaks, in the rhetorical devices they use. We have curated and annotated a dataset designed for multiple natural language processing tasks, but specifically useful for disinformation detection algorithms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

An expert-driven literature review of “negative” chemicals for developmental neurotoxicity (DNT) in vitro assay evaluation

To date, approximately 200 chemicals have been tested in US Environmental Protection Agency (EPA) or Organization for Economic Co-operation and Development (OECD) developmental neurotoxicity (DNT) guideline studies, leaving thousands of chemicals without traditional animal information on DNT hazard potential. To address this data gap, a battery of in vitro DNT new approach methodologies (NAMs) has been proposed. Evaluation of the performance of this battery will increase the confidence in its use to determine DNT chemical hazards. One approach to evaluate DNT NAM performance is to use a set of chemicals to evaluate sensitivity and specificity. Since a list of chemicals with potential evidence of in vivo DNT has been established, this study aims to develop a curated list of “negative” chemicals for inclusion in a “DNT NAM evaluation set”. A workflow, including a literature search followed by an expert-driven literature review, was used to systematically screen 39 chemicals for lack of DNT effect. Expert panel members evaluated the scientific robustness of relevant studies to inform chemical categorizations. Following review, the panel discussed each chemical and made categorical determinations of “Favorable”, “Not Favorable”, or “Indeterminate” reflecting acceptance, lack of suitability, or uncertainty given specific limitations and considerations, respectively. Further, the panel determined that 10, 22, and 7 chemicals met the criteria for “Favorable”, “Not Favorable”, and “Indeterminate”, for use as negatives in a DNT NAM evaluation set. Ultimately, this approach not only supports DNT NAM performance evaluation but also highlights challenges in identifying large numbers of negative DNT chemicals.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Linking metabolic phenotypes to pathogenic traits among “ Candidatus Liberibacter asiaticus” and its hosts

Candidatus Liberibacter asiaticus (CLas) has been associated with Huanglongbing, a lethal vector-borne disease affecting citrus crops worldwide. While comparative genomics has provided preliminary insights into the metabolic capabilities of this uncultured microorganism, a comprehensive functional characterization is currently lacking. Here, we reconstructed and manually curated genome-scale metabolic models for the six CLas strains A4, FL17, gxpsy, Ishi-1, psy62, and YCPsy, in addition to a model of the closest related culturable microorganism, L. crescens BT-1. Predictions about nutrient requirements and changes in growth phenotypes of CLas were confirmed using in vitro hairy root-based assays, while the L. crescens BT-1 model was validated using cultivation assays. Host-dependent metabolic phenotypes were revealed using expression data obtained from CLas-infected citrus trees and from the CLas-harboring psyllid Diaphorina citri Kuwayama. These results identified conserved and unique metabolic traits, as well as strain-specific interactions between CLas and its hosts, laying the foundation for the development of model-driven Huanglongbing management strategies.

59 BASIC BIOLOGICAL SCIENCES↗