Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data science workflows”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

A Geo-Data Science Method for Assessing Unconventional Rare-Earth Element Resources in Sedimentary Systems

Abstract Rare-earth elements (REEs) supply raw materials that constitute many of our modern critical infrastructure, defense, technology, and electrification needs. Despite REE accumulations occurring in conventional bedrock and ion-adsorption deposits sourced from weathering of igneous rocks, unconventional host materials such as coal and related sedimentary strata have been identified as promising sources of REEs to meet growing demand. To maximize the potential of unconventional resources such as REE-coal systems, new approaches are needed overcome challenges from mineral systems with no known deposits and areas with sparse geochemical data. This article presents a systematic knowledge-data resource assessment method for predicting and identifying REE resource potential and occurrence in these unconventional systems. The method utilizes a geologic and geospatial knowledge-data approach informed and guided by REE accumulation mechanisms to systematically assess and identify areas of higher enrichment. An assessment of the Powder River Basin is presented as a test case to demonstrate the method workflow and results. The key output is a potential enrichment score map reported with varying confidence levels based on the amount of supporting evidence. Results from the test case indicate several locations with promising potential for different types of coal-REE deposits, demonstrating the viability of the method for exploration and assessment of unconventional REE resources. The method is flexible by design and, with sufficient applicable knowledge and data, can be adapted for assessing critical mineral systems in other sedimentary systems as well.

58 GEOSCIENCES↗
DOE OSTI2022

Metagenome-assembled genome extraction and analysis from microbiomes using KBase

Uncultivated Bacteria and Archaea account for the vast majority of species on Earth, but obtaining their genomes directly from the environment, using shotgun sequencing, has only become possible recently. In order to realize the hope of capturing Earth’s microbial genetic complement and to facilitate the investigation of the functional roles of specific lineages in a given ecosystem, technologies that accelerate the recovery of high-quality genomes are necessary. We present a series of analysis steps and data products for the extraction of high-quality metagenome-assembled genomes (MAGs) from microbiomes using the U.S. Department of Energy Systems Biology Knowledgebase (KBase) platform (http://www.kbase.us/). Overall, these steps take about a day to obtain extracted genomes when starting from smaller environmental shotgun read libraries, or up to about a week from larger libraries. In KBase, the process is end-to-end, allowing a user to go from the initial sequencing reads all the way through to MAGs, which can then be analyzed with other KBase capabilities such as phylogenetic placement, functional assignment, metabolic modeling, pangenome functional profiling, RNA-Seq and others. While portions of such capabilities are available individually from other resources, the combination of the intuitive usability, data interoperability and integration of tools in a freely available computational resource makes KBase a powerful platform for obtaining MAGs from microbiomes. While this workflow offers tools for each of the key steps in the genome extraction process, it also provides a scaffold that can be easily extended with additional MAG recovery and analysis tools, via the KBase software development kit (SDK).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Automated and Distributed Monte Carlo Generation for GlueX

MCwrapper is a set of systems that manages the entire Monte Carlo production workflow for GlueX and provides standards for how that Monte Carlo is produced. MCwrapper was designed to be able to utilize a variety of batch systems in a way that is relatively transparent to the user, thus enabling users to quickly and easily produce valid simulated data at home institutions worldwide. Additionally, MCwrapper supports an autonomous system that takes user’s project submissions via a custom web application. The system then atomizes the project into individual jobs, matches these jobs to resources, and monitors the jobs status. The entire system is managed by a database which tracks almost all facets of the systems from user submissions to the individual jobs themselves. Users can interact with their submitted projects online via a dashboard or, in the case of testing failure, can modify their project requests from a link contained in an automated email. Beginning in 2018 the GlueX Collaboration began to utilize the Open Science Grid (OSG) to handle a bulk of simulation tasks; these tasks are currently being performed on the OSG automatically via MCwrapper. This talk will outline the entire system of MCwrapper, its use cases, and the unique challenges facing the system.

Britton, Thomas↗
DOE OSTI2025

An atomic cluster expansion potential for twisted multilayer graphene

Twisted multilayer graphene, characterized by its moiré patterns arising from inter-layer rotational misalignment, serves as a rich platform for exploring quantum phenomena. Machine learning interatomic potentials (MLIPs) are a promising approach to model such systems. Our work develops a method to generate training and test datasets for fitting MLIPs that capture all possible misalignments but remain small-scale to facilitate efficient data generation and parameter estimation. To achieve this, we generate configurations with periodic boundary conditions suitable for density functional theory calculations, and then introduce an internal twist and shift within those supercell structures. Using this technique, supplemented with an active learning workflow, we fit an Atomic Cluster Expansion potential for simulating twisted multilayer graphene and test it for accuracy and robustness on a range of simulation tasks.

2D materials↗
NASA NTRS2024

The Knowledge-based Digital Platform Concept for Advanced Air Mobility Research and Development

National Aeronautics and Space Administration (NASA) Langley Research Center (LaRC) is spearheading an innovative digital engineering approach to integrate, communicate, and facilitate the research of multi-modal transportation systems. The Knowledge-based Digital Platform (KbDP) is a concept being developed that ties the workflows of Project Managers (PM), Principal Investigators (PI), and System Engineers (SE) together across organizational boundaries. The overarching vision for the KbDP Concept for AAM R&D is a substantial undertaking. The initial concept and implementation will focus on UAM operations to tractably learn and adjust the concept with a manageable database. Lessons learned and best practices with a smaller scope will enable successful scalability to AAM R&D or even to the entire modes of transportation and logistics. The UAM vision is one in which advanced technologies and new operational procedures enable practical and cost-effective air transport as an integrated mode of movement of people and goods throughout metropolitan areas. Initial implementation of three KbDP concepts of use shows promising benefits to NASA’s Air Traffic Management-Exploration (ATM-X) UAM Airspace Subproject. It is envisioned that the KbDP will manage an information database defined by mathematical, data science, and system engineering principles. AIML algorithms play a vital role in this KbDP concept by extracting meaningful knowledge from the information database, which the human user leverages to improve the efficiency and effectiveness of their research greatly.

ATM↗
DOE OSTI2021

DOE JGI Metagenome Workflow

The DOE Joint Genome Institute (JGI) Metagenome Workflow performs metagenome data processing, including assembly; structural, functional, and taxonomic annotation; and binning of metagenomic data sets that are subsequently included into the Integrated Microbial Genomes and Microbiomes (IMG/M) (I.-M. A. Chen, K. Chu, K. Palaniappan, A. Ratner, et al., Nucleic Acids Res, 49:D751–D763, 2021, https://doi.org/10.1093/nar/gkaa939) comparative analysis system and provided for download via the JGI data portal (https://genome.jgi.doe.gov/portal/). This workflow scales to run on thousands of metagenome samples per year, which can vary by the complexity of microbial communities and sequencing depth. Here, we describe the different tools, databases, and parameters used at different steps of the workflow to help with the interpretation of metagenome data available in IMG and to enable researchers to apply this workflow to their own data. We use 20 publicly available sediment metagenomes to illustrate the computing requirements for the different steps and highlight the typical results of data processing. The workflow modules for read filtering and metagenome assembly are available as a workflow description language (WDL) file (https://code.jgi.doe.gov/BFoster/jgi_meta_wdl). The workflow modules for annotation and binning are provided as a service to the user community at https://img.jgi.doe.gov/submit and require filling out the project and associated metadata descriptions in the Genomes OnLine Database (GOLD) (S. Mukherjee, D. Stamatis, J. Bertsch, G. Ovchinnikova, et al., Nucleic Acids Res, 49:D723–D733, 2021, https://doi.org/10.1093/nar/gkaa983).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

pathSQE : an automated workflow for single-crystal inelastic neutron scattering data processing and analysis

Inelastic neutron scattering (INS) experiments utilizing modern time-of-flight spectrometers enable the comprehensive mapping of the energy (E)- and momentum (Q)-resolved dynamical structure factor of single crystals, probing both the lattice and magnetic excitations. Yet, the large size and complexity of four-dimensional INS data are challenging current analysis workflows, often resulting in an underutilization of the measured information. To help address this issue, this paper introduces new software interfaced with the Mantid framework, pathSQE, designed to streamline the processing, analysis and interpretation of 4D single-crystal INS data. By automating key tasks such as 1D/2D slicing, symmetrization, Brillouin zone folding, data visualization, prioritization and filtering, and comparisons with simulations, pathSQE facilitates and accelerates INS data analysis workflows. Here, this paper outlines the features and implementation and provides several illustrations of the use of pathSQE on data collected on single crystals using direct-geometry time-of-flight spectrometers at the Spallation Neutron Source, including Ge, FeSi, MnO and SnS single-crystal measurements on the ARCS, HYSPEC and CNCS neutron spectrometers. Beyond streamlining post-experiment data processing, pathSQE establishes an automated and modular processing pipeline that could support future real-time experiment steering.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Accelerating high-strain continuum-scale brittle fracture simulations with machine learning

Failure in brittle materials under dynamic loading conditions is a result of the propagation and coalescence of microcracks. Simulating this discrete crack evolution at the continuum level is computationally expensive or, in some cases, intractable, resulting in the need to make broad assumptions or neglect key physics. In this work, we have developed an approach using machine learning that overcomes the current inability to represent meso-scale physics at the macro-scale. Our approach leverages damage and stress data from a computationally expensive high-fidelity model that explicitly resolves microcrack behavior to build an inexpensive machine learning emulator. Once trained, the machine learning emulator is used to predict the evolution of crack length statistics, which then informs a continuum-scale constitutive model. This results in a significant speed-up of the workflow by four orders of magnitude. Both the machine learning emulator and the continuum-scale model are validated against the high-fidelity model and experimental data, respectively, showing excellent agreement. There are two key findings. The first is that we can reduce the dimensionality of the problem, establishing that the machine learning emulator only needs the length of the longest crack and one of the maximum stress components to capture the necessary physics. Another compelling finding is that the emulator can be trained in one experimental setting and transferred successfully to predict behavior in a different setting.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Sensitive and error-tolerant annotation of protein-coding DNA with BATH

We present BATH, a tool for highly sensitive annotation of protein-coding DNA based on direct alignment of that DNA to a database of protein sequences or profile hidden Markov models (pHMMs). BATH is built on top of the HMMER3 code base, and simplifies the annotation workflow for pHMM-based translated sequence annotation by providing a straightforward input interface and easy-to-interpret output. BATH also introduces novel frameshift-aware algorithms to detect frameshift-inducing nucleotide insertions and deletions (indels). BATH matches the accuracy of HMMER3 for annotation of sequences containing no errors, and produces superior accuracy to all tested tools for annotation of sequences containing nucleotide indels. These results suggest that BATH should be used when high annotation sensitivity is required, particularly when frameshift errors are expected to interrupt protein-coding regions, as is true with long-read sequencing data and in the context of pseudogenes.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Tailored approach to study Legionella infection using a lattice light sheet microscope (LLSM)

Legionella is a genus of ubiquitous environmental pathogens found in freshwater systems, moist soil, and composted materials. More than four decades of Legionella research has provided important insights into Legionella pathogenesis. Although standard commercial microscopes have led to significant advances in understanding Legionella pathogenesis, great potential exists in the deployment of more advanced imaging techniques to provide additional insights. The lattice light sheet microscope (LLSM) is a recently developed microscope for 4D live cell imaging with high resolution and minimum photo-damage. We built a LLSM with an improved version for the optical layout with two path-stretching mirror sets and a novel reconfigurable galvanometer scanner ( RGS ) module to improve the reproducibility and reliability of the alignment and maintenance of the LLSM. We commissioned this LLSM to study Legionella pneumophila infection with a tailored workflow designed over instrumentation, experiments, and data processing methods. Our results indicate that Legionella pneumophila infection is correlated with a series of morphological signatures such as smoothness, migration pattern and polarity both statistically and dynamically. Our work demonstrates the benefits of using LLSM for studying long-term questions in bacterial infection. Our free-for-use modifications and workflow designs on the use of LLSM system contributes to the adoption and promotion of the state-of-the-art LLSM technology for both academic and commercial applications.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Examination of 3013 Containers Baseline Surface Features

The Surveillance and Monitoring Program at Los Alamos National Laboratory (LANL) was tasked with evaluating the baseline features of 3013 containers. This baseline is to be used as a basis for comparison for 3013 containers that had been packaged with corrosive plutonium materials. The LANL team evaluated an unwelded container, an unused welded container, and a welded container that had held plutonium metal without any corrosive impurities. These three containers had features with depths no larger than 6 µm and had similar depth distributions. The features observed in the baseline containers were all shallower than those seen in containers packaged with corrosive plutonium materials. This work establishes workflows for feature identification and measurement, as well as establishment of baseline data for future comparison with corroded containers.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Workflow for Process Automation of Soil Gas Results from an Automated Soil Gas-Sampling System for Application in Carbon Storage Projects

Conference presentation at Geoconvention, Calgary, Alberta, Canada, May 12–14, 2025. The Energy & Environmental Research Center (EERC) developed an automated workflow for processing soil gas measurements collected from the automated soil gas-sampling systems deployed across the project site. Raw soil gas measurements are collected from each station every 4 hours and automatically uploaded to a cloud database. The workflow begins by writing code to download the data to a workstation automatically, then the data are published to an online dashboard that visualizes the measurements in time-series plots and a process-based decision-making framework. This automated workflow accelerates the time from data acquisition to decision-making. It supports carbon storage project operators by preparing and delivering a live, standardized dataset for quick analysis and source attribution to provide assurance of containment and overall permit compliance.

02 PETROLEUM↗
DOE OSTI2020

The Synthetic Biology Open Language (SBOL) Version 3: Simplified Data Exchange for Bioengineering

The Synthetic Biology Open Language (SBOL) is a community-developed data standard that allows knowledge about biological designs to be captured using a machine-tractable, ontology-backed representation that is built using Semantic Web technologies. While early versions of SBOL focused only on the description of DNA-based components and their sub-components, SBOL can now be used to represent knowledge across multiple scales and throughout the entire synthetic biology workflow, from the specification of a single molecule or DNA fragment through to multicellular systems containing multiple interacting genetic circuits. The third major iteration of the SBOL standard, SBOL3, is an effort to streamline and simplify the underlying data model with a focus on real-world applications, based on experience from the deployment of SBOL in a variety of scientific and industrial settings. Here, we introduce the SBOL3 specification both in comparison to previous versions of SBOL and through practical examples of its use.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Workflow for Process Automation of Soil Gas Results from an Automated Soil Gas-Sampling System for Application in Carbon Storage Projects

Extended abstract for Geoconvention, Calgary, Alberta, Canada, May 12–14, 2025. The Energy & Environmental Research Center (EERC) developed an automated workflow for processing soil gas measurements collected from the automated soil gas-sampling systems deployed across the project site. Raw soil gas measurements are collected from each station every 4 hours and automatically uploaded to a cloud database. The workflow begins by writing code to download the data to a workstation automatically, then the data are published to an online dashboard that visualizes the measurements in time-series plots and a process-based decision-making framework. This automated workflow accelerates the time from data acquisition to decision-making. It supports carbon storage project operators by preparing and delivering a live, standardized dataset for quick analysis and source attribution to provide assurance of containment and overall permit compliance.

02 PETROLEUM↗
DOE OSTI2026

Enhancing dimensionality prediction in hybrid metal halides via feature engineering and class-imbalance mitigation

We present a machine learning (ML) framework for predicting the structural dimensionality of hybrid metal halides (HMHs), including organic-inorganic perovskites, using a combination of chemically-informed feature engineering and advanced class-imbalance handling techniques. This study is motivated by the small and highly imbalanced nature of experimentally available HMH datasets, which limits the applicability and reliability of conventional ML approaches. The dataset, consisting of 494 HMH structures, is highly imbalanced across dimensionality classes (0D, 1D, 2D, 3D), posing significant challenges to predictive modeling. To mitigate this limitation, the dataset was augmented to 1336 samples using the synthetic minority oversampling technique, enabling improved learning of underrepresented dimensionality classes while preserving chemically meaningful feature relationships. We developed interaction-based descriptors designed to capture coupled steric and polarity effects relevant to dimensionality prediction, which are not readily captured by standard single-parameter or composition-only descriptors. These descriptors are integrated into a multi-stage workflow combining feature selection, ensemble stacking, and performance optimization. Our approach significantly improves F1-scores for underrepresented classes, achieving robust cross-validation performance across all dimensionalities. This work demonstrates a generalizable strategy for extracting reliable and interpretable structure–dimensionality relationships from limited experimental data, enabling pre-synthesis screening of organic cations and providing a practical blueprint for small-data ML in hybrid materials systems.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Simulation tools, first results and experimental status of the MURAVES experiment

The MUon RAdiography of VESuvius (MURAVES) project aims at the study of Mt. Vesuvius, an active and hazardous volcano near Naples, Italy, with the use of muons freely and abundantly produced by cosmic rays. In particular, the MURAVES experiment intends to perform muographic imaging of the internal structure of the summit of Mt. Vesuvius. The challenging measurement of the rock density distribution in its summit by muography, in conjunction with data from other geophysical techniques, can help model possible eruption dynamics. The MURAVES apparatus consists of an array of three independent and identical muon trackers, with a total sensitive area of 3 square meters. In each tracker, a sequence of 4 XY tracking planes made of plastic scintillators is complemented by a 60 cm thick lead wall inserted between the two downstream planes to improve rejection of background from low energy muons. The apparatus is currently acquiring data. This paper presents preliminary results from the analysis of the first data samples acquired with trackers pointing towards Mt. Vesuvius, including the first relative measurement of the density projection of two flanks of the volcano at three different altitudes; we also present the workflow of the simulation chain of the MURAVES experiment and its ongoing developments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Synthetic Soil Aggregates: Bioprinted Habitats for High-Throughput Microbial Metaphenomics

The dynamics of microbial processes are difficult to study in natural soil, owing to the small spatial scales on which microorganisms operate and to the opacity and chemical complexity of the soil habitat. To circumvent these challenges, we have created a 3D-bioprinted habitat that mimics aspects of natural soil aggregates while providing a chemically defined and translucent alternative culturing method for soil microorganisms. Our Synthetic Soil Aggregates (SSAs) retain the porosity, permeability, and patchy resource distribution of natural soil aggregates—parameters that are expected to influence emergent microbial community interactions. We demonstrate the printability and viability of several different microorganisms within SSAs and show how the SSAs can be integrated into a multi-omics workflow for single SSA resolution genomics, metabolomics, proteomics, lipidomics, and biogeochemical assays. We study the impact of the structured habitat on the distribution of a model co-culture microbial community and find that it is significantly different from the spatial organization of the same community in liquid culture, indicating a potential for SSAs to reproduce naturally occurring emergent community phenotypes. The SSAs have the potential as a tool to help researchers quantify microbial scale processes in situ and achieve high-resolution data from the interplay between environmental properties and microbial ecology.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Data supporting the manuscript "Nanometer Scale Imaging to Develop Quantitative Descriptors of Bipolar Membrane Junction Structure"

This dataset contains atomic force microscopy images associated with the manuscript "Nanometer Scale Imaging to Develop Quantitative Descriptors of Bipolar Membrane Junction Structure" by Maria Kelly, Emily R. Dunn, Ellis A. Spickermann, Josephine N. Gruber, César A. Lasalde-Ramírez, P. N. Romero Zavala, Éowyn Lucas, Ankur Gupta, Harry A. Atwater, and Wilson A. Smith. The dataset contains both raw images as well as segmented images produced by the image processing workflow described in the manuscript. A readme file and meta data file are included to provide additional details regarding the sample identity, image acquisition parameters, and file naming scheme.

36 MATERIALS SCIENCE↗