SEARCH · Engineering Papers

Results for “data science workflows”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Computer Vision Pipeline for Image Analysis for Freeze‐Fracture Electron Microscopy: Rosette Cellulose Synthase Complexes Case

In materials science, plant biology, agriculture, and environmental research, the automated analysis of high-magnification, complex microscopy images, such as those generated by freeze-fracture electron microscopy (FF-TEM), remains a critical challenge that limits the scalability of data interpretation. We present a deep learning computer vision pipeline for high-throughput detection and morphological characterization analysis of cellulose synthase complexes (CSCs, or rosettes) in FF-TEM images. The pipeline integrates preprocessing, detection, human-in-the-loop verification, and semantic segmentation to quantify features such as rosette diameter and inter-lobe spacing. The approach was trained and tested on a curated dataset of high-resolution FF-TEM micrographs of Physcomitrium patens, expanded via strategic tiling and augmentation to over 650 images. We compare YOLOv8 and YOLOv9 architectures and demonstrate that YOLOv9 achieves superior performance in both localization accuracy (mAP50-95 = 0.854) and inference speed. The resulting distributions revealed biological variability consistent with prior manual studies, validating the approach for high-throughput applications. Our results show that the pipeline achieves human-expert level accuracy while dramatically reducing analysis time, enabling scalable, reproducible structural characterization of intramembrane protein complexes. The pipeline is broadly applicable to other domains requiring precise interpretation of complex microscopy data and establishes a foundation for future artificial intelligence (AI)-assisted workflows in biological imaging.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Multi-Scale Characterization of Porosity and Cracks in Silicon Carbide Cladding after Transient Reactor Test Facility Irradiation

Silicon carbide (SiC) ceramic matrix composite (CMC) cladding is currently being pursued as one of the leading candidates for accident-tolerant fuel (ATF) cladding for light water reactor applications. The morphology of fabrication defects, including the size and shape of voids, is one of the key challenges that impacts cladding performance and guarantees reactor safety. Therefore, quantification of defects’ size, location, distribution, and leak paths is critical to determining SiC CMC in-core performance. This research aims to provide quantitative insight into the defect’s distribution under multi-scale characterization at different length scales before and after different Transient Reactor Test Facility (TREAT) irradiation tests. A non-destructive multi-scale evaluation of irradiated SiC will help to assess critical microstructural defects from production and/or experimental testing to better understand and predict overall cladding performance. X-ray computed tomography (XCT), a non-destructive, data-rich characterization technique, is combined with lower length scale electronic microscopic characterization, which provides microscale morphology and structural characterization. This paper discusses a fully automatic workflow to detect and analyze SiC-SiC defects using image processing techniques on 3D X-ray images. Following the XCT data analysis, advanced characterizations from focused ion beam (FIB) and transmission electron microscopy (TEM) were conducted to verify the findings from the XCT data, especially quantitative results from local nano-scale TEM 3D tomography data, which were utilized to complement the 3D XCT results. In this work, three SiC samples (two irradiated and one unirradiated) provided by General Atomics are investigated. The irradiated samples were irradiated in a way that was expected to induce cracking, and indeed, the automated workflow developed in this work was able to successfully identify and characterize the defects formation in the irradiated samples while detecting no observed cracking in the unirradiated sample. These results demonstrate the value of automated XCT tools to better understand the damage and damage propagation in SiC-SiC structures for nuclear applications.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2025

Predicting Trends in VOC Through Rapid, Multimodal Characterization of State-of-the-Art p-i-n Perovskite Devices

Perovskite photovoltaic technologies are approaching commercial deployment, yet single junction and tandem architectures both still have significant room to improve power conversion efficiency and stability. The ability to perform rapid screening of material quality after altering processing conditions is critical to accelerating the optimization and commercialization of perovskite-based technologies. Currently, researchers utilize a wide range of stand-alone metrology tools to isolate sources of power loss throughout a device stack, which can be slow and labor intensive. Here, we demonstrate the use of a multimodal metrology approach to rapidly determine the maximum achievable and predicted open circuit voltages of >100 perovskite devices during fabrication. Acquisition of these different data is facilitated by combining them into a single integrated measurement platform. We show that these data and automated analysis can be used to rapidly understand and ultimately predict quantitative trends in open circuit voltages of state-of-the-art device architectures. The data and automated analysis workflow presented provides a reliable approach to quickly identify absorber and charge transport layer combinations that can lead to improved open circuit voltages.

14 SOLAR ENERGY↗

DOE OSTI2020

Leading magnetic fusion energy science into the big-and-fast data lane

To crack the code of unlimited clean energy from magnetic fusion, researchers collaborate among numerous facilities that are scattered around the globe. Probing hot fusion plasmas with sophisticated diagnostics, they routinely generate fast streams of high-dimensional time-series data. We present the adaptation of a production code-base for a plasma diagnostic to the big-and-fast data lane. The new code-base is used to stream measurements, made in Korea, into a Top-15 computing facility in the US for remote analysis. We discuss software and design choices made for this new HPC-enabled scientific workflow.

Kube, Ralph↗

DOE OSTI2024

In Silico Screening of CO 2 –Dipeptide Interactions for Bioinspired Carbon Capture

Carbon capture, sequestration and utilization offers a viable solution for reducing the total amount of atmospheric CO 2 concentrations. On an industrial scale, amine-based solvents are extensively employed for CO 2 capture through chemisorption. Nevertheless, this method is marked by the high cost associated with solvent regeneration, high vapor pressure, and the corrosive and toxic attributes of by-products, such as nitrosamines. An alternative approach is the biomimicry of sustainable materials that have strong affinity and selectivity for CO 2 . Bioinspired approaches, such as those based on naturally occurring amino acids, have been proposed for direct air capture methodologies. In this study, we present a database consisting of 960 dipeptide molecular structures, composed of the 20 naturally occurring amino acids. Furthermore, those structures were analyzed with a novel computational workflow presented in this work that considers certain interaction sites that determine CO 2 affinity. Density functional theory (DFT) and symmetry-adapted perturbation theory (SAPT) computations were performed for the calculation of CO 2 interaction energies, which allowed to limit our search space to 400 unique dipeptide structures. Using this computational workflow, we provide statistical insights into dipeptides and their affinity for CO 2 binding, as well as design principles that can further enhance CO 2 capture through cooperative binding.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

White Paper: Scalable Digital Twin Capabilities for Aging and Surveillance of Engineered Systems

This white paper presents a multi-year initiative to develop practical, secure, and scalable digital twin capabilities for engineered systems in aging and surveillance contexts—an approach pioneered at the National Nuclear Security Administration (NNSA) Lawrence Livermore National Laboratory (LLNL) that maps directly onto the needs and ambitions of the Navy for ship- and fleet-level digital twins. LLNL’s work in building part- and process-level digital twins for advanced manufacturing, with a vision to scale up to entire factory floors and, ultimately, enterprise-wide digital twins, offers an adaptable pathway for the Navy as it seeks to modernize lifecycle management, readiness, and predictive maintenance across ships and fleets. For our application, we integrate physics-based modeling with automated data ingestion, processing, and AI-driven calibration, creating hybrid models that are both interpretable and data responsive. We modernized legacy workflows, established centralized data infrastructure, automated experimental pipelines, and demonstrated end-to-end coupling of accelerated aging data with finite element simulations via optimization and surrogate modeling. The result is a generalizable framework that supports part-level digital twins today and lays the groundwork for future system-level twins suitable for Navy applications.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Machine Learning for Materials Scientists: An Introductory Guide toward Best Practices

This Methods/Protocols article is intended for materials scientists interested in performing machine learning-centered research. Herein, we cover broad guidelines and best practices regarding the obtaining and treatment of data, feature engineering, model training, validation, evaluation and comparison, popular repositories for materials data and benchmarking data sets, model and architecture sharing, and finally publication. In addition, we include interactive Jupyter notebooks with example Python code to demonstrate some of the concepts, workflows, and best practices discussed. Overall, the data-driven methods and machine learning workflows and considerations are presented in a simple way, allowing interested readers to more intelligently guide their machine learning research using the suggested references, best practices, and their own materials domain expertise.

36 MATERIALS SCIENCE↗

NASA NTRSDate not supplied

The Future of NASA Earth Science in the Commercial Cloud: Challenges and Opportunities

NASA produces a large volume and variety of data products that are used every day to support research, decision making, and education. The widespread use of NASA’s Earth Science data is enabled by NASA’s Earth Science Data System (ESDS) program, which oversees the archiving and distribution of these data and invests in the development of new data systems and tools. However, NASA’s current approach to Earth Science data distribution — based on distributed institutional archives with individual on-premises high-performance computing capabilities — faces some significant challenges, including massive increases in data volume from upcoming missions, a greater need for transdisciplinary science that synthesizes many different kinds of observations, and a push to make science more open, inclusive, and accessible. To address these challenges, NASA is aggressively migrating its Earth Science data and related tools and services into the commercial cloud. Migration of data into the commercial cloud can significantly improve NASA’s existing data system capabilities by (1) providing more flexible options for storage and compute (including rapid, as-needed access to state-of-the-art capabilities); (2) by centralizing and standardizing data access, which gives all of NASA’s institutional data centers access to all of each other’s datasets; and (3) by facilitating “analysis-in-place”, whereby users can bring their own computational workflows and tools to the data rather than having to maintain their own copies of NASA datasets. However, migration to the commercial cloud also poses some significant challenges, including (1) managing costs under a “pay-as-you-go” model; (2) incompatibility with existing tools and data formats with object-based storage and network access; (3) vendor lock-in; (4) challenges with data access for workflows that mix on-premise and cloud computing; and (5) standardization for highly diverse data as is present in NASA’s data archive. I conclude with two examples of recent NASA activities showcasing capabilities enabled by the commercial cloud: An interactive analysis and development platform for analyzing airborne imaging spectroscopy data, and a new collection of tools and services for data discovery, analysis, publication, and data-driven storytelling (Visualization, Exploration, and Data Analysis, VEDA).

Alexey N Shiklomanov↗

NASA NTRSDate not supplied

Culture-Independent Fungal Profiling for the International Space Station using Nanopore Sequencing: Method Development

Microbial monitoring of the International Space Station (ISS) environment is a crew health requirement that encompasses both bacterial and fungal identification. To achieve this currently, culture-based methods are used for sample collection, and these samples must be returned to the laboratory for analysis. The use of culture and the need for sample return to Earth results in a bias toward culturable organisms and causes a significant delay between sample collection and delivery of final data (weeks to months), respectively. Recently, advancements in molecular technology have aided a broad range of applications, including medical, industrial, and basic sciences. Additionally, increases in portability and ease-of-use of molecular platforms have provided point-of-use capabilities demonstrated by the miniPCR thermal cycler (miniPCR bio) and the MinION sequencer (Oxford Nanopore Technologies). Together, these devices have been applied to, and validated for, the identification of bacteria onboard the ISS. Building on this work, we have developed a spaceflight-compatible fungal workflow. Molecular-based fungal analysis is complicated by low biomass, difficult-to-lyse spores, debate regarding the region for taxonomic assignment, and the lack of bioinformatic pipelines and reference databases. To overcome these difficulties, primers yielding an ~ 2 Kb amplicon were validated against a wide range of ISS fungal isolates. The current spaceflight library preparation was substantially optimized, a bioinformatic pipeline was created, and refinements to the UNITE database were implemented. To compare this optimized method to the current culture-based standard, 30 sample sets (60 total swabs, two swabs held in tandem) were evaluated. Parallel fungal profiles were obtained between the two methods, with the culture-independent method revealing increased diversity. The addition of this method to the already established bacterial process fulfills the crew health identification requirement. Moreover, the implementation of this method onboard ISS will enhance our understanding of its unique fungal microbiome.

Hang N. Nguyen↗

NASA NTRSDate not supplied

Automated Collection of Scientific Publications Linked to NASA Earth Science Datasets

NASA's Earth Observing System Data and Information System (EOSDIS) began dataset Digital Object Identifier (DOI) registration in 2012. The number of dataset DOIs registered as of January of 2023 exceeds 11,000. As the research community becomes aware of the importance of sharing data through Open Science and optimizing data reuse through Findability, Accessibility, Interoperability, and Reuse (FAIR) data management principles, datasets are increasingly being cited in scientific publications. When datasets are cited explicitly by DOI within published works, automated methods can be developed for collecting these published works from a variety of bibliometric sources. The coverage of the sources varies, so each source can collect citations that are only available within it. Using major citation databases such as Scopus and Web of Science, the Google Scholar search engine, the CrossRef Open Citation Index, and the dataset DOI registry DataCite, we present an automated workflow for dataset citation collection. By harvesting citations automatically, a citation library is created explicitly linking EOSDIS datasets to publications that cite them. Using Zotero, a free and open-source citation manager, we demonstrate how to access and browse this library by the tags indicating bibliometric sources, dataset DOI, and the dataset archive center. We also demonstrate temporary trends in the number of publications harvested from bibliometric sources.

Infometrics↗

DOE OSTI2024

Model data for Flood Frequency Analysis using Stochastic Storm Transposition and an Integrated Surface-Subsurface Hydrological Model

This archived provides scripts and input files used for the implementation of a novel approach to conduct process-based Flood Frequency Analysis using a Stochastic Storm Transposition (SST) and an Integrated Surface-Subsurface Hydrological Model (ISSHM). As a proof-of-concept, this study uses the ISSHM, Advanced Terrestrial Simulator (Amanzi-ATS) model, and the SST model, RainyDay, to conduct flood frequency analysis by simulating the flood response to 5,000 annual synthetic storm events in a ~2000 km2 Southeast Texas watershed.The Watershed Workflow package is implemented in Python3. The Jupyter notebooks can be executed through multiple open-source tools, for example, Anaconda Jupyter Lab, VS Studio Code, etc. Other data files include TXT, CSV, DAT, SBATCH, SHP, TIF, NetCDF, and HDF5 files, which can be read through Python scripts. The input files for the ATS model and RainyDay model have .XML and .SST extensions, respectively, and can be edited in any commonly used text editors.This archive contains:* Scripts and data files essential for generating the ATS model input. It uses the Watershed Workflow package to produce both mesh and ATS input files. * Jupyter notebooks designated for the ATS model evaluation, covering both long-term simulations and 40 rainfall-runoff events.* Input files required to simulate SST storm events using RainyDay.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Tilted fluctuation electron microscopy

Fluctuation electron microscopy (FEM) is a scanning nanodiffraction-based method that offers a unique approach to characterizing nanometer-scale medium-range order (MRO) in disordered materials. In addition to determining the degree of MRO, careful analysis of scanning nanodiffraction data can also be used to determine strain in thin film amorphous samples. We applied FEM to characterize the strain and MRO of magnetron sputtered amorphous tantalum (a-Ta) thin films over a range of tilt angles from 0° to 45° in order to measure any deviations between the in-plane and out-of-plane strain and MRO. We validate our approach using electron diffraction simulations of FEM experiments for a-Ta. We measure anisotropic strain in the simulated a-Ta diffraction patterns and find that the experimental a-Ta is isotropically strained within the accuracy of our method. Our approach provides a workflow for acquiring tilted scanning nanodiffraction data, determining the relative strain and ordering as a function of in- A nd out-of-plane directions, and removing any artifacts induced in FEM data due to strain. We also describe some limitations of the tilted FEM method when applied to thin films with very low strains.

36 MATERIALS SCIENCE↗

DOE OSTI2022

EDGE COVID-19: a web platform to generate submission-ready genomes from SARS-CoV-2 sequencing efforts

Abstract Summary Genomics has become an essential technology for surveilling emerging infectious disease outbreaks. A range of technologies and strategies for pathogen genome enrichment and sequencing are being used by laboratories worldwide, together with different and sometimes ad hoc, analytical procedures for generating genome sequences. A fully integrated analytical process for raw sequence to consensus genome determination, suited to outbreaks such as the ongoing COVID-19 pandemic, is critical to provide a solid genomic basis for epidemiological analyses and well-informed decision making. We have developed a web-based platform and integrated bioinformatic workflows that help to provide consistent high-quality analysis of SARS-CoV-2 sequencing data generated with either the Illumina or Oxford Nanopore Technologies (ONT). Using an intuitive web-based interface, this workflow automates data quality control, SARS-CoV-2 reference-based genome variant and consensus calling, lineage determination and provides the ability to submit the consensus sequence and necessary metadata to GenBank, GISAID and INSDC raw data repositories. We tested workflow usability using real world data and validated the accuracy of variant and lineage analysis using several test datasets, and further performed detailed comparisons with results from the COVID-19 Galaxy Project workflow. Our analyses indicate that EC-19 workflows generate high-quality SARS-CoV-2 genomes. Finally, we share a perspective on patterns and impact observed with Illumina versus ONT technologies on workflow congruence and differences. Availability and implementation https://edge-covid19.edgebioinformatics.org, and https://github.com/LANL-Bioinformatics/EDGE/tree/SARS-CoV2. Supplementary information Supplementary data are available at Bioinformatics online.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Crossing the Finish Line: Integration of Data-Driven Process Control for Maximization of Energy and Resource Efficiency in Advanced Water Resource Recovery Facilities

Improvements in process monitoring and control at water resource recovery facilities (WRRFs) could result in reductions in electricity consumption, chemical inputs, and greenhouse gas emissions, as well as improved energy recovery. Many current WRRF data collection, monitoring, and control approaches use 20th century process monitoring and control systems, which require large design safety factors to ensure reliability in the absence of more advanced, precise controls. Implementation of more modern data-driven control tools could lead to more efficient operations that provide intrinsic reliability with better overall process performance at full-scale. This project (1) developed and demonstrated data-driven process controls at full-scale facilities for five promising WRRF process technologies that provide whole-plant approaches and offer substantial energy and resource recovery benefits, and (2) created a Machine Learning (ML) Toolkit and an implementation guide of new process control approaches that walks users through each step of the ML workflow and illustrates the steps through case study examples.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Flexible visualization of a 3rd party Intrusion Prevention (Security) tool: A use case with the ELK stack

A difficult aspect of cyber security is the ability to achieve automated real time intrusion prevention across various sets of systems. To this extent, several companies are offering comprehensive solutions that leverage an "accuracy of scale" and moving much of the intelligence and detection on the Cloud, relying on an ever-growing set of data and analytics to increase decision accuracy. Often, they provide tools to visualize the decision workflows in attack prevention (as well as tune the algorithm) but those solutions are not always practical as companies see the problem as "global" that is, from a unified Cyber-security standpoint. However, a key to a successful Cyber-security program is transparency and trust: from an experimental team viewpoint, this specifically means having the ability to immediately see what and from where, who has been blocked and being able to inform the community in case of a revoked access without the need for filing a "ticket" (that may eventually be answered) – in other words, rapid response to their user-base is essential but solutions targeting "sub-groups" in an organization are not often available. We have come up with a versatile solution leveraging the ELK stack (Elasticsearch, Logstash, & Kibana) and an IPS (Intrusion Prevention System) based WAF (Web Application Firewall) from Signal Sciences. Signal Science allows the streaming of detailed logs in a Logstash format suitable for custom solutions for visualization. By combining these two tools, we have strengthened our security posture and enabled individual experiments to monitor their own traffic. Specifically, the IPS WAF provides unique data such as country of origin, protocol, response code, source IP, and paths accessed. In this contribution, we will show how we engineered a visualization solution so experiment groups could access a dashboard with predefined graphs but also, where they can create individual customizable dashboards used to display blocked traffic and troubleshoot latency issues. We will discuss the details and procedures for developing and configuring these tools and how it benefits cyber security postures across our scientific based environment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Cloud Services Enable Efficient AI-Guided Simulation Workflows across Heterogeneous Resources

Applications which fuse machine learning and simulation are rarely best served by a single computing resource. Highly parallel simulation codes are best deployed on super- computers, while AI tasks used to decide which simulations to perform may be best suited to specialized accelerators. Here we present a Function-as-a-Service (FaaS) system for executing complex, distributed computational campaigns that achieves performance parity with conventional workflow systems without the complexities of secure network connections between compute providers. One innovation enabling high performance is a subsystem that directly moves task data between sites, separate from the cloud-hosted FaaS system used to distribute task instructions. We also introduce a flexible scheduling system that allows us access factor of 2 trade offs between the amount of resources required to solve a problem at each compute site. We anticipate that this system will upgrade multi-site applications from demonstration projects to routine practice in computational science.

Ward, Logan↗

DOE OSTI2023

Uncovering acoustic signatures of pore formation in laser powder bed fusion

Abstract We present a machine learning workflow to discover signatures in acoustic measurements that can be utilized to create a low-dimensional model to accurately predict the location of keyhole pores formed during additive manufacturing processes. Acoustic measurements were sampled at 100 kHz during single-layer laser powder bed fusion (LPBF) experiments, and spatio-temporal registration of pore locations was obtained from post-build radiography. Power spectral density (PSD) estimates of the acoustic data were then decomposed using non-negative matrix factorization with custom $$\varvec{k}$$ k -means clustering (NMF $$\varvec{k}$$ k ) to learn the underlying spectral patterns associated with pore formation. NMF $$\varvec{k}$$ k returned a library of basis signals and matching coefficients to blindly construct a feature space based on the PSD estimates in an optimized fashion. Moreover, the NMF $$\varvec{k}$$ k decomposition led to the development of computationally inexpensive machine learning models which are capable of quickly and accurately identifying pore formation with classification accuracy of supervised and unsupervised label learning greater than 95% and 90%, respectively. The intrinsic data compression of NMF k , the relatively light computational cost of the machine learning workflow, and the high classification accuracy makes the proposed workflow an attractive candidate for edge computing toward in-situ keyhole pore prediction in LPBF.

36 MATERIALS SCIENCE↗

NASA NTRS2021

Automated Uas Measurements of Reflectance and Solar Induced Florescence (SIF) for Assessment Of the Dinamics in Photosynthetic Function, Application for Maze (Zea Mays L.) in Greenbelt, Maryland, Us

For accurate assessment of vegetation function there is a strong need for advancement in the remote sensing methods and instruments, to enable monitoring of the parameters governing photosynthesis at the temporal frequency relevant to their dynamics and at a spatial scale that allows practical assessment and management. Currently, no single sensor can provide data at the desired high temporal, spectral and spatial resolutions. Our field measurements obtained using the integrated UAS Piccolo system during the summers of2017 and 2018 demonstrate that science quality reflectance and solar induced fluorescence (SIF) data can be retrieved with high temporal frequency using small Unmanned Aerial Systems (UAS). The implemented approach facilitates data comparisons through space and time, and the integration with other spectral satellite and airborne data. This investigation contributes for bridging the gap in Earth observation between field and airborne measurements by implementing autonomous methods for obtaining high temporal frequency spectroscopy measurements from an Unmanned Aerial Systems (UAS) at various illumination conditions. An advancement in the Intelligent Payload Module (IPM) facilitated the implementation of an optimization workflow to collect spectral data for characterizing vegetation reflectance and solar induced fluorescence (SIF).

Petya Campbell↗