Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Computational pipelines”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Predicting Band-Gap of Inorganic Materials Using Neuromorphic Graph Learning

Predicting properties of inorganic materials is a heavily researched topic, with several new prediction approaches emerging as competitors. One such competitor is graph neural networks, which leverage the structure of the graph to aid in the prediction process. In this work, we propose integration of neuromorphic computation into the graph neural network pipeline. We call this approach Neuromorphic Graph Learning (NGL). We utilize the NGL approach to leverage evolutionary algorithms and a novel Spike Pipeline for Raster Analysis (SPIRE) for the prediction of band gap in inorganic materials.

Mulet, Ian [University of Tennessee (UT)]↗
DOE OSTI2024

autoGEMM: Pushing the Limits of Irregular Matrix Multiplication on Arm Architectures

This paper presents an open-source library that pushes the limits of performance portability for irregular General Matrix Multiplication (GEMM) on the widely-used Arm architectures. Our library, autoGEMM, is designed to support a wide range of Arm processors: from edge devices to HPC-grade CPUs. autoGEMM generates optimized kernels for various hardware configurations by auto-combining fragments of autogenerated micro-kernels that employ hand-written optimizations to maximize computational efficiency. We optimize the kernel pipeline by tuning the register reuse and the data load/store overlapping. In addition, we use a dynamic tiling scheme to generate balanced tile shapes. Finally, we position autoGEMM on top of the TVM framework where our dynamic tiling scheme prunes the search space for TVM to identify the optimal combination of parameters for code optimization. Evaluations on five different classes of Arm chips demonstrate the advantages of autoGEMM. For small matrices, autoGEMM achieves 98% of peak and up to 2.0x speedup over state-of-the-art libraries such as LIBXSMM and LibShalom. For irregular matrices (i.e. tall skinny and long rectangles), autoGEMM is 1.3-2.0x faster than widely-used libraries such as OpenBLAS and Eigen. autoGEMM is publicly available at: https://github.com/wudu98/autoGEMM.

Wu, Du↗
DOE OSTI2024

Exabiome: Advancing Microbial Science through Exascale Computing

The Exabiome project seeks to improve the understanding of microbiomes through the development of methods for accelerating metagenomic science using exascale computing. This article gives an overview of scientific impact of the three components of the project: metagenome assembly, protein family detection, and comparative analysis of metagenomes. Exabiome developed MetaHipMer, the only metagenome assembler capable of scaling to full exascale systems. MetaHipMer has enabled ground-breaking assemblies on the Frontier supercomputer, with many scientific benefits, such as the discovery of rare species and viral genomes. To investigate protein families, Exabiome developed two exascale tools, PASTIS and HipMCL. Together, these can utilize exascale resources to understand the functional diversity of billions of dark matter proteins and novel protein families. For comparative analysis, Exabiome developed kmerprof, a tool that can be used to compare huge metagenomes for many different scientific purposes, for example, grouping human microbiomes according to body location.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Seawater Acidification and Bubble Plume Dispersion from Accidental Subsea CO 2 Pipeline Rupture: A Multiphase CFD Study

If a CO 2 reservoir or transmission pipeline were to leak, both the surrounding ecology and maritime traffic safety could be put at risk. To better understand and prepare for this risk, multiphase Computational Fluid Dynamics (CFD) models were built in ANSYS Fluent to capture the behavior of a leak once it enters the water. A 3D Eulerian–Eulerian model was used for validation, while a simplified 2D model was applied to simulate conditions at a 50-m depth. The models integrate bubble dynamics, gas holdup, CO 2 dissolution, dissolved species transport, and seawater acidification into a unified CFD framework. Mass transfer was calculated using the Hughmark correlation, and local seawater temperature and salinity were factored in to determine dissociation behavior and the relevant Henry’s Law constant. To confirm the 3D model’s accuracy, results were checked against two experimental datasets: the QICS field study and the Hauser Tank experiments. The team also modeled a hypothetical release scenario at the High Island 10L site and compared the results with earlier published work. The results show that at a depth of 50 m, the surrounding water column can completely absorb a CO 2 release at a rate of 35 kg/s, since the gas dissolves into the seawater as it rises toward the surface. Beyond confirming this mitigation capacity, the simulations shed light on how a leak would actually unfold in the environment, including the shape and movement of the rising bubble plume, how much CO 2 dissolves along the way, and the resulting shifts in seawater pH and pCO 2 . Together, this provides a practical framework for assessing how CO 2 leaks could affect marine environments in the Gulf of Mexico.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Understanding performance variability in standard and pipelined parallel Krylov solvers

In this work, we collect data from runs of Krylov subspace methods and pipelined Krylov algorithms in an effort to understand and model the impact of machine noise and other sources of variability on performance. We find large variability of Krylov iterations between compute nodes for standard methods that is reduced in pipelined algorithms, directly supporting conjecture, as well as large variation between statistical distributions of runtimes across iterations. Based on these results, we improve upon a previously introduced nondeterministic performance model by allowing iterations to fluctuate over time. We present our data from runs of various Krylov algorithms across multiple platforms as well as our updated non-stationary model that provides good agreement with observations. We also suggest how it can be used as a predictive tool.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

MVP: a modular viromics pipeline to identify, filter, cluster, annotate, and bin viruses from metagenomes

While numerous computational frameworks and workflows are available for recovering prokaryote and eukaryote genomes from metagenome data, only a limited number of pipelines are designed specifically for viromics analysis. With many viromics tools developed in the last few years alone, it can be challenging for scientists with limited bioinformatics experience to easily recover, evaluate quality, annotate genes, dereplicate, assign taxonomy, and calculate relative abundance and coverage of viral genomes using state-of-the-art methods and standards. Here, we describe Modular Viromics Pipeline (MVP) v.1.0, a user-friendly pipeline written in Python and providing a simple framework to perform standard viromics analyses. MVP combines multiple tools to enable viral genome identification, characterization of genome quality, filtering, clustering, taxonomic and functional annotation, genome binning, and comprehensive summaries of results that can be used for downstream ecological analyses. Overall, MVP provides a standardized and reproducible pipeline for both extensive and robust characterization of viruses from large-scale sequencing data including metagenomes, metatranscriptomes, viromes, and isolate genomes. As a typical use case, we show how the entire MVP pipeline can be applied to a set of 20 metagenomes from wetland sediments using only 10 modules executed via command lines, leading to the identification of 11,656 viral contigs and 8,145 viral operational taxonomic units (vOTUs) displaying a clear beta-diversity pattern. Further, acting as a dynamic wrapper, MVP is designed to continuously incorporate updates and integrate new tools, ensuring its ongoing relevance in the rapidly evolving field of viromics. MVP is available at https://gitlab.com/ccoclet/mvp and as versioned packages in PyPi and Conda.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

High-Performance Deep Learning Toolbox for Genome-Scale Prediction of Protein Structure and Function

Computational biology is one of many scientific disciplines ripe for innovation and acceleration with the advent of high-performance computing (HPC). In recent years, the field of machine learning has also seen significant benefits from adopting HPC practices. In this work, we present a novel HPC pipeline that incorporates various machine-learning approaches for structure-based functional annotation of proteins on the scale of whole genomes. Our pipeline makes extensive use of deep learning and provides computational insights into best practices for training advanced deep-learning models for high-throughput data such as proteomics data. We showcase methodologies our pipeline currently supports and detail future tasks for our pipeline to envelop, including large-scale sequence comparison using SAdLSA and prediction of protein tertiary structures using AlphaFold2.

Gao, Mu↗
DOE OSTI2025

End-to-end deep learning pipeline for real-time Bragg peak segmentation: from training to large-scale deployment

X-ray crystallography reconstruction, which transforms discrete X-ray diffraction patterns into three-dimensional molecular structures, relies critically on accurate Bragg peak finding for structure determination. As X-ray free electron laser (XFEL) facilities advance toward MHz data rates (1 million images per second), traditional peak finding algorithms that require manual parameter tuning or exhaustive grid searches across multiple experiments become increasingly impractical. While deep learning approaches offer promising solutions, their deployment in high-throughput environments presents significant challenges in automated dataset labeling, model scalability, edge deployment efficiency, and distributed inference capabilities. We present an end-to-end deep learning pipeline with three key components: (1) a data engine that combines traditional algorithms with our peak matching algorithm to generate high-quality training data at scale, (2) a modular architecture that scales from a few million to hundreds of million parameters, enabling us to train large expert-level models offline while deploying smaller, distilled models at the edge, and (3) a decoupled producer-consumer architecture that separates specialized data source layer from model inference, enabling flexible deployment across diverse computing environments. Using this integrated approach, our pipeline achieves accuracy comparable to traditional methods tuned by human experts while eliminating the need for experiment-specific parameter tuning. Although current throughput requires optimization for MHz facilities, our system's scalable architecture and demonstrated model compression capabilities provide a foundation for future high-throughput XFEL deployments.

Wang, Cong↗
DOE OSTI2021

A Co-design Framework for Online Data Analysis and Reduction

Science applications preparing for the exascale era are increasingly exploring in situ computations comprising of simulation-analysis-reduction pipelines coupled in-memory. Efficient composition and execution of such complex pipelines for a target platform is a codesign process that evaluates the impact and tradeoffs of various application- and system-specific parameters. In this article, we describe a toolset for automating performance studies of composed HPC applications that perform online data reduction and analysis. We describe Cheetah, a new framework for composing parametric studies on coupled applications, and Savanna, a runtime engine for orchestrating and executing campaigns of codesign experiments. Furthermore, this toolset facilitates understanding the impact of various factors such as process placement, synchronicity of algorithms, and storage versus compute requirements for online analysis of large data. Ultimately, we aim to create a catalog of performance results that can help scientists understand tradeoffs when designing next-generation simulations that make use of online processing techniques. We illustrate the design of Cheetah and Savanna, and present application examples that use this framework to conduct codesign studies on small clusters as well as leadership class supercomputers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Uncertainty Quantification of Metal Additive Manufacturing Processing Conditions Through the use of Exascale Computing

Metal additive manufacturing (AM) is a disruptive manufacturing technology that opens the design space for parts outside those possible from traditional manufacturing methods. In order to accelerate industry and R&D needs to certify AM parts, the Exascale Additive Manufacturing project (ExaAM) has developed a suite of exascale-ready computational tools to model the process-to-structure-to-properties (PSP) relationship for additively manufactured metal components. One such tool is an uncertainty quantification (UQ) pipeline to quantify the effect that uncertainty in processing conditions has on local mechanical responses. We present an overview of this pipeline and its required simulation and workflow codes. Using the Oak Ridge National Laboratory’s (ORNL) exascale computer, Frontier, we utilize this pipeline to cross multiple length and time scales to predict the local mechanical response of a location within a complex AM bridge part, AMB2018-01 produced by the National Institute of Standards and Technology (NIST) as part of their 2018 AM-Bench test series. Our results are then compared to experimental mechanical tests of parts from the NIST build to quantify the error in the ExaAM UQ workflow.

Carson, Robert↗
DOE OSTI2021

Understanding Quantum Control Processor Capabilities and Limitations through Circuit Characterization

Continuing the scaling of quantum computers hinges on building classical control hardware pipelines that are scalable, extensible, and provide real time response. The instruction set architecture (ISA) of the control processor provides functional abstractions that map high-level semantics of quantum programming languages to low-level pulse generation by hardware. Here, we provide a methodology to quantitatively assess the effectiveness of the ISA to encode quantum circuits for intermediate-scale quantum devices with O(10 2 ) qubits. The characterization model that we define reflects performance, the ability to meet timing constraint implications, scalability for future quantum chips, and other important considerations making them useful guides for future designs. Using our methodology, we propose scalar (QUASAR) and vector (qV) quantum ISAs as extensions and compare them with other ISAs in metrics such as circuit encoding efficiency, the ability to meet real-time gate cycle requirements of quantum chips, and the ability to scale to more qubits.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Improving the Accessibility and Usability of Geothermal Information with Data Lakes and Data Pipelines on the Geothermal Data Repository

The Geothermal Data Repository (GDR) provides universal access to data and information resulting from research and development activities funded by the Department of Energy (DOE). The GDR has extended this universal access to big data through integration with data lakes developed by the Open Energy Data Initiative (OEDI). Previously, large datasets such as seismic waveform or distributed acoustic sensing (DAS) data could only be accessed by institutions with high performance data storage and compute capabilities, effectively limiting the accessibility of big data to national labs, larger universities, and major corporations. Moreover, the time and resources needed to transport big data and configure them can produce additional barriers to use. Many of the standard formats used for structured data models (also known as content models) are incapable of handling big data and can introduce additional usability problems, often requiring data to be reformatted prior to use. This paper will explore how recent integrations between the GDR and the OEDI data lake have improved the accessibility and usability of geothermal data in a big way, making the data available to a broader audience, and enabling collaborative analysis and innovation across the greater geothermal industry.

access↗
DOE OSTI2025

Discovery, characterization, and application of chromosomal integration sites in the hyperthermophilic archaeon Sulfolobus islandicus

Sulfolobus islandicus , an emerging archaeal model organism, offers unique advantages for metabolic engineering and synthetic biology applications owing to its ability to thrive in extreme environments. Although several genetic tools have been established for this organism, the lack of well-characterized chromosomal integration sites has limited its potential as a cellular factory. Here, in this work, we systematically identified and characterized 13 artificial CRISPR RNAs targeting eight integration sites in S. islandicus using the CRISPR-COPIES pipeline and a multi-omics-informed computational workflow. We leveraged the endogenous CRISPR-Cas system to integrate the reporter gene lacS and validated heterologous expression through a β-galactosidase assay, revealing significant positional effects. As a proof of concept, we utilized these sites to genetically manipulate lipid ether composition by overexpressing glycerol dibiphytanyl glycerol tetraether (GDGT) ring synthase B (GrsB). This study expands the genetic toolbox for S. islandicus and advances its potential as a robust platform for archaeal synthetic biology and industrial biotechnology.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Modeling and simulation of multiphase flows

Multiphase flow can be found in a wide range of natural and industrial systems, such as sediment flow in rivers and coasts to pipeline transport, and reactors of all types. Computational fluid dynamics (CFD) modeling provides a rigorous physics-based method to visualize and quantify these flows and to assess their influence on their surroundings. This presentation will highlight computational research on two varied technologies in the energy sector: carbon capture and wellbore acoustics.

acoustic analysis↗
DOE OSTI2023

The Dark Energy Survey Supernova Program: Corrections on Photometry Due to Wavelength-dependent Atmospheric Effects

Abstract Wavelength-dependent atmospheric effects impact photometric supernova flux measurements for ground-based observations. We present corrections on supernova flux measurements from the Dark Energy Survey Supernova Program’s 5YR sample (DES-SN5YR) for differential chromatic refraction (DCR) and wavelength-dependent seeing, and we show their impact on the cosmological parameters w and Ω m . We use g − i colors of Type Ia supernovae to quantify astrometric offsets caused by DCR and simulate point-spread functions (PSFs) using the GalSIM package to predict the shapes of the PSFs with DCR and wavelength-dependent seeing. We calculate the magnitude corrections and apply them to the magnitudes computed by the DES-SN5YR photometric pipeline. We find that for the DES-SN5YR analysis, not accounting for the astrometric offsets and changes in the PSF shape cause an average bias of +0.2 mmag and −0.3 mmag, respectively, with standard deviations of 0.7 mmag and 2.7 mmag across all DES observing bands ( griz ) throughout all redshifts. When the DCR and seeing effects are not accounted for, we find that w and Ω m are lower by less than 0.004 ± 0.02 and 0.001 ± 0.01, respectively, with 0.02 and 0.01 being the 1 σ statistical uncertainties. Although we find that these biases do not limit the constraints of the DES-SN5YR sample, future surveys with much higher statistics, lower systematics, and especially those that observe in the u band will require these corrections as wavelength-dependent atmospheric effects are larger at shorter wavelengths. We also discuss limitations of our method and how they can be better accounted for in future surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

NETL Plastic Pipes Project (Final Report)

Plastic or composite pipelines have been the bane of the utility locating industry because they are neither conductive nor magnetic which are the properties traditionally used to locate buried utilities. Ground penetrating radar (GPR) is an effective geophysical tool for locating plastic/composite pipelines where resistive cover allows for adequate penetration of radar energy. However, GPR has limited applicability in areas where the soil cover is conductive due to significant clay and/or salt content. This study examines complementary near-surface geophysical methods that are potentially useful for locating buried plastic/composite pipelines, either singly or in combination. Specifically, this modeling study used computational numerical methods to forward model the response of GPR, resistivity, seismic, gravity gradiometry, and photoacoustic/thermoacoustic imaging methods to plastic/composite pipelines for various scenarios including: (1) pipe diameters ranging between 2 in. to 12 in.; (2) burial depths ranging between 3 ft. to 4 ft.; (3) various degrees in contrast in physical properties (i.e., electrical permittivity, elasticity, resistivity, density); and (4) various experimental acquisition choices (e.g., GPR radar and seismic source frequencies, electrode spacing). Numerical modeling performed herein reconfirmed that GPR is the preferred method for detecting/locating plastic pipelines. A caveat for GPR detection is that the material covering the plastic pipe (trench fill material and adjacent soil) must be sufficiently resistive to allow the two-way propagation to the required depth of investigation and back to the surface. GPR was the only method modeled in this study that can be used to directly detect plastic pipelines of 2-in.-diameter and larger when buried 3-ft-deep. GPR data processing and imaging also can determine pipe depth, pipe diameter, trench dimensions, and moisture conditions. Seismic modeling results suggest that direct detection of a 12-in.-diameter plastic pipe at 3-ft.-depth may be possible under favorable conditions; however, the associated signature would be weak (e.g., surface- to S-wave, backscattered surface-waves, and/or forward scattered surface-waves to S-wave). Direct pipe detection under field conditions with noise and strong lateral geologic heterogeneity is doubtful. Numerical modeling also suggests that plastic pipelines can be indirectly located by detecting the trench in which they are buried. GPR, direct current (DC) resistivity, and seismic methods have the potential to locate the pipeline trench if there is sufficient contrast between the trench-wall and trench-fill materials for the physical property being measured by each method (i.e., electrical permittivity for GPR; resistivity for DC resistivity; or density, compressional velocity, or shear velocity for seismic). Modeling also indicated that currently available (commercial) gravity gradiometers would be unable to directly detect/locate plastic pipelines ≤ 8-in.-diameter when buried 3-ft.-deep given the typical instrument noise floor for field surveying as well as the expected density variations due to geologic heterogeneity. The numerical modeling performed in this project did not identify a universal geophysical technology that can locate buried plastic pipelines in all parts of the United States (although GPR is suggested for all areas with resistive cover). However, the project results suggest that a towed land streamer simultaneously acquiring multiple geophysical data types including multi-offset GPR, multi-channel DC resistivity, seismic geophone- and/or distributed acoustic sensing (DAS), and potentially photoacoustic/thermoacoustic data would be an appropriate platform for locating buried plastic pipeline. Moreover, the complementary multiphysics data acquired by a towed land streamer would permit the use of joint and/or cooperative inversion frameworks for a more rigorous and consistent data interpretation.

42 ENGINEERING↗
DOE OSTI2023

A Deep Learning Pipeline for Optimizing Large-scale Phase Field Simulations

Phase field (PF) simulations are computationally expensive but remain a key analysis tool to understand the complex mechanisms of additive manufacturing (AM) processes. Each PF simulation-aided analysis requires thousands of node hours on leadership-class supercomputers. One of the main goals of these analyses is the study of microstructure evolution during the build process which begins with the onset of nucleation. Nucleation occurs under certain thermomechanical conditions which are not known a priori and many PF simulations are required to identify ranges of input thermo-mechanical parameters that can result in the onset of nucleation. Since many of the simulations do not result in nucleation, an analysis campaign often ends up wasting tremendous amounts of precious computing resources executing nucleation-absent simulations. The goal of this work is to design and train deep learning models to inform a PF simulation about the likelihood of the occurrence of nucleation in a future simulation time-step based on the state summary over a finite number of past time-steps of a running simulation. If the prediction determines that the running simulation is unlikely to reach nucleation in the allotted time, then its execution is stopped immediately ultimately resulting in vast reduction in wasted computations when accrued over all the PF simulations typically performed in a single or multiple analysis campaign(s). The paper presents the performance of a machine learning pipeline that uses a convolutional neural network (CNN) model to learn an embedding which is then used with a self-attention network to build a multi-task deep learning model to predict the likelihood of nucleation. The model also predicts the input parameters used in a simulation. Performance is compared with a baseline pipeline that uses an off-the-shelf LeNet-5 model to learn the initial embedding. Despite their smaller size, performance results indicate significant improvement in accuracy of the proposed models compared to the larger baseline models.

Kannan, Ramakrishnan {ramki}↗