Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “pipeline”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

SynBio QC Dual Barcode QC (DBC) v1.0

This software was designed as a sequence validation tool for the assembly of synthetic constructs, where the constructs have a high degree of similarity and thus are barcoded prior to the sequencing library prep. It demultiplexes each FASTQ file for each barcode, then analyzes the resulting FASTQ files against a list of reference sequences for that barcode/library, combining the results from eight sequencing libraries to generate a summary, and the files needed to view the results in the Integrative Genomics Viewer (IGV) application for manual verification. This was developed for FASTQ files generated by PacBio sequencing, but could be used on any FASTQ files that do not have paired end reads. It can be used to analyze one - eight libraries at a time. Each construct is independently analyzed with only the sequences with the same barcode, in the same pooled library. Then the results are combined into a user friendly summary. This is used to identify which libraries of pooled sequences contains a perfect match, or fixable match to the reference file. This pipeline uses many freely available open source libraries, the value added is that in our application the steps of the pipeline are defined in Workflow Description Language (WDL) and run through the Cromwell workflow engine in Docker containers, for easy distribution and set up, as well as the user friendly html summary that is generated.

Simirenko, Lisa↗

GenomeDepot v1.0

GenomeDepot is a web-based platform for annotation, management, and comparative analysis of microbial genomic sequences and associated data including ortholog families, protein domains, operons, regulatory interactions, strain taxonomy, and sample metadata. GenomeDepot supports rapid creation of web-sites for user-defined genome collections that include bioinformatic tools for interactive genome browsing, BLAST search, annotation search, comparative genomic neighborhood visualization, and sequence download. Gene function annotations are generated by a customizable annotation pipeline. The pipeline runs annotation tools in Conda environments and can be easily extended with additional user-specified tools.

Kazakov, Alexey [Lawrence Berkeley National Labora↗

FAIR to WISE (F2W) v1.0.0

FAIR to WISE (F2W) is an iterative, large-language model (LLM) driven pipeline that turns unstructured research PDFs into structured, queryable knowledge graphs (KGs). Core features include schema-driven extraction to a LinkML model; full provenance capture; ontology-grounded enrichment (e.g., chemical validation and ChEBI lookup); graph construction to JSON-LD with stable IDs; and KG-RAG question answering with evidence-aware retrieval. The system is engineered for reproducibility and accessibility (open-source Ollama models, temperature=0, NVTX/Nsight profiling) with robust QA (relation verification, deduplication, and deterministic outputs). Primary uses are literature-to-KG automation, knowledge-grounded Q&A, and experimental steering support. We demonstrate the approach in organic photovoltaics, where the pipeline ingests papers, builds a domain KG, and evaluates answers against expert competency questions to guide experimental planning and interpretation. Compared with off-the-shelf LLMs and ad-hoc NLP tools, F2W addresses ontology gaps and reduces hallucination risk by grounding responses in extracted evidence and enforcing schema constraints; it also offers deterministic, provenance-linked outputs and open, cost-aware deployment. Evidence-aware ranking further improves answer quality over pure vector search.

Abramov, David [Lawrence Berkeley National Laborat↗

UBW (USLCI-Brightway2) [SWR-25-169]

Life cycle inventory (LCI) data are critical for robust life cycle assessment (LCA), yet many widely used datasets such as the U.S. Life Cycle Inventory (USLCI) are not natively compatible with advanced modeling frameworks like Brightway2. This work presents an automated pipeline to transform USLCI data into a fully functional Brightway2 project. The workflow performs systematic data cleaning, resolves duplicate process and exchange identifiers, and applies allocation to multi-output processes. Technosphere and biosphere flows are harmonized through unit conversions and a bridge mapping to the biosphere3 database, with comprehensive logging of missing flows and cutoff issues. The resulting Brightway2 database is validated using matrix diagnostics to ensure consistency of the technosphere, and is benchmarked via life cycle impact assessment (LCIA) methods such as ReCiPe and IPCC GWP. Outputs include reproducible CSV exports of corrected processes, elementary flows, characterization factors, and LCIA results, alongside backup utilities for project sharing. This pipeline lowers barriers for integrating USLCI data into open-source LCA workflows, enabling reproducible, validated LCA inventories within the Brightway 2 framework.

Ghosh, Tapajyoti [National Laboratory of the Rocki↗

HydraGNN_GFM_FineTuning4Materials v1.0

This repository enables fine-tuning of the HydraGNN Predictive GFM 2026 — an open-source ensemble of pre-trained graph foundation models for atomistic materials modeling, developed at Oak Ridge National Laboratory. The GFM 2026 is freely available and downloadable via Globus from the OLCF Data Constellation (DOI: 10.13139/OLCF/2562660). Starting from these pre-trained weights, this repository provides a complete transfer learning pipeline for adapting the GFM ensemble to domain-specific molecular and materials property prediction tasks. It includes: 1) Utilities for ensemble fine-tuning with task-specific output heads 2) Example pipelines for eight widely-used materials and molecular datasets 3) Tools for model adaptation and head configuration 4) Data preprocessing utilities for each supported dataset 5) Benchmarking and evaluation scripts

Ungerboeck, Linda↗

Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Prediction

Abstract The rapid rise of deep learning (DL) in numerical weather prediction (NWP) has led to a proliferation of models which forecast atmospheric variables with comparable or superior skill than traditional physics-based NWP. However, among these leading DL models, there is a wide variance in both the training settings and architecture used. Further, the lack of thorough ablation studies makes it hard to discern which components are most critical to success. In this work, we show that it is possible to attain high forecast skill even with relatively off-the-shelf architectures, simple training procedures, and moderate compute budgets. Specifically, we train a minimally modified Swin Transformer V2 (SwinV2) on ERA5 data and find that it attains superior skill in terms of mean-square errors of deterministic forecasts when compared against the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS). Almost all DL–NWP systems share a core set of hyperparameters and design decisions. To aid and expedite future DL–NWP research, we present an in-depth, systematic exploration of different loss functions, model sizes and depths, patch sizes, and multistep training objectives. We also examine the model performance with metrics beyond the typical accuracy (ACC) and RMSE and investigate how the performance scales with model size. Through our open-source code, scoring pipelines, and models, we share our findings on key aspects of the training pipeline. These ablations reduce the necessity for expensive hyperparameter tuning and lower the barrier to entry for future DL–NWP research. Significance Statement This study investigates the potential of using large-scale transformer-based models for weather prediction, showing that it is possible to achieve high forecast accuracy with simpler, off-the-shelf architectures. By training a minimally modified SwinV2 transformer on ERA5 data, we show that the model achieves competitive forecast skill in terms of mean-square error for key variables, outperforming the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS) at all lead times. Our findings suggest that effective training strategies, such as multistep fine-tuning and channel-weighted losses, significantly enhance the model’s performance. However, we also highlight that these improvements come with trade-offs in other areas, such as ensemble spread and high-frequency spatial detail. This work highlights the promise of deep learning in improving weather forecasts, which could lead to better preparedness and response to weather events, ultimately benefiting society by providing more reliable weather predictions.

Willard, Jared D. [Lawrence Berkeley National Labo↗

Semi-Automatic Geographic Information System Framework for Creating Photo-Realistic Digital Twin Cities to Support Autonomous Driving Research

Digital twin cities are frequently used in vehicle and traffic simulations to render realistic on-road driving scenarios under various traffic and environmental conditions. These digital twins provide a high-fidelity replica of the physical world (e.g., buildings, roads, infrastructures, traffic) to create three-dimensional (3D) virtual-physical environments to support various emerging vehicle and transportation technologies such as connected and automated vehicles. These virtual environments provide a cost-effective digital proving ground to evaluate, validate, and test emerging technologies that include control algorithms, localization, perception, and sensors. Replicating a real-world traffic scenario in a digital twin using a traditional 3D modeling approach is a time-consuming and labor-intensive effort. Here this paper presents a semi-automated spatial framework to construct realistic 3D digital twin cities to support autonomous driving research using readily available geographic information system (GIS) data and 3D prefabricated (prefab) models. We start with a comprehensive review of geospatial data sources of essential digital entities required in a 3D digital twin city and present an integrated GIS-3D modeling pipeline using customized QGIS/GDAL and Blender scripting in Python. The pipeline outputs are realistic 3D digital twin cities compatible with common vehicle simulation software, such as CARLA and IPG CarMaker. The paper closes with a showcase to demonstrate the quality and usability of a digital twin city created to replicate the Shallowford Road corridor in Chattanooga in both Unity and Unreal engine-based virtual environment. The generated digital twin city can be applied to a hardware-in-the-loop simulation environment with an actual testing vehicle to facilitate autonomous driving research.

33 ADVANCED PROPULSION SYSTEMS↗

A consensus-based ensemble approach to improve transcriptome assembly

Systems-level analyses, such as differential gene expression analysis, co-expression analysis, and metabolic pathway reconstruction, depend on the accuracy of the transcriptome. Multiple tools exist to perform transcriptome assembly from RNAseq data. However, assembling high quality transcriptomes is still not a trivial problem. This is especially the case for non-model organisms where adequate reference genomes are often not available. Different methods produce different transcriptome models and there is no easy way to determine which are more accurate. Furthermore, having alternative-splicing events exacerbates such difficult assembly problems. While benchmarking transcriptome assemblies is critical, this is also not trivial due to the general lack of true reference transcriptomes. In this study, we first provide a pipeline to generate a set of the simulated benchmark transcriptome and corresponding RNAseq data. Using the simulated benchmarking datasets, we compared the performance of various transcriptome assembly approaches including both de novo and genome-guided methods. The results showed that the assembly performance deteriorates significantly when alternative transcripts (isoforms) exist or for genome-guided methods when the reference is not available from the same genome. To improve the transcriptome assembly performance, leveraging the overlapping predictions between different assemblies, we present a new consensus-based ensemble transcriptome assembly approach, ConSemble. Without using a reference genome, ConSemble using four de novo assemblers achieved an accuracy up to twice as high as any de novo assemblers we compared. When a reference genome is available, ConSemble using four genome-guided assemblies removed many incorrectly assembled contigs with minimal impact on correctly assembled contigs, achieving higher precision and accuracy than individual genome-guided methods. Furthermore, ConSemble using de novo assemblers matched or exceeded the best performing genome-guided assemblers even when the transcriptomes included isoforms. We thus demonstrated that the ConSemble consensus strategy both for de novo and genome-guided assemblers can improve transcriptome assembly. The RNAseq simulation pipeline, the benchmark transcriptome datasets, and the script to perform the ConSemble assembly are all freely available from: http://bioinfolab.unl.edu/emlab/consemble/.

59 BASIC BIOLOGICAL SCIENCES↗

Galba: genome annotation with miniprot and AUGUSTUS

The Earth Biogenome Project has rapidly increased the number of available eukaryotic genomes, but most released genomes continue to lack annotation of protein-coding genes. In addition, no transcriptome data is available for some genomes. Various gene annotation tools have been developed but each has its limitations. Here, we introduce GALBA, a fully automated pipeline that utilizes miniprot, a rapid protein-to-genome aligner, in combination with AUGUSTUS to predict genes with high accuracy. Accuracy results indicate that GALBA is particularly strong in the annotation of large vertebrate genomes. We also present use cases in insects, vertebrates, and a land plant. GALBA is fully open source and available as a docker image for easy execution with Singularity in high-performance computing environments. Our pipeline addresses the critical need for accurate gene annotation in newly sequenced genomes, and we believe that GALBA will greatly facilitate genome annotation for diverse organisms.

59 BASIC BIOLOGICAL SCIENCES↗

An FPGA-based hardware accelerator supporting sensitive sequence homology filtering with profile hidden Markov models

Abstract Background Sequence alignment lies at the heart of genome sequence annotation. While the BLAST suite of alignment tools has long held an important role in alignment-based sequence database search, greater sensitivity is achieved through the use of profile hidden Markov models (pHMMs). Here, we describe an FPGA hardware accelerator, called HAVAC, that targets a key bottleneck step (SSV) in the analysis pipeline of the popular pHMM alignment tool, HMMER. Results The HAVAC kernel calculates the SSV matrix at 1739 GCUPS on a $$\sim$$ ∼ $3000 Xilinx Alveo U50 FPGA accelerator card, $$\sim$$ ∼ 227× faster than the optimized SSV implementation in nhmmer . Accounting for PCI-e data transfer data processing, HAVAC is 65× faster than nhmmer’s SSV with one thread and 35× faster than nhmmer with four threads, and uses $$\sim$$ ∼ 31% the energy of a traditional high end Intel CPU. Conclusions HAVAC demonstrates the potential offered by FPGA hardware accelerators to produce dramatic speed gains in sequence annotation and related bioinformatics applications. Because these computations are performed on a co-processor, the host CPU remains free to simultaneously compute other aspects of the analysis pipeline.

59 BASIC BIOLOGICAL SCIENCES↗

Data for Development of Vegetative Oil Sorghum: From Lab-to-Field

Biomass crops engineered to accumulate energy-dense triacylglycerols (TAG or ‘vegetable oils’) in their vegetative tissues have emerged as potential feedstocks to meet the growing demand for renewable diesel and sustainable aviation fuel (SAF). Unlike oil palm and oilseed crops, the current commercial sources of TAG, vegetative tissues, such as leaves and stems, only transiently accumulate TAG. In this report, we used grain (Texas430 or TX430) and sugar-accumulating ‘sweet’ (Ramada) genotypes of sorghum, a high-yielding, environmentally resilient biomass crop, to accumulate TAG in leaves and stems. We initially tested several gene combinations for a ‘push-pull-protect’ strategy. The top TAG-yielding constructs contained five oil transgenes for a sorghum WRINKLED1 transcription factor (‘push’), a Cuphea viscosissima diacylglycerol acyltransferase (DGAT; ‘pull’), a modified sesame oleosin (‘protect’) and two combinations of specialized Cuphea lysophosphatidic acid acyltransferases and medium-chain acyl-acyl carrier protein thioesterases. Though intended to generate oils with medium-chain fatty acids, engineered lines accumulated oleic acid-rich oil to amounts of up to 2.5% DW in leaves and 2.0% DW in stems in the greenhouse, 36-fold and 49-fold increases relative to wild-type (WT) plants, respectively. Under field conditions, the top-performing event accumulated TAG to amount to 5.5% DW in leaves and 3.5% DW in stems, 78-fold and 58-fold increases, respectively, relative to WT TX430. Transcriptomic and fluxomic analyses revealed potential bottlenecks for increased TAG accumulation. Overall, our studies highlight the utility of a lab-to-field pipeline coupled with systems biology studies to deliver high vegetative oil sorghum for SAF and renewable diesel production.

Biofuels↗

Data for "Discovery, Characterization, and Application of Chromosomal Integration Sites in the Hyperthermophilic Archaeon Sulfolobus islandicus"

Sulfolobus islandicus , an emerging archaeal model organism, offers unique advantages for metabolic engineering and synthetic biology applications owing to its ability to thrive in extreme environments. Although several genetic tools have been established for this organism, the lack of well-characterized chromosomal integration sites has limited its potential as a cellular factory. Here, we systematically identified and characterized 13 artificial CRISPR RNAs targeting eight integration sites in S. islandicus using the CRISPR-COPIES pipeline and a multi-omics-informed computational workflow. We leveraged the endogenous CRISPR-Cas system to integrate the reporter gene lacS and validated heterologous expression through a β-galactosidase assay, revealing significant positional effects. As a proof of concept, we utilized these sites to genetically manipulate lipid ether composition by overexpressing glycerol dibiphytanyl glycerol tetraether (GDGT) ring synthase B (GrsB). This study expands the genetic toolbox for S. islandicus and advances its potential as a robust platform for archaeal synthetic biology and industrial biotechnology.

AI/ML↗

Two-stage formation-energy correction (NbZr, TaZr, VZr)

This bundle contains the scripts, the raw and corrected per-structure data, and the manuscript plots for the NbZr / TaZr / VZr BCC binary formation energies and the associated RMSDs. Why a two-stage correction is necessary: The "raw" formation energy of every relaxed VASP configuration is computed in the usual way, FE_raw(c) = E_alloy(c) - sum_i x_i * E_pure_i , where E_pure_i are the per-atom total energies of the pure-element reference structures (Nb, Ta, V, Zr in the same BCC supercell, with identical INCAR / KPOINTS / PAW choices). With perfectly consistent reference runs the raw FE should vanish at the two pure-element endpoints (x = 0 and x = 1) by construction. In practice this does not hold for two reasons that are present in our dataset: 1. Reference-energy inconsistency (composition-dependent bias). Even with identical input parameters, the pure-element runs (stored in `corrected_DFT_pure_element_runs/`) differ slightly from the values that would be implied by the alloy runs at near-pure compositions (a few meV/atom). This bias is approximately linear in concentration, because the residual error in E_pure_Nb (or E_pure_Ta / E_pure_V) propagates into FE_raw(c) as (1 - x) * dE_pure_1, and the corresponding error in E_pure_Zr propagates as x * dE_pure_2. Left uncorrected, this produces a non-physical "tilt" of FE_raw(x) and shifts the entire FE-vs-x cloud away from zero at the endpoints. 2. Endpoint anchoring against the audited true endpoints. The strict endpoint values (FE_x0_meVatom, FE_x1_meVatom in `corrected_fe_strict_endpoints_20260518/strict_endpoint_check_20260518.csv`) were re-derived from an independent cross-check of the pure-element runs. After stage 1 removes the linear bias, the near-pure compositions in the alloy dataset still extrapolate to values that differ slightly from these audited endpoints — because stage 1 is fit from a few near-end alloy bins, not from the audited pure-element references themselves. The README.txt file discusses how these issues are addressed by the two-stage correction, and describes folder layout, pipeline summary, and how to re-run.

36 MATERIALS SCIENCE↗

Scatter Removal using Black Body Grids and Determining the Minimum Resolvable Hydrogen Concentration at MARS

This dataset was used to develop and validate a scatter-correction pipeline for neutron radiographs acquired at the MARS beamline, based on the methodology of Carminati et al. (2019). Scatter removal was performed using 36 gadolinium black bodies to characterize and remove the spatially varying neutron scatter field that cannot be eliminated by conventional open-beam normalization. The dataset comprises eight samples - four single-crystal nickel and four polycrystalline austenitic 316L stainless steel. Within each material system, samples were pre-charged with hydrogen gas at four charging pressures (1.5, 5, 12.5, and 20 kpsi). Following scatter correction, the pipeline was applied to all radiographs to recover quantitative attenuation maps. After subtracting the known attenuation contribution of the metal matrix, spatial maps of the hydrogen attenuation coefficient were obtained for each sample. This data was then used to construct a calibration curve relating hydrogen attenuation to hydrogen concentration and to determine the minimum resolvable hydrogen concentration at the MARS beamline. The resulting dataset provides a pressure-resolved calibration standard for quantitative hydrogen mapping using neutron radiography.

36 MATERIALS SCIENCE↗

Heavy Oil Polymer EOR in the Challenging Alaskan Arctic - It Works!

Under co-sponsorship of the US Department of Energy and Hilcorp Alaska LLC the first ever polymer field pilot commenced on 8/28/2018 in the Schrader Bluff heavy oil reservoir at the Milne Point Field on Alaska North Slope (ANS). The primary objective of the pilot is to prove the efficacy of polymer Enhanced Oil Recovery (EOR) to unlock the vast heavy oil resources on ANS. More than two and half years after startup, the polymer injection, supporting laboratory experiments and simulation studies steadily continue. The pilot started injecting hydrolyzed polyacrylamide (HPAM), at a concentration of 1,750 ppm to achieve a target viscosity of 45 cP, into the two horizontal injectors in the flood pattern. Production is monitored in the two horizontal producers. Based on laboratory measurements of polymer viscosity at reservoir conditions, the team decided to reduce polymer concentration to 1,200 ppm since July 2020 in an effort to control injection pressure and optimize polymer utilization. Quality control (QC) on the field ensures uniform polymer solution properties. Representative rock and fluid systems and test conditions are utilized in the corefloods on polymer retention, effect of injection water salinity, polymer loading, and their combinations on oil recovery. A history matched reservoir simulation model for forecasting oil recovery was developed on the basis of all the available field data. Field concerns related to the post-polymer breakthrough impact on flow assurance is addressed via specialized laboratory tests. Notwithstanding early operational disruptions and hydration issues, continuous polymer injection in both injectors has been achieved. To date, 950,000 lbs of polymer or 2 million barrels of polymer solution, equating to 13% of total pore volume (PV), has been placed in the flood pattern, serving as an effective indicator of adequate polymer injectivity. So far, the success of polymer EOR is evident from drastically reduced water cut in the producers, an estimated incremental 1,000 bopd over waterflood, and a favorable polymer utilization of 1.7 lbs/barrel of incremental oil. Polymer breakthrough was observed 26 months after the start of polymer injection. Main observations from corefloods are unusually high polymer retention values in some cases and a positive response to low salinity water. Although the heterogeneity in the flood pattern and exceptionally low water cut pose some challenges, persistent novel and justifiable simulation approaches have resulted in a robust history matched model. Experimental results on produced fluids treatment provide operational guidance for improved oil-water separation and mitigation of heater tube fouling. The ongoing success of the pilot is a key indicator of bringing the team ever closer to meeting the project’s primary objective. The encouraging results of the pilot is one of the drivers that has provided the impetus to apply polymer EOR throughout the Milne Point Field, which would increase oil recovery and extend the economic life of the Trans Alaska Pipeline System. The scientific knowledge, including the many lessons learned from this pilot also has referential value for other potential heavy oil EOR projects throughout the world. The collected data, operational lessons learned, and the overall success of the pilot are summarized in the paper.

None, None↗

PARETO 0.8.0 Release

PARETO 0.8.0 Release. Highlights: Model Updates - Applied unified sets for pipeline and trucking arcs in strategic model - Apply unified sets for pipeline and trucking arcs in operational model - Added new config argument for removal efficiency calculation method - Standardized bidirectional capacity constraint - Added dependencies removed in IDAES 2.1 - Created bounding functions & utilities - Added Hydraulics module to the strategic model - Add additional arc types to strategic model Documentation and Tutorial Updates - Improved PARETO treatment document - Introduced general tutorial and treatment module Jupyter notebooks for Strategic Model - Update docs with correct support email list address - Consolidate and deduplicate Getting Started and resources for developers - Enable Black formatting for Jupyter notebooks - Add Binder configuration files and README Bug Fixes - Fix strategic model documentation typos - Removed duplicated units from output file header UI Updates - Added view for comparing different scenarios - Added functionality for manually overriding PARETO decisions

PARETO,PARETO-UI,PSE,Process Systems Engineering,P↗

PARETO 0.5.0 Release

PARETO 0.5.0 Release. Highlights: Treatment Center Modeling - New case study with desalination, clean brine, and evaporation treatment technologies - New option to reduce disposal capacity due to Seismic Response Areas (SRA) - New option to consider water sharing outside of system General Updates - New features for Sankey Diagram visualization (multiple regions, filtered time periods) - Introduce badges to README.md - Convert documentation to ASCII LaTeX - Code cleaning and maintenance - Correct strategic model documentation typo - Update and format treatment demo input spreadsheet Bug Fixes - Fix water quality operational model results printing bug - Piping and trucking variables are now built only over defined arcs instead of all possible connections - Revise pipeline expansion cost constraints, ensure that all pipelines built incur cost

PARETO,PARETO-UI,PSE,Process Systems Engineering,P↗

EPICS Deployment at Fermilab

Fermilab has traditionally not been an EPICS house, as such expertise in EPICS is limited and scattered. However, PIP-II will be using EPICS for its control system. Furthermore, when PIP-II is operating, it must to interface with the existing, though modernized (see ACORN) legacy control system. We have developed and deployed a software pipeline that addresses these needs and presents to developers a tested and robust software framework, including template IOCs from which new developers can quickly gain experience. In this presentation, we will discuss the motivation for this work, the implementation of a continuous integration/continuous deployment pipeline, testing, template IOCs, and the deployment of user applications. We will also discuss how this is used with the current PIP-II teststand and lessons learned.

43 PARTICLE ACCELERATORS↗