Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “pipeline”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

LoVoCCS. I. Survey Introduction, Data Processing Pipeline, and Early Science Results

We present the Local Volume Complete Cluster Survey (LoVoCCS; we pronounce it as "low-vox" or "law-vox," with stress on the second syllable), an NSF's National Optical-Infrared Astronomy Research Laboratory survey program that uses the Dark Energy Camera to map the dark matter distribution and galaxy population in 107 nearby (0.03 < z < 0.12) X-ray luminous ([0.1–2.4 keV] L X500 > 10 44 erg s –1 ) galaxy clusters that are not obscured by the Milky Way. The survey will reach Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) Year 1–2 depth (for galaxies r = 24.5, i = 24.0, signal-to-noise ratio (S/N) > 20; u = 24.7, g = 25.3, z = 23.8, S/N > 10) and conclude in ~2023 (coincident with the beginning of LSST science operations), and will serve as a zeroth-year template for LSST transient studies. We process the data using the LSST Science Pipelines that include state-of-the-art algorithms and analyze the results using our own pipelines, and therefore the catalogs and analysis tools will be compatible with the LSST. We demonstrate the use and performance of our pipeline using three X-ray luminous and observation-time complete LoVoCCS clusters: A3911, A3921, and A85. A3911 and A3921 have not been well studied previously by weak lensing, and we obtain similar lensing analysis results for A85 to previous studies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Testing the LSST Difference Image Analysis Pipeline Using Synthetic Source Injection Analysis

Abstract We evaluate the performance of the Legacy Survey of Space and Time Science Pipelines Difference Image Analysis (DIA) on simulated images. By adding synthetic sources to galaxies on images, we trace the recovery of injected synthetic sources to evaluate the pipeline on images from the Dark Energy Science Collaboration Data Challenge 2. The pipeline performs well, with efficiency and flux accuracy consistent with the signal-to-noise ratio of the input images. We explore different spatial degrees of freedom for the Alard–Lupton polynomial-Gaussian image subtraction kernel and analyze for trade-offs in efficiency versus artifact rate. Increasing the kernel spatial degrees of freedom reduces the artifact rate without loss of efficiency. The flux measurements with different kernel spatial degrees of freedom are consistent. We also here provide a set of DIA flags that substantially filter out artifacts from the DIA source table. We explore the morphology and possible origins of the observed remaining subtraction artifacts and suggest that given the complexity of these artifact origins, a convolution kernel with a set of flexible bases with spatial variation may be needed to yield further improvements.

Liu, S. (ORCID:0000000244612143)↗
DOE OSTI2021

Implementing the LSST Software Stack for DESGW processing and the Integration of Convolutional Neural Networks into the DESGW Pipeline

The Dark Energy Survey Gravitational Wave (DESGW) group strives to understand thelargescale structure of the universe and galaxies by looking for electromagnetic signatures intelescope images following gravitational wave detections. The DESGW group uses a processing pipeline to perform difference imaging to look for potential candidates. In order to perform these searches more effectively, we first explored using an alternative processing pipeline, the LSST Software Stack to analyze the telescope images. Because the LSST software stack is currently transitioning between its generation 2 and generation 3 system, we decided that while the software will be usable in the future once generation 3 is complete, at the moment its incompleteness makes it impractical to use. We then decided to work on improving the current pipeline by developing a module that integrates a Convolutional Neural Network (CNN) to test difference imaging products for bad subtractions due to misalignment.

Navarro, Alexander↗
DOE OSTI2023

A Data Processing Pipeline for Adversarial Socio-Technical Network Analysis

With the rapid adoption of emerging technologies, there is a need to catalog and model sociotechnical interdependencies that have been historically used to influence the operation of Critical Infrastructure networks including the impacts of mergers and acquisitions, hostile takeovers, and foreign investment. Our research intends to address this need with two primary contributions. First, we have developed a data curation and processing pipeline to generate sociotechnical networks extracted from a variety of data sources including SEC filings and infrastructure asset databases. The pipeline, implemented in Apache Airflow, extracts and normalizes the representation of entities and relations, specified within ontologies. Our intent is to provide an extensible, machine-actionable approach to quickly communicate such models, reproduce previous results, and adapt them to new, unanticipated situations. Second, networks produced by our pipeline enable the development of graph-theoretic metrics that consider the properties of network components in addition to its topology. Metadata associated with network components---whether semantic, temporal, or geospatial---affects the alignment of generated networks with assumptions underlying complexity metrics. Validation of generated networks relative to component types defined by an ontology, may allow the research community to adapt metrics to the semantics of the domains being studied. Generated networks may be processed as knowledge, dynamic, or spatial graphs and enables a variety of analyses including automated reasoning and measures of network complexity. Automated reasoning views extracted entities and relations as a knowledge graph; this enables application of inference rules that represent historically-attested adversarial business methods and applies that behavior to a specific geographic context. Measures of network complexity, including degree distribution, reachability analyses, temporal analysis, and community detection can be adapted to indicate adversarial organizational influence.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Evaluation of NETL’s Self-Healing Metallic Coating for Internal Corrosion Protection of Natural Gas Pipelines: Field Test

Steel pipelines are a safe, reliable, and affordable way to transport natural gas. However, the presence of impurities (e.g., water, carbon dioxide, and hydrogen sulfide) in the natural gas can cause internal corrosion, which can lead to pipeline leaks and failure. This paper reports on field tests of an innovative self-healing, corrosion-resistant, metallic coating developed at the National Energy Technology Laboratory (NETL) for protecting the interior surfaces of pipelines.

carbon dioxide (CO2)↗
DOE OSTI2023

Modeling and optimization of steady flow of natural gas and hydrogen mixtures in pipeline networks

Here, we extend the canonical problems of simulation and optimization of steady-state gas flows in pipeline networks with compressors to the transport of mixtures of highly heterogeneous gases injected throughout a network. Our study is motivated by proposed projects to blend hydrogen generated using clean energy into existing natural gas pipeline systems as part of efforts to reduce the reliance of energy systems on fossil fuels. Flow in a pipe is related to endpoint pressures by a basic Weymouth equation model, with an ideal gas equation of state, where the wave speed depends on the hydrogen concentration. At vertices, in addition to mass balance, we also consider mixing of incoming flows of varying hydrogen concentrations. The problems of interest are the heterogeneous gas flow simulation (HGFS), which determines system pressures and flows given fixed boundary conditions and compressor settings, as well as the heterogeneous gas flow optimization (HGFO), which extremizes an objective by determining optimal boundary conditions and compressor settings. We examine conditions for uniqueness of solutions to the HGFS, as well as compare and contrast mixed-integer and continuous nonlinear programming formulations for the HGFO. We develop computational methods to solve both problems, and examine their performance using four test networks of increasing complexity.

08 HYDROGEN↗
DOE OSTI2021

Calibration and field deployment of low-cost sensor network to monitor underground pipeline leakage

Recent technological advances in methane detection have improved leak detection and repair. However, current methods to reliably measure methane concentrations rely on expensive instruments or demand significant labor input. There is interest in using affordable methane sensors that are responsive to ppmv level changes in methane concentrations in both urban and rural environments for monitoring underground natural gas pipeline leaks. This is especially relevant for situations where potentially significant leaks cannot be repaired immediately or smaller leaks that require long-term monitoring and further evaluation. In this work, a low-cost sensor unit, equipped with a metal oxide sensor, was designed, built, and calibrated over a wide range of methane concentrations and environmental conditions in preparation for field application. A network of these sensors was then installed at the test site and used to measure methane concentrations at ground level above known sub-surface natural gas emissions which emulated underground gas pipeline leaks. This low-cost sensor network measured over 4 days total for the two different known leakage rates. Results demonstrate that the sensors can continuously measure relative methane variability for extended periods but require calibration for a wide range of temperature and humidity conditions to properly determine absolute gas (i.e., methane) concentrations. Furthermore, when a regression analysis was conducted to evaluate the effects of meteorological parameters on methane concentration, air temperature and wind speed have strong impacts on the concentration. Overall, the network approach allows improved identification of leak location and monitoring of underground natural gas leaks.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Understanding performance variability in standard and pipelined parallel Krylov solvers

In this work, we collect data from runs of Krylov subspace methods and pipelined Krylov algorithms in an effort to understand and model the impact of machine noise and other sources of variability on performance. We find large variability of Krylov iterations between compute nodes for standard methods that is reduced in pipelined algorithms, directly supporting conjecture, as well as large variation between statistical distributions of runtimes across iterations. Based on these results, we improve upon a previously introduced nondeterministic performance model by allowing iterations to fluctuate over time. We present our data from runs of various Krylov algorithms across multiple platforms as well as our updated non-stationary model that provides good agreement with observations. We also suggest how it can be used as a predictive tool.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Utilization of Existing Pipelines in Hydrogen Transport: Literature Review Report

This report critically reviews the flow behavior of hydrogen-natural gas (H 2 -NG) mixtures in pipelines and examines the critical factors of hydrogen integration into existing natural gas infrastructure. It addresses the choking behavior characterized by velocity increase and pressure drop, as well as the effects of flow restrictions and pressure losses during hydrogen transport. Computational and analytical models are used to investigate these effects, and their effects on thermodynamic properties and system performance are evaluated. The study also reviews the energy efficiency and flow dynamics of hydrogen and methane-hydrogen mixtures and optimizes the hydrogen flow rate. In addition, the effects of these mixtures on the flow characteristics are discussed in detail, with special emphasis on the compressibility factor (z factor) and fluid properties based on equations of state for hydrogen-natural gas mixtures. The study also analyzes the mixture ratios and highlights the thermophysical properties, flow dynamics, and hydrogen-blended natural gas application potential. These investigations assess flow stability, material interactions, and operational feasibility of transporting hydrogen mixtures through natural gas pipelines, which contribute to developing sustainable and efficient energy systems.

08 HYDROGEN↗
DOE OSTI2025

REPACT tool: A Screening Model for Repurposing Natural Gas Pipelines

Presentation on Reuse of Existing Pipelines for Adapted Carbon Dioxide Transport (REPACT) Tool for the January 2025 FECM interagency CO2 Transport topic team Meeting. The tool enables the user to determine whether a pipeline that was originally deployed for natural gas transport can be reused for carbon dioxide (CO2) transport.

carbon dioxide (CO2)↗
DOE OSTI2025

Literature Review of Selected Publications Relevant to Carbon Dioxide Pipeline and Storage Systems

The annotated bibliographies provided in this document focus on identifying and reviewing environmental impact statements (EIS), environmental assessments (EA), and scientific literature relevant to aspects of CO 2 pipeline and storage construction and operation. The purpose of these summaries is to aid stakeholders responsible for the preparation of documents compliant with the National Environmental Policy Act (NEPA) requirements to have access to a quick and comprehensive guide of the literature that can inform their activities. They aim to inform the development of EISs and EAs by identifying potential environmental concerns and mitigation strategies. The annotated bibliographies captured in this document cover the general environmental assessment and impact topics relevant to CO 2 pipeline and storage construction and operation activities, with the subject of waste creation and handling being specifically pulled out into its own section. The reasoning behind a dedicated section for waste is that many EAs and EISs focus on the description of waste and its impacts, be it caused in routine operation or as a result of an accident.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Solar PV Oil and Gas Pipeline Setbacks: Ordinances (2022) and Extrapolated Trends

This dataset represents solar energy setback requirements from oil and gas pipelines. A setback requirement is a minimum distance from a pipeline that an energy project may be developed. As of April 2022, no ordinances were discovered for any counties. Such ordinances are likely to arise as regulations continue to expand. Therefore, this dataset applies a 30-meter setback, sourced from trends in other infrastructure. A TIF data file and a PNG map of the data are provided, showing areas where solar energy is prohibited or permitted across the contiguous United States. For further details and citation, please refer to the publication linked below: Lopez, Anthony, Pavlo Pinchuk, Michael Gleason, Wesley Cole, Trieu Mai, Travis Williams, Owen Roberts, Marie Rivers, Mike Bannister, Sophie-Min Thomson, Gabe Zuckerman, and Brian Sergi. 2024. Solar Photovoltaics and Land-Based Wind Technical Potential and Supply Curves for the Contiguous United States: 2023 Edition. Golden, CO: National Renewable Energy Laboratory. NREL/TP-6A20-87843.

Array↗
DOE OSTI2024

Wind Turbine Oil and Gas Pipeline Setbacks: Ordinances (2022) and Extrapolated Trends, 115 Hub Height 170 Rotor Diameter

This dataset represents wind energy setback requirements from oil and gas pipelines. A setback requirement is a minimum distance from a pipeline that an energy project may be developed. As of April 2022, no ordinances were discovered for any counties. Such ordinances are likely to arise as regulations continue to expand. Therefore, this dataset applies a median setback equivalent to 1.1 times the turbine tip-height, sourced from trends in other infrastructure. A TIF data file and a PNG map of the data are provided, showing areas where wind energy is prohibited or permitted across the contiguous United States. The turbine parameters used were a hub-height of 115 meters and a rotor diameter of 170 meters, as obtained from the Annual Technology Baseline (ATB) 2022. For further details and citation, please refer to the publication linked below: Lopez, Anthony, Pavlo Pinchuk, Michael Gleason, Wesley Cole, Trieu Mai, Travis Williams, Owen Roberts, Marie Rivers, Mike Bannister, Sophie-Min Thomson, Gabe Zuckerman, and Brian Sergi. 2024. Solar Photovoltaics and Land-Based Wind Technical Potential and Supply Curves for the Contiguous United States: 2023 Edition. Golden, CO: National Renewable Energy Laboratory. NREL/TP-6A20-87843.

Array↗
DOE OSTI2023

Criticality Safety Evaluation Project Development for University of California Berkely Nuclear Criticality Safety Pipeline Course

The Nuclear Criticality Safety Division at Lawrence Livermore National Laboratory (LLNL) has taken a unique approach to developing criticality safety evaluation topics in support of the University of California Berkeley criticality safety pipeline course. The evaluation topics are designed to go beyond the typical evaluation examples used for many training courses including vault storage and variations on storage arrays. These types of evaluations provide in-depth analysis into the fundamentals of criticality safety and are complex but may be far off from what a new criticality safety engineer may actually be evaluating. To provide more practical examples of criticality safety evaluation topics that are better fit for the knowledge level of a criticality safety engineer in-training, variations of current and future operations and research operations performed at LLNL are used as evaluation topics. Additionally, an emphasis on research is included in all evaluation topics as it allows students to take advantage of the concepts learned in class to apply them for process improvement, engineering equipment that is favorable for criticality safety, and negotiation tactics to work with operations personnel. The process used by LLNL to develop project topics for the pipeline course is provided in this paper. The intent is to provide an alternative technique for training students and potentially younger staff members in criticality safety on developing criticality safety evaluations.

42 ENGINEERING↗
DOE OSTI2025

BCARS Simulated Phantom Dataset for Evaluation of Processing Pipelines

Broadband coherent anti-Stokes Raman scattering (BCARS) microscopy is a powerful label-free biological imaging technique, but the raw signal requires careful processing. The vibrationally resonant (Raman) fingerprint signal is usually small compared with instrumental noise sources and the nonresonant background (NRB) inherent in the BCARS signal. Fortunately, the NRB exhibits a systematic phase relationship with the coherent Raman response, acting as a heterodyne amplifier for the weak fingerprint signal. Due to this heterodyne effect, the Raman response can be recovered quantitatively and invariantly across different instruments, provided the NRB shape is known. Even with heterodyne amplification, the amplitudes of fingerprint signal components are often comparable to system noise. Singular value decomposition (SVD), which utilizes spatial information, is often employed for additional noise filtering. Consequently, finding optimal processing parameters to properly distinguish the NRB and Raman responses and suppress noise in the complex BCARS signal requires a reference system that realistically represents the spectral and spatial properties of BCARS signals obtained from biological samples. We present a digital tissue phantom that meets these criteria as a tool for testing candidate signal processing pipelines. The digital phantom is generated with simulated hyperspectral Raman images having system-specific noise and background characteristics. Here, we analyze phantom datasets with differing background and signal-to-noise conditions to evaluate their impact on the performance of multiple signal processing pipelines. Specifically, we investigate the application of a Butterworth filter-based routine to directly estimate the NRB from the BCARS signal. Additionally, we evaluate a Lorentzian wavelet transform as an alternative to the Hilbert transform for extracting the Raman spectrum from the BCARS signal. While we demonstrate this phantom for BCARS, it can be used for any spectroscopic Raman imaging approach.

Dixon, Jessica Z. [Georgia Institute of Technology↗
DOE OSTI2025

UnigeneFinder: An Automated Pipeline for Gene Calling From Transcriptome Assemblies Without a Reference Genome

ABSTRACT For most species, transcriptome data are much more readily available than genome data. Without a reference genome, gene calling is cumbersome and inaccurate because of the high degree of redundancy in de novo transcriptome assemblies. To simplify and increase the accuracy of de novo transcriptome assembly in the absence of a reference genome, we developed UnigeneFinder. Combining several clustering methods, UnigeneFinder substantially reduces the redundancy typical of raw transcriptome assemblies. This pipeline offers an effective solution to the problem of inflated transcript numbers, achieving a closer representation of the actual underlying genome. UnigeneFinder performs comparably or better, compared with existing tools, on plant species with varying genome complexities. UnigeneFinder is the only available transcriptome redundancy solution that fully automates the generation of primary transcript, coding region, and protein sequences, analogous to those available for high‐quality reference genomes. These features, coupled with the pipeline’s cross‐platform implementation, focus on automation, and an accessible, user‐friendly interface, make UnigeneFinder a useful tool for many downstream sequence‐based analyses in nonmodel organisms lacking a reference genome, including differential gene expression analysis, accurate ortholog identification, functional enrichments, and evolutionary analyses. UnigeneFinder also runs efficiently both on high‐performance computing (HPC) systems and personal computers, further reducing barriers to use.

Xue, Bo [Plant Resilience Institute Michigan State↗
DOE OSTI2023

HopBox: An image analysis pipeline to characterize hop cone morphology

Abstract Hop cone morphology can influence picking and drying ability, and color can impact consumer preference and may be indicative of quality. However, these characteristics are not generally evaluated in hop breeding programs due to the tedious nature of trait quantification and the extensive variation among cones within a genotype. We developed the HopBox, which is a simply constructed light box with a camera mount, and a publicly available image processing pipeline that identifies hop cones within color‐corrected images, reads a QR code within the image, and outputs data on hop cone length, width, area, perimeter, openness, weight, color, and density. The trained model was applied to images of 500 cones each from 15 replicated advanced hop genotypes from the USDA‐ARS breeding program in Prosser, Washington. Analysis of variance revealed significant ( p < 0.001) differences between genotypes for all traits measured, enabling breeders to discriminate between genotypes for selection purposes. Broad sense heritability for all traits ranged from 0.23 to 0.59. A random sampling of hop cones from the complete dataset revealed that imaging only 5–10 cones adequately captured genotypic variation and provided acceptable rank correlations ( r s > 0.75); however, increasing the sample size to 30 provided optimal precision. Instructions for constructing a HopBox and the code for the analysis pipeline are publicly available online and have wide applicability for hop breeding and research.

Altendorf, Kayla R.↗