Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “pipeline”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

OPEN-Augmented Reality GUI for Bioenergy Crop Phenotyping and Precision Agriculture (Donald Danforth Plant Science Center Final Scientific Technical Report)

The project led by the Donald Danforth Plant Science Center, in collaboration with Arizona State University, George Washington University, and Saint Louis University, has made significant strides in advancing the phenotypic analysis of bioenergy crops through the development of an innovative AI processing pipeline. This initiative was primarily funded by ARPA-E, with additional cost-sharing provided by the participating institutions. The project successfully utilized a variety of sensors—3D scanners, thermal, RGB, and hyperspectral—to refine algorithms for data-driven trait signature identification and improve the classification and visualization of plant traits. The developed AI processing pipeline is capable of handling the complex, multidimensional data characteristic of dynamic agricultural environments. 1) Contributions to understanding: The research has advanced the field of plant phenomics by showcasing the synergistic use of various sensor data to enhance the precision of trait analysis in bioenergy crops. Through the integration of 3D scanners, thermal, RGB, and hyperspectral sensors, the project has developed robust data-driven trait signature algorithms and visualization techniques. These innovations have facilitated detailed monitoring and management of plant traits, providing vital insights into plant growth dynamics and stress responses. Further, the project has broadened our understanding of how machine learning can be effectively applied in multi-sensor environments to refine trait analysis. By leveraging diverse datasets, the research has not only improved the accuracy of phenotypic assessments but also established a versatile methodological framework that can be extended beyond agriculture to other fields requiring detailed phenotypic analysis. 2) Technical effectiveness and economic feasibility: The AI processing pipeline developed in this project demonstrated significant technical effectiveness, achieving high throughput analysis of extensive phenotypic data and meeting targeted accuracies. This system exemplified the capability of advanced machine learning technologies to efficiently manage and analyze large, complex datasets. Economically, the implementation of the project-developed pipelines may offer substantial cost savings across multiple sectors. It enhances data analysis processes and significantly reduces the need for manual data interpretation, thereby decreasing both the time and resources required. 3) Public benefit: The project has significantly broadened the scope of agricultural methodologies to enhance phenotypic analysis, with potential applications in various sectors beyond agriculture. Additionally, the initiative fostered an enriching educational and collaborative environment, significantly enhancing the technical skills of participants. It also made substantial contributions to the scientific community by providing open-access data sets and tools, encouraging ongoing research and development across various disciplines. Overall, the project not only met its scientific goals but also showcased the extensive utility of integrating advanced machine learning and sensor data analysis technologies. These advancements have proven instrumental in driving forward both theoretical research and practical applications, setting a strong foundation for future explorations and innovations in data-driven science.

60 APPLIED LIFE SCIENCES↗

Core Model Proposal #350: Detailed Natural Gas Trade

This core model proposal adds detail to GCAM's natural gas trade model by separating gas trade between Liquefied Natural Gas (LNG) and six regional gas pipeline networks. This entails creating new trade markets for global LNG and the six regional pipeline networks, and modifying the regional natural gas sector in each region to reflect the competition between LNG and pipelines within imported natural gas, and between different pipeline networks. The nesting subsector capability (CMP #299 Infinite Subsector Nesting) was used to represent this additional level of competition on the consumption side.

03 NATURAL GAS↗

A Semi-Supervised Learning Method for the Identification of Bad Exposures in Large Imaging Surveys

As the data volume of astronomical imaging surveys rapidly increases, traditional methods for image anomaly detection, such as visual inspection by human experts, are becoming impractical. We introduce a machine-learning-based approach to detect poor-quality exposures in large imaging surveys, with a focus on the DECam Legacy Survey (DECaLS) in regions of low extinction (i.e., E ( B − V ) < 0.04 ). Our semi-supervised pipeline integrates a vision transformer (ViT), trained via self-supervised learning (SSL), with a k-Nearest Neighbor (kNN) classifier. We train and validate our pipeline using a small set of labeled exposures observed by surveys with the Dark Energy Camera (DECam). A clustering-space analysis of where our pipeline places images labeled in good and bad categories suggests that our approach can efficiently and accurately determine the quality of exposures. Applied to new imaging being reduced for DECaLS Data Release 11, our pipeline identifies 780 problematic exposures, which we subsequently verify through visual inspection. Being highly efficient and adaptable, our method offers a scalable solution for quality control in other large imaging surveys.

Luo, Yufeng (ORCID:0000000246230683)↗

Transport Cost for Carbon Removal Projects With Biomass and CO2 Storage

Strategies to remove carbon from the atmosphere are needed to meet global climate goals. Promising strategies include the conversion of waste biomass to hydrogen, methane, liquid fuels, or electricity coupled with CO 2 capture and storage (CCS). A key challenge for these projects is the need to connect geographically dispersed biomass supplies with geologic storage sites by either transporting biomass or CO 2 . We assess the cost of transport for biomass conversion projects with CCS using publicly available cost data for trucking, rail, and CO 2 pipelines in the United States. We find that for large projects (order of 1 Mt/yr CO 2 or greater), CO 2 by pipeline is the lowest cost option. However, for projects that send most of the biomass carbon to storage, such as gasification to hydrogen or electricity production, biomass by rail is a competitive option. For smaller projects and lower fractions of carbon sent to storage, such as for pyrolysis to liquid fuels, CO 2 by rail is the lowest cost option. Assessing three plausible example projects in the United States, we estimate that total transport costs range from $24/t-CO 2 stored for a gasification to hydrogen project traversing 670 km to $\$ 36$/t for a gasification to renewable natural gas project traversing 530 km. In general, if developers have flexibility in choosing transport mode and project type, biomass sources and storage sites can be connected across hundreds of kilometers for transport costs in the range of $20-40/t-CO 2 stored. Truck and rail are often viable modes when pipelines cannot be constructed. Distances of 1,000 km or more can be connected in the same cost range when shared CO 2 pipelines are employed.

09 BIOMASS FUELS↗

Deep Learning and Photogrammetric Reconstruction for Automated Crack Detection and Dimensional Measurement in Mining Operations

Surface crack detection and dimensional measurement at active mining sites present significant safety and operational challenges. Manual inspection methods are labor-intensive, spatially incomplete, and expose personnel to hazardous environments, while existing automated approaches have been developed primarily for concrete civil infrastructure and have not been validated on the complex, variable surfaces characteristic of mining environments. This dissertation presents an automated pipeline that integrates deep learning semantic segmentation with Structure-from-Motion photogrammetry to detect surface cracks and measure their aperture, length, and vertical displacement from standard RGB imagery acquired during routine Uncrewed Aerial Vehicle (UAV) survey operations, without requiring additional sensor hardware or manual measurement. The pipeline combines a U-Net architecture with an EfficientNet-B0 encoder, pretrained on the SDNET2018 concrete crack dataset and fine-tuned on a mining-specific dataset spanning laboratory concrete specimens, coal refuse impoundment embankments, and post-blast limestone quarry benches. Photogrammetric reconstruction is performed using COLMAP Structure-from-Motion and Multi-View Stereo, with crack segmentation masks projected into the reconstructed point cloud to enable three-dimensional vertical displacement measurement through local plane fitting and bimodal surface detection. The pipeline was validated across 36 controlled laboratory specimens at three imaging distances and four vertical displacement levels, achieving aperture measurement RMSE of 0.047 cm and R² of 0.954, and vertical displacement RMSE of 0.140 cm and R² of 0.966, against independent caliper measurements. Field application at a coal refuse impoundment in southwestern Pennsylvania detected 71 crack components across the embankment crest, with a dominant longitudinal crack exhibiting aperture values reaching 28 cm and a 95th percentile vertical displacement of 35.53 cm, consistent in magnitude and spatial distribution with simultaneously acquired LiDAR-derived estimates. Application across four post-blast limestone quarry bench datasets in California successfully characterized blast-induced fracture networks at ground sampling distances ranging from 0.59 to 1.23 cm/pixel, with detected crack geometries physically consistent with observable surface conditions at each site. The results demonstrate that deep learning-based crack detection and photogrammetric measurement can be integrated into routine UAV inspection workflows at mining sites, providing repeatable, scalable, and quantitative crack characterization across surface types, crack scales, and displacement magnitudes not previously addressed in the literature. The pipeline requires no dedicated surveying equipment beyond the UAV platforms already deployed at mine sites for survey and monitoring purposes, supporting practical adoption within existing operational workflows.

Crack detection, Dimensional Measurement↗

Retrospective Search for Strongly Lensed Supernovae in the DESI Legacy Imaging Surveys

The introduction of deep wide-field surveys in recent years and the adoption of machine-learning techniques have led to the discoveries of $\mathcal{O}$(10 4 ) strong gravitational lensing systems and candidates. However, the discovery of multiply-lensed transients remains a rarity. Lensed transients and especially lensed supernovae are invaluable tools to cosmology because they allow us to constrain cosmological parameters via lens modeling and the measurements of their time delays. In this paper, we develop a pipeline to perform a targeted lensed transient search. We apply this pipeline to 5807 strong lenses and candidates, which were identified in the literature, in the DESI Legacy Imaging Surveys Data Release 9 (DR9) footprint. For each system, we analyze every exposure in all of the observed bands (DECam g, r, and z). Our pipeline finds, groups, and ranks detections that are in sufficient proximity temporally and spatially. After the first round of inspection, for promising candidate systems, we further examine the newly available DR10 data (with additional i and Y bands). Here we present our targeted lensed supernova search pipeline and seven new lensed supernova candidates, including a very likely lensed supernova—probably a Type Ia—in a system with an Einstein radius of ~1$^{"}_{.}$5.

79 ASTRONOMY AND ASTROPHYSICS↗

Enabling Early Transient Discovery in LSST via Difference Imaging with DECam

We present SLIDE, a pipeline that enables transient discovery in data from the Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST), using archival images from the Dark Energy Camera as templates for difference imaging. We apply this pipeline to the recently released Data Preview 1 (DP1; the first public release of Rubin commissioning data) and search for transients in the resulting difference images. The image subtraction, photometry extraction, and transient detection are all performed on the Rubin Science Platform. We demonstrate that SLIDE effectively extracts clean photometry by circumventing poor or missing LSST templates. We identified 29 previously unreported transients, 12 of which would not have been detected based on the DP1 DiaObject catalog. SLIDE will be especially useful for transient analysis in the early years of LSST, when template coverage will be largely incomplete or when templates may be contaminated by transients present at the time of acquisition. We present multiband light curves for a sample of known transients, along with new transient candidates identified through our search. Finally, we discuss the prospects of applying this pipeline during the main LSST survey. Our pipeline is broadly applicable and will support studies of all transients with slowly evolving phases.

Dong, Yize 一泽董 [Harvard-Smithsonian Center for Ast↗

Helium recovery system at IB3A

The growing demand for sustainable cryogenic operations at Fermilab has underscored the need to improve helium management, particularly at the Industrial Building 3A (IB3A) test facility. IB3A characterizes and tests superconductors, cables, and coils for projects such as the HL-LHC AUP and Mu2e, yet currently relies on 500 L Dewars whose boil-off is vented to atmosphere, wasting a critical, non-renewable resource and increasing the cost of testing. A project is therefore under way to link IB3A to an existing purification and liquefaction station in a neighboring building through a dedicated pipeline. Captured helium will be transferred, purified, reliquefied, and returned for reuse, cutting losses and operating costs. This paper details the first two project phases: "Design and Engineering" and "Procurement and Installation." The design phase finalizes pipeline specifications, establishes flow-control requirements, and resolves integration challenges with existing cryogenic infrastructure. The procurement and installation phase covers material sourcing, pipeline construction, and deployment of control and monitoring systems to assure reliable, efficient operation. Key technical hurdles-route optimization, pressure drop mitigation, and interface compatibility-are discussed alongside implemented solutions. Implementing the pipeline and upgrading IB3A will dramatically reduce helium consumption and therefore testing cost, strengthening Fermilab's capacity to support frontier science far into the future.

Porwisiak, D. [Fermilab; Wroclaw Tech. U.]↗

Method and apparatus for asynchronous scheduling

A method and apparatus of asynchronous scheduling in a graphics device includes sending one or more instructions from an instruction scheduler to one or more instruction first-in/first-out (FIFO) devices. An instruction in the one or more FIFO devices is selected for execution by a single-instruction/multiple-data (SIMD) pipeline unit. It is determined whether all operands for the selected instruction are available for execution of the instruction, and if all the operands are available, the selected instruction is executed on the SIMD pipeline unit. The self-timed arithmetic pipeline unit (SIMD pipeline unit) is effectively encapsulated in a synchronous, (e.g., clocked by global clock), scheduler and register file environment.

Kalamatianos, John↗

ZnCr and ZnNb Cold Spray Coatings

Novel cold spray zinc-based alloy coatings have been investigated for corrosion protection of API 5L low carbon steel pipelines used in transporting natural gas. These different zinc alloy coatings are designed for use to help prevent internal corrosion and improve the lifespan of steel pipelines via sacrificial anodic protection. The corrosion behavior of these cold deposited zinc alloy coatings was investigated in CO2 saturated 3.5 wt.% NaCl solutions under simulated natural gas pipeline conditions. Electrochemical tests were conducted at 25 and 40 °C to determine the polarization resistance and galvanic current between each coating and the steel substrate in the galvanic couple. Tests were conducted at atmospheric, 1 bar, pressure. The results indicate that use of these coatings has the potential to increase the lifespan of steel pipelines above what a zinc coating alone could provide.

Teeter, Lucas↗

The 200 Gbps Challenge: Imagining HL-LHC analysis facilities

The IRIS-HEP software institute, as a contributor to the broader HEP Python ecosystem, is developing scalable analysis infrastructure and software tools to address the upcoming HL-LHC computing challenges with new approaches and paradigms, driven by our vision of what HL-LHC analysis will require. The institute uses a "Grand Challenge" format, constructing a series of increasingly large, complex, and realistic exercises to show the vision of HL-LHC analysis. Recently, the focus has been demonstrating the IRIS-HEP analysis infrastructure at scale and evaluating technology readiness for production. As a part of the Analysis Grand Challenge activities, the institute executed a "200 Gbps Challenge", aiming to show sustained data rates into the event processing of multiple analysis pipelines. The challenge integrated teams internal and external to the institute, including operations and facilities, analysis software tools, innovative data delivery and management services, and scalable analysis infrastructure. The challenge showcases the prototypes - including software, services, and facilities - built to process around 200 TB of data in both the CMS NanoAOD and ATLAS PHYSLITE data formats with test pipelines. The teams were able to sustain the 200 Gbps target across multiple pipelines. The pipelines focusing on event rate were able to process at over 30 MHz. These target rates are demanding; the activity revealed considerations for future testing at this scale and changes necessary for physicists to work at this scale in the future. The 200 Gbps Challenge has established a baseline on today's facilities, setting the stage for the next exercise at twice the scale.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Capacity Density Considerations for Offshore Wind Plants in the United States

The United States is a rapidly emerging market for offshore wind energy, with a project pipeline estimated at over 52 GW as of May 31, 2023 (Musial et al. 2023). The capacity density, measured in megawatts per square kilometer (MW/km 2 ), is a crucial parameter for estimating the magnitude of the development pipeline and the nameplate potential of existing lease areas. The offshore wind energy industry is comprised of diversity of participants, including developers, governmental bodies, investors, environmental advocacy groups, and researchers. These various stakeholders use capacity density in different ways as a key metric for evaluating the potential of individual offshore wind lease area or even a section of ocean space. This report presents our assessment of capacity density values in the current pipeline of emerging U.S. offshore wind farms and a detailed list of the main factors that influence capacity density. This understanding is critical for planning of future lease areas, for estimating the technical resource potential for offshore wind on the U.S. outer continental shelf (OCS), and for estimating ocean space requirements needed for meeting state and national goals for a carbon neutral energy transition.

17 WIND ENERGY↗

HyBlend Collaborative Research Partnership (CRADA Final Report)

This agreement assembles a multi-lab, multi-industry team to address high-priority research topics related to the blending of hydrogen (H2) into the U.S. natural gas (NG) pipeline network. There are four main research objectives: 1. Compatibility of metals (SNL) – Develop general principles for operation of HyBlend™ delivery systems in the context of structural integrity and assess the role of gas impurities on degradation of metal pipelines. 2. Compatibility of polymers (PNNL) – Assess gas impurities in HyBlend for polymer pipeline degradation and lifetime predictions. 3. Life cycle analysis (LCA) (ANL) – Analyze the life cycle of technology pathways for hydrogen and NG blends, as well as alternative pathways. 4.Techno-economic analysis (TEA) (NREL) – Quantify the costs and opportunities for hydrogen production and blending with the NG network, as well as alternative pathways.

08 HYDROGEN↗

Wyoming Trails Carbon Hub (WyoTCH)

The Wyoming Trails Carbon Hub (WyoTCH) project completed a front-end engineering and design (FEED) study for a commercial-scale, open-access carbon dioxide (CO 2 ) transport pipeline in Wyoming under U.S. Department of Energy (DOE) Award DE&#x2;FE0032347, funded through the Bipartisan Infrastructure Law Carbon Capture Technology Program and administered by the National Energy Technology Laboratory. The project’s approach of designing a multi-source, multi-destination pipeline, rather than a dedicated line serving a single project, would lower the barrier to entry for individual CO 2 projects. The projects would leverage Wyoming's concentrated industrial and power generation CO 2 sources, its existing CO 2 pipeline infrastructure, and its extensive CO 2 storage and utilization capacity. This is the project's final technical report.

01 COAL, LIGNITE, AND PEAT↗

Relaxations of the steady optimal gas flow problem for a non-Ideal gas

Natural gas ranks second in U.S. primary energy consumption. Because most production sites are remote, gas must be transported through pipeline networks equipped with compressors, valves, and other components. For both economic efficiency and system reliability, it is desirable to operate these networks optimally. The governing physics across pipeline components entails nonlinear, non-convex equality and inequality constraints, and the most general steady-flow operations problem is a Mixed-Integer Nonlinear Program (MINLP).This work focuses on one such steady-flow problem-the Optimal Gas Flow (OGF) for a natural gas pipeline network-which minimizes production cost subject to the steady-flow physics. For day-to-day operations, the ability to quickly compute a globally optimal solution and a strong lower bound for varying demand profiles is crucial. A promising strategy is to build tight relaxations of the OGF’s nonlinear constraints. However, many nonlinearities arising from non-ideal equations of state either lack relaxations or have relaxations that do not scale to realistic network sizes. We address this gap by combining recent advances in polyhedral relaxations for univariate functions to construct tight, computationally efficient relaxations of the OGF with a non-ideal equation of state. These relaxations solve within seconds on a standard laptop. In conclusion, we demonstrate their quality through extensive numerical experiments on very large-scale test networks from the literature and find that the proposed approach proves optimality in 92% of tested instances.

03 NATURAL GAS↗

In-depth analysis on parallel processing patterns for high-performance Dataframes

The Data Science domain has expanded monumentally in both research and industry communities during the past decade, predominantly owing to the Big Data revolution. Artificial Intelligence (AI) and Machine Learning (ML) are bringing more complexities to data engineering applications, which are now integrated into data processing pipelines to process terabytes of data. Typically, a significant amount of time is spent on data preprocessing in these pipelines, and hence improving its efficiency directly impacts the overall pipeline performance. The community has recently embraced the concept of Dataframes as the de-facto data structure for data representation and manipulation. However, the most widely used serial Dataframes today (R, pandas) experience performance limitations while working on even moderately large data sets. We believe that there is plenty of room for improvement by taking a look at this problem from a high-performance computing point of view. In a prior publication, we presented a set of parallel processing patterns for distributed dataframe operators and the reference runtime implementation, Cylon. In this paper, we are expanding on the initial concept by introducing a cost model for evaluating the said patterns. Furthermore, we evaluate the performance of Cylon on the ORNL Summit supercomputer.

97 MATHEMATICS AND COMPUTING↗

Comparison of automated chemical-guided segmentation and human annotation of soil organic matter in X-ray microcomputed tomography imaging in contrasted soil types

Soil organic matter (OM) formation and persistence is strongly influenced by the spatial distribution of organic substrates and microscale soil heterogeneity by dictating OM accessibility to microorganisms. However, traditional size and/or density fractionation techniques disrupt aggregate architecture, eliminating spatial information needed to fully understand intra-aggregate OM distribution. To quantify three-dimensional OM spatial distribution and automate segmentation in X-ray microcomputed tomography (µCT) imaging without human annotation bias, we developed an iodine gas vapor (I2) based staining workflow that eliminates labor-intensive manual annotation while maintaining segmentation accuracy, using aggregates from four taxonomically diverse soils (Xerofluvent, Haploxeroll Sphagnofibrist, Palehumult) with an 8-fold range of soil organic carbon. Human annotation of 10 µCT slices by the experienced and inexperienced annotators resulted in variations up to 3% in the Dice similarity coefficient (DSC), reflecting a degree of inherent subjectivity of manual labeling. Such inconsistencies are expected to compound as the number of manually annotated slices increases. Dual-energy µCT imaging at 33.1 keV (below the iodine (I) K-edge) and 33.2 keV (above the I K-edge) was used to resolve aggregate microstructure following I2 staining. The automated image subtraction pipeline identified OM regions by the I Kedge induced brightness increases, achieving DSC values of 0.58–0.83 relative to an experienced annotator. Sensitivity analyses revealed that the reconstruction alpha value—optimized via the open-source tool TomocuPy—and the 3D registration slice count were the primary determinants of accuracy, providing a novel benchmark for dual-energy soil imaging. The pipeline without GPU acceleration achieved 9.6 to 43.2 times faster than manual annotation. Using GPU-accelerated image post-processing and affine transformation matrices, the pipeline successfully segmented OM elements for large-scale datasets (3232×3232 pixel, 2048 slices) within ~5200 s from raw file acquisition to segmented output. The high-throughput approach enables the quantification of OM spatial distribution across diverse and heterogeneous soil.

Soil microbial biomass↗

Towards operational atmospheric correction of airborne hyperspectral imaging spectroscopy: Algorithm evaluation, key parameter analysis, and machine learning emulators

Atmospheric correction of airborne hyperspectral imaging spectroscopy (AHIS) to obtain high-quality surface reflectance is the prerequisite for remote sensing applications. Over the last decades, different atmospheric correction methods have been developed based on radiative transfer models (RTMs), however, the relative performances of different algorithms are unclear. Automated operational atmospheric correction methods to process large-volume AHIS data in a high-accurate and high-throughput manner are still lacking. Therefore, this study proposed an operational atmospheric correction pipeline for deriving surface reflectance from AHIS data. To ensure the accuracy and efficiency of the pipeline, we focused on three specific aspects: (1) selecting a suitable RTM for the development of atmospheric lookup tables (LUTs) by comparing the commercial MODerate resolution atmospheric TRANsmission (MODTRAN) and open-sourced Library for Radiative TRANsfer (LibRadTRAN) models, where the widely-used software, Atmospheric/Topographic Correction for Airborne Imagery (ATCOR), was used as benchmarks; (2) identifying key atmospheric correction parameters and determining suitable sources for parameter retrievals including AHIS, Moderate Resolution Imaging Spectroradiometer (MODIS), and AErosol RObotic NETwork (AERONET); and (3) testing the performance of using machine learning emulators to speed up the RTM-based atmospheric correction. Results indicate that (1) atmospheric correction based on MODTRAN LUTs can produce surface reflectance accurately with mean absolute errors < 0.05 and cosine similarities > 0.98 compared to field measurements, which is comparable to the software ATCOR and slightly outperforms the LibRadTRAN LUTs; (2) sobol global sensitivity analysis demonstrates that in the atmospheric correction, visibility and water vapor are two key parameters that can be accurately derived from AHIS in contrast to MODIS or AERONET data; and (3) Random Forest emulators can produce accurate estimations of surface reflectance with mean absolute errors < 0.03 and cosine similarities > 0.98 for higher processing efficiency and determine a suitable set of wavelengths for retrieving atmospheric visibility and water vapor. In conclusion, the proposed atmospheric correction pipeline also improved the four-stream radiative transfer theory for airborne applications by considering adjacent effects from airborne surrounding pixels and can also be applied for atmospheric correction of hyperspectral data from spaceborne missions.

47 OTHER INSTRUMENTATION↗