Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “PIPELINES”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Data Reduction Pipeline for the CHARIS Integral-Field Spectrograph I: Detector Readout Calibration and Data Cube Extraction

We present the data reduction pipeline for CHARIS, a high-contrast integral-field spectrograph for the Subaru Telescope. The pipeline constructs a ramp from the raw reads using the measured nonlinear pixel response and reconstructs the data cube using one of three extraction algorithms: aperture photometry, optimal extraction, or chi-squared fitting. We measure and apply both a detector flatfield and a lenslet flatfield and reconstruct the wavelength- and position-dependent lenslet point-spread function (PSF) from images taken with a tunable laser. We use these measured PSFs to implement a chi-squared-based extraction of the data cube, with typical residuals of approximately 5 percent due to imperfect models of the under-sampled lenslet PSFs. The full two-dimensional residual of the chi-squared extraction allows us to model and remove correlated read noise, dramatically improving CHARIS's performance. The chi-squared extraction produces a data cube that has been deconvolved with the line-spread function and never performs any interpolations of either the data or the individual lenslet spectra. The extracted data cube also includes uncertainties for each spatial and spectral measurement. CHARIS's software is parallelized, written in Python and Cython, and freely available on github with a separate documentation page. Astrometric and spectrophotometric calibrations of the data cubes and PSF subtraction will be treated in a forthcoming paper.

Brandt, Timothy D.↗

Pixel-Level Calibration in the Kepler Science Operations Center Pipeline

We present an overview of the pixel-level calibration of flight data from the Kepler Mission performed within the Kepler Science Operations Center Science Processing Pipeline. This article describes the calibration (CAL) module, which operates on original spacecraft data to remove instrument effects and other artifacts that pollute the data. Traditional CCD data reduction is performed (removal of instrument/detector effects such as bias and dark current), in addition to pixel-level calibration (correcting for cosmic rays and variations in pixel sensitivity), Kepler-specific corrections (removing smear signals which result from the lack of a shutter on the photometer and correcting for distortions induced by the readout electronics), and additional operations that are needed due to the complexity and large volume of flight data. CAL operates on long (~30 min) and short (~1 min) sampled data, as well as full-frame images, and produces calibrated pixel flux time series, uncertainties, and other metrics that are used in subsequent Pipeline modules. The raw and calibrated data are also archived in the Multi-mission Archive at Space Telescope at the Space Telescope Science Institute for use by the astronomical community.

Calibration↗

Data Validation in the Kepler Science Operations Center Pipeline

We present an overview of the Data Validation (DV) software component and its context within the Kepler ScienceOperations Center (SOC) pipeline and overall Kepler Science mission. The SOC pipeline performs a transiting planetsearch on the corrected light curves for over 150,000 targets across the focal plane array. We discuss the DV strategy forautomated validation of Threshold Crossing Events (TCEs) generated in the transiting planet search. For each TCE, atransiting planet model is fitted to the target light curve. A multiple planet search is conducted by repeating the transitingplanet search on the residual light curve after the model flux has been removed; if an additional detection occurs, aplanet model is fitted to the new TCE. A suite of automated tests are performed after all planet candidates have beenidentified. We describe a centroid motion test to determine the significance of the motion of the target photocenterduring transit and to estimate the coordinates of the transit source within the photometric aperture; a series of eclipsingbinary discrimination tests on the parameters of the planet model fits to all transits and the sequences of odd and eventransits; and a statistical bootstrap to assess the likelihood that the TCE would have been generated purely by chancegiven the target light curve with all transits removed.

photometry↗

Pipeline for Applications-Based Data Discovery

From disaster response and mitigation to monitoring water quality or protecting wildlife habitat, satellite Earth observation data can be applied in countless ways to meet pressing needs and benefit society. The crucial first step toward successful data application is data discovery. Potential users often know exactly what data they need--what Earth feature or phenomenon they need to observe, how frequently, and at what resolution or level of accuracy--but may still struggle to discover the existing observations that meet their needs. We have developed a pipeline to connect applications-based users to specific satellites and data collections within NASA's Earth observation program of record that are highly relevant to their data needs. This pipeline combines available information on satellite and instrument measurement characteristics with an innovative machine learning-based approach that identifies instruments that are most relevant to the feature or phenomenon of interest.

Katrina S Virts↗

BatAnalysis - A Comprehensive Python Pipeline for Swift BAT Survey Analysis

The Swift Burst Alert Telescope (BAT) is a coded aperture gamma-ray instrument with a large field of view that primarily operates in survey mode when it is not triggering on transient events. The survey data consists of eighty-channel detector plane histograms that accumulate photon counts over time periods of at least 5 minutes. These histograms are processed on the ground and are used to produce the survey dataset between 14 and 195 keV. Survey data comprises >90% of all BAT data by volume and allows for the tracking of long term light curves and spectral properties of cataloged and uncataloged hard X-ray sources. Until now, the survey dataset has not been used to its full potential due to the complexity associated with its analysis and the lack of easily usable pipelines. Here, we introduce the BatAnalysis python package , a wrapper for HEASoftpy, which provides a modern, open-source pipeline to process and analyze BAT survey data. BatAnalysis allows members of the community to use BAT survey data in more advanced analyses of astrophysical sources including pulsars, pulsar wind nebula, active galactic nuclei, and other known/unknown transient events that may be detected in the hard X-ray band. We outline the steps taken by the python code and exemplify its usefulness and accuracy by analyzing survey data from the Crab Pulsar, NGC 2992, and a previously uncataloged MAXI Transient. The BatAnalysis package allows for ∼ 18 years of BAT survey to be used in a systematic way to study a large variety of astrophysical sources.

Tyler Parsotan↗

Combinatorial Reasoning: Selecting Reasons in Generative AI Pipelines via Combinatorial Optimization

Recent Large Language Models (LLMs) have demonstrated impressive capabilities at tasks that require human intelligence and are a significant step towards human-like artificial intelligence (AI). Yet the performance of LLMs at reasoning tasks have been subpar and the reasoning capability of LLMs is a matter of significant debate. While it has been shown that the choice of the prompting technique to the LLM can alter its performance on a multitude of tasks, including reasoning, the best performing techniques require human-made prompts with the knowledge of the tasks at hand. We introduce a framework for what we call Combinatorial Reasoning (CR), a fully-automated prompting method, where reasons are sampled from an LLM pipeline and mapped into a Quadratic Unconstrained Binary Optimization (QUBO) problem. The framework investigates whether QUBO solutions can be profitably used to select a useful subset of the reasons to construct a Chain-of-Thought style prompt. We explore the acceleration of CR with specialized solvers. We also investigate the performance of simpler zero-shot strategies such as linear majority rule or random selection of reasons. Our preliminary study indicates that coupling a combinatorial solver to generative AI pipelines is an interesting avenue for AI reasoning and elucidates design principles for future CR methods.

combinatorial reasoning↗

Comparison of Ring Diagrams Based on the Doppler Shifts of Synthetic Data Obtained with Bisector Method and SDO/HMI Pipeline

Ring diagrams are cross-sections of three-dimensional spatiotemporal power spectra of solar oscillations. The rings reveal information about sub-surface flows and represent an important tool for helioseismology. Ring diagrams can be constructed using Doppler velocity or intensity maps of spectral lines. How the velocities are computed is an important factor for accuracy of information we can retrieve on subsurface flows. In our work, the ring diagrams are generated from Doppler shift data of synthesized Fe I 6173 Å line. We compare ring diagrams computed by two methods–HMI line-of-sight pipeline and the bisector of Fe line. Fe I line is synthesized for StellarBox 3D Radiative hydrodynamic simulations under LTE assumption. We aim to answer the following questions: 1.How do power spectra obtained from velocities computed with the HMI pipeline and bisector of the Fe I 6173Å compare? 2.How do the power spectral density retrieved with each method vary with heliocentric angle? 3.What is the effect of changing resolution on the power spectral density in ring diagrams obtained with the two methods?

SMD↗

An Efficient GPU-Accelerated Multi-Source Global Fit Pipeline for LISA Data Analysis

The large-scale analysis task of deciphering gravitational wave signals in the LISA data stream will be difficult, requiring a large amount of computational resources and extensive development of computational methods. Its high dimensionality, multiple model types, and complicated noise profile require a global fit to all parameters and input models simultaneously. In this work, we detail our global fit algorithm, called “Erebor,” designed to accomplish this challenging task. It is capable of analysing current state-of-the-art datasets and then growing into the future as more pieces of the pipeline are completed and added. We describe our pipeline strategy, the algorithmic setup, and the results from our analysis of the LDC2A Sangria dataset, which contains Massive Black Hole Binaries, compact Galactic Binaries, and a parameterized noise spectrum whose parameters are unknown to the user. The Erebor algorithm includes three unique and very useful contributions: GPU acceleration for enhanced computational efficiency; ensemble MCMC sampling with multiple MCMC walkers per temperature for better mixing and parallelized sample creation; and special online updates to reversible-jump (or trans-dimensional) sampling distributions to ensure sampler mixing and accurate initial estimates for detectable sources in the data. We recover posterior distributions for all 15 (6) of the injected MBHBs in the LDC2A training (hidden) dataset. We catalog ∼12000 Galactic Binaries (∼8000 as high confidence detections) for both the training and hidden datasets. All of the sources and their posterior distributions are provided in publicly available catalogs.

LISA global fit↗

Efficient GPU-Accelerated MultiSource Global Fit Pipeline for LISA Data Analysis

The large-scale analysis task of deciphering gravitational-wave signals in the LISA data stream will be difficult, requiring a large amount of computational resources and extensive development of computational methods. Its high dimensionality, multiple model types, and complicated noise profile require a global fit to all parameters and input models simultaneously. In this work, we detail our global fit algorithm, called “Erebor,” designed to accomplish this challenging task. It is capable of analyzing current state-of-the-art datasets and then growing into the future as more pieces of the pipeline are completed and added. We describe our pipeline strategy, the algorithmic setup, and the results from our analysis of the LDC2A Sangria dataset, which contains massive black hole binaries, compact galactic binaries, and a parametrized noise spectrum whose parameters are unknown to the user. The Erebor algorithm includes three unique and very useful contributions: GPU acceleration for enhanced computational efficiency; ensemble Markov Chain Monte Carlo (MCMC) sampling with multiple MCMC walkers per temperature for better mixing and parallelized sample creation; and special online updates to reversible-jump (or transdimensional) sampling distributions to ensure sampler mixing and accurate initial estimates for detectable sources in the data.We recover posterior distributions for all 15 (6) of the injected massive black hole binaries (MBHB) in the LDC2A training (hidden) dataset. We catalog ∼12000 galactic binaries (∼8000 as high confidence detections) for both the training and hidden datasets. All of the sources and their posterior distributions are provided in publicly available catalogs.

LISA↗

Place Based STEM: Leveraging Local Resources to Engage K-12 Teachers in Teaching Integrated STEM and for Addressing the Local STEM Pipeline

Business, industry, parks, nature settings, government infrastructure, and people, can be invaluable resources for connecting STEM curriculum within context which results in conditions ideal for promoting purposeful learning of authentic STEM content. Thus, community-based STEM resources offer ideal context for teaching STEM content. A benefit of focusing teacher attention on these contextual, content aligned resources is that they are in every community; making place-based STEM education a possibility, regardless of the location of STEM teaching and learning. Further, associating STEM teaching and learning with local resources addresses workforce development and the STEM pipeline by exposing students to STEM careers and applications in their local communities. The desire to align STEM teaching and learning with local STEM related resources guided the design of our week-long integrated STEM K-12 teacher professional development (PD) program, i-STEM. We have completed four years of our i-STEM PD program and have made place-based STEM a major emphasis of our curriculum. This report focuses on the data collected in the fourth year of our program. Our week-long i-STEM PD served over 425 educators last summer (2013), providing them with in depth theme-based integrated STEM short courses which were limited to an average of 15 participants and whole group plenary sessions focused around placed based integrated STEM, inquiry, engineering design, standards and practices of Common Core and 21st Century skills. This state wide PD was distributed in five Idaho community colleges and took place over two weeks. The STEM short courses included topics on engineering for sustainability, using engineering to spark interest in STEM, municipal water systems, health, agriculture, food safety, mining, forestry, energy, and others. Integral to these short courses were field trips designed to connect the K-12 educators to the resources in their local communities that could be leveraged for teaching integrated STEM and provide a relevant context for teaching STEM content. Workplace presentations made by place-based STEM experts and provided teachers field trips to place-base STEM industries and business such as manufacturing plants, waste water treatment systems, mines, nature parks, food processing plants, research, hospitals, and laboratory facilities. We researched the 425 participants’ conceptions of place-based STEM prior to and after their taking part in the summer institutes, which included fieldtrips. Our findings revealed substantial increase in our participants’ knowledge, interest, and plans to use place-based resources for teaching integrated STEM. We detail the data analysis and provide a theoretical foundation and justification for the importance of place-based STEM to address the STEM pipeline for the future workforce.

99 GENERAL AND MISCELLANEOUS↗

The Updated DESGW Processing Pipeline for the Third LIGO/VIRGO Observing Run

The DESGW group seeks to identify electromagnetic counterparts of gravitational wave events seen by the LIGO-VIRGO network, such as those expected from binary neutron star mergers or neutron star- black hole mergers. DESGW was active throughout the first two LIGO observing seasons, following up several binary black hole mergers and the first binary neutron star merger, GW170817. We describe the modifications to the observing strategy generation and image processing pipeline between the second (ending in August 2017) and third (beginning in April 2019) LIGO observing seasons. The modifications include a more robust observing strategy generator, further parallelization of the image reduction software and difference imaging processing pipeline, data transfer streamlining, and a public webpage listing identified counterpart candidates that updates in real time. Taken together, the additional parallelization steps enable us to identify potential electromagnetic counterpa rts within fully calibrated search images in less than one hour, compared to the 3-5 hours it would typically take during the first two seasons. These performance improvements are critical to the entire EM followup community, as rapid identification (or rejection) of candidates enables detailed spectroscopic followup by multiple instruments as soon as possible, leading to more information about the environment immediately following such gravitational wave events.

79 ASTRONOMY AND ASTROPHYSICS↗

The updated DESGW processing pipeline for the third LIGO/VIRGO observing run

The DESGW group seeks to identify electromagnetic counterpartsof gravitational wave events seen by the LIGO-VIRGO network, such as thoseexpected from binary neutron star mergers or neutron star- black hole mergers.DESGW was active throughout the first two LIGO observing seasons, followingup several binary black hole mergers and the first binary neutron star merger,GW170817. We describe the modifications to the observing strategy generationand image processing pipeline between the second (ending in August 2017)and third (beginning in April 2019) LIGO observing seasons. The modifica-tions include a more robust observing strategy generator, further parallelizationof the image reduction software and dierence imaging processing pipeline,data transfer streamlining, and a web page listing identified counterpart candi-dates that updates in real time. Taken together, the additional parallelizationsteps enable us to identify potential electromagnetic counterparts within fullycalibrated search images in less than one hour, compared to the 3-5 hours itwould typically take during the first two seasons. These performance improve-ments are critical to the entire EM followup community, as rapid identification(or rejection) of candidates enables detailed spectroscopic followup by multipleinstruments as soon as possible, leading to more information about the environ-ment immediately following such gravitational wave events.

Herner, Kenneth R.↗

BETO 2021 Peer Review - Biomethanation to Upgrade Biogas to Pipeline Grade Methane WBS 5.1.3.102

We are developing, innovating and de-risking a biomethanation process capable of megawatt-scale deployment that upgrades biogas waste streams to produce pipeline quality renewable natural gas (RNG). Biomethanation is a two-step process using a methanogenic microorganism to convert renewable hydrogen (H2) and waste carbon dioxide (CO2) to renewable methane (CH4) - the primary component in natural gas. Using biogenic CO2 from biogas sources like dairies, wastewater treatment plants, and landfills allows production of this drop-in direct replacement fuel to participate in the growing number of carbon markets; like California's Low Carbon Fuel Standard and the Federal Renewable Fuel Standard. The end-of-project goal is to demonstrate pipeline quality RNG production (> 95% CH4, < 4% H2, <1% CO2, < 0.2% O2 and < 4 parts per million hydrogen sulfide) using real biogas feedstocks. We will accomplish this goal by designing and building a pressurized (18 bar) mobile lab-scale (20L) bioreactor research platform, including integrated electrolyzer system, based on lessons learned from operating the 700L pilot system from Southern California Gas Company. In collaboration with Electrochaea, natural gas utilities and Argonne National lab, will provide the data to establish a preliminary range of carbon intensity to help accelerate the deployment of utility-scale H2 production and qualify the biomethanation pathway process for RNG production.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Novel Membrane-Based Corrosion Sensors For Operating In Natural Gas Pipelines

Membrane-based electrochemical sensors (MBES) provide an attractive option for real-time continuous humidity and corrosion rate measurements inside of natural gas pipelines. The MBES, can use electrochemical techniques such as linear polarization resistance and electrochemical impedance spectroscopy even when a conductive aqueous phase is intermittent or unavailable. We now present field-test performance data of our MBES operated inside a multiphase water and natural gas flow facility. The MBES measured internal corrosion and conductivity at the top, bottom, and side of the pipe spool. Tests were carried out with flow rates of 4.6, 9.1, and 18.3 m/s, temperatures of 21, 29, and 35 °C, and a pressure of 1000 psia. All sensors followed similar trends in open circuit potential, corrosion rate, and conductivity over time. Neither flow rate, temperature, nor build-up of metal-based solids on the sensor surfaces impacted the quality of the electrochemical measurements. The field-test results confirm that the membrane-based electrochemical sensors are suitable for monitoring internal corrosion of operational natural-gas pipelines.

Duffy, Timothy↗

ML Clustering to Identify Natural Gas Pipeline Infrastructure Vulnerabilities

The network of more than 2.5 million miles of natural gas pipelines the U.S. are exposed to a range of vulnerabilities, ranging from extreme weather, to human behavior, and increasingly, to cyber threats. Advanced, data-driven analytics, including the use of machine learning and artificial intelligence, afford an opportunity to identify potential vulnerabilities, better understand risks, and help mitigate vulnerabilities in the network. At NETL, machine learning is being used to explore pipeline vulnerabilities and identify significant clusters of failure events, including failures due to weather, human behavior, and materials. These findings are being used to support the development of new technologies, including sensors, but can also be used to evaluate and inform mitigation strategies to reduce risks and vulnerabilities throughout the network.

Bauer, Jennifer↗

Development of Automated Pipeline for Time-Resolved Link-Wise Vehicular Energy Consumption in the Chattanooga, TN Road Network

The Department of Energy (DOE) has shown strong interest in detecting energy inefficiencies in regional road networks, so as to derive energy consumed at a high spatial temporal resolution. We have developed a workflow to automate the estimation of time-resolved vehicular energy consumption over each link in a road network of interest. The road network used in the current work is centered around the city of Chattanooga, Tennessee and its bordering regions. Utilizing the most mature road network for the Chattanooga, TN region, vehicle speed & count data from TomTom in conjunction with machine learning methods, we have developed an automated pipeline to estimate energy consumption for every link in the network. The first step in the pipeline is ingesting vehicle probe counts and speed estimates from TomTom API. In the next step, the probe counts, speed profiles and other exogenous data (i.e. road types, weather data, ground-truth volume counts and more) were used as input to a supervised learning algorithm to estimate the number of vehicles throughout the entire region for each road segment. These volume estimates were then mapped to a unified road network that contained additional important information such as percentage change in gradient across a link, number of lanes and link lengths that are features in pre-trained single vehicle energy-consumption models available with the RouteE software developed at NREL. The per vehicle energy consumption on each road link predicted using appropriate RouteE vehicular models were multiplied by the volume estimate for the corresponding link over a given time period to predict energy consumed per link for the time interval of interest. Currently, work is underway to improve both the RouteE per vehicle energy estimate and the volume estimates derived from TomTom probe counts. We have also explored the correlation of the link-wise energy estimates with the features of the pre-trained RouteE machine learning model in order to gain insight into what factors contribute most to the link-wise energy consumption.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION,↗

Nuclear Criticality Safety Pipeline Course with Hands-On Experimental Training at Lawrence Livermore's Inherently Safe Subcritical Assembly Training Center

The Nuclear Criticality Safety Divisions at Lawrence Livermore National Laboratory (LLNL) and Los Alamos National Laboratory (LANL) have partnered with Prof. Massimiliano Fratoni of the University of California Berkeley to offer a semester long course on nuclear criticality safety. This course is part of a larger pipeline project among many of the Department of Energy (DOE) laboratories designed to stimulate student interest in the field of criticality safety. The course focuses on teaching the fundamentals of criticality safety, familiarity with national and consensus standards, and preparing criticality safety evaluations. Students also receive hands-on experience with special nuclear material by performing experiments with the Inherently Safe Subcritical Assembly (ISSA) at LLNL. Guest lectures are taught remotely and in-person by criticality safety engineers at LLNL and LANL, giving students an opportunity to interact with professionals in the field. The students complete a semester long project involving developing and writing a criticality safety evaluation. As universities tend to focus heavily on nuclear power and advanced nuclear reactor design, this course gives students a better understanding and perspective of what criticality safety entails. The goal of this pipeline course is to introduce students to criticality safety as another available field for nuclear engineers. It is also a way for criticality safety programs to identify talented students who have the interest and aptitude to work in criticality safety for hire upon graduation. LLNL and LANL have both hosted past students as summer students, participated in student's graduate projects, and hired students as criticality safety engineers. This has provided a unique opportunity for criticality safety programs to spot young talent with better retention outcomes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Biomethanation to Upgrade Biogas to Pipeline Grade Methane

NREL is working closely with DOE, Electrochaea GmbH, and Southern California Gas Company (SoCalGas) to reduce costs of a biomethanation process capable of megawatt-scale deployment that upgrades organic biogas waste streams to produce pipeline quality renewable natural gas (RNG). Biomethanation is a two-step process using a single-celled methanogenic archaea that converts low-carbon low-cost hydrogen (H2) and waste carbon dioxide (CO2) to produce renewable methane (CH4). The process upgrades the biogenic CO2 - while allowing the CH4 to pass through - from biogas sources like dairies, wastewater treatment plants, and landfills. The CH4 produced is a drop-in direct replacement fuel and producers can participate in the growing number of carbon markets; like California's Low Carbon Fuel Standard and the Federal Renewable Fuel Standard. NREL and Argonne National Laboratory have completed a life cycle analysis using the GREET model to show that the biomethanation process produces RNG that is carbon negative even when H2 production via low-temperature water electrolysis is driven by the existing carbon intensity of California's electricity grid. And of course, even further carbon negative (-233 kg CO2e/kWh) when the electricity is produced from low-carbon sources like wind and solar. Leveraging lessons learned from operating SoCalGas' 700L 18-bar bioreactor system, NREL is designing and building a flexible RD&D platform that will enable field trials at biogas and other CO2 sources. A custom 16' long trailer will house a 20L 18-bar bioreactor, 3 - 25 kW proton exchange membrane electrolyzer, and dosing, thermal, and controls systems to support operations with only power, biogas, and water feedstocks required by the field locations. The end-of-project goal is to demonstrate pipeline quality RNG production (> 95% CH4, < 4% H2, <1% CO2, < 0.2% O2 and < 4 parts per million H2 sulfide) using real biogas feedstocks - thereby recycling both greenhouse gases for injection into the natural gas network or to be used onsite.

biogas upgrading↗