SEARCH · Engineering Papers

Results for “Preprocessing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Providing Geospatial Intelligence through a Scalable Imagery Pipeline

This chapter describes ORNL’s (Oak Ridge National Laboratory’s) contributions to imagery preprocessing for geospatial intelligence research and development (R&D) in four sections. First, we discuss challenges involved in building an effective imagery preprocessing workflow and the world-class high-performance computing (HPC) resources at ORNL available to process petabytes of imagery data. Second, we highlight how we developed imagery preprocessing tools over three decades while paving the way for our current cutting-edge machine learning and computer vision algorithms that are impacting humanitarian and disaster response efforts. Third, we discuss how PIPE modules work together to turn raw images into analysis-ready datasets. Fourth, we look toward the future and discuss planned advancements to PIPE and computing trends that will affect geospatial intelligence R&D.

Reith, Andrew↗

DOE OSTI2020

Herbaceous Feedstock 2018 State of Technology Report

The U.S. Department of Energy (DOE) promotes the production of advanced liquid transportation fuels from lignocellulosic biomass by funding fundamental and applied research that advances the state of technology (SOT). As part of its involvement with this mission, Idaho National Laboratory (INL) completes an annual SOT report for biomass feedstock logistics. This report summarizes supply system impacts of Bioenergy Technologies Office (BETO)-funded research and development efforts at INL and elsewhere (such as the High-Tonnage Feedstock Logistics projects (Webb et al. 2013a, Webb et al. 2013b, Webb et al. 2013c, Webb and Sokhansanj 2014, Sokhansanj et al. 2014) that lead to improvements in feedstock supply systems. These include improvements to and observed performance of innovative harvest and collection methods, storage technologies, transportation and handling approaches, and advanced preprocessing technologies. Biomass quality and variability, and the interface between feedstock quality and conversion performance are key drivers in addition to delivered feedstock cost. In this report, we estimate the benefits of R&D improvements to individual supply system unit operations, and present the status of feedstock logistics technology development for converting biomass into biofuels. These analyses are supported by experimental data where possible, and help to align the SOT relative to the cost goals defined in the Multi-Year Program Plan. The 2018 Herbaceous SOT aligned feedstock logistic design with current biorefinery’s design capacity utilized by biochemical conversion platform. Currently biochemical conversion platform utilizes a 725,000 dry ton/year biorefiney design for the techno economic analysis. Hence, feedstock delivered cost in the 2018 Herbaceous SOT is calculated based on biorefinery’s 725,000 dry ton design capacity instead of 800, 000 dry ton capacity utilized in the 2017 Herbaceous SOT. Biomass availabilities in this SOT were updated to year 2018 data from the 2016 Billion-Ton Report (BT16) (DOE 2016a), with the exception of switchgrass, for which the 2018 Herbaceous SOT utilized the 2019 switchgrass availability data from BT16. The BT16 report (DOE 2016a) does not project switchgrass availability in 2018; the soonest switchgrass is available in the BT16 report is 2019. Therefore, availability of switchgrass for this analysis was that projected for 2019. The 2018 Herbaceous SOT incorporates same technologies utilized in the 2017 Herbaceous SOT. However, a sensitivity analysis is performed to understand the impact of variation of process parameters on those technologies on feedstock logistic cost. New R&D data that shows the variations of process parameters affecting process performance is incorporated in the 2018 SOT to measure the variations in delivered feedstock cost. The 2018 Herbaceous SOT has also provided projected delivered feedstock of 2022 design case based on near term technical target under BETO funded R&D project. Finally, updated biorefinery size of 725,000 dry ton/year was incorporated within least-cost formulation model to select optimal siting and depot scales during optimization of the least cost blend. This modification to the optimization algorithm allows the trade-off between the cost of increased supply radius and the savings from selecting biomass from higher producing counties to be assessed. Such optimization has also showed the economic benefit of decentralized depots in comparison to centralized preprocessing co-located with the biorefinery by decoupling the biorefinery and feedstock locations. The 2018 Herbaceous SOT report documents the current modeled cost of a herbaceous feedstock supply system (from harvest to the pretreatment reactor throat, including grower payment) for hydrocarbon fuel production via biochemical conversion, based on equipment and processes now available or potentially available in the near term. The modeled cost also considers both the required quality and the availability of the biomass resources. The 2018 Herbaceous SOT predicts a modeled delivered feedstock cost of $83.67/dry ton (2016$); this is a $0.23/dry ton (2016$) decrease from the 2017 Herbaceous SOT. The modification of biorefinery’s designed capacity and increased projected biomass availability in the same supply shed contributed to this modeled cost reduction. The least-cost formulation model to optimally site and scale local distributed preprocessing depots also contributed to the cost reduction by considering county-level grower payment and distance from the biorefinery as variables in the optimization algorithm. Sensitivity analysis on various process parameters that affect delivered feedstock cost in the 2018 Herbaceous SOT shows that the delivered cost could varies from $80.45-$88.83/dry ton. The top factors that causes such variations are: effective baling rate, bale density, hammer mill throughput, interest rate and storage dry matter loss.

09 BIOMASS FUELS↗

DOE OSTI2020

Improved Advanced Biomass Logistics Utilizing Woody and other Feedstocks in the Northeast and Pacific Northwest (Final Report)

Willow and poplar short rotation woody crops (SRWC) have shown promise with regards to environmental benefits and rural development but wide adoption lags due to underdeveloped markets and supply systems. High costs associated with harvesting, handling and transportation (40-60% of delivered cost) have impeded expansion. A better understanding of these systems will create opportunities to improve efficiency, reduce costs, and realize environmental benefits and impacts. The project’s goal was to lower the delivered cost of hybrid poplar in the Northwest and willow in the Northeast by optimizing harvesting and logistics supply systems while maintaining or improving biomass quality along the supply chain. Over 3,400 Mg of biomass and 300 ha of willow and poplar were monitored over a range of crop and field conditions. Feedstock quality as affected by storage and preprocessing were shown to improve or maintain feedstock quality. Modeled harvesting costs ranged from $38–61 Mg -1 dry; when including delivery and preprocessing feedstock costs ranged between $79-83 Mg -1 dry for willow and $106-116 Mg -1 dry for poplar. Costs for willow minimized when hot water extraction and high-moisture densification preprocessing were used. Models also suggest that social and regional factors could further reduce costs. Results will give guidance to feedstock growers, harvesting and logistic operations, biorefinery project developers, and policy makers developing SRWC to support a growing bioeconomy.

, biomass↗

DOE OSTI2024

Performance Comparison of Machine Learning Models for Ultrasonic Nondestructive Evaluation of Alkali-Silica Reaction in Concrete

Alkali-silica reaction (ASR) causes concrete degradation, leading to cracking, rebar corrosion, and reduced structural integrity, which raises safety concerns. Ultrasonic nondestructive evaluation (NDE) effectively assesses concrete properties and monitors ASR progression. However, its deployment and analysis require specialized expertise and subjective interpretation. As computational power increases, artificial intelligence (AI) and machine learning (ML) algorithms are increasingly being used to automate NDE data analysis across various industries for AI-assisted automation. Regulatory agencies are adapting to this technological shift, prompting a need to evaluate current ML technologies’ capabilities and limitations in assessing concrete material properties and damage. This report presents a comparative analysis of four ML regression models for predicting concrete material damage induced by ASR expansion using long-term ultrasonic data monitoring. The models investigated include linear regression (LR), support vector regression (SVR), shallow neural networks (NN), and deep neural networks (DNN). LR, SVR, and shallow NN models use features extracted from ultrasonic signals, whereas the DNN model processes time-domain ultrasonic signals and frequency spectra directly. The study systematically compared the models’ performance from various perspectives, including model input, prediction performance, and generalization ability. The findings indicate significant variability in model performance, with some ML algorithms achieving very high or very low prediction accuracy depending on the preprocessing and feature engineering (extraction and selection) applied. Key insights include the observation that shallow ML models (LR, SVR, and shallow NNs) require meticulous preprocessing and feature extraction to achieve high accuracy. In contrast, the DNN model, although it bypasses the need for feature engineering, necessitates extensive preprocessing to mitigate noise and computational demands. The SVR model emerged as the top performer among the shallow models, and the DNN model exhibited superior performance on specific datasets but struggled with generalization across specimens from different batches. Additionally, the SVR model is sensitive to temperature variations, whereas the DNN model is robust in this regard. Using recurrent neural networks is recommended for future ASR expansion prediction studies. Recurrent neural networks’ inherent ability to capture temporal dependencies and long-term patterns makes them well suited for analyzing sequential ultrasonic monitoring data. Overall, the results and conclusions of this study could provide insights into the capabilities and effectiveness of ML when applied to ultrasonic NDE data and help identify best practices for using ML for ultrasonic NDE of concrete material properties.

36 MATERIALS SCIENCE↗

NASA NTRS1971

Layered recognition networks that pre-process, classify, and describe

A brief overview is presented of six types of pattern recognition programs that: (1) preprocess, then characterize; (2) preprocess and characterize together; (3) preprocess and characterize into a recognition cone; (4) describe as well as name; (5) compose interrelated descriptions; and (6) converse. A computer program (of types 3 through 6) is presented that transforms and characterizes the input scene through the successive layers of a recognition cone, and then engages in a stylized conversation to describe the scene.

Uhr, L.↗

NASA NTRS1978

On-board compensation for temporal changes in pushbroom scanner detector arrays

The design and operation of pushbroom and mechanical scanners are reviewed in order to determine differences in data preprocessing. Data preprocessing is categorized into spatial registration and radiometric corrections, as well as into systematic versus nonsystematic corrections. The category of nonsystematic radiometric errors due to temporal changes in detector array properties is emphasized as a subject of special interest and a challenging problem for onboard data preprocessing. Concepts for onboard compensation of temporal changes are presented. In particular one concept which uses dark current as an indicator of temperature change for determining gain and offset corrections is shown to have a number of advantages.

Jobson, D. J.↗

NASA NTRS1979

Compensation for atmospheric effects in LANDSAT data

Preprocessing algorithms were developed to remove or reduce the variations in multispectral data caused by variations in Sun angle and by changes in the atmospheric aerosol and water vapor levels. The two most significant algorithms developed by using mathematical models to define interrelations between the required multiplicative and additive correction factors so that just a few statistical characteristics of a LANDSAT distribution model would be sufficient to drive the mathematical model and to calculate the preprocessing corrections are examined. These are the atmospheric correction (ATCOR) computer program and the XSTAR haze correction algorithm. Neither the ATCOR nor the XSTAR algorithm provides an explicit compensation for the effects of changing LANDSAT view angle. Development efforts are underway to address this aspect of the preprocessing problem.

Lambeck, P. F.↗

NASA NTRS1981

Low-cost digital image processing at the University of Oklahoma

Computer assisted instruction in remote sensing at the University of Oklahoma involves two separate approaches and is dependent upon initial preprocessing of a LANDSAT computer compatible tape using software developed for an IBM 370/158 computer. In-house generated preprocessing algorithms permits students or researchers to select a subset of a LANDSAT scene for subsequent analysis using either general purpose statistical packages or color graphic image processing software developed for Apple II microcomputers. Procedures for preprocessing the data and image analysis using either of the two approaches for low-cost LANDSAT data processing are described.

Harrington, J. A., Jr.↗

NASA NTRS1988

Robot Gripper With Signal Processing

Single-chip computer and sensor-circuit chips preprocess sensor data. Self-contained circuitry combines sensor signals for serial digital transmission. Gripping surfaces crossed with grooves for grasping differently shaped objects. Gripper cavities house sensors and preprocessing circuitry. Sensors and preprocessing circuitry in robot gripper reduce amount of data being transmitted between robot controller and gripper. Placement in gripper reduces signal delays and vulnerability to electromagnetic interference.

Killion, Richard R.↗

NASA NTRS1991

Three dimensional unstructured multigrid for the Euler equations

The three dimensional Euler equations are solved on unstructured tetrahedral meshes using a multigrid strategy. The driving algorithm consists of an explicit vertex-based finite element scheme, which employs an edge-based data structure to assemble the residuals. The multigrid approach employs a sequence of independently generated coarse and fine meshes to accelerate the convergence to steady-state of the fine grid solution. Variables, residuals and corrections are passed back and forth between the various grids of the sequence using linear interpolation. The addresses and weights for interpolation are determined in a preprocessing stage using linear interpolation. The addresses and weights for interpolation are determined in a preprocessing stage using an efficient graph traversal algorithm. The preprocessing operation is shown to require a negligible fraction of the CPU time required by the overall solution procedure, while gains in overall solution efficiencies greater than an order of magnitude are demonstrated on meshes containing up to 350,000 vertices. Solutions using globally regenerated fine meshes as well as adaptively refined meshes are given.

Mavriplis, D. J.↗

NASA NTRS1992

Compiler analysis for irregular problems in FORTRAN D

We developed a dataflow framework which provides a basis for rigorously defining strategies to make use of runtime preprocessing methods for distributed memory multiprocessors. In many programs, several loops access the same off-processor memory locations. Our runtime support gives us a mechanism for tracking and reusing copies of off-processor data. A key aspect of our compiler analysis strategy is to determine when it is safe to reuse copies of off-processor data. Another crucial function of the compiler analysis is to identify situations which allow runtime preprocessing overheads to be amortized. This dataflow analysis will make it possible to effectively use the results of interprocedural analysis in our efforts to reduce interprocessor communication and the need for runtime preprocessing.

Vonhanxleden, Reinhard↗

NASA NTRS2007

Automated Recognition of 3D Features in GPIR Images

A method of automated recognition of three-dimensional (3D) features in images generated by ground-penetrating imaging radar (GPIR) is undergoing development. GPIR 3D images can be analyzed to detect and identify such subsurface features as pipes and other utility conduits. Until now, much of the analysis of GPIR images has been performed manually by expert operators who must visually identify and track each feature. The present method is intended to satisfy a need for more efficient and accurate analysis by means of algorithms that can automatically identify and track subsurface features, with minimal supervision by human operators. In this method, data from multiple sources (for example, data on different features extracted by different algorithms) are fused together for identifying subsurface objects. The algorithms of this method can be classified in several different ways. In one classification, the algorithms fall into three classes: (1) image-processing algorithms, (2) feature- extraction algorithms, and (3) a multiaxis data-fusion/pattern-recognition algorithm that includes a combination of machine-learning, pattern-recognition, and object-linking algorithms. The image-processing class includes preprocessing algorithms for reducing noise and enhancing target features for pattern recognition. The feature-extraction algorithms operate on preprocessed data to extract such specific features in images as two-dimensional (2D) slices of a pipe. Then the multiaxis data-fusion/ pattern-recognition algorithm identifies, classifies, and reconstructs 3D objects from the extracted features. In this process, multiple 2D features extracted by use of different algorithms and representing views along different directions are used to identify and reconstruct 3D objects. In object linking, which is an essential part of this process, features identified in successive 2D slices and located within a threshold radius of identical features in adjacent slices are linked in a directed-graph data structure. Relative to past approaches, this multiaxis approach offers the advantages of more reliable detections, better discrimination of objects, and provision of redundant information, which can be helpful in filling gaps in feature recognition by one of the component algorithms. The image-processing class also includes postprocessing algorithms that enhance identified features to prepare them for further scrutiny by human analysts (see figure). Enhancement of images as a postprocessing step is a significant departure from traditional practice, in which enhancement of images is a preprocessing step.

Park, Han↗

NASA NTRS2007

Simple, Script-Based Science Processing Archive

The Simple, Scalable, Script-based Science Processing (S4P) Archive (S4PA) is a disk-based archival system for remote sensing data. It is based on the data-driven framework of S4P and is used for data transfer, data preprocessing, metadata generation, data archive, and data distribution. New data are automatically detected by the system. S4P provides services such as data access control, data subscription, metadata publication, data replication, and data recovery. It comprises scripts that control the data flow. The system detects the availability of data on an FTP (file transfer protocol) server, initiates data transfer, preprocesses data if necessary, and archives it on readily available disk drives with FTP and HTTP (Hypertext Transfer Protocol) access, allowing instantaneous data access. There are options for plug-ins for data preprocessing before storage. Publication of metadata to external applications such as the Earth Observing System Clearinghouse (ECHO) is also supported. S4PA includes a graphical user interface for monitoring the system operation and a tool for deploying the system. To ensure reliability, S4P continuously checks stored data for integrity, Further reliability is provided by tape backups of disks made once a disk partition is full and closed. The system is designed for low maintenance, requiring minimal operator oversight.

Lynnes, Christopher↗

NASA NTRS2021

Improving Automated Strategies for Univariate Quantifier Elimination

This report discusses improved support for univariate quantifier elimination in the Prototype Verification System (PVS). Previously, PVS had three strategies for quantifier elimination—hutch, tarski, and sturm. Of these, only hutch is able to decide queries in any input format—sturm only works on queries regarding a single polynomial on an interval and tarski resolves queries in the universal existential fragment. This paper describes an extended version of tarski. The extension is accomplished by formally verifying a disjunctive normal form transformation in PVS and using tarski on each conjunctive clause. Additionally, a preprocessing step is added to the decision procedure underlying tarski. This preprocessing is designed to exploit properties of polynomial structure to quickly resolve queries that have certain formats. The preprocessing produces dramatic speedup when it succeeds in resolving a query, and seems to introduce negligible overhead when it does not resolve a query. Finally, testing reveals some ways to improve the hutch and tarski strategies.

Polynomial Constraints↗

DOE OSTI2021

BETO 2021 Peer Review - Rational Design of Robust Reactor Feeding Systems for Heterogeneous Cellulosic and Agricultural Wastes Based on Biomass Quality Characteristics

Consistent and reliable preprocessing, conveyance, and reactor in-feed systems, particularly for low-cost waste feedstocks, remains a major technical challenge for the emerging Bioeconomy. By identifying critical biomass attributes and connecting them to flow and conversion behavior, science-driven system designs can address these often-overlooked solids handling challenges. The Wonderful Company (TWC) is the world's largest almond and pistachio grower, generating 250,000 dry tons/year of waste material including hulls, shells, and wood (>5 million tons/year industry wide in the U.S.). This project seeks to turn this environmental and economic liability into a sustainable and profitable resource, targeting conversion via gasification to syngas for electricity and bio-char, by addressing related material handling and feeding challenges. Based on optimized preprocessing strategies, bulk material flow, and thermal conversion properties, an overall system design will be developed. The methodology will be tested with FCIC's benchmark loblolly pine residues, to demonstrate the robustness of the overall approach and provide insight and guidance for future systems. The project will culminate in extended field trials to demonstrate an improved continuous feeding system with a commercial biomass-to-electricity gasifier vendor, and an economic analysis demonstrating a reduction in electricity production costs by maximizing on-stream time while minimizing preprocessing and CapEx costs.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2022

Understanding Biomass and Polymer Feedstock Variability Through Analytical Pyrolysis and Two Dimensional Gas Chromatography and Mass Spectrometry

Moving toward a circular carbon economy requires enabling reuse of carbon-based macromolecules like those in biomass and polymers. Meeting this goal requires increased upcycling of waste products into higher value products. For biomass waste such as corn stover, pine needles, or bark, one approach is using pyrolysis to convert these feedstocks into bio-oil that can be used for liquid fuel or transformed into other hydrocarbon based products, like bio-polymers. Waste plastics can be upcycled or recycled into new products, or alternatively converted into bio-oil by pyrolysis. Macromolecules from biomass and polymers are challenging to convert into liquid fuel or chemical feedstocks, due to large and sometimes heterogeneous networks of polymeric bonds. We work with the Idaho National Laboratory’s Biomass Feedstock National User Facility and Department of Energy’s Feedstock Conversion Interface Consortium to develop a molecular understanding of biomass variability that occurs naturally and as a result of storage or preprocessing techniques applied to feedstocks, to understand chemical reactions occurring during pyrolysis and other biomass or polymer conversion techniques. Using two dimensional gas chromatography mass spectrometry coupled to analytical pyrolysis provides insight into the molecular changes that occur during the pyrolysis event, and these insights can extend to bench or pilot scale pyrolysis conversions. Understanding pyrolysis of biomass and polymers at a molecular level contributes to development of new tools to predict and manipulate the optimum conditions and identify the best storage, preprocessing, and conversion techniques to maximize output of specific high-value chemical species in the conversion to fuels, or to characterize feedstocks for blending before pyrolysis. Identification and understanding of the molecular level changes resulting from novel preprocessing techniques that can be used to control and manipulate the chemical output of bench or pilot scale pyrolysis is another focus of investigation, including the use of gamma irradiation, acid, or enzyme pre-treatments. We also focus on the impacts of storage conditions and techniques, which can affect moisture levels, degradation, and impacts from naturally occurring microbes in the environment.

09 BIOMASS FUELS↗

DOE OSTI2020

Pilot plant reliability metrics for grinding and fast pyrolysis of woody residues

Here we report on the effects of loblolly pine residue variability on material throughput, pilot plant uptime, operator intervention, product yield, and product quality for grinding, fast pyrolysis, and hydrotreating operations. Preprocessing throughput using a hammer mill varied between 31-48% of nameplate capacity (5 tons/hr). Grinder overloads in the size reduction step were more prevalent for lower ash and higher moisture materials. Fast pyrolysis throughput varied between 57-72% of nameplate capacity (20 kg/hr) and bio-oil yields varied between 46-53% (feedstock carbon to oil, dry basis). During fast pyrolysis operations, downtime was caused by bridging in the feed and char removal systems and plugging in the condensation system. Cohesion of feedstock and char leading to system plugging was less frequent for higher ash feedstocks, and differences in condenser plugging behavior between high and low ash feedstocks were observed. The catalyst stability of the bio-oil stabilization step was strongly dependent on the sulfur content in the bio-oil, which was higher for the high-ash residue oils. Lower moisture content in the starting biomass was consistent with lower sulfur content in bio-oil. Yields and properties of hydrotreated fuel products showed minimal deference among the bio-oils.

Klinger, Jordan↗

DOE OSTI2023

Design of an Integrated Solids Handling System to Maximize Syngas Process Reliability (Cooperative Research and Development Final Report)

The National Renewable Energy Laboratory (NREL), in partnership with Wonderful Renewable Energy (WRE) and Idaho National Laboratory (INL), plans to develop a general methodology for designing integrated biorefinery solids preprocessing, handling, and feeding systems based on the chemical, physical, and mechanical attributes of the starting biomass material. This attribute-driven approach will include detailed feedstock property measurements, iterative computational modeling, and bench-scale testing to design systems for preprocessing, handling, and reactor in-feed, up to and including the selection of the conversion reactor. The initial tests and system design will be conducted using waste material from almond and pistachio growing and production operations (shells, hulls, and wood), targeting the conversion of this material to syngas for electricity production. The methodology will then be generalized to other feedstocks. The purpose of this project is to design an integrated solids handling system to maximize the process reliability of converting almond and pistachio waste to electricity. The design methodology and workflow developed from this example will then be applied to the Feedstock Conversion Interface Consortium (FCIC) benchmark loblolly pine residues, thus demonstrating the robustness of the overall design approach and providing insight and guidance for future conversion systems. V-Grid Energy Systems was brought on as a subcontractor to provide gasifiers and labor to complete gasifier runs.

09 BIOMASS FUELS↗