Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Preprocessing Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Creating a Training Dataset for Semantic Segmentation of Canal Networks for Irrigation Modernization

Canal infrastructure has provided critical irrigation water to the western United States for over a century. To continue providing vital water resources to the semi-arid West, irrigation systems must undergo maintenance and modernization. Many canal companies are resource-constrained, and because funding opportunities often require detailed knowledge of existing infrastructure, they can struggle to secure financial capital. We address this problem by creating training data for a semantic segmentation deep learning model to map canal networks throughout the western United States. To create a diverse and robust training dataset, we labelled 1-m NAIP imagery with the locations of no canals, wet canals, and dry/vegetated canals. Since creating these datasets is time consuming, we first developed a preprocessing methodology to identify canals within our four study areas. We used NAIP imagery and provided canal centerline data to buffer, standardize, and cluster the imagery, automating the labeling process as much as possible. However, this still required manual cleaning and manual classification of canal type. Challenges arose when canals were interrupted (e.g., road culverts or piped sections) or when nearby features shared similar characteristics (e.g., irrigated fields, trees, and shadows). Combining automated preprocessing with manual refinement produced four detailed canal masks to be used in the semantic segmentation model developed by Richard Tapia.

13 - HYDRO ENERGY↗

Scalable Multi-Facility Workflows for Artificial Intelligence Applications in Climate Research

Earth observation satellites and earth system models are sources of vast, multi-modal datasets that are invaluable for advancing climate and environmental research. However, their scale and complexity pose significant challenges for processing and analysis. In this paper we discuss our experiences in developing and using a scientific research application using an automated multi-facility workflow that orchestrates data collection, preprocessing, artificial intelligence (AI) inferencing, and data movement across diverse computational resources, leveraging the Advanced Computing Ecosystem Testbed at the Oak Ridge Leadership Computing Facility (OLCF). We demonstrate that our workflow can be seamlessly integrated and orchestrated across research facilities managed by different federal agencies, thus allowing users to extract new scientific insights from climate datasets. The experimental results indicate that the multi-facility workflow significantly reduces processing time, enhances scalability, and maintains high efficiency across varying workloads. Notably, our workflow processes 12,000 high-resolution satellite images in just 44 seconds using 80 workers distributed across 10 nodes on the OLCF systems. Such high throughput is essential for dynamic tokenization and sharding of petascale satellite data for distributed AI model training and inferencing at scale across thousands of GPUs.

Kurihana, Takuya [ORNL] (ORCID:0000000156698565)↗

Web-based Preprocessing and Visualization of 3D FIB Tomography Data for Nuclear Fuel Characterization

Three-dimensional (3D) focused ion beam (FIB) tomography enables reconstruction of internal nuclear fuel features that can't be fully evaluated through surface imaging alone. This capability supports characterization of fuel constituents and defects under thermal and irradiation conditions relevant to microreactor development. However, large tomography datasets can create data-handling, loading, and visualization challenges, especially when image-stack preparation and file conversion must be completed with separate tools. The Computational Ultraspatial Tomography Toolkit for High-Resolution Object Analysis Tools (CUTTRHOAT) is an open-source web application being developed to display FIB tomography datasets available through the Nuclear Research Data System (NRDS). The current alpha version requires prepared HDF5 datasets and has limited integrated data-preparation capabilities. This project improves CUTTHROAT by adding dataset-folder selection, automatic input detection, dataset scanning, missing-slice identification, blank-slice insertion, and image-stack-to-HDF5 conversion. Two applications will be compared: the baseline CUTTHROAT alpha workflow and the updated application containing the integrated data-handling and preprocessing functions. Evaluation will consider dataset detection accuracy, conversion success, loading time, rendering responsiveness, application stability, and user interaction. Preliminary results demonstrate successful loading of existing HDF5 files and converted image stacks, while testing also identified performance reductions caused by excessive blank-slice generation. The updated workflow reduces reliance on external preparation tools and supports more direct movement from image stacks to color-code 3D visualization. Future work includes refining missing-slice handling, integrating additional preprocessing functions, like a denoising feature, parsing TIFF metadata for automatic voxel scaling, and adding manual X, Y, and Z voxel-spacing inputs for PNG and JPEG.

36 - MATERIALS SCIENCE↗

The PDS-VAX intelligent plate scanning system of Trieste Astronomical Observatory

An intelligent subsystem for interfacing a PDS1010A digital microdensitometer to a DEC DR11W DMA 16 bit UNIBUS port in DEC VAX VMS environment was tested. The subsystem employs two MOTOROLA M68000 microprocessors with 128 KB data memory. The PDS primitives and the user defined high level scanning functions and preprocessing modules are loaded from the host computer into two 8 KB RAM memories in the microprocessors using a dedicated PDS control language. The subsystem is planned to employ a nonstandard photomultiplier electronics. Two design schemes were tested: (1) based on three amplifiers of gain 10 cascaded and multiplexed to a 12 bit AD converter, and (2) based on a single amplifier of gain 100 and two 14 bit AD converters.

Pucillo, M.↗

A 640-MHz 32-megachannel real-time polyphase-FFT spectrum analyzer

A polyphase fast Fourier transform (FFT) spectrum analyzer being designed for NASA's Search for Extraterrestrial Intelligence (SETI) Sky Survey at the Jet Propulsion Laboratory is described. By replacing the time domain multiplicative window preprocessing with polyphase filter processing, much of the processing loss of windowed FFTs can be eliminated. Polyphase coefficient memory costs are minimized by effective use of run length compression. Finite word length effects are analyzed, producing a balanced system with 8 bit inputs, 16 bit fixed point polyphase arithmetic, and 24 bit fixed point FFT arithmetic. Fixed point renormalization midway through the computation is seen to be naturally accommodated by the matrix FFT algorithm proposed. Simulation results validate the finite word length arithmetic analysis and the renormalization technique.

Zimmerman, G. A.↗

Explainable tokamak-agnostic forecasting of fusion plasma instability via megahertz turbulent fluctuations

Scientific applications of artificial intelligence (AI) often remain limited by device-specific training and unexplained “black-box” approaches, creating fundamental barriers to cross-system generalization. This challenge is critical for nuclear fusion, where future reactors will have limited operational data for AI training. Here, we demonstrate that our neural network, trained solely on megahertz-scale turbulence measurements from one machine (DIII-D), forecasts Type-I edge localized mode (ELM) onsets in a different tokamak (KSTAR) through zero-shot weight transfer following physics-consistent preprocessing without device-specific retraining. Through an explainable AI framework combining gradient-weighted class activation mapping with physics validation, we reveal that our network can internalize physics relationships governing the ELM instabilities rather than memorizing device-specific patterns. The network perceives spatiotemporal features that correlate consistently with independently calculated instability growth rates, magnetohydrodynamic stability limits, and pedestal structure dynamics. Statistical analyses of dimensionally-reduced saliency features reveal the identical triangular features between the saliency representations, instability growth rates, and prediction probability across tokamaks, providing evidence that our forecasting system can show tokamak-agnostic generalization. This work contributes to a foundation for explainable scientific AI systems, where cross-system developments are essential for transcending traditional domain-specific constraints.

AI↗

Pilot plant reliability metrics for grinding and fast pyrolysis of woody residues

Here we report on the effects of loblolly pine residue variability on material throughput, pilot plant uptime, operator intervention, product yield, and product quality for grinding, fast pyrolysis, and hydrotreating operations. Preprocessing throughput using a hammer mill varied between 31-48% of nameplate capacity (5 tons/hr). Grinder overloads in the size reduction step were more prevalent for lower ash and higher moisture materials. Fast pyrolysis throughput varied between 57-72% of nameplate capacity (20 kg/hr) and bio-oil yields varied between 46-53% (feedstock carbon to oil, dry basis). During fast pyrolysis operations, downtime was caused by bridging in the feed and char removal systems and plugging in the condensation system. Cohesion of feedstock and char leading to system plugging was less frequent for higher ash feedstocks, and differences in condenser plugging behavior between high and low ash feedstocks were observed. The catalyst stability of the bio-oil stabilization step was strongly dependent on the sulfur content in the bio-oil, which was higher for the high-ash residue oils. Lower moisture content in the starting biomass was consistent with lower sulfur content in bio-oil. Yields and properties of hydrotreated fuel products showed minimal deference among the bio-oils.

Klinger, Jordan↗

Improving Automated Strategies for Univariate Quantifier Elimination

This report discusses improved support for univariate quantifier elimination in the Prototype Verification System (PVS). Previously, PVS had three strategies for quantifier elimination—hutch, tarski, and sturm. Of these, only hutch is able to decide queries in any input format—sturm only works on queries regarding a single polynomial on an interval and tarski resolves queries in the universal existential fragment. This paper describes an extended version of tarski. The extension is accomplished by formally verifying a disjunctive normal form transformation in PVS and using tarski on each conjunctive clause. Additionally, a preprocessing step is added to the decision procedure underlying tarski. This preprocessing is designed to exploit properties of polynomial structure to quickly resolve queries that have certain formats. The preprocessing produces dramatic speedup when it succeeds in resolving a query, and seems to introduce negligible overhead when it does not resolve a query. Finally, testing reveals some ways to improve the hutch and tarski strategies.

Polynomial Constraints↗

Applications of TRMM-based Multi-Satellite Precipitation Estimation for Global Runoff Simulation: Prototyping a Global Flood Monitoring System

Advances in flood monitoring/forecasting have been constrained by the difficulty in estimating rainfall continuously over space (catchment-, national-, continental-, or even global-scale areas) and flood-relevant time scale. With the recent availability of satellite rainfall estimates at fine time and space resolution, this paper describes a prototype research framework for global flood monitoring by combining real-time satellite observations with a database of global terrestrial characteristics through a hydrologically relevant modeling scheme. Four major components included in the framework are (1) real-time precipitation input from NASA TRMM-based Multi-satellite Precipitation Analysis (TMPA); (2) a central geospatial database to preprocess the land surface characteristics: water divides, slopes, soils, land use, flow directions, flow accumulation, drainage network etc.; (3) a modified distributed hydrological model to convert rainfall to runoff and route the flow through the stream network in order to predict the timing and severity of the flood wave, and (4) an open-access web interface to quickly disseminate flood alerts for potential decision-making. Retrospective simulations for 1998-2006 demonstrate that the Global Flood Monitor (GFM) system performs consistently at both station and catchment levels. The GFM website (experimental version) has been running at near real-time in an effort to offer a cost-effective solution to the ultimate challenge of building natural disaster early warning systems for the data-sparse regions of the world. The interactive GFM website shows close-up maps of the flood risks overlaid on topography/population or integrated with the Google-Earth visualization tool. One additional capability, which extends forecast lead-time by assimilating QPF into the GFM, also will be implemented in the future.

Hong, Yang↗

Mass Spectrometer Transient Analysis

This software implements a complete preprocessing pipeline for transient mass spectrometry (MS) data collected during TAP (Temporal Analysis of Products) experiments. It is designed to extract chemically meaningful fluxes from overlapping ion signals by applying a calibrated defragmentation matrix and solving the resulting linear system using non-negative least squares (NNLS) regression. The core script, preprocess_mass_spec.py, performs the following operations: Gain correction: Applies amplifier gain scalars derived from inert-packed calibration pulses to normalize signal intensities across AMUs and acquisition settings. Background subtraction: Removes experiment baselines using user-defined time windows, ensuring compatibility with slow-diffusing species and preventing negative values that would interfere with NNLS. Options to subtract before and after defragmentation. Defragmentation: Constructs a fragmentation matrix A from zeroth moments of calibration pulses (equal molar gas:inert mixtures) and solves Ax=b at each time point, where b is the raw MS signal and x is the estimated species flux. The matrix is normalized to inert signals and accounts for instrument-specific fragmentation behavior. Pulse-mode handling: Supports both averaged and individual pulse modes, enabling statistical treatment of fluxes and calculation of standard deviations. Integration and output: Computes zeroth moments (integrated fluxes) and exports time-resolved and integrated data in CSV format, suitable for downstream kinetic modeling. The software is validated using both virtual TAP simulations (VTAP) and experimental data from propane dehydrogenation (PDH) on CrOx/Al2O3 catalysts. It preserves temporal resolution by applying NNLS point-by-point across the pulse duration (typically 6,000+ time slices per pulse), leveraging the linear superposition principle to reconstruct full flux profiles. The defragmented outputs are compatible with kinetic extraction methods such as the G and Y procedures, which are used to derive rate–concentration relationships from TAP data. The details of these validations are discussed in detail in the supporting manuscript and supporting information. Example data and output files are also included. The methodology is robust to experimental noise and drift, with calibration protocols that account for pulse size effects, MS aging, and inert gas normalization. The software is modular, reproducible, and tailored for high-throughput TAP-MS workflows in catalysis research.

Kristy, Stephen [Idaho National Laboratory (INL), ↗

Machine processing of remotely acquired data

The two major branches of remote sensing are based on image orientation and numerical orientation. Numerically oriented systems tend to involve computers for data analysis. In designing an information-gathering system, the sensor as well as the means of analysis must be well mated to the type of system orientation. Attention is given to sensor types as related to system types, the multispectral approach and pattern recognition, the multispectral scanner as data source, an illustrative example, procedural details in the use of pattern recognition, the speed and cost of data processing, the use of spatial information, and data preprocessing steps.

Landgrebe, D. A.↗

An interactive preprocessor for the NASA engine performance program

The Simplified NEPP Automated Preprocessor (SNAP), which is written to aid in the preparation of input data files for the NASA Engine Performance Program (NEPP), is described. Specifically, SNAP is a software package on the Virtual Machine operating system that prompts the NEPP user for input information via a series of menus. The data collected from these menus are assimilated into an input file suitable for the running of NEPP. SNAP acts as a user-friendly preprocessing interface for NEPP. This serves as an introduction to the SNAP software, a user's manual, a description of the program logic, and a maintenance manual for future modifications to the software.

Berton, Jeffrey J.↗

Origin of Outer Solar System

We feel that at the present moment the available theoretical models of the Kuiper belt are still in advance of the data, and thus our main task has been to conduct observational work guided by theoretical motivations. Our efforts over the past year can be divided into four categories: A) Wide-field Searches for Kuiper Belt Objects; B) Pencil-beam Searches for Kuiper Belt Objects; C) Wide-field Searches for Moons of the Outer Planets; D) Pencil-beam Searches for Faint Uranian and Neptunian Moons; E) Recovery Observations. As of April 2002, we have conducted several searches for Kuiper belt objects using large-format mosaic CCD camera on 4-meter class telescopes. In May 1999, we used the Kitt Peak 4-meter with the NOAO Mosaic camera we attempted a search for KBOs at a range of ecliptic latitudes. In addition to our wide-field searches, we have conducted three 'pencil-beam' searches in the past year. In a pencil-beam search we take repeated integrations of the same field throughout a night. After preprocessing the resulting images we shift and recombine them along a range of rates and directions consistent with the motion of KBOs. Stationary objects then smear out, while objects moving at near the shift rate appear as point sources. In addition to our searches for Kuiper belt objects, we are completing the inventory of the outer solar system by search for faint satellites of the outer planets. In August 2001 we conducted pencil beam searches for faint Uranian and Neptunian satellites at CFHT and CTIO. These searches resulted in the discover of two Neptunian and four Uranian satellite candidates. The discovery of Kuiper belt objects and outer planet satellites is of little use if the discoveries are not followed by systematic, repeated astrometric observations that permit reliable estimates of their orbits.

Holman, Matthew J.↗

Forest Resource Information System. Phase 3: System transfer report

Transfer of the forest reserve information system (FRIS) from the Laboratory for Applications of Remote Sensing to St. Regis Paper Company is described. Modifications required for the transfer of the LARYS image processing software are discussed. The reformatting, geometric correction, image registration, and documentation performed for preprocessing transfer are described. Data turnaround was improved and geometrically corrected and ground-registered CCT LANDSAT 3 data provided to the user. The technology transfer activities are summarized. An application test performed in order to assess a Florida land acquisition is described. A benefit/cost analysis of FRIS is presented.

Mroczynski, R. P.↗

Next Generation Logistics Systems for Delivering Optimal Biomass Feedstocks to Biorefining Industries in the Southeastern U.S.

The diverse portfolio of biomass sources that is available in the Southeastern U.S., including a significant supply of pine “residue”, represents a valuable strategic position for the region. Through blends formulated based on critical properties, this project will take full advantage of the range in biomass properties afforded by the portfolio to produce a consistent, high-performance feedstock for the industry, while lowering cost. Key developments being targeted to enable this potential include whole-tree transport to a state-of-the-art merchandising depot that will further access biomass from ongoing, forest industry operations. The approach will more effectively utilize the tree and distribute cost, while minimizing in-woods contamination of the woody biomass component. To implement this vision, information on the chemical composition and changes that are induced during multiple preprocessing steps (size reduction, moisture removal, densification, etc.) is needed. New NIR sensor technology will be developed for online monitoring of important biomass properties. The data will be incorporated into a statistical process control platform to improve process efficiency and meet required specifications. Advanced process models are being developed to inform the techno-economic and life-cycle assessment of the program’s impact. The new system will ultimately reduce operational risks from supply chain disruptions, and allow operation of larger-scale biorefineries.

09 BIOMASS FUELS↗

Improved Advanced Biomass Logistics Utilizing Woody and other Feedstocks in the Northeast and Pacific Northwest (Final Report)

Willow and poplar short rotation woody crops (SRWC) have shown promise with regards to environmental benefits and rural development but wide adoption lags due to underdeveloped markets and supply systems. High costs associated with harvesting, handling and transportation (40-60% of delivered cost) have impeded expansion. A better understanding of these systems will create opportunities to improve efficiency, reduce costs, and realize environmental benefits and impacts. The project’s goal was to lower the delivered cost of hybrid poplar in the Northwest and willow in the Northeast by optimizing harvesting and logistics supply systems while maintaining or improving biomass quality along the supply chain. Over 3,400 Mg of biomass and 300 ha of willow and poplar were monitored over a range of crop and field conditions. Feedstock quality as affected by storage and preprocessing were shown to improve or maintain feedstock quality. Modeled harvesting costs ranged from $38–61 Mg -1 dry; when including delivery and preprocessing feedstock costs ranged between $79-83 Mg -1 dry for willow and $106-116 Mg -1 dry for poplar. Costs for willow minimized when hot water extraction and high-moisture densification preprocessing were used. Models also suggest that social and regional factors could further reduce costs. Results will give guidance to feedstock growers, harvesting and logistic operations, biorefinery project developers, and policy makers developing SRWC to support a growing bioeconomy.

, biomass↗

Annual Symposium on Machine Processing of Remotely Sensed Data, 4th, Purdue University, West Lafayette, Ind., June 21-23, 1977, Proceedings

Papers are presented on a variety of techniques for the machine processing of remotely sensed data. Consideration is given to preprocessing methods such as the correction of Landsat data for the effects of haze, sun angle, and reflectance and to the maximum likelihood estimation of signature transformation algorithm. Several applications of machine processing to agriculture are identified. Various types of processing systems are discussed such as ground-data processing/support systems for sensor systems and the transfer of remotely sensed data to operational systems. The application of machine processing to hydrology, geology, and land-use mapping is outlined. Data analysis is considered with reference to several types of classification methods and systems.

Morrison, D. B.↗

Computer vision techniques for rotorcraft low altitude flight

Rotorcraft operating in high-threat environments fly close to the earth's surface to utilize surrounding terrain, vegetation, or manmade objects to minimize the risk of being detected by an enemy. Increasing levels of concealment are achieved by adopting different tactics during low-altitude flight. Rotorcraft employ three tactics during low-altitude flight: low-level, contour, and nap-of-the-earth (NOE). The key feature distinguishing the NOE mode from the other two modes is that the whole rotorcraft, including the main rotor, is below tree-top whenever possible. This leads to the use of lateral maneuvers for avoiding obstacles, which in fact constitutes the means for concealment. The piloting of the rotorcraft is at best a very demanding task and the pilot will need help from onboard automation tools in order to devote more time to mission-related activities. The development of an automation tool which has the potential to detect obstacles in the rotorcraft flight path, warn the crew, and interact with the guidance system to avoid detected obstacles, presents challenging problems. Research is described which applies techniques from computer vision to automation of rotorcraft navigtion. The effort emphasizes the development of a methodology for detecting the ranges to obstacles in the region of interest based on the maximum utilization of passive sensors. The range map derived from the obstacle-detection approach can be used as obstacle data for the obstacle avoidance in an automatic guidance system and as advisory display to the pilot. The lack of suitable flight imagery data presents a problem in the verification of concepts for obstacle detection. This problem is being addressed by the development of an adequate flight database and by preprocessing of currently available flight imagery. The presentation concludes with some comments on future work and how research in this area relates to the guidance of other autonomous vehicles.

Sridhar, Banavar↗