Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “preprocessed data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
NASA NTRS2006

Discerning Trends in Performance Across Multiple Events

Mass Data is a computer program that enables rapid, easy discernment of trends in performance data across multiple flights and ground tests. The program can perform Fourier analysis and other functions for the purposes of frequency analysis and trending of all variables. These functions facilitate identification of past use of diagnosed systems and of anomalies in such systems, and enable rapid assessment of related current problems. Many variables, for computation of which it is usually necessary to perform extensive manual manipulation of raw downlist data, are automatically computed and made available to all users, regularly eliminating the need for what would otherwise be an extensive amount of engineering analysis. Data from flight, ground test, and simulation are preprocessed and stored in one central location for instantaneous access and comparison for diagnostic and trending purposes. Rules are created so that an event log is created for every flight, making it easy to locate information on similar maneuvers across many flights. The same rules can be created for test sets and simulations, and are searchable, so that information on like events is easily accessible.

Slater, Simon↗
DOE OSTI2024

gcxgclab: Two Dimensional Gas Chromatography Preprocessing and Analysis

The goal of gcxgclab is to provide a comprehensive program for preprocessing and analysis of two dimensional gas chromatography data. It is equipped with functions for baseline correction, smoothing, peak identification, peak alignment, identification of EICs, Mass Spectra, targeted analysis, compound identification with NIST and non-targeted analysis, plus plotting and data visualization.

GAMBLE, STEPHANIE↗
DOE OSTI2025

PhotonIDs: ML-Powered Photon Identification System for Dark Count Elimination

Reliable single photon detection is the foundation for practical quantum communication and networking. However, today's superconducting nanowire single photon detector(SNSPD) inherently fails to distinguish between genuine photon events and dark counts, leading to degraded fidelity in long-distance quantum communication. In this work, we introduce PhotonIDs, a machine learning-powered photon identification system that is the first end-to-end solution for real-time discrimination between photons and dark count based on full SNSPD readout signal waveform analysis. PhotonIDs ~demonstrates: 1) an FPGA-based high-speed data acquisition platform that selectively captures the full waveform of signal only while filtering out the background data in real time; 2) an efficient signal preprocessing pipeline, and a novel pseudo-position metric that is derived from the physical temporal-spatial features of each detected event; 3) a hybrid machine learning model with near 98% accuracy achieved on photon/dark count classification. Additionally, proposed PhotonIDs ~ is evaluated on the dark count elimination performance with two real-world case studies: (1) 20 km quantum link, and (2) Erbium ion-based photon emission system. Our result demonstrates that PhotonIDs ~could improve more than 31.2 times of signal-noise-ratio~(SNR) on dark count elimination. PhotonIDs ~ marks a step forward in noise-resilient quantum communication infrastructure.

Linne, Karl C. [Chicago U.] (ORCID:000900091870358↗
NASA NTRS1975

ATS-6 - Preliminary results from the 13/18-GHz COMSAT Propagation Experiment

The 13/18-GHz COMSAT Propagation Experiment (CPE) is reviewed, the data acquisition and processing are discussed, and samples of preliminary results are presented. The need for measurements of both hydrometeor-induced attenuation statistics and diversity effectiveness is brought out. The facilitation of the experiment - CPE dual frequency and diversity site location, the CPE ground transmit terminals, the CPE transponder on Applications Technology Satellite-6 (ATS-6), and the CPE receive and data acquisition system - is briefly examined. The on-line preprocessing of the received signal is reviewed, followed by a discussion of the off-line processing of this database to remove signal fluctuations not due to hydrometeors. Finally, samples of the results of first-level analysis of the resultant data for the 18-GHz diversity site near Boston, Mass., and for the dual frequency 13/18-GHz site near Detroit, Mich., are presented and discussed.

Hyde, G.↗
NASA NTRS1973

A study of techniques for processing multispectral scanner data

A linear decision rule to reduce the time required for processing multispectral scanner data is developed. Test results are presented which justify the use of the new rule for digital processing whenever both accuracy and processing time are important. A method of evaluating the performance of the rule is also developed and applied to the problem of choosing a subset of channels. A technique used to find linear combinations of channels is described. The ability to extend signatures throughout a small area of approximately fifty square miles is tested. After preprocessing, signatures derived from the first of seven overlapping data sets are applied to all data sets. The test results show that the average probability of misclassification tends to increase with an increase in the number of data sets over which the signatures are extended.

Crane, R. B.↗
NASA NTRS1981

Software for universal noiseless coding

An overview is provided of the universal noiseless coding algorithms as well as their relationship to the now available FORTRAN implementations. It is suggested that readers considering investigating the utility of these algorithms for actual applications should consult both NASA's Computer Software Management and Information Center (COSMIC) and descriptions of coding techniques provided by Rice (1979). Examples of applying these techniques have also been given by Rice (1975, 1979, 1980). Attention is given to reversible preprocessing, general implementation instructions, naming conventions, and calling arguments. A general applicability of the considered algorithms to solving practical problems is obtained because most real data sources can be simply transformed into the required form by appropriate preprocessing.

Rice, R. F.↗
NASA NTRS1992

Laser ranging data analysis

Center for Space Research efforts have focused on the near real-time analysis of Lageos laser ranging data and on the production of predictive ephemerides. The data are analyzed in terms of range bias, time bias, and internal precision, and estimates for the Earth orientation parameters X(sub p), Y(sub p) and UT1 are obtained. The results of these analyses are reported in a variety of formats. In addition several additional stations began sending not only quick-look observations but also normal points created on-site with new software. These normal points are transmitted in a new standard format different from either current quick-look or MERIT-II full-rate formats. Thus new preprocessing software was written and successfully tested on these data. Inspection of the Bendix produced Lageos full-rate normal points continued, with detailed analyses and filtering of all 1991 A and B release normal points for Lageos through the beginning of 1992. A summary of the combined full-rate and quick-look normal point data set created for 1991 is provided. New long-term ephemerides for Lageos satellite, as well as for Etalon-1 and Etalon-2 (the so-called high satellites used for laser ranging) were produced and distributed to the network stations in cooperation with the Crustal Dynamics Project and Eurolas. These predictions are used by essentially every laser ranging site obtaining regular returns from any of these three satellites.

Source record↗
NASA NTRS2006

Estimating Total Electron Content Using 1,000+ GPS Receivers

A computer program uses data from more than 1,000 Global Positioning System (GPS) receivers in an Internet-accessible global network to generate daily estimates of the global distribution of vertical total electron content (VTEC) of the ionosphere. This program supersedes an older program capable of processing readings from only about 200 GPS receivers. This program downloads the data via the Internet, then processes the data in three stages. In the first stage, raw data from a global subnetwork of about 200 receivers are preprocessed, station by station, in a Kalman-filter-based least-squares estimation scheme that estimates satellite and receiver differential biases for these receivers and for satellites. In the second stage, an observation equation that incorporates the results from the first stage and the raw data from the remaining 800 receivers is solved to obtain the differential biases for these receivers. The only remaining error sources for which an account cannot be given are multipath and receiver noise contributions. The third stage is a postprocessing stage in which all the processed data are combined and used to generate new data products, including receiver differential biases and global and regional VTEC maps and animations.

Komjathy, Attila↗
DOE OSTI2021

Techno-Economic Analysis of decentralized preprocessing systems for fast pyrolysis biorefineries with blended feedstocks in the southeastern United States

This study evaluated the economic feasibility of fast pyrolysis biorefineries fed with blended pine residues and switchgrass in the Southeastern U.S. with different supply chain design. Previous techno-economic analyses (TEA) have focused on either blended biomass or decentralized preprocessing without investigating the impacts of varied process parameters, technology options, and real-world biomass distribution. This study fills the literature gap by modeling scenarios for different biomass blending ratios, biorefinery and preprocessing site (so-called depot) capacities, and alternative preprocessing technologies. High-resolution, real-world geospatial data were analyzed using Geographic Information Systems to facilitate supply chain design and TEA. For a decentralized system, the minimum fuel selling price (MFSP) of biofuel was 3.92–4.33 per gallon gasoline equivalent (GGE), while the MFSP for the centralized biorefinery at the same capacities ranged between 3.75–4.02/GGE. Implementing a high moisture pelleting process depot rather than a conventional pelleting process lowered the MFSP by 0.03–0.17/GGE. Scenario analysis indicated decreased MFSP with increasing biorefinery capacities but not necessarily with increasing depot size. Medium-size depots (500 OMDT/day) achieved the lowest MFSP. Here, this analysis identified the optimal blending ratios for two preprocessing technologies at varied depot sizes. Counterintuitively, increasing the proportion of higher cost switchgrass reduced the MFSP for large biorefineries (>5000 ODMT/day), but increased the MFSP for small biorefineries (1000–2500 ODMT/day). Although the decentralized systems have a higher MFSP based on current analysis, it has other potential benefits such as mitigated supply chain risks and improved feedstock quality that are difficult to be quantified in this TEA.

09 BIOMASS FUELS↗
DOE OSTI2023

Air Classification of Forest Residue for Tissue and Ash Separation Efficiency

The goal of this Case Study was to evaluate the performance of air classification of logging residues toward meeting conversion CMAs for carbon and ash contents, as compared to the static status quo Base Case system in which the residues are first dried and then ground in a hammer mill with a 6 mm screen and fines less than 1.18 mm are removed. Also considered were moisture and ash impacts on throughput and Overall Operating Effectiveness (OOE), as well as delivered feedstock cost and minimum fuel selling price (MFSP). Laboratory data on the impacts of fan speed and moisture content on the separation efficiency of soil ash, needles and bark from white wood were received from FCIC Subtask 5.2: Preprocessing, High Temperature Conversion Preprocessing (Jordan Klinger and Tiasha Bhattacharjee, INL). Average throughput and energy consumption data were obtained from the Bioenergy Feedstock National User Facility (BFNUF) (Neal Yancey, INL) for the same air classifier. These data were utilized to develop the necessary response surface equations to perform throughput analysis using discrete event simulation. Feedstock-Conversion Interface Consortium. Because the Base Case status quo system utilizes drying prior to grinding, we modeled the Case Study with drying prior to air classification and subsequent grinding of the separated white wood to isolate the individual quality and cost impacts of air classification relative to the Base Case system.

CMA↗
DOE OSTI2024

RAP: Resource-aware Automated GPU Sharing for Multi-GPU Recommendation Model Training and Input Preprocessing

Ensuring high-quality recommendations for newly onboarded users requires the continuous retraining of Deep Learning Recommendation Models (DLRMs) with freshly generated data. To serve the online DLRM retraining, existing solutions use hundreds of CPU computing nodes designated for input preprocessing, causing significant power consumption that surpasses even the power usage of GPU trainers. To this end, we propose RAP, an end-to-end DLRM training framework that supports Resource-aware Automated GPU sharing for DLRM input Preprocessing and Training. The core idea of RAP is to accurately capture the remaining GPU computing resources during DLRM training for input preprocessing, achieving superior training efficiency without requiring additional resources. Specifically, RAP utilizes a co-running cost model to efficiently assess the costs of various input preprocessing operations, and it implements a resource-aware horizontal fusion technique that adaptively merges smaller kernels according to GPU availability, circumventing any interference with DLRM training. In addition, RAP leverages a heuristic searching algorithm that jointly optimizes both the input preprocessing graph mapping and the co-running schedule to maximize the end-to-end DLRM training throughput. The comprehensive evaluation shows that RAP achieves 78.3× speedup on average over CPU-based DLRM input preprocessing frameworks. In addition, the end-to-end training throughput of RAP is only 2.04% lower than the ideal case, which has no input preprocessing overhead.

Wang, Zheng↗
DOE OSTI2023

GMT: A deep learning approach to generalized multivariate translation for scientific data analysis and visualization

In scientific visualization, despite the significant advances of deep learning for data generation, researchers have not thoroughly investigated the issue of data translation. We present a new deep learning approach called generalized multivariate translation (GMT) for multivariate time-varying data analysis and visualization. Like V2V, GMT assumes a preprocessing step that selects suitable variables for translation. However, unlike V2V, which only handles one-to-one variable translation during training and inference, GMT enables one-to-many and many-to-many variable translation in the same framework. We leverage the recent StarGAN design from multi-domain image-to-image translation to achieve this generalization capability. We experiment with different loss functions and injection strategies to explore the best choices and leverage pre-training for performance improvement. We compare GMT with other state-of-the-art methods (i.e., Pix2Pix, V2V, StarGAN). Furthermore, the results demonstrate the overall advantage of GMT in translation quality and generalization ability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Integrating Analytical Solutions and U-Net Model for Predicting Groundwater Contaminant Plumes in Pump-and-Treat Systems

Pump-and-treat (P&T) is a common technique for groundwater remediation involving the extraction and treatment of contaminated water above ground. Optimizing the design and operation of the P&T well network is essential for maximizing the system’s effectiveness and efficiency. However, this optimization often necessitates many model evaluations, leading to computationally demanding tasks. This study introduces a novel approach that integrates analytical solutions for groundwater dynamics with the U-Net (Ronneberger et al., 2015) deep learning framework to predict groundwater contaminant plume migration under dynamic pumping conditions. By incorporating the Thiem equation (Thiem, 1906) into the input preprocessing, the U-Net model transforms sparse well data into a continuous spatial field that captures the hydraulic impacts of pumping activities. This integration enables the model to leverage both deep learning capabilities and classical physics-based groundwater theories, enhancing prediction accuracy and computational efficiency. These advancements can facilitate rapid, large-scale evaluations of P&T optimization simulations, allowing for timely and effective decision-making in well placement and system management. We demonstrate the model's robust performance across both simplified transient 2D models and a more complex 3D heterogeneous site model at the 200 West P&T facility at the Hanford Site. The U-Net-based model offers substantial computational advantages, reducing simulation times significantly compared to full physics-based models and providing a powerful tool for rapid site evaluation and P&T system optimization, such as evaluating alternative P&T well network designs. Our findings highlight the potential of advanced machine learning models to significantly enhance the efficiency and sustainability of groundwater remediation efforts, offering a novel application of U-Net architecture in environmental science.

Pump-and-treat↗
NASA NTRS1981

Thermal mapping, geothermal source location, natural effluents and plant stress in the Mediterranean coast of Spain

Data obtained by HCMM satellite over a complex area in eastern Spain were evaluated and found to be most useful in studying macrostructures in geology and in analyzing marine currents, layers, and areas (although other satellites provide more data). The upper scale to work with HCMM data appears to be 1:2.000.000. Techniques used in preprocessing, processing, and analyzing imagery are discussed as well as methods for pattern recognition. Surface temperatures obtained for soils, farmlands, forests, geological structures, and coastal waters are discussed. Suggestions are included for improvements needed to achieve better results in geographic areas similar to the study area.

Delascuevas, R. N.↗
NASA NTRS1982

Accomplishments of the NASA Johnson Space Center portion of the soil moisture project in fiscal year 1981

The NASA/JSC ground scatterometer system was used in a row structure and row direction effects experiment to understand these effects on radar remote sensing of soil moisture. Also, a modification of the scatterometer system was begun and is continuing, to allow cross-polarization experiments to be conducted in fiscal years 1982 and 1983. Preprocessing of the 1978 agricultural soil moisture experiment (ASME) data was completed. Preparations for analysis of the ASME data is fiscal year 1982 were completed. A radar image simulation procedure developed by the University of Kansas is being improved. Profile soil moisture model outputs were compared quantitatively for the same soil and climate conditions. A new model was developed and tested to predict the soil moisture characteristic (water tension versus volumetric soil moisture content) from particle-size distribution and bulk density data. Relationships between surface-zone soil moisture, surface flux, and subsurface moisture conditions are being studied as well as the ways in which measured soil moisture (as obtained from remote sensing) can be used for agricultural applications.

Paris, J. F.↗
NASA NTRS1988

Digital and optical shape representation and pattern recognition; Proceedings of the Meeting, Orlando, FL, Apr. 4-6, 1988

The present conference discusses topics in pattern-recognition correlator architectures, digital stereo systems, geometric image transformations and their applications, topics in pattern recognition, filter algorithms, object detection and classification, shape representation techniques, and model-based object recognition methods. Attention is given to edge-enhancement preprocessing using liquid crystal TVs, massively-parallel optical data base management, three-dimensional sensing with polar exponential sensor arrays, the optical processing of imaging spectrometer data, hybrid associative memories and metric data models, the representation of shape primitives in neural networks, and the Monte Carlo estimation of moment invariants for pattern recognition.

Juday, Richard D.↗
NASA NTRS2000

Information Theoretic Extraction of EEG Features for Monitoring Subject Attention

The goal of this project was to test the applicability of information theoretic learning (feasibility study) to develop new brain computer interfaces (BCI). The difficulty to BCI comes from several aspects: (1) the effective data collection of signals related to cognition; (2) the preprocessing of these signals to extract the relevant information; (3) the pattern recognition methodology to detect reliably the signals related to cognitive states. We only addressed the two last aspects in this research. We started by evaluating an information theoretic measure of distance (Bhattacharyya distance) for BCI performance with good predictive results. We also compared several features to detect the presence of event related desynchronization (ERD) and synchronization (ERS), and concluded that at least for now the bandpass filtering is the best compromise between simplicity and performance. Finally, we implemented several classifiers for temporal - pattern recognition. We found out that the performance of temporal classifiers is superior to static classifiers but not by much. We conclude by stating that the future of BCI should be found in alternate approaches to sense, collect and process the signals created by populations of neurons. Towards this goal, cross-disciplinary teams of neuroscientists and engineers should be funded to approach BCIs from a much more principled view point.

Principe, Jose C.↗
NASA NTRS2012

Linguistic Preprocessing and Tagging for Problem Report Trend Analysis

Mr. Robert Beil, Systems Engineer at Kennedy Space Center (KSC), requested the NASA Engineering and Safety Center (NESC) develop a prototype tool suite that combines complementary software technology used at Johnson Space Center (JSC) and KSC for problem report preprocessing and semantic tag extraction, to improve input to data mining and trend analysis. This document contains the outcome of the assessment and the Findings, Observations and NESC Recommendations.

Beil, Robert J.↗