Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Intelligent Experiments through Real-Time AI: Fast Data Processing and Autonomous Detector Control for High-Energy Nuclear Experiments

The aim of this project is to develop software and hardware for fast real-time data processing and autonomous detector control and calibration for the sPHENIX and the future EIC experiments. Below summarizes Georgia Tech team efforts in the past year: 1. We developed a real-time clustering algorithm and FPGA-based pipeline architecture for processing fired pixel data from ALPIDE sensors in sPHENIX experiments. Our Columnar Clustering Co-Design introduces a hardware-aware, stream-friendly approach that segments pixel data by column pairs using a Column Pair Clustering (CPC) strategy, followed by Cluster Stitching to merge adjacent subclusters. Implemented in Vitis HLS, the pipeline comprises five stages—read-in, subclustering, stitching, analysis, and write-out—connected by tagged HLS streams with custom end-of-event signaling for robust synchronization. We designed a pipelined dataflow model optimized for throughput, low latency, and minimal buffering, enabling scalable clustering across events of arbitrary size. Our system maintains spatial precision via center-of-mass and shape key extraction and efficiently handles edge cases such as fragmented or nested clusters. Compared against DBSCAN in both software and hardware, our approach demonstrates competitive performance under FPGA constraints. 2. We also conducted a comprehensive algorithm-to-hardware co-design of connected component analysis tailored for sPHENIX experiments, focusing on real-time, low-latency processing using FPGAs and High-Level Synthesis (HLS). Starting from a Python-based particle tracking pipeline, the team translated the core logic—graph traversal via DFS and Union-Find—into an HLS-compatible C++ model, replacing dynamic memory and recursion with static arrays and pipelined control flow. The final design includes a fully streamed and dataflow-compatible Union-Find kernel optimized across five iterations, incorporating loop pipelining, array partitioning, AXI/FIFO interface tuning, and function flattening. Experimental results show up to 14.8× speedup over the CPU baseline, reducing per-graph latency to 1.58 μs and demonstrating strong resource efficiency with only ~7k LUTs and zero BRAM usage. The design maintains functional correctness against the Python reference using a Python-based C-simulation framework and Mean Squared Error metrics. This work validates the potential of HLS-driven FPGA designs for edge-level HEP data acquisition, laying a scalable foundation for future integration with real-time detector pipelines and multi-graph processing systems.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2003

First Year Wilkinson Microwave Anisotropy Probe(WMAP) Observations: Data Processing Methods and Systematic Errors Limits

We describe the calibration and data processing methods used to generate full-sky maps of the cosmic microwave background (CMB) from the first year of Wilkinson Microwave Anisotropy Probe (WMAP) observations. Detailed limits on residual systematic errors are assigned based largely on analyses of the flight data supplemented, where necessary, with results from ground tests. The data are calibrated in flight using the dipole modulation of the CMB due to the observatory's motion around the Sun. This constitutes a full-beam calibration source. An iterative algorithm simultaneously fits the time-ordered data to obtain calibration parameters and pixelized sky map temperatures. The noise properties are determined by analyzing the time-ordered data with this sky signal estimate subtracted. Based on this, we apply a pre-whitening filter to the time-ordered data to remove a low level of l/f noise. We infer and correct for a small (approx. 1 %) transmission imbalance between the two sky inputs to each differential radiometer, and we subtract a small sidelobe correction from the 23 GHz (K band) map prior to further analysis. No other systematic error corrections are applied to the data. Calibration and baseline artifacts, including the response to environmental perturbations, are negligible. Systematic uncertainties are comparable to statistical uncertainties in the characterization of the beam response. Both are accounted for in the covariance matrix of the window function and are propagated to uncertainties in the final power spectrum. We characterize the combined upper limits to residual systematic uncertainties through the pixel covariance matrix.

Hinshaw, G.↗
NASA NTRS1995

Data processing of solar EUV instruments on the METEOR satellite

The Multiple Experiment Transporter into Earth Orbit and Return-Solar EUV Experiment (METEOR-SEE) project will take daily extreme ultraviolet (EUV) irradiance spectra starting in the summer of 1995. The METEOR-SEE package consists of an EUV grating spectrograph (EGS) and a cluster of 5 soft x-ray photometers (XP's). Both these instruments have flown previously on NASA sounding rockets. Because of the scope of the project, new data processing algorithms had to be developed for the SEE instruments onboard the METEOR satellite. An overview of the data flow describes how satellite data are collected and processed. Detailed descriptions of specific routines will show what data processing entails.

Brown, Hipook↗
NASA NTRS1969

Computer program developed for flowsheet calculations and process data reduction

Computer program PACER-65, is used for flowsheet calculations and easily adapted to process data reduction. Each unit, vessel, meter, and processing operation in the overall flowsheet is represented by a separate subroutine, which the program calls in the order required to complete an overall flowsheet calculation.

Alfredson, P. G.↗
DOE OSTI2021

Systems and methods for real-time data processing and for emergency planning

Systems and methods are described herein for real-time data processing and for emergency planning. Scenario test data may be collected in real-time based on monitoring local or regional data to ascertain any anomaly phenomenon that may indicate an imminent danger or of concern. A computer-implemented method may include filtering a plurality of different test scenarios to identify a sub-set of test scenarios from the plurality of different test scenarios that may have similar behavior characteristics. A sub-set of test scenarios is provided to a trained neural network to identify one or more sub-set of test scenarios. The one or more identified sub-set of test scenarios may correspond to one or more anomaly test scenarios from the sub-set of test scenarios that is most likely to lead to an undesirable outcome. The neural network may be one of: a conventional neural network and a modular neural network.

Yilmaz, Alper↗
DOE OSTI2023

Systems and methods for real-time data processing and for emergency planning

Systems and methods are described herein for real-time data processing and for emergency planning. Scenario test data may be collected in real-time based on monitoring local or regional data to ascertain any anomaly phenomenon that may indicate an imminent danger or of concern. A computer-implemented method may include filtering a plurality of different test scenarios to identify a sub-set of test scenarios from the plurality of different test scenarios that may have similar behavior characteristics. A sub-set of test scenarios is provided to a trained neural network to identify one or more sub-set of test scenarios. The one or more identified sub-set of test scenarios may correspond to one or more anomaly test scenarios from the sub-set of test scenarios that is most likely to lead to an undesirable outcome. The neural network may be one of: a conventional neural network and a modular neural network.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Planck 2018 results: III. High frequency instrument data processing and frequency maps

This paper presents the High Frequency Instrument (HFI) data processing procedures for the Planck 2018 release. Major improvements in mapmaking have been achieved since the previous Planck 2015 release, many of which were used and described already in an intermediate paper dedicated to the Planck polarized data at low multipoles. These improvements enabled the first significant measurement of the reionization optical depth parameter using Planck-HFI data. This paper presents an extensive analysis of systematic effects, including the use of end-to-end simulations to facilitate their removal and characterize the residuals. The polarized data, which presented a number of known problems in the 2015 Planck release, are very significantly improved, especially the leakage from intensity to polarization. Calibration, based on the cosmic microwave background (CMB) dipole, is now extremely accurate and in the frequency range 100-353 GHz reduces intensity-to-polarization leakage caused by calibration mismatch. The Solar dipole direction has been determined in the three lowest HFI frequency channels to within one arc minute, and its amplitude has an absolute uncertainty smaller than 0.35 μK, an accuracy of order 10 -4 . This is a major legacy from the Planck HFI for future CMB experiments. The removal of bandpass leakage has been improved for the main high-frequency foregrounds by extracting the bandpass-mismatch coefficients for each detector as part of the mapmaking process; these values in turn improve the intensity maps. This is a major change in the philosophy of "frequency maps", which are now computed from single detector data, all adjusted to the same average bandpass response for the main foregrounds. End-to-end simulations have been shown to reproduce very well the relative gain calibration of detectors, as well as drifts within a frequency induced by the residuals of the main systematic effect (analogue-to-digital convertor non-linearity residuals). Using these simulations, we have been able to measure and correct the small frequency calibration bias induced by this systematic effect at the 10 -4 level. There is no detectable sign of a residual calibration bias between the first and second acoustic peaks in the CMB channels, at the 10 -3 level.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1972

Space vehicle-borne application of optical data processing

A model is considered for vehicle-borne parallel optical data processing which might be used as a key part of an advanced earth resources satellite mission. Some typical applications and the operation of the on-board processor are discussed.

Welch, J. D.↗
NASA NTRS1988

Expert system technology as a data processing tool

The expert system technology is focused on as a data processing tool. Several existing applications are analyzed. Their original definition as pure expert systems is contrasted with their current status as integrated systems. The architectural requirements needed to support such a heterogeneous environment are given.

Hennessy, John F.↗