Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
NASA NTRS1978

Application of the informational reference system OZhUR to the automated processing of data from satellites of the Kosmos series

The structure and potential of the information reference system OZhUR designed for the automated data processing systems of scientific space vehicles (SV) is considered. The system OZhUR ensures control of the extraction phase of processing with respect to a concrete SV and the exchange of data between phases.The practical application of the system OZhUR is exemplified in the construction of a data processing system for satellites of the Cosmos series. As a result of automating the operations of exchange and control, the volume of manual preparation of data is significantly reduced, and there is no longer any need for individual logs which fix the status of data processing. The system Ozhur is included in the automated data processing system Nauka which is realized in language PL-1 in a binary one-address system one-state (BOS OS) electronic computer.

Pokras, V. M.↗
NASA NTRS2011

Framework for Integrating Science Data Processing Algorithms Into Process Control Systems

A software framework called PCS Task Wrapper is responsible for standardizing the setup, process initiation, execution, and file management tasks surrounding the execution of science data algorithms, which are referred to by NASA as Product Generation Executives (PGEs). PGEs codify a scientific algorithm, some step in the overall scientific process involved in a mission science workflow. The PCS Task Wrapper provides a stable operating environment to the underlying PGE during its execution lifecycle. If the PGE requires a file, or metadata regarding the file, the PCS Task Wrapper is responsible for delivering that information to the PGE in a manner that meets its requirements. If the PGE requires knowledge of upstream or downstream PGEs in a sequence of executions, that information is also made available. Finally, if information regarding disk space, or node information such as CPU availability, etc., is required, the PCS Task Wrapper provides this information to the underlying PGE. After this information is collected, the PGE is executed, and its output Product file and Metadata generation is managed via the PCS Task Wrapper framework. The innovation is responsible for marshalling output Products and Metadata back to a PCS File Management component for use in downstream data processing and pedigree. In support of this, the PCS Task Wrapper leverages the PCS Crawler Framework to ingest (during pipeline processing) the output Product files and Metadata produced by the PGE. The architectural components of the PCS Task Wrapper framework include PGE Task Instance, PGE Config File Builder, Config File Property Adder, Science PGE Config File Writer, and PCS Met file Writer. This innovative framework is really the unifying bridge between the execution of a step in the overall processing pipeline, and the available PCS component services as well as the information that they collectively manage.

Mattmann, Chris A.↗
NASA NTRS1972

A computer program for Moessbauer data processing

A computer program to analyze Mossbauer data is presented in detail. The least-squares curve fitting techniques described apply to single line spectra, single hyperfine spectra, or when the constituent spectra are separated well enough to let the individual absorption peaks stand alone. The present program is not adapted for complex spectra resulting from the existence of several local environments in the absorber iron alloy. Sample problems are presented to aid the user in setting up and running the program. The program is written in FORTRAN 4 language for the Control Data 6000 series digital computer with the SCOPE 3.0 operating system and requires approximately 115,000 octal locations of core storage. A typical case with one absorption peak runs in 20 seconds, and a typical problem with six absorption peaks requires 50 seconds.

Howser, L. M.↗
NASA NTRS1978

Data processing for water monitoring system

Water monitoring data acquisition system is structured about central computer that controls sampling and sensor operation, and analyzes and displays data in real time. Unit is essentially separated into two systems: computer system, and hard wire backup system which may function separately or with computer.

Monford, L.↗
NASA NTRS1978

Future timing accuracy requirements and procedures for data processing

Timing accuracy requirements for satellite experiment data are discussed. Although time accuracies of 100 milliseconds were sufficient when OSO-3, 4, 5 were launched in the mid-60s, time accuracies of 100 microseconds are necessary for OSO-8, HEAO-A, and Seasat, and it is thought likely that accuracies of 10 microseconds will become routine in the 1980s. An approach to the problem of identifying the sources of spacecraft timing errors - from the onboard counters to the final tagging of data - is considered.

Smith, G. A.↗
DOE OSTI2020

Offsite Data Processing for the GlueX Experiment

The Thomas Jefferson National Accelerator Facility (JLab) 12GeV accelerator upgrade completed in 2015 is now producing data at volumes unprecedented for the lab. The resources required to process this data now exceed the capacity of the onsite farm necessitating the use of offsite computing resources for the first time in the history of JLab. GlueX is now utilizing NERSC and PSC for raw data production. Details of the workflow are presented.

Lawrence, David↗
DOE OSTI2023

Accelerating Machine Learning Inference with GPUs in ProtoDUNE Data Processing

Abstract We study the performance of a cloud-based GPU-accelerated inference server to speed up event reconstruction in neutrino data batch jobs. Using detector data from the ProtoDUNE experiment and employing the standard DUNE grid job submission tools, we attempt to reprocess the data by running several thousand concurrent grid jobs, a rate we expect to be typical of current and future neutrino physics experiments. We process most of the dataset with the GPU version of our processing algorithm and the remainder with the CPU version for timing comparisons. We find that a 100-GPU cloud-based server is able to easily meet the processing demand, and that using the GPU version of the event processing algorithm is two times faster than processing these data with the CPU version when comparing to the newest CPUs in our sample. The amount of data transferred to the inference server during the GPU runs can overwhelm even the highest-bandwidth network switches, however, unless care is taken to observe network facility limits or otherwise distribute the jobs to multiple sites. We discuss the lessons learned from this processing campaign and several avenues for future improvements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

CMS Tier-0 data processing during the detector commissioning in Run 3

The CMS Tier-0 system is responsible for the prompt processing and distribution of the data collected by the CMS Experiment. A number of upgrades were implemented during the long shutdown 2 of the Large Hadron Collider, which improved the performance and reliability of the system. In this report, these upgrades are discussed and a more detailed description of the Tier-0 system is given. The experience of the data taking during Run 3 detector commissioning as well as the performance of the system are highlighted.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Colorado State University (CSU) X-Band Precipitation Radar Plan Position Indicator Data Processed with Corrected Moments in Antenna Coordinates (CMAC) Value-Added Product Report

In 2010 the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility procured 3- and 5-cm wavelength radars for documenting the macrophysical, microphysical, and dynamical structure of precipitating systems. To maximize the scientific impact, ARM supported the development of an application chain to correct for various phenomena in order to retrieve the “point” values of moments of the radar spectrum and polarimetric measurements. We have now used the lessons learned from the processing of the 3- and 5-cm wavelength radars obtained by ARM to help process X-band radar data from the Surface Atmospheric Integrated Field Laboratory (SAIL) field campaign. This report details the motivation, science, and progress to date as well as charting a path forward.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1986

NASA scatterometer data processing system: Features for validation

The design of the N-ROSS scatterometer data system and the development of key processing algorithms are described. The data products and parts of the data system to be directly validated are listed. The main features of the Data Management Subsystem, which delivers data to science users and supports system validation are outlined.

Callahan, Philip S.↗
NASA NTRS1992

An optimal GPS data processing technique

A formula is derived to optimally combine dual-frequency GPS (Global Positioning System) pseudorange and carrier phase data streams into a single equivalent data stream, reducing the data volume and computing time in the filtering process for parameter estimation by a factor of four. The resulting single data stream is that of carrier phase measurements with both data noise and bias uncertainty strictly defined. With this analytical formula the single stream of equivalent GPS measurements can be efficiently formed by simple numerical calculations without any degradation in data strength. The formulation for the optimally combined GPS data and their covariances are given in closed form. Carrier phase ambiguity resolution, when feasible, is improved due to the preservation of the full data strength with the optimal data combining process.

Wu, S. C.↗
NASA NTRS1994

Simulation and data processing of GOMOS measurements

In this paper the data simulation and data inversion studies for stellar occultation measurements are discussed. The specific application is the Global Ozone Monitoring by Occultation of Stars (GOMOS) instrument which has been proposed for the first European Platform, Polar Orbiting Earth Mission (POEM-1).

Kyrola, E.↗
NASA NTRS2004

Processing Spacecraft Data Without Confusion

Producing multiple versions of the same data product for the same time frame with the same remotely sensed inputs can be a recipe for disaster. Yet, amidst the commotion of satellite launch and early operations (LEO), such data processing is needed. After LEO, the situation gets worse. Processing newly arriving data ("forward processing") is augmented with reprocessing and algorithm development, comparison, evaluation, and testing -- often happening all at the same time. The problem can be analyzed in three main parts -- maintaining multiple versions of algorithms and data so that end-product users are not overwhelmed,allocating computer resources efficiently, and simplifying production operations so that va st amounts of data can be processed with minimal staff and fewer errors. OMIDAPS provides a framework for execution of algorithms that transform lower level data acquired by OMI on NASA's Aura satellite into higher level science data products. In contrast to traditional science data processing systems, we address all parts of the problem with an innovative approach allowing multiple data processing to run within a single physical system. The data products, imports, exports, and execution planning are all segregated into distinct "ArchiveSets." This paper describes reasons for multiple concurrent productions on a typical satellite data processing project using OMI as an example. It describes the virtual data processing system concept and its advantages over separate physical processing strings. It explores the specific implementation of the virtual systems within OMIDAPS and discusses some of the implications of our approach and describes how virtual processing is used to accomplish the overall mission of OMI data processing.

Tilmes, Curt↗
NASA NTRS2014

Prototype and Metrics for Data Processing Chain Components of IPM

This presentation lays out the evolution of the Intelligent Payload Module (IPM) vision given that the HyspIRI mission has been delayed. It shows that there has been a focus on airborne vehcile and unmanned aerial systems to further develop the IPM functionality. This of course does not preclude use of the IPM for space missions but provides alternate paths to continue the concept of improved onboard processing for low latency users of science data products.

Onboard Processing↗
DOE OSTI2026

pathSQE : an automated workflow for single-crystal inelastic neutron scattering data processing and analysis

Inelastic neutron scattering (INS) experiments utilizing modern time-of-flight spectrometers enable the comprehensive mapping of the energy (E)- and momentum (Q)-resolved dynamical structure factor of single crystals, probing both the lattice and magnetic excitations. Yet, the large size and complexity of four-dimensional INS data are challenging current analysis workflows, often resulting in an underutilization of the measured information. To help address this issue, this paper introduces new software interfaced with the Mantid framework, pathSQE, designed to streamline the processing, analysis and interpretation of 4D single-crystal INS data. By automating key tasks such as 1D/2D slicing, symmetrization, Brillouin zone folding, data visualization, prioritization and filtering, and comparisons with simulations, pathSQE facilitates and accelerates INS data analysis workflows. Here, this paper outlines the features and implementation and provides several illustrations of the use of pathSQE on data collected on single crystals using direct-geometry time-of-flight spectrometers at the Spallation Neutron Source, including Ge, FeSi, MnO and SnS single-crystal measurements on the ARCS, HYSPEC and CNCS neutron spectrometers. Beyond streamlining post-experiment data processing, pathSQE establishes an automated and modular processing pipeline that could support future real-time experiment steering.

36 MATERIALS SCIENCE↗
NASA NTRS1986

DSN microwave antenna holography. Part 2: Data processing and display of high-resolution effective maps

The results of a recently completed computer graphic package for the process and display of holographically recorded data into effective aperture maps are presented. The term effective maps (labelled provisional on the holograms) signifies that the maps include contributions of surface mechanical errors as well as other electromagnetic factors (phase error due to feed/subreflector misalignment, linear phase error contribution due to pointing errors, subreflector flange diffraction effects, and strut diffraction shadows). While these maps do not show the true mechanical surface errors, they nevertheless show the equivalent errors, which are effective in determining overall antenna performance. Final steps to remove electromagnetic pointing and misalignment factors are now in progress. The processing and display of high-resolution effective maps of a 64m antenna (DSS 63) are presented.

Rochblatt, D. J.↗
NASA NTRS1972

User oriented multispectral data processing at the University of Michigan

The feasibility of solving practical multispectral data reduction problems by available processing techniques and the identification of areas for more technical development requirements are considered. Parameter mapping and ratio mapping techniques prove their usefulness in a corn blight watch experiment. A hybrid computer processing system is advocated for complete realization of aircraft and spacecraft sensor potentials.

Thomson, F. J.↗