Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
NASA NTRS1971

Scientific data reduction and analysis plan: PI services

This plan comprises two parts. The first concerns the real-time data display to be provided by MSC during the mission. The prime goal is to assess the operation of the UVS and to identify any problem areas that could be corrected during the mission. It is desirable to identify any possible observations of unusual scientific interest in order to repeat these observations at a later point in the mission, or to modify the time line with respect to the operating modes of the UVS. The second part of the plan discusses the more extensive postflight analysis of the data in terms of the scientific objectives of this experiment.

Feldman, P. D.↗
NASA NTRS1992

Project Magnet High-level Vector Survey Data Reduction

Since 1951, the U.S. Navy, under its Project MAGNET program, has been continuously collecting vector aeromagnetic survey data to support the U.S. Defense Mapping Agency's world magnetic and charting program. During this forty-year period, a variety of survey platforms and instrumentation configurations have been used. The current Project MAGNET survey platform is a Navy Orion RP-3D aircraft which has been specially modified and specially equipped with a redundant suite of navigational positioning, attitude, and magnetic sensors. A review of the survey data collection procedures and calibration and editing techniques applied to the data generated by this suite of instrumentation will be presented. Among the topics covered will be the determination of its parameters from the low-level calibration maneuvers flown over geomagnetic observatories.

Rachel J Coleman↗
NASA NTRS1971

Digital automatic data reduction techniques used in a 1000-flight biomedical study

Techniques developed to automatically process a large quantity of physiological data obtained during a 1000-flight study are described. To reduce this data reliably, a study program was conducted using physiological data from X-15 flights as a data source for experimenting with signal enhancement and noise elimination techniques. The techniques include an automatic means for counting heart rates, averaging electrocardiogram waveforms, plotting histograms of heart rate versus frequency, and counting respiration rates. These techniques were used to reduce more than 2000 hours of physiological data recorded in flight.

Carpenter, R.↗
NASA NTRS1981

IECM calibration and data reduction requirements

The induced environment contamination monitor (IECM) tape recorder format, as it relates to the ouput of meaningful data from the IECM instrument, is explained. Eight-bit words (or bytes) generate numbers that represent voltage levels of electronic detection probes for each experiment. This information is amalgamated by the IECM Data Acquisition and Control System (DACS). In some cases bits represent certain status situations concerning an experiment, such as whether a valve is opened or closed. Voltages are transformed into meaningful physical phenomena through equations of calibration. Data formats and plots are generated as requested for each IECM experimenter.

Wills, F. D.↗
NASA NTRS1994

Data Reduction Procedures for Laser Velocimeter Measurements in Turbomachinery Rotors

Blade-to-blade velocity distributions based on laser velocimeter data acquired in compressor or fan rotors are increasingly used as benchmark data for the verification and calibration of turbomachinery computational fluid dynamics (CFD) codes. Using laser Doppler velocimeter (LDV) data for this purpose, however, must be done cautiously. Aside from the still not fully resolved issue of the seed particle response in complex flowfields, there is an important inherent difference between CFD predictions and LDV blade-to-blade velocity distributions. CFD codes calculate velocity fields for an idealized rotor passage. LDV data, on the other hand, stem from the actual geometry of all blade channels in a rotor. The geometry often varies from channel to channel as a result of manufacturing tolerances, assembly tolerances, and incurred operational damage or changes in the rotor individual blades.

Lepicovsky, Jan↗
NASA NTRS1997

MISR photogrammetric data reduction for geophysical retrievals

The theoretical concept, based on modern photogrammetric methods, underlying the design of the MISR science data processing system responsible for the autonomous and continuous georectification of multi-angle imagery is the subject of this paper.

photogrammetric↗
DOE OSTI2025

Machine Learning Techniques for Data Reduction of Climate Applications

Scientists conduct large-scale simulations to compute derived quantities-of-interest (QoI) from primary data. Often, QoI are linked to specific features, regions, or time intervals, such that data can be adaptively reduced without compromising the integrity of QoI. For many spatiotemporal applications, these QoI are binary in nature and represent presence or absence of a physical phenomenon. We present a pipelined compression approach that first uses neural-network-based techniques to derive regions where QoI are highly likely to be present. Then, we employ a Guaranteed Autoencoder (GAE) to compress data with differential error bounds. GAE uses QoI information to apply low-error compression to only these regions. This results in overall high compression ratios while still achieving downstream goals of simulation or data collections. Experimental results are presented for climate data generated from the E3SM Simulation model for downstream quantities such as tropical cyclone and atmospheric river detection and tracking. These results show that our approach is superior to comparable methods in the literature.

Li, Xiao [University of Florida]↗
NASA NTRS1980

Automated frequency standard stability data reduction

A design using a medium sized computer, a fiber optic communication link, and a desk top computer to reduce data collected at a remote site for analysis of frequency standard tests is described. Data generated at the Interim Frequency Standards Test Facility is collected on magnetic tape, which is then transported to a Sigma 5 computer. An Allan variance (two sample variance) is then calculated. The Allan variance (sigma vs tau) is then written to a data file in the Sigma 5. A fiber optic communication link between the Sigma 5 and a desk top computer was designed to transmit data in the Sigma 5 file to the desk top computer. A program was written for the desk top computer that will automatically access the data file in the Sigma 5, process the data and provide a data plot.

Knapp, L. J.↗
NASA NTRS1984

Data reduction programs for a laser radar system

The listing and description of software routines which were used to analyze the analog data obtained from LIDAR - system are given. All routines are written in FORTRAN - IV on a HP - 1000/F minicomputer which serves as the heart of the data acquisition system for the LIDAR program. This particular system has 128 kilobytes of highspeed memory and is equipped with a Vector Instruction Set (VIS) firmware package, which is used in all the routines, to handle quick execution of different long loops. The system handles floating point arithmetic in hardware in order to enhance the speed of execution. This computer is a 2177 C/F series version of HP - 1000 RTE-IVB data acquisition computer system which is designed for real time data capture/analysis and disk/tape mass storage environment.

Badavi, F. F.↗
NASA NTRS1992

Data reduction using cubic rational B-splines

A geometric method is proposed for fitting rational cubic B-spline curves to data that represent smooth curves including intersection or silhouette lines. The algorithm is based on the convex hull and the variation diminishing properties of Bezier/B-spline curves. The algorithm has the following structure: it tries to fit one Bezier segment to the entire data set and if it is impossible it subdivides the data set and reconsiders the subset. After accepting the subset the algorithm tries to find the longest run of points within a tolerance and then approximates this set with a Bezier cubic segment. The algorithm uses this procedure repeatedly to the rest of the data points until all points are fitted. It is concluded that the algorithm delivers fitting curves which approximate the data with high accuracy even in cases with large tolerances.

Chou, Jin J.↗
DOE OSTI2024

A High-Quality Workflow for Multi-Resolution Scientific Data Reduction and Visualization

Multi-resolution methods such as Adaptive Mesh Refinement (AMR) can enhance storage efficiency for HPC applications generating vast volumes of data. However, their applicability is limited and cannot be universally deployed across all applications. Furthermore, integrating lossy compression with multi-resolution techniques to further boost storage efficiency encounters significant barriers. To this end, we introduce an innovative workflow that facilitates high-quality multi-resolution data compression for both uniform and AMR simulations. Initially, to extend the usability of multi-resolution techniques, our workflow employs a compression-oriented Region of Interest (ROI) extraction method, transforming uniform data into a multi-resolution format. Subsequently, to bridge the gap between multi-resolution techniques and lossy compressors, we optimize three distinct compressors, ensuring their optimal performance on multi-resolution data. These optimizations can improve the compression ratio of SOTA approaches by up to 3.3× under the same data quality loss. Lastly, we incorporate an advanced uncertainty visualization method into our workflow to understand the potential impacts of lossy compression. Experimental evaluation demonstrates that our workflow achieves significant compression quality improvements.

Wang, Daoce↗
NASA NTRS1992

Residual acceleration data on IML-1: Development of a data reduction and dissemination plan

The main thrust of our work in the third year of contract NAG8-759 was the development and analysis of various data processing techniques that may be applicable to residual acceleration data. Our goal is the development of a data processing guide that low gravity principal investigators can use to assess their need for accelerometer data and then formulate an acceleration data analysis strategy. The work focused on the flight of the first International Microgravity Laboratory (IML-1) mission. We are also developing a data base management system to handle large quantities of residual acceleration data. This type of system should be an integral tool in the detailed analysis of accelerometer data. The system will manage a large graphics data base in the support of supervised and unsupervised pattern recognition. The goal of the pattern recognition phase is to identify specific classes of accelerations so that these classes can be easily recognized in any data base. The data base management system is being tested on the Spacelab 3 (SL3) residual acceleration data.

Rogers, Melissa J. B.↗
DOE OSTI2021

Abridged spectral matrix inversion: parametric fitting of X-ray fluorescence spectra following integrative data reduction

Recent improvements in both X-ray detectors and readout speeds have led to a substantial increase in the volume of X-ray fluorescence data being produced at synchrotron facilities. This in turn results in increased challenges associated with processing and fitting such data, both temporally and computationally. Herein an abridging approach is described that both reduces and partially integrates X-ray fluorescence (XRF) data sets to obtain a fivefold total improvement in processing time with negligible decrease in quality of fitting. The approach is demonstrated using linear least-squares matrix inversion on XRF data with strongly overlapping fluorescent peaks. This approach is applicable to any type of linear algebra based fitting algorithm to fit spectra containing overlapping signals wherein the spectra also contain unimportant (non-characteristic) regions which add little (or no) weight to fitted values, e.g. energy regions in XRF spectra that contain little or no peak information.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1970

Spectral reflectance characteristics and automated data reduction techniques which identify wetland and water quality conditions in the Chesapeake Bay

Progress on research designed to test the usability of multispectral, high altitude, remotely sensed data to analyze ecological and hydrological conditions in estuarine environments is presented. Emphasis was placed on data acquired by NASA aircraft over the Patuxent River Chesapeake Bay Test Site, No. 168. Missions were conducted over the Chesapeake Bay at a high altitude flight of 18,460 m and a low altitude flight of 3070. The principle objectives of the missions were: (1) to determine feasibility of identifying source and extent of water pollution problems in Baltimore Harbor, Chesapeake Bay and major tributaries utilizing high altitude, ERTS analogous remote sensing data; (2) to determine the feasibility of mapping species composition and general ecological condition of Chesapeake Bay wetlands, utilizing high altitude, ERTS analogous data; (3) to correlate ground spectral reflectance characteristics of wetland plant species with tonal characteristics on multispectral photography; (4) to determine usefulness of high altitude thermal imagery in delinating isotherms and current patterns in the Chesapeake Bay; and (5) to investigate automated data interpretive techniques which may be usable on high altitude, ERTS analogous data.

Anderson, R. R.↗
NASA NTRS1972

Off-line data analysis and data reduction from digitally controlled random test systems.

This paper discusses the merits of employing the new computer-controlled random environment control systems for fast and efficient large-scale data analysis when they are not being used for test control. Hardware and software requirements are stated. Several of the more familiar frequency functions are defined from the Fourier coefficients, the main product of the Fourier processors used in these control systems. Another function, the probability density function, is defined and suggestions for its application are made. An analysis example is presented. Some programming tips are listed, and the accuracy and reliability of frequency analysis measurements are considered.

Chapman, C. P.↗
NASA NTRS2012

New Techniques for High-Contrast Imaging with ADI: The ACORNS-ADI SEEDS Data Reduction Pipeline

We describe Algorithms for Calibration, Optimized Registration, and Nulling the Star in Angular Differential Imaging (ACORNS-ADI), a new, parallelized software package to reduce high-contrast imaging data, and its application to data from the Strategic Exploration of Exoplanets and Disks (SEEDS) survey. We implement seyeral new algorithms, includbg a method to centroid saturated images, a trimmed mean for combining an image sequence that reduces noise by up to approx 20%, and a robust and computationally fast method to compute the sensitivitv of a high-contrast obsen-ation everywhere on the field-of-view without introducing artificial sources. We also include a description of image processing steps to remove electronic artifacts specific to Hawaii2-RG detectors like the one used for SEEDS, and a detailed analysis of the Locally Optimized Combination of Images (LOCI) algorithm commonly used to reduce high-contrast imaging data. ACORNS-ADI is efficient and open-source, and includes several optional features which may improve performance on data from other instruments. ACORNS-ADI is freely available for download at www.github.com/t-brandt/acorns_-adi under a BSD license

Brandt, Timothy D.↗