Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,711 records · Page 95
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Manifold Learning: What, How, and Why

Manifold learning (ML), also known as nonlinear dimension reduction, is a set of methods to find the low-dimensional structure of data. Dimension reduction for large, high-dimensional data is not merely a way to reduce the data; the new representations and descriptors obtained by ML reveal the geometric shape of high-dimensional point clouds and allow one to visualize, denoise, and interpret them. This review presents the underlying principles of ML, its representative methods, and their statistical foundations, all from a practicing statistician's perspective. It describes the trade-offs and what theory tells us about the parameter and algorithmic choices we make in order to obtain reliable conclusions.

Mathematics↗
DOE OSTI2024

On data set tensions and signatures of new cosmological physics

ABSTRACT Can new cosmic physics be uncovered through tensions amongst data sets? Tensions in parameter determinations amongst different types of cosmological observation, especially the ‘Hubble tension’ between probes of the expansion rate, have been invoked as possible indicators of new physics, requiring extension of the ΛCDM paradigm to resolve. Within a fully Bayesian framework, we show that the standard tension metric gives only part of the updating of model probabilities, supplying a data co-dependence term that must be combined with the Bayes factors of individual data sets. This shows that, on its own, a reduction of data set tension under an extension to ΛCDM is insufficient to demonstrate that the extended model is favoured. Any analysis that claims evidence for new physics solely on the basis of alleviating data set tensions should be considered incomplete and suspect. We describe the implications of our results for the interpretation of the Hubble tension.

Cortês, Marina (ORCID:0000000304853767)↗
NASA NTRS2001

A New Centimeter-Level Real-Time Global Navigation and Positioning Capability with GPS

NASA/JPL has developed a new, precise, global, GPS-based capability for real-time terrestrial and space platform navigation. It has been demonstrated on Earth's surface and is 10 times more accurate than other real-time GPS-based systems. The new system poses certain advantages for Earth science remote sensing, including: the onboard generation of science data products in real-time, sensor control and reduction of data transmission bandwidth, improved environmental forecasting, autonomous and intelligent platform control, operations cost savings, and technology transfer and commercial partnership opportunities. The system's measurement capabilities and applications, demonstrated orbit accuracies, and precision LEO and spacecraft positioning and timing are highlighted.

real time↗
NASA NTRS2016

Application of Compressive Sensing to Gravitational Microlensing Experiments

Compressive Sensing is an emerging technology for data compression and simultaneous data acquisition. This is an enabling technique for significant reduction in data bandwidth, and transmission power and hence, can greatly benefit spaceflight instruments. We apply this process to detect exoplanets via gravitational microlensing. We experiment with various impact parameters that describe microlensing curves to determine the effectiveness and uncertainty caused by Compressive Sensing. Finally, we describe implications for spaceflight missions.

Compressive Sensing↗
NASA NTRS1985

Observing tectonic plate motions and deformations from satellite laser ranging

The scope of geodesy has been greatly affected by the advent of artificial near-earth satellites. The present paper provides a description of the results obtained from the reduction of data collected with the aid of satellite laser ranging. It is pointed out that dynamic reduction of satellite laser ranging (SLR) data provides very precise positions in three dimensions for the laser tracking network. The vertical components of the stations, through the tracking geometry provided by the global network and the accurate knowledge of orbital dynamics, are uniquely related to the center of mass of the earth. Attention is given to the observations, the methodologies for reducing satellite observations to estimate station positions, Lageos-observed tectonic plate motions, an improved temporal resolution of SLR plate motions, and the SLR vertical datum.

Christodoulidis, D. C.↗
NASA NTRS1998

Versatile Software Package For Near Real-Time Analysis of Experimental Data

This paper provides an overview of a versatile software package developed for time- and frequency-domain analyses of experimental wind-tunnel data. This package, originally developed for analyzing data in the NASA Langley Transonic Dynamics Tunnel (TDT), is applicable for analyzing any time-domain data. A Matlab-based software package, TDT-analyzer, provides a compendium of commonly-required dynamic analysis functions in a user-friendly interactive and batch processing environment. TDT-analyzer has been used extensively to provide on-line near real-time and post-test examination and reduction of measured data acquired during wind tunnel tests of aeroelastically-scaled models of aircraft and rotorcraft as well as a flight test of the NASA High Alpha Research Vehicle (HARV) F-18. The package provides near real-time results in an informative and timely manner far exceeding prior methods of data reduction at the TDT.

Wieseman, Carol D.↗
NASA NTRS1983

Understanding and utilization of Thematic Mapper and other remotely sensed data for vegetation monitoring

The TM Tasseled Cap transformation, which provides both a 50% reduction in data volume with little or no loss of important information and spectral features with direct physical association, is presented and discussed. Using both simulated and actual TM data, some important characteristics of vegetation and soils in this feature space are described, as are the effects of solar elevation angle and atmospheric haze. A preliminary spectral haze diagnostic feature, based on only simulated data, is also examined. The characteristics of the TM thermal band are discussed, as is a demonstration of the use of TM data in energy balance studies. Some characteristics of AVHRR data are described, as are the sensitivities to scene content of several LANDSAT-MSS preprocessing techniques.

Crist, E. P.↗
NASA NTRS1981

Use of MAGSAT anomaly data for crustal structure and mineral resources in the US Midcontinent

The analysis and preliminary interpretation of investigator-B MAGSAT data are addressed. The data processing included: (1) removal of spurious data points; (2) statistical smoothing along individual data tracks, to reduce the effect of geomagnetic transient disturbances; (3) comparison of data profiles spatially coincident in track location but acquired at different times; (4) reduction of data by weighted averaging to a grid with 1 deg xl deg latitude/longitude spacing, and with elevations interpolated and weighted to a common datum of 400 km; (5) wavelength filtering; and (6) reduction of the anomaly map to the magnetic pole. Agreement was found between a magnitude data anomaly map and a reduce-to-the-pole map supporting the general assumption that, on a large scale (long wavelength), it is induced crustal magnetization which is responsible for major anamalies. Anomalous features are identified and explanations are suggested with regard to crustal structure, petrologic characteristics, and Curie temperature isotherms.

Carmichael, R. S.↗
DOE OSTI2026

Scientific Data Compression for Large Scale Computational Fluid Dynamics (CFD) Simulations

This Cooperative Research and Development Agreement (CRADA) between Oak Ridge National Laboratory (ORNL) and General Electric (GE) investigated methods for reducing the size of large computational fluid dynamics (CFD) simulation datasets using scientific data compression techniques. The work focused on adapting the MultiGrid Adaptive Reduction of Data (MGARD) compression framework and integrating it with high-performance I/O and visualization tools used in CFD workflows. MGARD uses hierarchical multilevel decomposition to enable error-controlled compression of floating-point scientific data while preserving quantities of interest. During the project, MGARD compression was integrated with the ADIOS I/O framework and visualization tools such as ParaView to enable efficient storage, transfer, and analysis of simulation data. The collaboration also explored approaches for improving compression performance for CFD data defined on unstructured meshes. Results demonstrate that scientific data compression can significantly reduce storage requirements and improve data management for large-scale CFD simulations.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2018

Traction Control Design and Integration Onboard the Mars Science Laboratory Curiosity Rover

The Mars Science Laboratory (MSL) Curiosity rover experienced increasing wheel damage beginning in October 2013. While the wheels were designed to operate with considerable damage, the rate at which damage was occurring was unexpected and raised concerns regarding wheel lifetime. The Jet Propulsion Laboratory (JPL) has now developed and deployed new software on Curiosity that reduces the forces acting on the wheels. Our new Traction Control algorithm adapts each wheel’s speed to fit the terrain it drives over. It does not rely on any a priori knowledge of the terrain, and instead leverages the rover’s measured attitude rates and suspension angles, together with a rigid-body kinematics model, to estimate the real-time wheel-terrain contact angles and ideal, no-slip wheel angular rates. In addition, free-floating “wheelies” are detected and autonomously corrected. In this paper, we describe the algorithm, its ground testing campaign and associated challenges, and finally its validation and performance in flight. Ground test data demonstrates reductions in the forces acting on the wheels and validates the wheelie-damping capability. Secondary benefits in some terrains include a reduction in heading deviations while climbing rocks, with a reduction in slip in certain sandy terrains. Preliminary validation from flight data confirms these findings.

Maimone, Mark↗
NASA NTRS1982

Analysis of remote sensing data collected for detection and mapping of oil spills: Reduction and analysis of multi-sensor airborne data of the NASA Wallops oil spill exercise of November 1978

Airborne, remotely sensed data of the NASA Wallops controlled oil spill were corrected, reduced and analysed. Sensor performance comparisons were made by registering data sets from different sensors, which were near-coincident in time and location. Multispectral scanner images were, in turn, overlayed with profiles of correlation between airborne and laboratory-acquired fluorosensor spectra of oil; oil-thickness contours derived (by NASA) from a scanning fluorosensor and also from a two-channel scanning microwave radiometer; and synthetic aperture radar X-HH images. Microwave scatterometer data were correlated with dual-channel (UV and TIR) line scanner images of the oil slick.

Source record↗
NASA NTRS1974

Test of acoustic tone source and propulsion performance of C8A Buffalo suppressor nozzle

Results are presented for a static acoustic and propulsion performance ground test conducted at the Boeing hot nozzle facility on the C8A Buffalo noise suppressor nozzle. Various methods to remove a nozzle-associated 2000-Hz tone are evaluated. Results of testing this rectangular-array lobed nozzle for propulsion performance and acoustic directivity are reported. Recommendations for future nozzle modifications and further testing are included. Appendix A contains the test plan. Appendix B presents the test log. Appendix C contains plots of the one-third octave sound pressure levels recorded during the test. Appendix D describes the acoustic data recording and reduction systems. The performance data is tabulated in Appendix E.

Marrs, C. C.↗
NASA NTRS2002

Investigation of Error Patterns in Geographical Databases

The objective of the research conducted in this project is to develop a methodology to investigate the accuracy of Airport Safety Modeling Data (ASMD) using statistical, visualization, and Artificial Neural Network (ANN) techniques. Such a methodology can contribute to answering the following research questions: Over a representative sampling of ASMD databases, can statistical error analysis techniques be accurately learned and replicated by ANN modeling techniques? This representative ASMD sample should include numerous airports and a variety of terrain characterizations. Is it possible to identify and automate the recognition of patterns of error related to geographical features? Do such patterns of error relate to specific geographical features, such as elevation or terrain slope? Is it possible to combine the errors in small regions into an error prediction for a larger region? What are the data density reduction implications of this work? ASMD may be used as the source of terrain data for a synthetic visual system to be used in the cockpit of aircraft when visual reference to ground features is not possible during conditions of marginal weather or reduced visibility. In this research, United States Geologic Survey (USGS) digital elevation model (DEM) data has been selected as the benchmark. Artificial Neural Networks (ANNS) have been used and tested as alternate methods in place of the statistical methods in similar problems. They often perform better in pattern recognition, prediction and classification and categorization problems. Many studies show that when the data is complex and noisy, the accuracy of ANN models is generally higher than those of comparable traditional methods.

Dryer, David↗
DOE OSTI2024

Multitask methods for predicting molecular properties from heterogeneous data

Data generation remains a bottleneck in training surrogate models to predict molecular properties. We demonstrate that multitask Gaussian process regression overcomes this limitation by leveraging both expensive and cheap data sources. In particular, we consider training sets constructed from coupled-cluster (CC) and density functional theory (DFT) data. We report that multitask surrogates can predict at CC-level accuracy with a reduction in data generation cost by over an order of magnitude. Of note, our approach allows the training set to include DFT data generated by a heterogeneous mix of exchange–correlation functionals without imposing any artificial hierarchy on functional accuracy. More generally, the multitask framework can accommodate a wider range of training set structures—including the full disparity between the different levels of fidelity—than existing kernel approaches based on Δ-learning although we show that the accuracy of the two approaches can be similar. Consequently, multitask regression can be a tool for reducing data generation costs even further by opportunistically exploiting existing data sources.

Chemistry↗
DOE OSTI2025

Lossy Compression: An Online Multi-Stage Technology for High-Fidelity Synchro- Waveform Measurements

Effective real-time monitoring and analysis of distributed grids necessitate the use of synchro-waveform measurements, which capture almost all high-frequency disturbances and transient phenomena. However, due to limitations in high-speed measurements and network bandwidth, it is challenging to transfer all high-fidelity synchro-waveforms losslessly and successfully. To cope with these challenges, a hybrid-based online multi-stage compression algorithm is proposed to significantly improve the compression efficiency for synchro-waveform measurements. Initially, the multiple discrete Wavelet transformation is deployed to deconstruct the waveform components. The delta encoding is further developed to decrease the magnitude. In conjunction with the Lempel-Ziv-Markov chain, the hybrid compression algorithm is implemented to achieve real-time compression for the synchro-waveform measurements. Moreover, an innovative error index that synergizes the time and frequency domain error and correlation is formulated to evaluate the waveform distortion. By integrating compression ratio, suitable parameters can be optimally selected. Finally, the simulation, laboratory experiments, as well as field tests across a spectrum of sampling frequencies and time intervals are conducted to substantiate the efficacy of the proposed method. Here, the outcomes demonstrated that a compression ratio of approximately 15.5 and 17.83 can be reached for 0.5 s and 1 s data under both offline and online scenarios, which equates to a substantial 93.5% to 94.39% reduction in data storage requirements.

High-fidelity synchro-waveform measurements↗
NASA NTRS1975

Multiple detector focal plane array ultraviolet spectrometer for the AMPS laboratory

The possibility of meeting the requirements of the amps spectroscopic instrumentation by using a multi-element focal plane detector array in a conventional spectrograph mount was examined. The requirements of the detector array were determined from the optical design of the spectrometer which in turn depends on the desired level of resolution and sensitivity required. The choice of available detectors and their associated electronics and controls was surveyed, bearing in mind that the data collection rate from this system is so great that on-board processing and reduction of data are absolutely essential. Finally, parallel developments in instrumentation for imaging in astronomy were examined, both in the ultraviolet (for the Large Space Telescope as well as other rocket and satellite programs) and in the visible, to determine what progress in that area can have direct bearing on atmospheric spectroscopy.

Feldman, P. D.↗
NASA NTRS1975

Canonical analysis and transformation of Skylab multispectral scanner data

The author has identified the following significant results. The original transformation matrix, C, had sixteen axes. However, the first three axes contained 98.83% of the variance contained within the transformation. The values for axes one, two, and three were 83.61%, 14.49%, and 0.72%, respectively. The result was an 81.25% reduction in data bulk. It is expected that using transformed data for classification will result in significant reductions in computer cost.

Mcmurtry, G. J.↗