Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Principal Component Analysis (PCA)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

105 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Continuing Long-term Global SO 2 Data Record with JPSS OMPS Instruments

NASA’s long-term Earth Observing System (EOS) SO 2 climate data record (CDR) started with Aura/Ozone Monitoring Instrument (OMI, launched in 2004) and is now being continued with the SNPP/Ozone Mapping and Profiler Suite (OMPS, launched in 2011). Both OMI and SNPP/OMPS SO 2 CDRs are produced with the Goddard principal component analysis (PCA) spectral fitting algorithm. By inherently accounting for various instrumental factors, the PCA technique enables highly consistent retrievals between different instruments. In this presentation, we will provide an overview on our effort to further extend the EOS SO 2 CDR, by implementing the PCA SO 2 algorithm with multiple OMPS instruments flying on the Joint Polar Satellite System (JPSS) constellation, including NOAA-20 (launched in 2017) and NOAA-21 (launched in 2022). We will present results analyzing our new NOAA-20/OMPS PCA SO 2 EOS continuity product, to be publicly released in fall of 2023. We will show statistical analyses on the quality of NOAA-20 PCA SO 2 product, such as retrieval noise, biases over background areas, and long-term stability. We will employ a previously established top-down method to estimate SO2 emissions from selected large point sources, using NOAA-20 SO 2 retrievals and assimilated wind fields as input. The SO 2 emission estimates derived from NOAA-20 retrievals will be compared with those from OMI, SNPP/OMPS, and S5P/TROPOMI (TROPOspheric Monitoring Instrument). We will also demonstrate the application of a new machine learning technique that further reduces the noise of NOAA-20 SO 2 retrievals. Finally, we will present preliminary PCA SO 2 retrievals from recently launched satellite sensors, including NOAA-21/OMPS and NASA’s geostationary TEMPO (Tropospheric Emissions: Monitoring of Pollution) instrument.

SO2↗
NASA NTRSDate not supplied

Training and Validation of Spectral Gap Filling Algorithm for Cpf-Ceres Intercalibration

The Climate Absolute Radiance and Refractivity Observatory (CLARREO) Pathfinder (CPF) mission is set to launch an SI-traceable reflective solar (RS) spectrometer aboard the International Space Station to measure Earth-reflected solar radiation with a radiometric uncertainty of 0.3% (k=1). The CPF intercalibration team has devised a cutting-edge methodology to accurately transfer the benchmark CPF calibration reference to the shortwave (SW) channel (200-5000 nm) of the Clouds and the Earth’s Radiant Energy System (CERES) instrument. The spectral range of CPF measurements spans from 350-2300 nm, while the CERES SW channel measures the Earth-reflected broadband solar radiances between 200 nm to 5 μm. To conduct precise CPF-CERES intercalibration analysis, the CPF-like spectral radiances outside the CPF spectral range need to be estimated to match the CERES SW spectral range. In response, the team has developed a fast algorithm that leverages spectrally redundant information within the CPF-measured portion through principal component analysis (PCA) and utilizes pre-established spectral correlation relationships among wavelengths to extend the CPF spectrum below 350 nm and above 2300 nm. Our results show that the algorithm achieves excellent accuracy in generating the missing energy in the UV and IR portions. The RMS error in the UV region is less than 4.5x10-3 W/m2/sr/nm, while in the IR region, it is smaller than 8x10-5 W/m2/sr/nm. Our methodology was validated using measured EMIT radiance data, which covers the spectral range from 0.381 μm to 2.493 μm. We employed EMIT radiances within the wavelength range of 0.43 – 2.25 μm to generate radiances for both the shorter wavelength range (0.381 – 0.43 μm) and longer wavelength range (2.25 – 2.493 μm). The generated radiances agree very well with the measured EMIT radiances. The standard deviation in the integrated broadband radiances was about 0.1%, and the bias is less than 0.004% for over 1.5 million EMIT measured samples. These statistics show that the spectral gap filling algorithm is robust and effective in substantially reducing the spectral difference-induced uncertainty in the CPF-CERES intercalibration samples.

Qiguang Yang↗
NASA NTRSDate not supplied

Enabling Intelligent Data Downlink Prioritization of In-Situ Observations through Generalizable and Computationally Inexpensive Anomaly Detection

High-fidelity measurements of magnetic fields and other observed properties, such as energetic particle fluxes, are a necessary component to our understanding of the highly dynamic near-Earth space environment. As our desire to study smaller-scale phenomena such as shocks and dipolorizations has increased, we have been driven to take and telemeter measurements at higher cadences. Unfortunately, many missions are unable to downlink all their captured data due to the well-known data transmission bottleneck at the DSN. These missions must then prioritize their high-cadence data such that the most scientifically useful intervals are transmitted. One simple prioritization technique uses the spacecraft position to telemeter data from only the region of interest. Although easy to implement, this method does not leverage the available scientific data and can omit intervals of useful scientific data when they lie outside the region of interest. The Magnetospheric Multiscale Mission (MMS) uses mission-specific parameterization of several data products to automatically prioritize scientifically useful intervals. Then, MMS verifies the automatically selected intervals by having a domain expert manually select intervals for downlink. The overall complexity required by this technique make it prohibitive for deployment on low-cost platforms (i.e., CubeSats) or on future missions featuring large constellations of satellites such as the Geospace Dynamics Constellation (GDC). We present preliminary results for a simple, generic, and data-driven method of downlink prioritization for magnetic field (and other) measurements. Specifically, Principal Components Analysis (PCA) and One-Class Support Vector Machines (OC-SVMs) are used to detect intervals containing anomalous activity, which can then be prioritized for subsequent downlink. The computational simplicity of this algorithm makes it an excellent candidate for implementation on spaceflight hardware, as well as provide generalizability to a broad range of missions and data products. Initial analysis of this technique has been performed using magnetic field measurements from the Magnetospheric Multiscale Mission and CASSIOP, where it automatically identified scientifically interesting intervals containing Alfvén waves and EMIC activity.

Matthew G. Finley↗
NASA NTRSDate not supplied

Anomaly Detection for the Roman Space Telescope Wide Field Instrument’s Science Data Processing Pipeline

The Roman Space Telescope (RST) Wide Field Instrument (WFI) will be utilizing a preliminary Science Data Processing (SDP) pipeline during its Integration and Test, and to some extent during Operations, to track basic statistics and identify known features such as cosmic rays, snowballs as well as possible anomalies in raw detector data. In our detectors, these anomalies appear as jumps in the ramp of a readout and are classified as cosmic rays if they appear as a streak or snowballs if they’re more circular. The WFI employs an array of 18 H4RG-10 detectors that collect image samples. Each set of raw frames within a non-destructive exposure is packaged by the SDP pipeline into image cubes for each detector. Each cube is a time series of 4096 × 4096 accumulating pixel frames. The preliminary analysis pipeline is used to locate anomalies in these time-series accumulation frames and identify the type of anomaly, either natural phenomena or detector characteristic. To compare different methods, we’ve implemented both heuristic-based and data-driven methods to identify anomalies. For the heuristic-based approach, we identify snowballs and cosmic rays by the size and shape of outlier pixel clusters between consecutive frames. For data driven methods, we evaluated a Convolutional Neural Network (CNN) model, and more traditional methods like Principal Component Analysis (PCA). CNN is a supervised learning/classification method. Thus, we used a labeled dataset of anomalies to perform segmentation of the image and identify anomalies. We used previously identified cosmic rays and snowballs to measure the accuracy and efficiency of the mentioned approaches. In evaluating these methods, we aim to pick the best fit for the SDP pipeline’s anomaly detection in terms of both performance and runtime.

Paul Horton↗
NASA NTRS2009

Sequential Principal Component Analysis -An Optimal and Hardware-Implementable Transform for Image Compression

This paper presents the JPL-developed Sequential Principal Component Analysis (SPCA) algorithm for feature extraction / image compression, based on "dominant-term selection" unsupervised learning technique that requires an order-of-magnitude lesser computation and has simpler architecture compared to the state of the art gradient-descent techniques. This algorithm is inherently amenable to a compact, low power and high speed VLSI hardware embodiment. The paper compares the lossless image compression performance of the JPL's SPCA algorithm with the state of the art JPEG2000, widely used due to its simplified hardware implementability. JPEG2000 is not an optimal data compression technique because of its fixed transform characteristics, regardless of its data structure. On the other hand, conventional Principal Component Analysis based transform (PCA-transform) is a data-dependent-structure transform. However, it is not easy to implement the PCA in compact VLSI hardware, due to its highly computational and architectural complexity. In contrast, the JPL's "dominant-term selection" SPCA algorithm allows, for the first time, a compact, low-power hardware implementation of the powerful PCA algorithm. This paper presents a direct comparison of the JPL's SPCA versus JPEG2000, incorporating the Huffman and arithmetic coding for completeness of the data compression operation. The simulation results show that JPL's SPCA algorithm is superior as an optimal data-dependent-transform over the state of the art JPEG2000. When implemented in hardware, this technique is projected to be ideally suited to future NASA missions for autonomous on-board image data processing to improve the bandwidth of communication.

Duong, Tuan A.↗
NASA NTRS2007

New and Improved T-wave Morphology Parameters to Differentiate Healthy Individuals from those with Cardiomyopathy and Coronary Artery Disease

We investigated the ability of several known as well as new ECG repolarization parameters to differentiate healthy individuals from patients with obstructive coronary artery disease (CAD) and cardiomyopathy (CM). Advanced high-fidelity 12-lead ECG tests (approx. 5-min supine) were first performed on a "training set" of 99 individuals: 33 with ischemic or dilated CM and low ejection fraction (EF less than 40%); 33 with catheterization-proven obstructive CAD but normal EF; and 33 age-/gender-matched healthy controls. The following multiple parameters of T-wave morphology (TWM) were derived via signal averaging and singular value decomposition (SVD, which yields 8 eigenvalues, rho(sub 1) greater than rho(sub 2)...greater than rho(sub 8) and studied for their retrospective accuracy in detecting underlying disease: 1) Principal component analysis ratio of the T wave (T-PCA) = 100*rho(sub 2)/rho(sub 1); 2) Relative T-wave residuum (rTWR) = 100* SIGMA (rho(sub 4)(sup 2) +...+ rho(sub 8)(sup 2)); 3) Modified complexity ratio of the T wave (T-mCR) = 100*SIGMA(rho(sub 3)(sup 2) +...+rho(sb 8) (sup 2)); and 4) Normalized 3-dimensional volume of the T wave (nTV) = 100*(rho(sub 2)*rho(sub 3)/rho(sub 1)(sup 2). All TWM parameters significantly differentiated CAD from controls (p less than 0.0001), and also CM from controls (p less than 0.0001). Retrospective areas under the ROC curve were 0.77, 0.81, 0.82, and 0.83 (CAD vs. controls) and 0.93, 0.89, 0.95 and 0.96 (CM vs. controls) for T-PCA, rTWR, T-mCR and nTV respectively. The newer TWM parameters (T-mCR and nTV) thus outperformed the more established parameters (T-PCA and rTWR), presumably by putting a greater emphasis on the third T-wave eigenvalue, which in most healthy subjects has little energy compared to the first two eigenvalues. Subsequent prospective analyses have also yielded similar results, such that we conclude that diagnostic differentiation of pathology from non-pathology may be especially aided by detecting the transference of energy from the first and second T-wave eigenvalues into the third T-wave eigenvalue.

Greco, E. C.↗
NASA NTRS2001

Rotation of EOFs by the Independent Component Analysis: Towards A Solution of the Mixing Problem in the Decomposition of Geophysical Time Series

The Independent Component Analysis is a recently developed technique for component extraction. This new method requires the statistical independence of the extracted components, a stronger constraint that uses higher-order statistics, instead of the classical decorrelation, a weaker constraint that uses only second-order statistics. This technique has been used recently for the analysis of geophysical time series with the goal of investigating the causes of variability in observed data (i.e. exploratory approach). We demonstrate with a data simulation experiment that, if initialized with a Principal Component Analysis, the Independent Component Analysis performs a rotation of the classical PCA (or EOF) solution. This rotation uses no localization criterion like other Rotation Techniques (RT), only the global generalization of decorrelation by statistical independence is used. This rotation of the PCA solution seems to be able to solve the tendency of PCA to mix several physical phenomena, even when the signal is just their linear sum.

Aires, Filipe↗
NASA NTRS2000

Rotation of EOFs by the Independent Component Analysis: Towards a Solution of the Mixing Problem in the Decomposition of Geophysical Time Series

The Independent Component Analysis is a recently developed technique for component extraction. This new method requires the statistical independence of the extracted components, a stronger constraint that uses higher-order statistics, instead of the classical decorrelation, a weaker constraint that uses only second-order statistics. This technique has been used recently for the analysis of geophysical time series with the goal of investigating the causes of variability in observed data (i.e. exploratory approach). We demonstrate with a data simulation experiment that, if initialized with a Principal Component Analysis, the Independent Component Analysis performs a rotation of the classical PCA (or EOF) solution. This rotation uses no localization criterion like other Rotation Techniques (RT), only the global generalization of decorrelation by statistical independence is used. This rotation of the PCA solution seems to be able to solve the tendency of PCA to mix several physical phenomena, even when the signal is just their linear sum.

Aires, Filipe↗
NASA NTRS2021

Thermal Inspection of a Composite Fuselage Section Using theMethod of Proper Generalized Decomposition

Proper Generalized Decomposition (PGD) is a reduced order modeling technique for the simulation of physical systems whose governing equations depend on boundary conditions, initial conditions, material properties, and geometric parameters. It uses separated representations of system covariates combined with an iterative approximation method known as successive enrichment in order to compute an accurate parameter-dependent approximation to the full governing equations. PGD can also be used as an alternative to the Singular Value Decomposition (SVD) of a matrix and therefore as an alternative to PCA thermography. In this paper PGD was used to analyze data derived from the inspection of a composite fuselage forward section using flash thermography, and the results were compared against the standard PCA approach.

Nondestructive Evaluation↗
NASA NTRS2004

Real time on-chip sequential adaptive principal component analysis for data feature extraction and image compression

In this paper, we present a new, simple, and optimized hardware architecture sequential learning technique for adaptive Principle Component Analysis (PCA) which will help optimize the hardware implementation in VLSI and to overcome the difficulties of the traditional gradient descent in learning convergence and hardware implementation.

PCA feature extraction image compression real time↗
NASA NTRS2014

Application of Spectral Analysis Techniques in the Intercomparison of Aerosol Data: Part III. Using Combined PCA to Compare Spatiotemporal Variability of MODIS, MISR and OMI Aerosol Optical Depth

Satellite measurements of global aerosol properties are very useful in constraining aerosol parameterization in climate models. The reliability of different data sets in representing global and regional aerosol variability becomes an essential question. In this study, we present the results of a comparison using combined principal component analysis (CPCA), applied to monthly mean, mapped (Level 3) aerosol optical depth (AOD) product from Moderate Resolution Imaging Spectroradiometer (MODIS), Multiangle Imaging Spectroradiometer (MISR), and Ozone Monitoring Instrument (OMI). This technique effectively finds the common space-time variability in the multiple data sets by decomposing the combined AOD field. The results suggest that all of the sensors capture the globally important aerosol regimes, including dust, biomass burning, pollution, and mixed aerosol types. Nonetheless, differences are also noted. Specifically, compared with MISR and OMI, MODIS variability is significantly higher over South America, India, and the Sahel. MODIS deep blue AOD has a lower seasonal variability in North Africa, accompanied by a decreasing trend that is not found in either MISR or OMI AOD data. The narrow swath of MISR results in an underestimation of dust variability over the Taklamakan Desert. The MISR AOD data also exhibit overall lower variability in South America and the Sahel. OMI does not capture the Russian wild fire in 2010 nor the phase shift in biomass burning over East South America compared to Central South America, likely due to cloud contamination and the OMI row anomaly. OMI also indicates a much stronger (boreal) winter peak in South Africa compared with MODIS and MISR.

satellite observation↗
NASA NTRS2004

Fossil Signatures Using Elemental Abundance Distributions and Bayesian Probabilistic Classification

Elemental abundances (C6, N7, O8, Na11, Mg12, Al3, P15, S16, Cl17, K19, Ca20, Ti22, Mn25, Fe26, and Ni28) were obtained for a set of terrestrial fossils and the rock matrix surrounding them. Principal Component Analysis extracted five factors accounting for the 92.5% of the data variance, i.e. information content, of the elemental abundance data. Hierarchical Cluster Analysis provided unsupervised sample classification distinguishing fossil from matrix samples on the basis of either raw abundances or PCA input that agreed strongly with visual classification. A stochastic, non-linear Artificial Neural Network produced a Bayesian probability of correct sample classification. The results provide a quantitative probabilistic methodology for discriminating terrestrial fossils from the surrounding rock matrix using chemical information. To demonstrate the applicability of these techniques to the assessment of meteoritic samples or in situ extraterrestrial exploration, we present preliminary data on samples of the Orgueil meteorite. In both systems an elemental signature produces target classification decisions remarkably consistent with morphological classification by a human expert using only structural (visual) information. We discuss the possibility of implementing a complexity analysis metric capable of automating certain image analysis and pattern recognition abilities of the human eye using low magnification optical microscopy images and discuss the extension of this technique across multiple scales.

Hoover, Richard B.↗
NASA NTRS1991

The spectral relationships between NEA and the meteorites: An overview using principal components analysis

One of the primary reservoirs for meteorites is probably the planet-crossing Aten, Apollo, and Amor asteroids. Comparing the spectral characteristics of these two populations with each other and with the spectra of the main belt asteroids would provide insight into the dynamical processes that deliver meteorites to Earth. One method for obtaining an overview of general relationships in a large spectral data set is the statistical technique of principal components analysis. This technique quantifies general spectral similarities and reprojects the data in a plot of major axes of variation where distance is a measure of relative similarity. A major caveat should be kept in mind, however, spectra are sensitive to particle size and viewing geometry effects, and near Earth asteroids (NEA's) are probably significantly different from main belt asteroids in both these factors. The analysis was restricted to the spectral range of ECAS filters and included 116 meteorite spectra from the Gaffey (1976) survey and 417 asteroids from the Zellner et. al. (1985) survey of which 13 are planet-crossers. Although thirteen asteroids are not much of a sample on which to base conclusions, a few inferences can be drawn from this exercise. First, the NEA spectral characteristics are, on average, more consistent with the spectra of meteorites than are the main belt asteroids. Second, the S-type NEA's tend to be spectrally more similar to the ordinary chondrite meteorites than the main belt S-types. This suggests that the planet-crossing S-types do not represent the spectral range of the main belt S-type population and that the planet-crossing S-types are on average more like the ordinary chondrites than the main belt S-types. Third, the only direct asteroidal ordinary chondrite analog, the Q-type asteroid, 1862 Apollo, plots well within the field of the ordinary chondrite meteorites and represents the most common meteorite fall type. Finally, it is interesting that the planet-crossing asteroids occupy similar PCA space with the general trend of the meteorites while most of the main belt objects are offset from the meteorites in statistical space.

Britt, D. T.↗