Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Principal component analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

A Fast and Sensitive New Satellite SO2 Retrieval Algorithm based on Principal Component Analysis: Application to the Ozone Monitoring Instrument

We describe a new algorithm to retrieve SO2 from satellite-measured hyperspectral radiances. We employ the principal component analysis technique in regions with no significant SO2 to capture radiance variability caused by both physical processes (e.g., Rayleigh and Raman scattering and ozone absorption) and measurement artifacts. We use the resulting principal components and SO2 Jacobians calculated with a radiative transfer model to directly estimate SO2 vertical column density in one step. Application to the Ozone Monitoring Instrument (OMI) radiance spectra in 310.5-340 nm demonstrates that this approach can greatly reduce biases in the operational OMI product and decrease the noise by a factor of 2, providing greater sensitivity to anthropogenic emissions. The new algorithm is fast, eliminates the need for instrument-specific radiance correction schemes, and can be easily adapted to other sensors. These attributes make it a promising technique for producing longterm, consistent SO2 records for air quality and climate research.

Principal component analysis↗
NASA NTRS2024

Noise Reduction for Solar-Induced Fluorescence Retrievals Using Machine Learning and Principal Component Analysis: Simulations and Applications to GOME-2 Satellite Retrievals

We use a spectral-based approach that employs principal component analysis along with a relatively shallow artificial neural network (NN) to substantially reduce noise and other artifacts in terrestrial chlorophyll solar-induced fluorescence (SIF) retrievals. SIF is a very small emission at red and far-red wavelengths that is difficult to measure and is highly sensitive to random errors and systematic artifacts. Our approach relies upon an assumption that a trained NN can effectively reconstruct the total SIF signal from a relatively small number of leading principal components of the satellite-observed far-red radiance spectra without using information from the trailing modes that contain most of the random errors. We test the approach with simulated reflectance spectra produced with a full atmospheric and surface radiative transfer model using different observing and geophysical parameters and various noise levels. Resulting noisy and noise-reduced retrieved SIF values are compared with true values to assess performance. We then apply our noise reduction approach to SIF derived from two different satellite spectrometers. For evaluation, since the truth in this case is unknown, we compare SIF retrievals from two independent sensors with each other. We also compare the noise-reduced SIF temporal variations with those from an independent gross primary product (GPP) product that should display similar variations. Results show that our noise reduction approach improves capture of SIF seasonal and inter-annual variability. Our approach should be applicable to many noisy data products derived from spectral measurements. Our methodology does not replace the original retrieval algorithms; rather the original noisy retrievals are needed as the target for the NN training process.

noise reduction, solar-induced fluorescence, SIF, ↗
NASA NTRS2022

Advanced Statistical Methods in Spacecraft Flight Software Cost Estimation: Bayesian Regression and Nonlinear Principal Components Analysis to Support System Engineering in the Early Project Lifecycle

This paper provides an overview of the new features and model updates in the upcoming release of the NASA Analogy Software Cost Tool (ASCoT). ASCoT, hosted within the Online NASA Space Estimation Tools (ONSET) on the One NASA Cost Engineering (ONCE) Database, is a web-based tool that provides a suite of estimation tools to support early lifecycle NASA flight software cost analysis. In addition to the traditional parametric flight software costing method COCOMO II, ASCoT contains a Bayesian linear regression to predict total flight software development cost as a function of total spacecraft cost, as well as four analogic methods: k-Nearest Neighbors (kNN) and Clustering models to predict Effort (in work-months) and total source lines of code (SLOC). These methods are designed to work primarily with system-level inputs such as mission type (orbiter, lander, etc.), mission destination (Earth, Inner Planetary, etc.), and the number of instruments and deployables. Nonlinear principal components analysis (NLPCA) is performed to find the principal features of the data composed of both categorical and numerical variables and is necessary prior to defining our analogic methods. Sensitivity analyses and in- and out-of-sample model performance results are presented for the Bayesian CER and the analogic models.

Johnson, James K.↗
DOE OSTI2023

Diffuse Reflectance Spectroscopy and Principal Component Analysis to Retrospectively Determine Production History of Plutonium Dioxide

Diffuse reflectance spectroscopy measurements in the shortwave infrared (930–1600 nm) spectral region were acquired for Pu 2 (C 2 O 4 ) 3 •9H 2 O and its thermal decomposition product, PuO 2 . We analyzed a total of eight PuO 2 samples that were produced at different calcination temperatures (300, 350, 450, 525, 600, 675, 750, and 900 °C). Our goal was to identify spectroscopic fingerprints that could be used to gain retrospective information regarding the production parameters of these important nuclear compounds. The diffuse reflectance spectrum of Pu 2 (C 2 O 4 ) 3 •9H 2 O features several broad bands that currently preclude detailed analysis. However, all PuO 2 samples produced relatively sharp spectral features that got sharper and more intense for samples that were produced at higher calcination temperatures. The electronic band observed at 1433 nm in the diffuse reflectance spectra of PuO 2 was found to be a sensitive indicator of crystallinity; a result that is corroborated by ancillary Raman spectroscopy measurements. Principal component analysis of diffuse reflectance spectra was able to clearly rank and categorize PuO 2 samples based on the calcination temperature that was employed during their production. Thus, we show herein that important retrospective information pertaining to the process history of PuO 2 can be gained through the relatively simplistic combination of diffuse reflectance spectroscopy and principal component analysis. This discovery presents a new method for determining the provenance and process history of PuO 2 and should have an impact in the fields of nuclear forensics and nuclear nonproliferation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS2005

Method of Real-Time Principal-Component Analysis

Dominant-element-based gradient descent and dynamic initial learning rate (DOGEDYN) is a method of sequential principal-component analysis (PCA) that is well suited for such applications as data compression and extraction of features from sets of data. In comparison with a prior method of gradient-descent-based sequential PCA, this method offers a greater rate of learning convergence. Like the prior method, DOGEDYN can be implemented in software. However, the main advantage of DOGEDYN over the prior method lies in the facts that it requires less computation and can be implemented in simpler hardware. It should be possible to implement DOGEDYN in compact, low-power, very-large-scale integrated (VLSI) circuitry that could process data in real time.

Duong, Tuan↗
DOE OSTI2023

Confidentiality-preserving machine learning algorithms for soft-failure detection in optical communication networks

Automated fault management is at the forefront of next-generation optical communication networks. The increase in complexity of modern networks has triggered the need for programmable and software-driven architectures to support the operation of agile and self-managed systems. In these scenarios, the European Telecommunications Standards Institute zero-touch network and service management approach is imperative. The need for machine learning algorithms to process the large volume of telemetry data brings safety concerns as distributed cloud-computing solutions become the preferred approach for deploying reliable communication network automation. This paper’s contribution is twofold. First, we propose a simple yet effective method to guarantee the confidentiality of the telemetry data based on feature scrambling. The method allows the operation of third-party computational services without direct access to the full content of the collected data. Additionally, the effectiveness of four unsupervised machine learning algorithms for soft-failure detection is evaluated when applied to the scrambled telemetry data. The methods are based on factor analysis, principal component analysis, nonlinear principal component analysis, and singular value decomposition. Most dimensionality reduction algorithms have the common property that they can maintain similar levels of fault classification performance while hiding the data structure from unauthorized access. Evaluations of the proposed algorithms demonstrate this capability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Fault Detection via Occupation Kernel Principal Component Analysis

Reliable operation of automatic systems is heavily dependent on the ability to detect faults in the underlying dynamics. While traditional model-based methods have been widely used for fault detection, data-driven approaches have garnered increasing attention due to their ease of deployment and minimal need for expert knowledge. In this letter, we present a novel principal component analysis (PCA) method that uses occupation kernels. Occupation kernels result in feature maps that are tailored to the measured data, have inherent noise-robustness due to the use of integration, and can utilize irregularly sampled system trajectories of variable lengths for PCA. The occupation kernel PCA method is used to develop a reconstruction error approach to fault detection and its efficacy is validated using numerical simulations.

42 ENGINEERING↗
DOE OSTI2023

Quantitation of olefins in sustainable aviation fuel intermediates using principal component analysis coupled with vacuum ultraviolet spectroscopy

Olefins, a common intermediate from biomass conversion processes, are undesirable in jet fuel because of their poor thermal stability. This paper presents an approach for olefin quantitation using 2D gas chromatography coupled with vacuum ultraviolet spectroscopy. Principal component analysis was used to reduce the dimensionality of the spectroscopic data from a highly olefinic fuel intermediate. A principal component template was created that enabled olefin quantitation, which was compared to the existing GCxGC-VUV approach from the literature. The principal component method was able to identify and quantify trace amounts of cyclodienes, which were present at only 0.01 wt% in the fuel sample. The principal component approach also identifies species that fall outside of the GCxGC template. For instance, quantitation with the literature method resulted in an olefin concentration of 0.95 times that of the principal component method due to olefins falling outside of the expected GCxGC regions. The principal component results were compared with 13 C and 1 H NMR data, which confirmed that the fuel had a high concentration of olefins and alkanes with little aromatic content.

Kosir, Shane↗
NASA NTRS1985

Quantitative determination of mineral types and abundances from reflectance spectra using principal components analysis

A procedure was developed for analyzing remote reflectance spectra, including multispectral images, that quantifies parameters such as types of mineral mixtures, the abundances of mixed minerals, and particle sizes. Principal components analysis reduced the spectral dimensionality and allowed testing the uniqueness and validity of spectral mixing models. By analyzing variations in the overall spectral reflectance curves, the type of spectral mixture was identified, mineral abundances quantified and the effects of particle size identified. The results demonstrate an advantage in classification accuracy over classical forms of analysis that ignore effects of particle-size or mineral-mixture systematics on spectra. The approach is applicable to remote sensing data of planetary surfaces for quantitative determinations of mineral abundances.

Smith, M. O.↗
NASA NTRS2006

Spatiotemporal Filtering Using Principal Component Analysis and Karhunen-Loeve Expansion Approaches for Regional GPS Network Analysis

Spatial filtering is an effective way to improve the precision of coordinate time series for regional GPS networks by reducing so-called common mode errors, thereby providing better resolution for detecting weak or transient deformation signals. The commonly used approach to regional filtering assumes that the common mode error is spatially uniform, which is a good approximation for networks of hundreds of kilometers extent, but breaks down as the spatial extent increases. A more rigorous approach should remove the assumption of spatially uniform distribution and let the data themselves reveal the spatial distribution of the common mode error. The principal component analysis (PCA) and the Karhunen-Loeve expansion (KLE) both decompose network time series into a set of temporally varying modes and their spatial responses. Therefore they provide a mathematical framework to perform spatiotemporal filtering.We apply the combination of PCA and KLE to daily station coordinate time series of the Southern California Integrated GPS Network (SCIGN) for the period 2000 to 2004. We demonstrate that spatially and temporally correlated common mode errors are the dominant error source in daily GPS solutions. The spatial characteristics of the common mode errors are close to uniform for all east, north, and vertical components, which implies a very long wavelength source for the common mode errors, compared to the spatial extent of the GPS network in southern California. Furthermore, the common mode errors exhibit temporally nonrandom patterns.

displacement↗
DOE OSTI2025

Modeling MTS pyrolysis and SiC deposition kinetics using principal component analysis and neural networks

Accurate chemical kinetics modeling is crucial for improving the efficiency of chemical processing and synthesis of ceramic matrix composites. Detailed kinetic models are computationally expensive due to the large number of transported chemical species, while the simplified physics-based models, such as single-step global mechanisms, are efficient but often overlook key chemical intermediates and pathways. Recent deep learning approaches promise accurate and cost-effective models. Yet, they require additional closures for the transported nonlinear latent variables, complicating integration with existing solvers. In this work, we develop a hybrid linear—nonlinear reduced model for silicon carbide deposition from methyltrichlorosilane precursor by combining principal component analysis (PCA) and autoencoder (AE) neural network (NN) approaches. PCA is used to identify a smaller set of linear transport variables, enabling direct reuse of conventional transport solvers. NNs then reconstruct the full chemical state from these reduced variables. We demonstrate the method on a chemical vapor deposition reactor—comprising a gas-phase pyrolysis plug flow reactor and a heterogeneous surface reactor—over a wide range of temperatures, pressures, and residence times. Our PCA–AE model achieves high accuracy with only five transported scalars, achieving an eightfold cost reduction compared to detailed mechanisms, in both a priori (using data from the test set only) and a posteriori (coupled with a differential equation solver). In conclusion, notable errors arise primarily near training domain boundaries and for long residence times, indicating the need for domain shift indicators and better long-horizon predictions in future reduced chemistry model development.

autoencoder neural networks↗
NASA NTRS2000

Principal Component Analysis of Arctic Solar Irradiance Spectra

During the FIRE (First ISCPP Regional Experiment) Arctic Cloud Experiment and coincident SHEBA (Surface Heat Budget of the Arctic Ocean) campaign, detailed moderate resolution solar spectral measurements were made to study the radiative energy budget of the coupled Arctic Ocean - Atmosphere system. The NASA Ames Solar Spectral Flux Radiometers (SSFRs) were deployed on the NASA ER-2 and at the SHEBA ice camp. Using the SSFRs we acquired continuous solar spectral irradiance (380-2200 nm) throughout the atmospheric column. Principal Component Analysis (PCA) was used to characterize the several tens of thousands of retrieved SSFR spectra and to determine the number of independent pieces of information that exist in the visible to near-infrared solar irradiance spectra. It was found in both the upwelling and downwelling cases that almost 100% of the spectral information (irradiance retrieved from 1820 wavelength channels) was contained in the first six extracted principal components. The majority of the variability in the Arctic downwelling solar irradiance spectra was explained by a few fundamental components including infrared absorption, scattering, water vapor and ozone. PCA analysis of the SSFR upwelling Arctic irradiance spectra successfully separated surface ice and snow reflection from overlying cloud into distinct components.

Rabbette, Maura↗
NASA NTRSDate not supplied

Forward and Inverse Models for Satellite Remote Sensors using Principal Component Analysis

Satellite remote sensors such as AIRS on Aqua, CrIS on S-NPP, NOAA20 and JPSS-2, IASI on Metop A, B, and C make millions of observations each day with thousands of spectral channels for each observation; this poses challenges for efficiently inversion of the inherently large dataset as needed to retrieve atmospheric and surface properties. This presentation will illustrate the use of Principal Component Analysis (PCA) to speed up radiative transfer forward model calculations and to stabilize the inversion algorithms. A Principal Component-based radiative transfer model (PCRTM) developed at NASA Langley Research Center can simulate top of atmosphere (TOA) radiance or reflectance spectra from 50 cm-1 to 50000 cm-1 (200 m to 0.20 m quickly and accurately. PCRTM demonstrated very high accuracy relative to reference line-by-line radiative transfer models and it saves orders of magnitude computational time. Examples of the PCRTM model developed for hyperspectral sensors such as AIRS, CrIS, IASI, NAST-I, SHIS, CPF, TEMPO, SBG, OMI, and SCIAMACHY will be presented. In addition to using the PCRTM as forward model, the NASA Langley developed inversion algorithm also uses PCA to compress the state vector into a compressed dimension to speed up and stabilize the inversion process. Examples of retrieved atmospheric temperature, water vapor, CO2, CO, CH4, N2O, and O3 profiles, cloud properties (optical depth, size, phase, and height), and surface properties (surface emissivity spectra and skin temperatures) will be presented. This algorithm is being transitioned to the NASA Sounder SIPS and NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC).

forward model↗
NASA NTRS1989

Data structure characterization of miltispectral data using principal component and principal factor analysis

Both principal component analysis (PCA) and principal factor analysis (PFA) were used to analyze an experimental multispectral data structure in terms of common and unique variance. Only the common variance of the multispectral data was associated with the principal factor, while higher-order principal components were associated with both common and unique variance. The unique variance was found to represent small spectral variations within each cover type as well as noise vectors, and was most abundant in the lower-order principal components. The lower-order principal components can be useful in research designed to discriminate minor physical variations within features, and to highlight localized change when using multitemporal-multispectral data. Conversely, PFA of the multispectral data provided an insight into a great potential for discriminating basic land-cover types by excluding the unique variance which was related to the noise and minor spectral variations.

Lee, Jae K.↗
DOE OSTI2023

Application of Principal Component Analysis to Electrochemical Reprocessing PM and NMAC

In this report, data from an electrorefiner (ER) for nuclear fuel reprocessing is evaluated for process monitoring (PM) conclusions. This data comes from tests performed at the Idaho National Laboratory in 2022. Multivariate approaches utilizing methods of Principal Component Analysis (PCA) is applied. This is based off established work in process monitoring for fault detection in industrial facilities. This report will discuss the background, methods, and results of the application and some of the conclusions and applications that can be drawn from them. PCA is applied to two different electrorefiner (ER) operations that occurred at Idaho National Laboratory between August and October 2022. The first operation occurred with little incident while the second had several noted faults in the equipment in operational logs. The data from the first run was used to train the data for “normal” operations and applied to both sets of data to determine when operations were in an “off-normal” condition and identify where the fault occurs through PCA. PCA was able to identify off-normal events and identify the cause for off-normal operations. These identified off-normal events matched with the events and their causes in the operational logs. However, small amounts of variance in the data led to false detection of “off-normal” events. Thus, careful selection of training data and a-posteriori conclusions based off operator assessments will both be required for application of PCA to PM applications. This work demonstrated that multivariate approaches and latent variables are applicable to pyroprocessing PM applications and can be further expanded in future work as quality variables such as salt concentration from sensors and sampling become available.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Extrapolation of Type Ia Supernova Spectra into the Near-infrared Using Principal Component Analysis

Abstract We present a method of extrapolating the spectroscopic behavior of Type Ia supernovae (SNe Ia) in the near-infrared (NIR) wavelength regime up to 2.30 μ m using optical spectroscopy. Such a process is useful for accurately estimating K-corrections and other photometric quantities of SNe Ia in the NIR. A principal component analysis is performed on data consisting of Carnegie Supernova Project I & II optical and NIR FIRE spectra to produce models capable of making these extrapolations. This method differs from previous spectral template methods by not parameterizing models strictly by photometric light-curve properties of SNe Ia, allowing for more flexibility of the resulting extrapolated NIR flux. A difference of around −3.1% to −2.7% in the total integrated NIR flux between these extrapolations and the observations is seen here for most test cases including Branch core-normal and shallow-silicon subtypes. However, larger deviations from the observation are found for other tests, likely due to the limited high-velocity and broad-line SNe Ia in the training sample. Maximum-light principal components are shown to allow for spectroscopic predictions of the color-stretch light-curve parameter, s BV , within approximately ±0.1 units of the value measured with photometry. We also show these results compare well with NIR templates, although in most cases the templates are marginally more fitting to observations, illustrating a need for more concurrent optical+NIR spectroscopic observations to truly understand the diversity of SNe Ia in the NIR.

Astronomy & Astrophysics↗