Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “PRINCIPAL COMPONENT ANALYSIS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Variational encoder geostatistical analysis (VEGAS) with an application to large scale riverine bathymetry

Estimation of riverbed profiles, also known as bathymetry, plays a vital role in many applications, such as safe and efficient inland navigation, prediction of bank erosion, land subsidence, and flood risk management. The high cost and complex logistics of direct bathymetry surveys, i.e, depth imaging, have encouraged the use of indirect measurements such as surface flow velocities. However, estimating high-resolution bathymetry from indirect measurements is an inverse problem that can be computationally challenging. Here, we propose a reduced-order model (ROM) based approach that utilizes a variational autoencoder (VAE), a type of deep neural network with a narrow layer in the middle, to compress bathymetry and flow velocity information and accelerate bathymetry inverse problems from flow velocity measurements. In our application, the shallow-water equations (SWE) with appropriate boundary conditions (BCs), e.g., the discharge and/or the free surface elevation, constitute the forward problem, to predict flow velocity. Then, ROMs of the SWEs are constructed on a nonlinear manifold of low dimensionality through a variational encoder and the bathymetry inversion problem is derived on the low-dimensional latent space in a Hierarchical Bayesian setting. Further, the reformulation allows variational inference with a small number (e.g., $\mathscr{O}$ (100) of ROM runs and efficient uncertainty quantification. We have tested our inversion approach on a one-mile reach of the Savannah River, GA, USA. Once the neural network is trained (offline stage), the proposed technique can perform the inversion operation orders of magnitude faster than traditional inversion methods that are commonly based on linear projections, such as principal component analysis (PCA), or the principal component geostatistical approach (PCGA). Furthermore, tests show that the algorithm can estimate the bathymetry with good accuracy even with sparse flow velocity measurements.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2003

Applications of Sea-Ice Motion and Deformation Derived from Satellite Data

QuikSCAT backscatter, AMSR and DMSP SSM/I radiance data have been used to derive sea ice motion for both the Arctic and Antarctic region using the wavelet analysis tracking method. All results from QuikSCAT, AMSR and SSM5 are compatible with buoys and can then be merged by data fusion method to generate composite sea ice motion maps for more complete coverage. Furthermore, based on this merged data set daily sea-ice deformation (shear, and convergence) maps have been produced and show consistent spatial and temporal patterns. Temporal correlation maps between ice deformation and SSM/II ice concentration show interesting results in the Arctic, especially the coast area. In this study, principal component analysis for both the merged ice tracking result from satellite data and pressure field from buoy have also been examined for the relationship between the principal components and eigenvectors from these two data sets. While the result shows that principal components of modes 1 and 2 from two data sets are highly correlated which confirms that wind forcing is a major factor driving the ice drift, it also reveals that other high energy modes are not highly correlated which maybe caused by coastal effects. Principal component analysis of Arctic sea-ice motion during fall/winter period in different years shows the reverse of dominant modes or patterns is related to the Arctic Oscillation.

Liu, Antony K.↗
DOE OSTI2020

Machine Learning Approaches for Nuclear Material Accounting Data from Irradiation and Reprocessing

We are currently exploring data analysis methods for their ability to strengthen the synthesis and evaluation of information generated within domestic and international safeguard regimes. Safeguard data typically includes rich heterogenous datasets amenable to advanced data analytics methods, such as machine learning. We have converted transactional data containing both numerical and categorical attributes from a domestic nuclear material control and accountability (NMC&A) system into a low-dimensional numerical structure via linear principal component analysis. This data representation allows for global structure discovery via cluster analysis, which can characterize the typical behavior of each of the primary types of transaction events. Furthermore, the structure of the top principal components captures the “typical behavior” of the data and is thus amenable to anomaly detection through statistical hypothesis testing. We explored this capability by generating erroneous permutations of the data and computing the Q-residual quantity increase associated with the information loss when these data are projected into the low-dimensional principal component analysis space representative of typical transactions.Future work will focus on identifying data transformations (e.g., graph networks) that more closely align with the inherent structure of these transactions to explain more salient information and disambiguate the underlying nuclear process—in this case, irradiation and reprocessing—from artifacts of NMC&A system transactional record keeping data.

Drescher, Adam↗
NASA NTRS2005

In Situ Aerosol Profile Measurements and Comparisons with SAGE 3 Aerosol Extinction and Surface Area Profiles at 68 deg North

Under funding from this proposal three in situ profile measurements of stratospheric sulfate aerosol and ozone were completed from balloon-borne platforms. The measured quantities are aerosol size resolved number concentration and ozone. The one derived product is aerosol size distribution, from which aerosol moments, such as surface area, volume, and extinction can be calculated for comparison with SAGE III measurements and SAGE III derived products, such as surface area. The analysis of these profiles and comparison with SAGE III extinction measurements and SAGE III derived surface areas are provided in Yongxiao (2005), which comprised the research thesis component of Mr. Jian Yongxiao's M.S. degree in Atmospheric Science at the University of Wyoming. In addition analysis continues on using principal component analysis (PCA) to derive aerosol surface area from the 9 wavelength extinction measurements available from SAGE III. Ths paper will present PCA components to calculate surface area from SAGE III measurements and compare these derived surface areas with those available directly from in situ size distribution measurements, as well as surface areas which would be derived from PCA and Thomason's algorithm applied to the four wavelength SAGE II extinction measurements.

Source record↗
NASA NTRS2014

Data Analysis & Statistical Methods for Command File Errors

This paper explains current work on modeling for managing the risk of command file errors. It is focused on analyzing actual data from a JPL spaceflight mission to build models for evaluating and predicting error rates as a function of several key variables. We constructed a rich dataset by considering the number of errors, the number of files radiated, including the number commands and blocks in each file, as well as subjective estimates of workload and operational novelty. We have assessed these data using different curve fitting and distribution fitting techniques, such as multiple regression analysis, and maximum likelihood estimation to see how much of the variability in the error rates can be explained with these. We have also used goodness of fit testing strategies and principal component analysis to further assess our data. Finally, we constructed a model of expected error rates based on the what these statistics bore out as critical drivers to the error rate. This model allows project management to evaluate the error rate against a theoretically expected rate as well as anticipate future error rates.

Correlation Analysis↗
NASA NTRS1983

Shuttle Imaging Radar-A (SIR-A) data as a complement to Landsat Multispectral Scanner (MSS) data

Principal components analysis and supervised classifications were performed on two dates of Landsat multispectral scanner (MSS) data registered to one date of Shuttle Imaging Radar-A (SIR-A) data in a wheat-growing area of New South Wales, Australia. The purpose was to evaluate SIR-A data as a complement to Landsat MSS data in an agricultural environment. The SIR-A data was filtered using a 7 x 7 pixel moving window median filter. Principal components analysis indicated the SIR-A data were discriminating between trees and agricultural fields. Supervised classifications using wheat, pasture, trees, and idle classes resulted in increased accuracies for wheat and pasture and slightly decreased accuracies for trees and idle for the Landsat MSS/SIR-A registered data sets over the Landsat MSS alone. Overall classification accuracies were unchanged for one date and substantially increased for the other when the SIR-A data were added to the Landsat MSS data.

Henninger, D. L.↗
DOE OSTI2025

Using the optimal combined index weight ratio to improve the probability of anomaly detection in big area additive manufacturing

Big Area Additive Manufacturing (BAAM) of composites requires significant time, energy, and material, so it is critical to reduce production inefficiencies to make functional parts without multiple iterations. Statistical process control coupled with Principal Component Analysis (PCA) is a powerful technique that provides a quick, computationally inexpensive, and intuitive way for operators to detect defects that form in a manufacturing process without massive datasets. Recently, a combined index that is a weighted sum of the Hotelling's T 2 and squared residual error statistics has been proposed that can be monitored in one chart, improving interpretation accuracy and simplicity. However, the literature does not offer a formal method to optimise the weights. Here, we introduce two new approaches to the traditional weight selection approach using simulated and BAAM image data. Approach 1 uses a theoretically motivated optimum inspired by probabilistic principal component analysis. Approach 2 systematically varies the ratio of the weights to find the optimum. We show that approach 1 delivers optimal anomaly detection performance in select cases while approach 2 fares better in practice. Surprisingly, we also show that choosing a more complex PCA model has a minimal negative impact on anomaly detection performance compared to a more simplistic model.

3-dimensional printing↗
DOE OSTI2020

Whose Gas is it anyway? Differentiating the Source of a Large Soil Vapor Plume beneath Two Adjacent Waste Sites - 20487

DOE contractor CH2M Hill Plateau Remediation Company is currently responsible for conducting groundwater contamination monitoring at several RCRA treatment, storage, and disposal units located on the Hanford Site in Richland, Washington State. The Nonradioactive Dangerous Waste Landfill treatment, storage, and disposal unit presents a distinct groundwater monitoring problem because of a large multi-contaminant soil vapor plume beneath it that is a likely source of low-level volatile organic compound groundwater contamination. Adjacent to Nonradioactive Dangerous Waste Landfill is the Solid Waste Landfill. Volatile organic compounds are inventory components of both the Nonradioactive Dangerous Waste Landfill and the Solid Waste Landfill. Therefore, it is possible that both sites could be contributing to the soil vapor plume. For regulatory purposes, it is important to differentiate which site is the primary contributor of volatile organic compounds to the plume. An approach was developed to identify the primary volatile organic compound source of the soil vapor plume beneath Nonradioactive Dangerous Waste Landfill and Solid Waste Landfill. The site conceptual model hypothesis of vapor-phase volatile organic compound transport to the dissolved phase in groundwater was tested by a simple mathematical model of vapor/liquid equilibrium concentrations at the groundwater/air interface. Once it was shown that vapor-phase volatile organic compound transport to groundwater was a valid conceptual model for Nonradioactive Dangerous Waste Landfill and Solid Waste Landfill, spatial and statistical methods were used to determine the primary site contributing to the majority of volatile organic compounds to the soil vapor plume. Average groundwater chloroform, tetrachloroethene, and trichloroethene concentrations from Nonradioactive Dangerous Waste Landfill and Solid Waste Landfill monitoring network wells were plotted on maps of the facilities and immediate vicinities and compared to soil vapor sampling probe locations. Principal component analysis and mixing ratios were used to identify source contributions of each treatment, storage, and disposal unit to the plume. Results of the vapor/liquid equilibrium concentrations mathematical model showed that transport phenomena outweigh steady-state equilibria. Estimated vapor/liquid equilibrium concentrations were considerably lower than soil vapor measurements. The results indicate that dynamic vadose zone and groundwater factors such as decreased vapor concentrations with depth, vapor dilution from dispersion in the vadose zone, and advective and diffusional volatile organic compound dilution in groundwater result in groundwater volatile organic compound concentrations much less than would be measured under steady-state equilibrium conditions. Site source contribution differentiation by principal component analysis and mixing ratios was inconclusive using actual soil gas data because of the similarity in concentration values in both datasets for Nonradioactive Dangerous Waste Landfill and Solid Waste Landfill. Similar data populations suggest mixing of the vapor contributions from both sites by dispersion through the soil matrix pore spaces. However, when groundwater volatile organic compound data were compared between the Nonradioactive Dangerous Waste Landfill and Solid Waste Landfill monitoring networks, Solid Waste Landfill mean concentrations were higher, suggesting more vapor-phase volatile organic compound transport to groundwater at those locations. Simulated volatile organic compound soil vapor and groundwater datasets created to test the methods developed for this study show that the method can be successful in source differentiation when significantly different datasets are compared. This paper will describe a method of testing a conceptual model for vapor-phase contaminant transport to groundwater and for differentiating site sources of contaminants comprising a mixed-constituent soil vapor plume. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Bounding uncertainty in functional data: A case study

Functional data are fast becoming a preeminent source of information across a wide range of industries. A particularly challenging aspect of functional data is bounding uncertainty. In this unique case study, we present our attempts at creating bounding functions for selected applications at Sandia National Laboratories (SNL). The first attempt involved a simple extension of functional principal component analysis (fPCA) to incorporate covariates. Though this method was straightforward, the extension was plagued by poor coverage accuracy for the bounding curve. This led to a second attempt utilizing elastic methodology which yielded more accurate coverage at the cost of more complexity.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Structuring Nutrient Yields throughout Mississippi/Atchafalaya River Basin Using Machine Learning Approaches

To minimize the eutrophication pressure along the Gulf of Mexico or reduce the size of the hypoxic zone in the Gulf of Mexico, it is important to understand the underlying temporal and spatial variations and correlations in excess nutrient loads, which are strongly associated with the formation of hypoxia. This study’s objective was to reveal and visualize structures in high-dimensional datasets of nutrient yield distributions throughout the Mississippi/Atchafalaya River Basin (MARB). For this purpose, the annual mean nutrient concentrations were collected from thirty-three US Geological Survey (USGS) water stations scattered in the upper and lower MARB from 1996 to 2020. Eight surface water quality indicators were selected to make comparisons among water stations along the MARB over the past two decades. Principal component analysis (PCA) was used to comprehensively evaluate the nutrient yields across thirty-three USGS monitoring stations and identify the major contributing nutrient loads. The results showed that all samples could be analyzed using two main components, which accounted for 81.6% of the total variance. The PCA results showed that yields of orthophosphate (OP), silica (SI), nitrate–nitrites (NO 3 -NO 2 ), and total suspended sediment (TSS) are major contributors to nutrient yields. It also showed that land-planted crops, density of population, domestic and industrial discharges, and precipitation are fundamental causes of excess nutrient loads in MARB. These factors are of great significance for the excess nutrient load management and pollution control of the Mississippi River. It was found that the average nutrient yields were stable within the sub-MARB area, but the large nitrogen yields in the upper MARB and the large phosphorus yields in the lower MARB were of great concern. t-distributed stochastic neighbor embedding (t-SNE) revealed interesting nonlinear and local structures in nutrient yield distributions. Clustering analysis (CA) showed the detailed development of similarities in the nutrient yield distribution. Moreover, PCA, t-SNE, and CA showed consistent clustering results. This study demonstrated that the integration of dimension reduction techniques, PCA, and t-SNE with CA techniques in machine learning are effective tools for the visualization of the structures of the correlations in high-dimensional datasets of nutrient yields and provide a comprehensive understanding of the correlations in the distributions of nutrient loads across the MARB.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2011

Fixed Eigenvector Analysis of Thermographic NDE Data

Principal Component Analysis (PCA) has been shown effective for reducing thermographic NDE data. This paper will discuss an alternative method of analysis that has been developed where a predetermined set of eigenvectors is used to process the thermal data from both reinforced carbon-carbon (RCC) and graphiteepoxy honeycomb materials. These eigenvectors can be generated either from an analytic model of the thermal response of the material system under examination, or from a large set of experimental data. This paper provides the details of the analytic model, an overview of the PCA process, as well as a quantitative signal-to-noise comparison of the results of performing both conventional PCA and fixed eigenvector analysis on thermographic data from two specimens, one Reinforced Carbon-Carbon with flat bottom holes and the second a sandwich construction with graphite-epoxy face sheets and aluminum honeycomb core.

Cramer, K. Elliott↗
NASA NTRS2013

Application of Spectral Analysis Techniques in the Intercomparison of Aerosol Data: 1. an EOF Approach to the Spatial-Temporal Variability of Aerosol Optical Depth Using Multiple Remote Sensing Data Sets

Many remote sensing techniques and passive sensors have been developed to measure global aerosol properties. While instantaneous comparisons between pixel-level data often reveal quantitative differences, here we use Empirical Orthogonal Function (EOF) analysis, also known as Principal Component Analysis, to demonstrate that satellite-derived aerosol optical depth (AOD) data sets exhibit essentially the same spatial and temporal variability and are thus suitable for large-scale studies. Analysis results show that the first four EOF modes of AOD account for the bulk of the variance and agree well across the four data sets used in this study (i.e., Aqua MODIS, Terra MODIS, MISR, and SeaWiFS). Only SeaWiFS data over land have slightly different EOF patterns. Globally, the first two EOF modes show annual cycles and are mainly related to Sahara dust in the northern hemisphere and biomass burning in the southern hemisphere, respectively. After removing the mean seasonal cycle from the data, major aerosol sources, including biomass burning in South America and dust in West Africa, are revealed in the dominant modes due to the different interannual variability of aerosol emissions. The enhancement of biomass burning associated with El Niño over Indonesia and central South America is also captured with the EOF technique.

variability↗
DOE OSTI2020

System and method for automated extraction of high resolution structural dynamics from video

A method for extracting vibrational modes of a structure includes: receiving a plurality of video frames, each of the video frames including a plurality of pixels; decomposing each of the video frames on a plurality of spatial scales in accordance with complex steerable pyramid filters to obtain a filter response for each of the spatial scales; computing a plurality of local phases of the pixels of each frame; removing a temporal mean from each frame to obtain a plurality of factored vibration motion functions; performing principal component analysis on the factored vibration motion functions to obtain principal components; blind source separating the principal components to compute a plurality of modal coordinates; computing frequency and damping ratios in accordance with the modal coordinates; and outputting the computed frequency and damping ratios.

42 ENGINEERING↗
NASA NTRS2001

Multivariate Analysis of Solar Spectral Irradiance Measurements

Principal component analysis is used to characterize approximately 7000 downwelling solar irradiance spectra retrieved at the Southern Great Plains site during an Atmospheric Radiation Measurement (ARM) shortwave intensive operating period. This analysis technique has proven to be very effective in reducing a large set of variables into a much smaller set of independent variables while retaining the information content. It is used to determine the minimum number of parameters necessary to characterize atmospheric spectral irradiance or the dimensionality of atmospheric variability. It was found that well over 99% of the spectral information was contained in the first six mutually orthogonal linear combinations of the observed variables (flux at various wavelengths). Rotation of the principal components was effective in separating various components by their independent physical influences. The majority of the variability in the downwelling solar irradiance (380-1000 nm) was explained by the following fundamental atmospheric parameters (in order of their importance): cloud scattering, water vapor absorption, molecular scattering, and ozone absorption. In contrast to what has been proposed as a resolution to a clear-sky absorption anomaly, no unexpected gaseous absorption signature was found in any of the significant components.

Pilewskie, P.↗
DOE OSTI2022

Functional Data Analysis for Extracting the Intrinsic Dimensionality of Spectra: Application to Chemical Homogeneity in the Open Cluster M67

High-resolution spectroscopic surveys of the Milky Way have entered the Big Data regime and have opened avenues for solving outstanding questions in Galactic archeology. However, exploiting their full potential is limited by complex systematics, whose characterization has not received much attention in modern spectroscopic analyses. In this work, we present a novel method to disentangle the component of spectral data space intrinsic to the stars from that due to systematics. Using functional principal component analysis on a sample of 18,933 giant spectra from APOGEE, we find that the intrinsic structure above the level of observational uncertainties requires ≈10 functional principal components (FPCs). Our FPCs can reduce the dimensionality of spectra, remove systematics, and impute masked wavelengths, thereby enabling accurate studies of stellar populations. To demonstrate the applicability of our FPCs, we use them to infer stellar parameters and abundances of 28 giants in the open cluster M67. We employ Sequential Neural Likelihood, a simulation-based Bayesian inference method that learns likelihood functions using neural density estimators, to incorporate non-Gaussian effects in spectral likelihoods. By hierarchically combining the inferred abundances, we limit the spread of the following elements in M67: Fe ≲ 0.02 dex; C ≲ 0.03 dex; O, Mg, Si, Ni ≲ 0.04 dex; Ca ≲ 0.05 dex; N, Al ≲ 0.07 dex (at 68% confidence). Our constraints suggest a lack of self-pollution by core-collapse supernovae in M67, which has promising implications for the future of chemical tagging to understand the star formation history and dynamical evolution of the Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

DESI Emission-line Galaxies: Unveiling the Diversity of [O II ] Profiles and Its Links to Star Formation and Morphology

We study the [O II ] profiles of emission-line galaxies (ELGs) from the Early Data Release of the Dark Energy Spectroscopic Instrument (DESI). To this end, we decompose and classify the shape of [O II ] profiles with the first two eigenspectra derived from principal component analysis. Our results show that DESI ELGs have diverse line profiles, which can be categorized into three main types: (1) narrow lines with a median width of ∼50 km s −1 , (2) broad lines with a median width of ∼80 km s −1 , and (3) two redshift systems with a median velocity separation of ∼150 km s −1 , i.e., double-peak galaxies. To investigate the connections between the line profiles and galaxy properties, we utilize the information from the COSMOS data set and compare the properties of ELGs, including star formation rate (SFR) and galaxy morphology, with the average properties of reference star-forming galaxies with similar stellar mass, sizes, and redshifts. Our findings show that, on average, DESI ELGs have a higher SFR and more asymmetrical/disturbed morphology than the reference galaxies. Moreover, we uncover a relationship between the line profiles, the excess SFR, and the excess asymmetry parameter, showing that DESI ELGs with broader [O II ] line profiles have more disturbed morphology and higher SFR than the reference star-forming galaxies. Finally, we discuss possible physical mechanisms giving rise to the observed relationship and the implications of our findings on the galaxy clustering measurements, including the halo occupation distribution modeling of DESI ELGs and the observed excess velocity dispersion of the satellite ELGs.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Covariate Dependent Sparse Functional Data Analysis

This study proposes a method to incorporate covariate information into sparse functional data analysis. The method aims at cases where each subject has a limited number of longitudinal measurements and is associated with static covariates. This research is motivated by several use cases in practice. One representative example is void swelling, a nuclear-specific material degradation mechanism. Void swelling is affected by many covariates, including alloy composition and irradiation type. How to accurately model the complicated joint effects of such covariates on the swelling process is the key to mitigating the effect of swelling and ensuring safe operation. Unlike most of the existing methods, the proposed method can handle high-dimensional covariates with the informative covariate identification procedure and sparse and irregularly spaced measurements, that is, does not require complete or dense observations. The main innovation of the proposed method is that we model the variation coming from covariates and the variation left conditioned on covariates, such that the functional principal component analysis and Gaussian process can be conducted in a unified manner. Further, we also propose a systematic approach to identify important covariates in the hypothesis testing context. The methodology is demonstrated on applications in nuclear engineering and healthcare and simulation studies.

42 ENGINEERING↗