SEARCH · Engineering Papers

Results for “Principal Component Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

All sources NASA NTRS DOE OSTI

DOE OSTI2017

Characterizing Time Series Data Diversity for Wind Forecasting

Wind forecasting plays an important role in integrating variable and uncertain wind power into the power grid. Various forecasting models have been developed to improve the forecasting accuracy. However, it is challenging to accurately compare the true forecasting performances from different methods and forecasters due to the lack of diversity in forecasting test datasets. This paper proposes a time series characteristic analysis approach to visualize and quantify wind time series diversity. The developed method first calculates six time series characteristic indices from various perspectives. Then the principal component analysis is performed to reduce the data dimension while preserving the important information. The diversity of the time series dataset is visualized by the geometric distribution of the newly constructed principal component space. The volume of the 3-dimensional (3D) convex polytope (or the length of 1D number axis, or the area of the 2D convex polygon) is used to quantify the time series data diversity. The method is tested with five datasets with various degrees of diversity.

big data visualization↗

DOE OSTI2014

TU-C-17A-04: BEST IN PHYSICS (THERAPY) - A Supervised Framework for Automatic Contour Assessment for Radiotherapy Planning of Head- Neck Cancer

Purpose: Precise contour delineation of tumor targets and critical structures from CT simulations is essential for accurate radiotherapy (RT) treatment planning. However, manual and automatic delineation processes can be error prone due to limitations in imaging techniques and individual anatomic variability. Tedious and laborious manual verification is hence needed. This study develops a general framework for automatically assessing RT contours for head-neck cancer patients using geometric attribute distribution models (GADMs). Methods: Geometric attributes (centroid and volume) were computed from physician-approved RT contours of 29 head-neck patients. Considering anatomical correlation between neighboring structures, the GADM for each attribute was trained to characterize intra- and interpatient structure variations using principal component analysis. Each trained GADM was scalable and deformable, but constrained by the principal attribute variations of the training contours. A new hierarchical model adaptation algorithm was utilized to assess the RT contour correctness for a given patient. Receiver operating characteristic (ROC) curves were employed to evaluate and tune system parameters for the training models. Results: Experiments utilizing training and non-training data sets with simulated contouring errors were conducted to validate the framework performance. Promising assessment results of contour normality/abnormality for the training contour-based data were achieved with excellent accuracy (0.99), precision (0.99), recall (0.83), and F-score (0.97), while corresponding values of 0.84, 0.96, 0.83, and 0.9 were achieved for the non-training data. Furthermore, the areas under the ROC curves were above 0.9, validating the accuracy of this test. Conclusion: The proposed framework can reliably identify contour normality/abnormality based upon intra- and inter-structure constraints derived from clinically-approved contours. It also allows physicians to analytically determine the system parameters to fit various clinic requirements (e.g. as-low-as-possible false positives). It has great potential for improving RT work flow. More geometric attributes and training sets will be investigated to improve framework performance in the future.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2018

Automated Classification and Analysis of Non-metallic Inclusion Data Sets

The aim of this study is to utilize principal component analysis (PCA), clustering methods, and correlation analysis to condense and examine large, multivariate data sets produced from automated analysis of non-metallic inclusions. Non-metallic inclusions play a major role in defining the properties of steel and their examination has been greatly aided by automated analysis in scanning electron microscopes equipped with energy dispersive X-ray spectroscopy. The methods were applied to analyze inclusions on two sets of samples: two laboratory-scale samples and four industrial samples from a near-finished 4140 alloy steel components with varying machinability. The laboratory samples had well-defined inclusions chemistries, composed of MgO-Al{sub 2}O{sub 3}-CaO, spinel (MgO-Al{sub 2}O{sub 3}), and calcium aluminate inclusions. The industrial samples contained MnS inclusions as well as (Ca,Mn)S + calcium aluminate oxide inclusions. PCA could be used to reduce inclusion chemistry variables to a 2D plot, which revealed inclusion chemistry groupings in the samples. Clustering methods were used to automatically classify inclusion chemistry measurements into groups, i.e., no user-defined rules were required.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Comparison of machine learning techniques to optimize the analysis of plutonium surrogate material via a portable LIBS device

The utilization of machine learning techniques has become commonplace in the analysis of optical emission spectra. These methods are often limited to variants of principal components analysis (PCA), partial-least squares (PLS), and artificial neural networks (ANNs). A plethora of other techniques exist and are well established in the world of data science, yet are seldom investigated for their use in spectroscopic problems. In this study, machine learning techniques were used to analyze optical emission spectra of laser-induced plasma from ceria pellets doped with silicon in order to predict silicon content. Additionally, a boosted regression ensemble model was created, and its predictive accuracy was compared to that of traditional PCA, PLS, and ANN regression models. Boosted regression tree ensembles yielded fits with R-squared (R2) values as high as 0.964 and mean-squared errors of prediction (MSEPs) as low as 0.074, providing the most accurate predictive model. Neural networks performed with slightly lower R2 values and higher MSEPs compared to the ensemble methods, thus indicating susceptibility to overfitting.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS1982

Principal Components as a Data Reduction and Noise Reduction Technique

The potential of principal components as a pipeline data reduction technique for thematic mapper data was assessed and principal components analysis and its transformation as a noise reduction technique was examined. Two primary factors were considered: (1) how might data reduction and noise reduction using the principal components transformation affect the extraction of accurate spectral classifications; and (2) what are the real savings in terms of computer processing and storage costs of using reduced data over the full 7-band TM complement. An area in central Pennsylvania was chosen for a study area. The image data for the project were collected using the Earth Resources Laboratory's thematic mapper simulator (TMS) instrument.

Imhoff, M. L.↗

DOE OSTI2015

Type II and type III radio bursts and their correlation with solar energetic proton events

Using the Wind/WAVES radio observations from 2010 to 2013, we present an analysis of the 123 decametric–hectometric (DH) type II solar radio bursts during this period, the associated type III burst properties, and their correlation with solar energetic proton (SEP) properties determined from analysis of the Geostationary Operational Environmental Satellite (GOES) observations. We present a useful catalog of the type II burst, type III burst, Langmuir wave, and proton flux properties for these 123 events, which we employ to develop a statistical relationship between the radio properties and peak proton flux that can be used to forecast SEP events. We find that all SEP events with a peak >10 MeV flux above 15 protons cm{sup −2} s{sup −1} sr{sup −1} are associated with a type II burst and virtually all SEP events, 92%, are also associated with a type III radio burst. Based on a principal component analysis, the radio burst properties that are most highly correlated with the occurrence of gradual SEP events and account for the most variance in the radio properties are the type III burst intensity and duration. Further, a logistic regression analysis with the radio-derived principal component (dominated by the type III and type II radio burst intensity and type III duration) obtains SEP predictions approaching the human forecaster rates, with a false alarm rate of 22%, a probability of detection of 62%, and with 85% of the classifications correct. Therefore, type III radio bursts that occur along with a DH type II burst are shown to be an important diagnostic that can be used to forecast SEP events.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2004

Global variability of precipitation according to the Tropical Rainfall Measuring Mission

Numerous studies have documented the effect of El Nino-Southern Oscillation (ENSO) on rainfall in many regions of the globe. The question of whether ENSO is the single most important factor in interannual rainfall variability has received less attention, mostly because the kind of data that would be required to make such an assessment were simply not available. Until 1979 the evidence linking El Nino with changes in rainfall around the world came from rain gauges measuring precipitation over land masses and a handful of islands. From 1980 until the launch of the Tropical Rainfall Measuring Mission (TRMM) in November 1997 the remote sensing evidence was confined to ocean rainfall because of the very poor sensitivity of the instruments over land. In this paper we summarize the results of a principal component analysis of TRMM's 60-month (January 1998 to December 2002) global land and ocean remote-sensing record of monthly rainfall accumulations. Contrary to the first principal component of the rainfall itself, the first three indices of the anomaly are most sensitive to precipitation over the ocean rather than over the land. With the help of archived surface station data the first TRMM rain anomaly index is extended back several decades. Comparison of the extended index with the Southern Oscillation Index confirms that the first principal component of the rainfall anomaly is strongly correlated with the ENSO indices.

rainfall↗

NASA NTRS2012

Representation of Probability Density Functions from Orbit Determination using the Particle Filter

Statistical orbit determination enables us to obtain estimates of the state and the statistical information of its region of uncertainty. In order to obtain an accurate representation of the probability density function (PDF) that incorporates higher order statistical information, we propose the use of nonlinear estimation methods such as the Particle Filter. The Particle Filter (PF) is capable of providing a PDF representation of the state estimates whose accuracy is dependent on the number of particles or samples used. For this method to be applicable to real case scenarios, we need a way of accurately representing the PDF in a compressed manner with little information loss. Hence we propose using the Independent Component Analysis (ICA) as a non-Gaussian dimensional reduction method that is capable of maintaining higher order statistical information obtained using the PF. Methods such as the Principal Component Analysis (PCA) are based on utilizing up to second order statistics, hence will not suffice in maintaining maximum information content. Both the PCA and the ICA are applied to two scenarios that involve a highly eccentric orbit with a lower apriori uncertainty covariance and a less eccentric orbit with a higher a priori uncertainty covariance, to illustrate the capability of the ICA in relation to the PCA.

Mashiku, Alinda K.↗

DOE OSTI2014

1 H NMR metabolomics study of metastatic melanoma in C57BL/6J mouse spleen

Melanoma is a malignant tumor of melanocytes. Although extensive investigations have been done to study metabolic changes in primary melanoma in vivo and in vitro, little effort has been devoted to metabolic profiling of metastatic tumors in organs other than lymph nodes. As such, in this work, NMR-based metabolomics combined with multivariate data analysis is used to study metastatic B16-F10 melanoma in C57BL/6J mouse spleen. Principal Component Analysis (PCA), an unsupervised multivariate data analysis method, is used to detect possible outliers, while Orthogonal Projection to Latent Structure (OPLS), a supervised multivariate data analysis method, is employed to find important metabolites responsible for discriminating the control and the melanoma groups. Two different strategies, i.e., spectral binning and spectral deconvolution, are used to reduce the original spectral data before statistical analysis. Spectral deconvolution is found to be superior for identifying a set of discriminatory metabolites between the control and the melanoma groups, especially when the sample size is small. OPLS results show that the melanoma group can be well separated from its control group. It is found that taurine, glutamate, aspartate, O-Phosphoethanolamine, niacinamide ,ATP, lipids and glycerol derivatives are decreased statistically and significantly while alanine, malate, xanthine, histamine, dCTP, GTP, thymidine, 2'-Deoxyguanosine are statistically and significantly elevated. Furthermore, these significantly changed metabolites are associated with multiple biological pathways and may be potential biomarkers for metastatic melanoma in spleen.

1H NMR metabolomics↗

DOE OSTI2021

Identification and correction of temporal and spatial distortions in scanning transmission electron microscopy

Scanning transmission electron microscopy (STEM) has become the technique of choice for quantitative characterization of atomic structure of materials, where the minute displacements of atomic columns from high-symmetry positions can be used to map strain, polarization, octahedra tilts, and other physical and chemical order parameter fields. The latter can be used as inputs into mesoscopic and atomistic models, providing insight into the correlative relationships and generative physics of materials on the atomic level. However, these quantitative applications of STEM necessitate understanding the microscope induced image distortions and developing the pathways to compensate them both as part of a rapid calibration procedure for in situ imaging, and the post-experimental data analysis stage. Here, we explore the spatiotemporal structure of the microscopic distortions in STEM using multivariate analysis of the atomic trajectories in the image stacks. Based on the behavior of principal component analysis (PCA), we develop the Gaussian process (GP)-based regression method for quantification of the distortion function. The limitations of such an approach and possible strategies for implementation as a part of in-line data acquisition in STEM are discussed. Here, the analysis workflow is summarized in a Jupyter notebook that can be used to retrace the analysis and analyze the reader's data.

36 MATERIALS SCIENCE↗

NASA NTRS2022

Using Machine Learning for Timely Estimates of Ocean Color Information From Hyperspectral Satellite Measurements in the Presence of Clouds, Aerosols, and Sunglint

Retrievals of ocean color from space are important for better understanding of the ocean ecosystem but can be limited under conditions such as clouds, aerosols, and sunglint. Many ocean color algorithms use a few selected spectral bands to perform an atmospheric correction and then derive the upwelling radiance from the ocean. The limitations in the atmospheric correction under certain conditions lead to many gaps in daily spatial coverage of ocean color retrievals. To address these limitations, we introduce a new approach that uses machine learning to estimate ocean color from top of atmosphere radiances or reflectance measurements. In this approach, a principal component analysis is used to decompose the hyperspectral measurements into spectral features that describe the scattering and absorption of the atmosphere and the underlying surface. The coefficients of the principal components are then used to train a neural network to predict ocean color properties derived from the MODIS atmospheric correction algorithm. This machine learning approach is independent of a priori information and does not rely on any radiative transfer modeling. We apply the approach to two hyperspectral UV/VIS instruments, the ozone monitoring instrument (OMI) and the TROPOspheric Monitoring Instrument (TROPOMI), using measurements from 320–500 nm to show that it can be used to reproduce ocean color properties in less-than-ideal conditions. This machine learning approach complements the current atmospheric correction ocean color retrievals by filling in the gaps resulting from cloud, aerosol, and sunglint contamination. This method can be applied to the future hyperspectral Ocean Color Instrument (OCI), which will be onboard NASA’s Plankton, Aerosol Cloud, ocean Ecosystem (PACE) ocean color satellite set to launch in 2024.

Ocean color↗

DOE OSTI2018

NMR-based serum metabolomics study reveals a innovative diagnostic model for missed abortion

A missed abortion (MA) is an in-utero death of the embryo or fetus before the 20th week of gestation with retained products of conception. In order to discover novel biomarkers for MA, a {sup 1}H NMR spectroscopy-based metabolomics approach was applied to detect human MA serum metabolic profiles. Serum samples were obtained from patients with MA (n = 15) and healthy controls (n = 9) for study. The NOESYPR1D spectrum combined with multi-variate pattern recognition analysis was used to cluster the groups and establish a disease-specific metabolites phenotype. Principal component analysis (PCA) and orthogonal partial least-squares discriminant analysis (OPLS-DA) models were capable of distinguishing MA patients from healthy subjects. The results revealed that 24 metabolites altered in MA patients compared with the control population. Metabolomic pathway analysis demonstrated that alanine, aspartate and glutamate metabolism, citrate cycle (TCA cycle), taurine and hypotaurine metabolism were significantly altered in MA. The results indicated that serum NMR-based metabolomic profiling method is sensitive and specific enough to distinguish MA and from healthy controls, this method could be developed as a clinically useful diagnostic tool for MA. The finding from the MA serum metabolic profiling shed a new light on further understanding of MA disease mechanisms.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Clustering High-dimensional Toxicogenomics Data with Rare Signals

Toxicogenomics studies the gene and protein activities to drug treatments or toxic exposures. As the drugs and genes are numerous, toxicogenomics data are naturally high dimensional, with dimension sizes up to millions. In addition, the distribution of toxicogenomics data is oftentimes skewed, and they contain rare but important signals representing a cell or organism’s response to toxicity. The combination of high dimension and extremely skewed distribution of toxicogenomics data makes clustering analysis extremely challenging.We present our study of clustering toxicogenomics data using classical approaches such as principal component analysis as well as deep learning approaches such as auto-encoders. Our experiments show that these approaches fail to preserve rare signals and produce high-quality clusters. We then explore augmenting matrix factorization with deep learning techniques such as attention mechanism to produce latent representations for clustering. Our technique is able to better preserve rare signals after dimensionality reduction than prior approaches. Furthermore, we combine our augmented matrix factorization with a mechanism similar to autoencoder to balance separable clusters and low regeneration errors. Our experiments demonstrate better clustering with our proposed approach.

Cong, Guojing↗

NASA NTRS1985

Preliminary Comparisons of the Information Content and Utility of TM Versus MSS Data

Some preliminary indications were provided as to the relative merits of actual TM data versus MSS data for land cover mapping related applications. Three analyses were designed which had sensitivity to the differences in spectral, spatial and radiometric parameters between the TM and MSS. In the water body analysis, a primarily spatially related test, the detectability of small uniform targets was examined. The principal components analysis, an examination of the inherent dimensionality of the data, was more spectrally and radiometrically related. The spectral clustering analysis, also heavily spectrally and radiometrically influenced, provided information on the types of targets separable on TM versus MSS data. These analyses were to be conducted with simultaneously collected LANDSAT-4 complete TM (7 band) and MSS (4 band) data. In actuality, 4-band TM data, and archived LANDSAT-2 MSS data of the same area were used.

Markham, B. L.↗

NASA NTRS1990

Pattern recognition of clouds and ice in polar regions

The study is based on AVHRR imagery and results from Landsat high-spatial-resolution scenes. Among the textual features investigated are the gray level difference vector (GLDV), and sum and difference histogram (SADH) approaches as well as gray level run length, spatial-coherence, and spectral-histogram measures. The traditional stepwise discriminant analysis and neural-network analysis are used for the identification of 20 Arctic surface and cloud classes. A principal-component analysis and hybrid architecture employing a modularized competitive learning layer are utilized. It is pointed out that the cloud-classification accuracy comparable to that of back-propagation could be achieved with a training time two orders of magnitude faster.

Welch, R. M.↗

NASA NTRSDate not supplied

A Principal Component and Machine Learning Approach to Spatially Gap Fill Hyperspectral Ocean Color Satellite Retrievals

Retrievals of ocean color properties from space are important for monitoring the health of the ocean ecosystem but such retrievals tend to be limited in spatial coverage due to conditions such as clouds, aerosols, and sun glint. Gap filling of ocean color retrievals is typically performed by combining retrievals from multiple satellites or temporally averaging multiple days of retrievals but despite these techniques large gaps still exist posing challenges for near real time monitoring of events like harmful algae blooms. To address these limitations, we propose a spatial gap filling approach using machine learning to learn how to perform an atmospheric correction under challenging retrieval conditions. In this approach a principal component analysis is used to decompose the hyperspectral measurements into spectral features that describe the scattering and absorption of the atmosphere as well as the underlying surface. The coefficients of the principal components are then used to train a neural network to predict ocean color properties derived from a standard ocean color algorithm such as the MODIS atmospheric correction algorithm. This machine learning approach is independent of a priori information and does not rely on any radiative transfer modeling. We apply the approach to two hyperspectral UV/VIS instruments, the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) to show that it can be used to estimate ocean color properties such as chlorophyll, remote sensing reflectance, and fluorescence line height. This method could be used as a gap-filling technique for the future Ocean Color Instrument (OCI) which will be onboard NASA's Plankton, Aerosol Cloud, ocean Ecosystem (PACE) ocean color satellite to provide additional information for monitoring the health of our global oceans. Additionally, it could be applied to the geostationary satellite Tropospheric Emissions: Monitoring of Pollution (TEMPO) to better understand diurnal variability in ocean ecology.

MODIS atmospheric correction algorithm↗

DOE OSTI2023

A bi-level data-driven framework for fault-detection and diagnosis of HVAC systems

Long-term operation of heating, ventilation, and air conditioning (HVAC) systems will eventually lead to a range of HVAC system failures, resulting in excessive energy consumption and maintenance costs. Here, to avoid HVAC malfunctioning, fault detection diagnostic (FDD) is utilized as a common practice. Machine learning methods have lately received considerable interest for FDD analysis of HVAC systems due to their high detection accuracy. Meanwhile, HVAC malfunctions are regarded as rare occurrences, hence normal operating data samples are much more accessible than data samples in faulty and malfunctioning conditions. The dominating frequency of normal operation in HVAC datasets has also led to heavily biased classification algorithms within the literature. Moreover, the focus of previous literature has been on increasing the accuracy of the models which leads to a high number of false positives (misleading alarms) in the system. In order to enhance the performance of diagnostic procedures and fill the mentioned gaps, this study proposes a novel data-driven framework. A bi-level machine learning framework is developed for diagnosing faults in air handling units (AHUs) and rooftop units (RTUs) based on principal component analysis (PCA), time series anomaly detection, and random forest (RF). It is shown that PCA can reduce the dataset dimension with one principal component accounting for 95% of data variance. Also, the random forest could classify the faults with 89% precision for single-zone AHU, 85% precision for RTU, and 79% for multi-zone AHU. By proposing this framework, three persistent challenges are addressed: (I) minimizing false positives; (II) accounting for data imbalance; and (III) normal condition monitoring of equipment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2016

Principal shapes and squeezed limits in the effective field theory of large scale structure

We apply an orthogonalization procedure on the effective field theory of large scale structure (EFT of LSS) shapes, relevant for the angle-averaged bispectrum and non-Gaussian covariance of the matter power spectrum at one loop. Assuming natural-sized EFT parameters, this identifies a linear combination of EFT shapes—referred to as the principal shape—that gives the dominant contribution for the whole kinematic plane, with subdominant combinations suppressed by a few orders of magnitude. For the covariance, our orthogonal transformation is in excellent agreement with a principal component analysis applied to available data. Additionally we find that, for both observables, the coefficients of the principal shapes are well approximated by the EFT coefficients appearing in the squeezed limit, and are thus measurable from power spectrum response functions. Employing data from N-body simulations for the growth-only response, we measure the single EFT coefficient describing the angle-averaged bispectrum with Ο (10%) precision. These methods of shape orthogonalization and measurement of coefficients from response functions are valuable tools for developing the EFT of LSS framework, and can be applied to more general observables.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗