Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “PCA”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Neural Learning Based Blind Source Separation for Detection of Material Defects in Pulsed Thermography Images

In this paper, we introduce a neural learning-based approach to blind source separation for detection of material flaws in pulsed thermography (PT) images. This approach can be used to detect internal defects (pores) in metallic Additively Manufactured (AM) materials. Such defects occur in high-strength alloys produced with direct laser sintering AM method for nuclear energy applications. Pulsed thermal imaging system utilizes a high intensity flash lamp to rapidly heat surface of sample, a high sensitivity infrared camera to capture data of surface temperature variations. The data cube obtained with PT (stack of surface temperature images at different times) can be analyzed with image processing algorithms to detect material defects. Compared with conventional nondestructive evaluation (NDE) methods, such as digital radiography and ultrasonic testing, the PT pulsed infrared thermal detection technique has advantages of one-sided non-contact measurements, fast processing of large sample areas captured in one image. Detection of small material defects requires finding features in thermal images, which have signal contrast levels approaching sensitivity limit of IR camera. In this study, an optimized Neural Learning based Blind Source Separation (NLBSS) algorithm, including Principal Component Analysis (PCA), and Independent Component Analysis (ICA) is demonstrated to automatically extract principal temporal and spatial features of thermography frames to enhance flaw detection. By using the NLBSS algorithm, material internal defects can be automatically detected. Furthermore, this processing approach compensates for experimental thermal imaging artifacts, such as noise and uneven heating. By merging artificial intelligence with the photothermic, the NDE system detects internal calibrated defects of various sizes and depths in AM nuclear-grade metallic alloys.

Zhang, Xin↗
DOE OSTI2018

Performance Issues of SYRK Implementations in Shared Memory Environments for Edge Cases

The symmetric rank-k update (SYRK) is a level-3 BLAS routine commonly used by many Data Mining/Machine Learning(DM/ML) algorithms such as regression, dimensionality reduction algorithms like PCA, matrix factorization and k-mean clustering. This paper presents a comprehensive analysis of the SYRK routine under popular dense linear algebra libraries such as OpenBLAS, Intel MKL, and BLIS particularly focusing on edge cases of dense matrices (thin or fat shapes) that are common in DM/ML applications. Our work identifies some performance issues of the SYRK routine in multi-threaded shared memory environments for edge cases and discuss matrix dependent modifications for performance improvement.

Hossain, Md Mosharaf↗
DOE OSTI2016

Universal Collaboration Strategies for Signal Detection: A Sparse Learning Approach

Here, this paper considers the problem of high-dimensional signal detection in a large distributed network whose nodes can collaborate with their one-hop neighboring nodes (spatial collaboration). We assume that only a small subset of nodes communicate with the fusion center (FC). We design optimal collaboration strategies which are universal for a class of deterministic signals. By establishing the equivalence between the collaboration strategy design problem and sparse principal component analysis (PCA), we solve the problem efficiently and evaluate the impact of collaboration on detection performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Application of Multivariate Data Analysis Techniques for the Portable Isotopic Neutron Spectroscopy system

The Portable Isotopic Neutron Spectroscopy (PINS) is a commercialized system developed by Idaho National Laboratory (INL) to examine chemical compounds non-destructively, utilizing Prompt Gamma Neutron Activation Analysis (PGNAA) techniques. The PINS systems have been successfully deployed around the world to identify chemical munitions and containers. The PINS system takes advantage of a high-resolution gamma-ray spectrum from a high-purity germanium (HPGe) detector, and gamma-ray peak analysis provides input to its chemical identification logic with the probabilistic decision tree (PDT). Gamma-ray peak analyses, however, require knowledge of pre-selected gamma-ray peaks whose energies, intensities, and origins are well studied, and some peaks might be excluded from the decision making processes due to lack of current nuclear data. In contrast, Multivariate Analysis (MVA) treats a whole gamma-ray spectrum as a collection of multiple variables or a pattern. The effectiveness of chemical identification algorithm is determined by the availability of a wide range of data to train an algorithm to identify chemical fills with accuracy. INL has a collection of gamma-ray spectra of various chemical-fills from the field-deployed PINS systems over the years, and it was envisaged to combine such a database with the principle of multivariate statistics. Therefore, in parallel with the current decision tree algorithm, an MVA-based chemical identification algorithm was developed as an independent verification of the current results. The Principal Component Analysis (PCA) method was adopted to build an MVA-based identification algorithm, using the collected field data to refine and validate the algorithm. A benchmarking study of the MVA-based algorithm’s performance was conducted alongside the current algorithm, with the results presented and discussed in this study.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2018

Multimodal biological analysis using NLP and expression profile

The goal of this project is to gather biological data from different sources and use computational analysis to evaluate it together. Two data sources were used: microarray gene expression data for Arabidopsis thaliana, and gene co-occurrences in scientific literature extracted from bioRxiv using natural language processing (NLP). For analysis, the microarray data was normalized, its dimensionality was reduced using principal component analysis (PCA), and it was grouped into different numbers of clusters using K-means clusters. Then these expression clusters were compared to the co-occurrence pairs in the NLP data, to evaluate the quality of the NLP extractions. This evaluation was done using entropy analysis on the combined data, compared to the maximum entropy in the clustering alone. As a result, the evaluation of the NLP data shows that the results do correspond to the clusters from the microarray data, and may be used for further analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A Survey of Singular Value Decomposition Methods for Distributed Tall/Skinny Data

The Singular Value Decomposition (SVD) is one of the most important matrix factorizations, enjoying a wide variety of applications across numerous application domains. In statistics and data analysis, the common applications of SVD inclue Principal Components Analysis (PCA) and regression. Usually these applications arise on data that has far more rows than columns, so-called "tall/skinny" matrices. In the big data analytics context, this may take the form of hundreds of millions to billions of rows with only a few hundred columns. There is a need, therefore, for fast, accurate, and scalable tall/skinny SVD implementations which can fully utilize modern computing resources. To that end, we present a survey of three different algorithms for computing the SVD for these kinds of tall/skinny data layouts using MPI for communication. We contextualize these with common big data analytics techniques. Finally, we present both CPU and GPU timing results from the Summit supercomputer, and discuss possible alternative approaches.

Schmidt, Drew↗
DOE OSTI2021

Prediction of DIII-D Pedestal Structure From Externally Controllable Parameters

The sharp increase of pressure at the edge of a high confinement mode (H-mode) plasma, the pedestal, strongly impacts overall plasma performance. Predicting the pedestal is a necessity to control and optimize tokamak operations. Here, an experimental data-driven machine learning (ML) approach is presented that predicts the pedestal heights and widths of electron density (n e ) and electron temperature (T e ) profiles as well as the separatrix ne from externally controllable parameters such as the plasma shape, heating method and power, and gas puff rate and integrated gas puff. The OMFIT framework was used with DIII-D data to efficiently, robustly, and automatically build a database of pedestal parameters to train machine learning models. Database creation was enabled by the search engine tool for DIII-D data, TokSearch, which parallelizes data fetching, enabling fast searches through basic signals of thousands of DIII-D shots and selection of relevant time intervals. Principal Component Analysis (PCA) separated the database into three clusters that represent classes of plasma shapes that are regularly used in DIII-D. The most important parameters for setting the pedestal structure were plasma current (I p ), toroidal magnetic field (B Φ ), neutral beam heating power (P NBI ) and shaping quantities. The Deep Jointly Informed Neural Networks (DJINN) algorithm was applied to identify suitable neural network (NN) architectures that appropriately capture the features of the pedestal database. Separate NNs were implemented for each pedestal parameter, and ensembling methods were used to improve the prediction accuracy and allowed estimation of the prediction uncertainty. The pedestal predictions of the test dataset lie within the measurement uncertainties of the pedestal parameters. The NN outperformed simple Linear Regression (LR) analysis, indicating non-linear dependencies in the pedestal structure. The presented achievements illustrate a promising path for future research, using feature extraction to infer experimental trends and thereby improve pedestal models as well as deploying NN for a fast pedestal prediction in DIII-D scenario development.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Data-driven Event Identification in the U.S. Power Systems Based on 2D-OLPP and RUSBoosting Trees

Accurate event identification is an essential part of situation awareness ability for power system operators. Therefore, this work proposes an integrated event identification algorithm for power systems. First, to obtain and filter suitable inputs for event identification, an event detection trigger based on the rate of change of frequency (RoCoF) is presented. Then, the wave arrival time difference-based triangulation method considering the anisotropy of wave propagation speed is utilized to estimate the location of the detected event. Next, the two-dimensional orthogonal locality preserving projection (2D-OLPP)-based method, which is suitable for multiple types of measured data, is employed to achieve higher effectiveness in extracting the event features compared with traditional one-dimensional projection and principle component analysis (PCA). Finally, the random undersampling boosted (RUSBoosted) trees-based classifier, which can mitigate the data sample imbalance issue, is utilized to identify the type of the detected event. Furthermore, the proposed approach is demonstrated using the actual measurement data of U.S. power systems from FNET/GridEye. Comparison results show that the proposed event identification algorithm can achieve better performance than existing approaches.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Data-Driven Event Detection of Power Systems Based on Unequal-Interval Reduction of PMU Data and Local Outlier Factor

With the deployment of phasor measurement units (PMU) and wide area measurement system (WAMS), it is feasible to have an insight into the events occurred in power systems based on measured data. Thus, a novel data-driven algorithm based on local outlier factor (LOF) is proposed in this work to detect and locate events in power systems using reduced PMU data. First, the unequal-interval reduction method is presented to reduce the scale of PMU data in sub-stations and reconstruct it in master station of WAMS, which can relieve the burden of communication systems. Then, principle component analysis (PCA)-based similarity search method is proposed to measure the differences of operation state between any two buses. Next, LOF is presented to detect the abnormal events in power systems, and employed to determine the region of the event source. Finally, six cases from the Western electricity coordinating council (WECC) 179-bus power system, a case from the South China power system (SCPS), and a case from the Guangdong power system (GDPS) are utilized to demonstrate the effectiveness of the proposed algorithm. Overall, the results show that proposed algorithm is effective and can be applied to event detection, event location, and online monitoring, which can enhance the situation awareness ability of power system operators.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Cy-Phy ADS: Cyber Physical Anomaly Detection Framework for EV Charging Systems

Today’s large-scale Electric Vehicle (EV) infrastructures are heavily dependent on information communication technologies to maintain their operation and to support communication within sub-system components as well as the outside world. These technologies are vulnerable to various cyber and physical threats. Timely identification and mitigation of these threats are critical for improving human safety, avoiding economic losses, and preventing catastrophic system failures. By addressing this, our work presents a ResNet Autoencoder (AE) based Cyber-Physical Anomaly Detection System (Cy-Phy ADS) for detecting anomalies in EV Controller Area Network (CAN) protocol communication. It consists of four main components: Cyber-Physical Feature Extractor, ResNet AE-based Anomaly Detection Framework, Cyber-Physical Health Metric (CPHM), and Visualization Dashboard. The presented framework was trained and tested using CAN data collected from the EV charging system testbed at the Idaho National Laboratory. The presented Cy-Phy ADS compared against six widely used unsupervised anomaly detection algorithms: One Class Support Vector Machine (OCSVM), Variational Autoencoder (VAE), LSTM Autoencoder (LSTM AE), Isolation Forest (IForest), Principle Component Analysis (PCA) and Local Outlier Factor (LOF). Here the presented approach showed the highest accuracy among the compared methods. Further, the proposed approach showed comparable performance in terms of precision, F1, and False positive rate. It also showed the lowest training and inference time compared to the neural network-based baseline algorithms compared against with. Additionally, the Cy-Phy ADS has advantages such as unsupervised training, the ability to provide a holistic metric for system health characterization, and non-linear feature extraction.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2017

Visual Exploration of Semantic Relationships in Neural Word Embeddings

Constructing distributed representations for words through neural language models and using the resulting vector spaces for analysis has become a crucial component of natural language processing (NLP). But, despite their widespread application, little is known about the structure and properties of these spaces. To gain insights into the relationship between words, the NLP community has begun to adapt high-dimensional visualization techniques. Particularly, researchers commonly use t-distributed stochastic neighbor embeddings (t-SNE) and principal component analysis (PCA) to create two-dimensional embeddings for assessing the overall structure and exploring linear relationships (e.g., word analogies), respectively. Unfortunately, these techniques often produce mediocre or even misleading results and cannot address domain-specific visualization challenges that are crucial for understanding semantic relationships in word embeddings. We introduce new embedding techniques for visualizing semantic and syntactic analogies, and the corresponding tests to determine whether the resulting views capture salient structures. Additionally, we introduce two novel views for a comprehensive study of analogy relationships. Finally, we augment t-SNE embeddings to convey uncertainty information in order to allow a reliable interpretation. Combined, the different views address a number of domain-specific tasks difficult to solve with existing tools.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Assisted migration in a warmer and drier climate: less climate buffering capacity, less facilitation and more fires at temperate latitudes?

Assisted tree migration has been proposed as a conceptual solution to mitigate lags in biotic responses to anthropogenic climate change. The rationale behind this concept is that tree species currently growing under warmer and drier climates will be more resistant and resilient to the new climatic conditions than tree species naturally growing in currently wetter and colder climates. However, we hypothesize that, by being more stress‐tolerant to warmer and drier conditions, translocated species should exhibit different functional attributes, which could induce important ecological and societal costs and overcome the desired benefits of maintaining wood production and other ecosystem services. We used principal component analysis (PCA) to analyze variation in seven traits of 106 tree and tall shrub species from contrasting latitudinal distributions in western North America and Europe to predict the potential functional changes of forest ecosystems due to the translocation of tree species from low to high latitudes. We show that species from both continents differed primarily by their position on the leaf economy spectrum (LES) and their size traits. Even though, in Europe, differences in LES were significantly correlated to species southern latitudinal positions, in both continents differences in size traits were significantly correlated to latitude. These results suggest that assisted migration by translocating more conservative species of shorter stature in currently cooler climates should decrease the buffering capacity of forest canopies, decrease facilitation for understory species, and increase wildfire risks, whose effects have the potential to accelerate climate warming through negative atmospheric feedback processes. As an alternative solution to assisted migration that may accelerate rather than mitigate climate change, we recommend that foresters gradually diversify the vertical structure and layering of the existing forest canopy to maintain a sustainable water cycle and energy balance between the soil, the tree and the atmosphere without increasing the wildfire risk.

Environmental Sciences & Ecology↗
DOE OSTI2025

Advancements in Constitutive Model Calibration: Leveraging the Power of Full‐Field DIC Measurements and In Situ Load Path Selection for Reliable Parameter Inference

Accurate material characterization and model calibration are essential for computationally supported high-consequence engineering decisions. Historically, characterization and calibration methods (1) use simplified test specimen geometries and global data, (2) cannot guarantee that sufficient characterization data are collected for a specific model of interest, (3) use deterministic methods that provide best-fit parameter values with no uncertainty quantification, and (4) are sequential, inflexible, and time-consuming. This work brings together several recent advancements into an improved workflow called interlaced characterization and calibration (ICC) that advances the state-of-the-art in constitutive model calibration. The ICC paradigm (1) employs tools to efficiently use full-field data to calibrate high-fidelity material models, (2) aligns the data needed with the data collected by adopting an optimal experimental design protocol, (3) quantifies parameter uncertainty through Bayesian inference and (4) incorporates these advancements into a quasi real-time feedback loop. The ICC framework is demonstrated here on the calibration of a material model using simulated full-field data for an aluminium cruciform specimen being deformed biaxially. The cruciform is actively driven through the myopically preferred load path using Bayesian optimal experimental design, which selects load steps that yield the maximum expected information gain (EIG). Principal component analysis (PCA) is performed on the model predictions of full-field displacements, and fast surrogate models are built to approximate the input-output relationships of the expensive finite element model. Furthermore, the tools developed and demonstrated here show that high-fidelity constitutive models can be efficiently and reliably calibrated with quantified uncertainty, thus supporting credible decision-making and potentially increasing the agility of solid mechanics modelling by enabling utilization of computational simulations at earlier stages of the design cycle.

Bayesian optimal experimental design↗
DOE OSTI2017

Characterization of Syntrophic Geobacter Communities Using ToF-SIMS

The aggregation of syntrophic Geobacter metallireducens and Geobacter sulfurreducens is known to be beneficial for enhancing direct interspecies electron transfer (DIET). However, the chemical speciation of such co-cultured communities was unclear. Time-of-flight secondary ion mass spectrometry (ToF-SIMS) has been used to characterize biological samples relevant to aggregates of Geobacter, including G. metallireducens and G. sulfurreducens single cultures in planktonic, biofilms formed from either the single bacteria or both, and co-cultures of these two strains in planktonic and aggregate forms. By using principle component analysis (PCA), the syntrophic Geobacter communities were significantly distinguished from their planktonic cells by a series of characteristic peaks such as amino acids, fatty acids/lipids, and quorum sensing signal molecules, indicating a different chemical composition and structure formed on their surfaces. Additionally, insights of co-culture community dynamics were obtained from a new perspective . These first SIMS results demonstrate that proteins played an important role in microbial communications.

ToF-SIMS, Geobacter, DIET, syntrophic↗
DOE OSTI2019

Hyperspectral imaging of minerals in the longwave infrared: the use of laboratory directional-hemispherical reference measurements for field exploration data

Hyperspectral Imaging (HSI) continues to grow as a method for remote detection of vegetation, materials, minerals, and pure chemicals. We have used a longwave infrared (7.7 - 11.8 µm) imaging spectrometer in a static outdoor experiment to collect HSI data from 24 minerals and background materials to determine the efficacy with which HSI can remotely detect and distinguish both pure minerals and mineral mixtures at three solar angles (25°, 35°, and 45° relative to ground) as well as varying backgrounds and other sample effects. Measurements were obtained separately for the minerals and materials mounted directly both on a bare plywood board and a plywood board coated with aluminum foil: 19 powders (3 mixtures and 16 pure mineral powders) held in polyethylene bottle lids as well as 5 samples in rock form were taped directly to the boards. The primary goal of the experiment was to demonstrate that a longwave infrared (LWIR) library of solids and minerals collected as directional-hemispherical reflectance spectra in the laboratory can be used directly for HSI field identification. Prior to the experiment, all 24 mineral/inorganic samples were measured in the laboratory using a Fourier transform infrared spectrometer (FTIR) equipped with a gold-coated IR integrating sphere; the spectra were assimilated as part of a larger reference library of 21 pure minerals, 3 mixtures, and the polyethylene lid. Principal components analysis (PCA) with mean-centering was used in an exploratory analysis of the HSI images and showed that for the aluminum coated board, the first principal component captured the difference between signal that resembled a blackbody and the highly reflective aluminum background. In contrast, principal components PC 2, 3, and 4 were able to discriminate the materials including phosphates, sulfates, silicates, carbonates, and the mixtures. Results from generalized least squares target detection clearly showed that laboratory reference spectra of minerals could be utilized as targets with high fidelity for field detection, both for pure and mixed samples.

47 OTHER INSTRUMENTATION↗
DOE OSTI2016

Label-free molecular imaging of bacterial communities of the opportunistic pathogen Pseudomonas aeruginosa

Biofilms, such as those formed by the opportunistic human pathogen Pseudomonas aeruginosa are complex, matrix enclosed, and surface-associated communities of cells. Bacteria that are part of a biofilm community are much more resistant to antibiotics and the host immune response than their free-floating counterparts. P. aeruginosa biofilms are associated with persistent and chronic infections in diseases such as cystic fibrosis and HIV-AIDS. P. aeruginosa synthesizes and secretes signaling molecules such as the Pseudomonas quinolone signal (PQS) which are implicated in quorum sensing (QS), where bacteria regulate gene expression based on population density. Processes such as biofilms formation and virulence are regulated by QS. This manuscript describes the powerful molecular imaging capabilities of confocal Raman microscopy (CRM) and surface enhanced Raman spectroscopy (SERS) in conjunction with multivariate statistical tools such as principal component analysis (PCA) for studying the spatiotemporal distribution of signaling molecules, secondary metabolites and virulence factors in biofilm communities of P. aeruginosa. Our observations reveal that the laboratory strain PAO1C synthesizes and secretes 2-alkyl-4-hydroxyquinoline N-oxides and 2-alkyl-4-hydroxyquinolones in high abundance, while the isogenic acyl homoserine lactone QS-deficient mutant (ΔlasIΔrhlI) strain produces predominantly 2-alkyl-quinolones during biofilm formation. Furthermore, this study underscores the use of CRM, along with traditional biological tools such as genetics, for studying the behavior of microbial communities at the molecular level.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

DP-TwoLevel: two-stage gradient subspace learning for differentially private federated learning

Federated learning (FL) enables collaborative model training across distributed data sources without sharing raw data, but faces fundamental challenges in communication efficiency and privacy. Differentially private (DP) training mitigates information leakage but introduces noise that degrades model performance, especially in high-dimensional settings. We propose DP-TwoLevel, a hierarchical gradient projection method that improves utility under fixed DP constraints by exploiting low-dimensional structure in model updates. Our approach learns a two-level PCA-based representation of gradients and applies DP noise in a reduced-dimensional subspace, thereby lowering the effective noise magnitude while preserving dominant signal components. We evaluate the method across three datasets (MNIST, Fashion-MNIST, CIFAR-10) and three privacy regimes (ϵ∈0.5, 1.0, 2.0). Across nine experimental settings, DP-TwoLevel consistently outperforms DP-FedAvg, achieving an average accuracy improvement of 9.44%, with larger gains observed in lower ϵ(higher-noise) regimes (up to +22.31%). We further analyze scalability across models ranging from 100K to 1.49M parameters and identify a variance-based success criterion: performance remains strong when the projection preserves more than 75% of gradient variance, degrades in a marginal regime (65–75%), and fails below this threshold. Our results demonstrate that structure-aware dimensionality reduction can significantly improve the privacy–utility tradeoff in FL without modifying formal privacy guarantees. We also provide empirical evidence of scaling limitations for global projections and motivate per-layer extensions for larger models.

Kotevska, Olivera [ORNL] (ORCID:0000000316772243)↗
DOE OSTI2012

A method to estimate the effect of deformable image registration uncertainties on daily dose mapping

Purpose: To develop a statistical sampling procedure for spatially-correlated uncertainties in deformable image registration and then use it to demonstrate their effect on daily dose mapping. Methods: Sequential daily CT studies are acquired to map anatomical variations prior to fractionated external beam radiotherapy. The CTs are deformably registered to the planning CT to obtain displacement vector fields (DVFs). The DVFs are used to accumulate the dose delivered each day onto the planning CT. Each DVF has spatially-correlated uncertainties associated with it. Principal components analysis (PCA) is applied to measured DVF error maps to produce decorrelated principal component modes of the errors. The modes are sampled independently and reconstructed to produce synthetic registration error maps. The synthetic error maps are convolved with dose mapped via deformable registration to model the resulting uncertainty in the dose mapping. The results are compared to the dose mapping uncertainty that would result from uncorrelated DVF errors that vary randomly from voxel to voxel. Results: The error sampling method is shown to produce synthetic DVF error maps that are statistically indistinguishable from the observed error maps. Spatially-correlated DVF uncertainties modeled by our procedure produce patterns of dose mapping error that are different from that due to randomly distributed uncertainties. Conclusions: Deformable image registration uncertainties have complex spatial distributions. The authors have developed and tested a method to decorrelate the spatial uncertainties and make statistical samples of highly correlated error maps. The sample error maps can be used to investigate the effect of DVF uncertainties on daily dose mapping via deformable image registration. An initial demonstration of this methodology shows that dose mapping uncertainties can be sensitive to spatial patterns in the DVF uncertainties.

61 RADIATION PROTECTION AND DOSIMETRY↗