Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “CLASSIFICATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Critical Infrastructure Classification via CNN-based Modeling and Image Analysis

With recent advances in the fields of satellite imagery and machine learning we now have the ability to develop explainable deep learning models that enhance critical infrastructure analysis. Funded through Idaho National Laboratory’s (INL) Laboratory Directed Research and Development (LDRD) office we are in the process of developing a deep learning model capable of identifying critical infrastructure facilities and embedded features within those facilities. Utilizing current limit of practice techniques in the machine learning areas of explainability and transfer learning our model, once complete, will have the capacity to be used on multiple different imagery data sets and produce results that not only classify critical infrastructure facilities, but also explain why a critical infrastructure facility was classified as a certain type of facility. These advancements eliminate the ‘black box’ approach deep learning models have had in the past, where a user will have to trust the conclusion of a model without understanding what reasoning when into the model’s classification process. They also expand a model’s usefulness, traditionally a deep learning model will have to use the same data set it was originally trained on. Given the long training times of deep learning models this is impractical in a number of scenarios. By utilizing transfer learning advancements, we are eliminating the need to train our model on the same data set it is then run on to classify critical infrastructure facilities. We are also enabling the analysis and classification of data sets that are potentially too small to be divided into a training and testing data set. Once completed this model can provide a foundation to enhanced critical infrastructure analysis, dependency analysis, and potential disaster relief efforts.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A Classification of G -invariant Shallow Neural Networks

When trying to fit a deep neural network (DNN) to a G-invariant target function with G a group, it only makes sense to constrain the DNN to be G-invariant as well. However, there can be many different ways to do this, thus raising the problem of “G-invariant neural architecture design”: What is the optimal Ginvariant architecture for a given problem? Before we can consider the optimization problem itself, we must understand the search space, the architectures in it, and how they relate to one another. In this paper, we take a first step towards this goal; we prove a theorem that gives a classification of all G-invariant single-hidden-layer or “shallow” neural network (G-SNN) architectures with ReLU activation for any finite orthogonal group G, and we prove a second theorem that characterizes the inclusion maps or “network morphisms” between the architectures that can be leveraged during neural architecture search (NAS). The proof is based on a correspondence of every G-SNN to a signed permutation representation of G acting on the hidden neurons; the classification is equivalently given in terms of the first cohomology classes of G, thus admitting a topological interpretation. The G-SNN architectures corresponding to nontrivial cohomology classes have, to our knowledge, never been explicitly identified in the literature previously. Using a code implementation, we enumerate the G-SNN architectures for some example groups G and visualize their structure. Lastly, we prove that architectures corresponding to inequivalent cohomology classes coincide in function space only when their weight matrices are zero, and we discuss the implications of this for NAS.

Agrawal, Devanshu↗
DOE OSTI2024

Decentralized Microgrid Protection Through Relative Fault Direction Classification: Preprint

Protection in inverter-based resources (IBRs) dominated microgrids generally face significant challenges due to the low fault current and inconsistent fault behaviors from IBRs. Recently, machine learning-based approaches have attracted considerable attention to address these challenges. This paper introduces a novel decentralized protection strategy for microgrids. The proposed method decomposes the protection challenge into several distributed learning tasks, enabling individual relays to autonomously determine the direction of faults using a binary classification framework based on support vector machine (SVM) algorithms. Following the distributed fault direction estimation, classifier outcomes are shared among neighboring relays, facilitating a local decision-making process to ascertain the presence of faults within the neighborhood. Finally, a tripping signal is generated based on the classifier results of each relay to operate the circuit breaker. To test and validate this approach, a 100% renewable microgrid model is simulated in MATLAB/Simulink. In the numerical analysis, the application of SVM classifiers in our approach yields impressive results: an average relay classification accuracy of 98%, and a 96% accuracy in circuit breaker control. These findings highlight the potential of machine-learning-based approaches in enhancing the efficiency and reliability of microgrid protection systems.

decentralized algorithm↗
DOE OSTI2026

The DESI Transients Survey: Legacy Classifications and Methodology

We present the first systematic spectroscopic observations of extragalactic transients from the Dark Energy Spectroscopic Instrument (DESI), as part of the DESI Transients Survey program. With 5,000 fibers and an ${\sim} 8$ deg$^2$ field of view, we exploit DESI as a machine for the discovery and classification of transients. We present transient classifications from archival DESI data in Data Releases 1 and 2, relying on a combination of a secondary target program and serendipitous observations. We also present observations from the first 6 months of the DESI spare fiber program dedicated to transients. The program is run in coordination with a dedicated DECam time-domain survey, serving as a pathfinder for what we will be able to achieve in conjunction with the Rubin Observatory Legacy Survey of Space and Time (LSST). We classify over 250 transients, of which the majority were previously unclassified. The sample comprises thermonuclear and core-collapse supernovae and tidal disruption events (TDEs), including a TDE observed before its discovery in imaging. We demonstrate DESI's ability to classify a population of faint transients down to $r\sim 22.5$ mag during main survey operations, with negligible impacts on DESI's main observations.

Hall, Xander J. [Carnegie Mellon U.] (ORCID:000000↗
DOE OSTI2024

Quantifying Epistemic Uncertainty in Binary Classification via Accuracy Gain

ABSTRACT Recently, a surge of interest has been given to quantifying epistemic uncertainty (EU), the reducible portion of uncertainty due to lack of data. We propose a novel EU estimator in the binary classification setting, as the posterior expected value of the empirical gain in accuracy between the current prediction and the optimal prediction. In order to validate the performance of our EU estimator, we introduce an experimental procedure where we take an existing dataset, remove a set of points, and compare the estimated EU with the observed change in accuracy. Through real and simulated data experiments, we demonstrate the effectiveness of our proposed EU estimator.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

A Review of Machine Learning Classification Using Quantum Annealing for Real-World Applications

Optimizing the training of a machine learning pipeline helps in reducing training costs and improving model performance. One such optimizing strategy is quantum annealing, which is an emerging computing paradigm that has shown potential in optimizing the training of a machine learning model. The implementation of a physical quantum annealer has been realized by D-wave systems and is available to the research community for experiments. Recent experimental results on a variety of machine learning applications using quantum annealing have shown interesting results where the performance of classical machine learning techniques is limited by limited training data and high dimensional features. This article explores the application of D-wave’s quantum annealer for optimizing machine learning pipelines for real-world classification problems. Finally, we review the application domains on which a physical quantum annealer has been used to train machine learning classifiers. We discuss and analyze the experiments performed on the D-Wave quantum annealer for applications such as image recognition, remote sensing imagery, computational biology, and particle physics. We discuss the possible advantages and the problems for which quantum annealing is likely to be advantageous over classical computation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

High dimensional binary classification under label shift: phase transition and regularization

Label Shift has been widely believed to be harmful to the generalization performance of machine learning models. Researchers have proposed many approaches to mitigate the impact of the label shift, e.g., balancing the training data. However, these methods often consider the underparametrized regime, where the sample size is much larger than the data dimension. The research under the overparametrized regime is very limited. Here, to bridge this gap, we propose a new asymptotic analysis of the Fisher Linear Discriminant classifier for binary classification with label shift. Specifically, we prove that there exists a phase transition phenomenon: Under certain overparametrized regime, the classifier trained using imbalanced data outperforms the counterpart with reduced balanced data. Moreover, we investigate the impact of regularization to the label shift: The aforementioned phase transition vanishes as the regularization becomes strong.

binary classification↗
DOE OSTI2021

Industrial control system device classification using network traffic features and neural network embeddings

Characterization of modern cyber–physical Industrial Control System (ICS) devices is critical to the evaluation of their security posture and an understanding of the underlying industrial processes with which they interact. In this work, we address two related ICS device identification tasks: (1) separating ICS from non-ICS devices and (2) identifying specific ICS device types. We propose two distinct methods (one based on the existing IP2Vec method, and a novel traffic-features-based method) for achieving the first task. For transferability of the first task between two datasets, the traffic-features-based method performs significantly better (75% overall accuracy) compared to IP2Vec (22.5% overall accuracy). We further propose a novel method called DNP2Vec to address the second task. DNP2Vec is evaluated on two different datasets and achieves perfect multi-class classification accuracy (100%) for both datasets.

42 ENGINEERING↗
DOE OSTI2025

Machine learning for photovoltaic single axis tracker fault detection and classification

More than 81% of the annual capacity of utility-scale photovoltaic (PV) power plants in the U.S. use single-axis trackers (SATs) due to SATs delivering 4% in capacity factor on average over fixed-array systems. However, SATs are subject to faults, such as software misconfigurations and mechanical failures, resulting in suboptimal tracking. If left undetected, the overall power yield of the PV power plant is reduced significantly. Minimizing downtime and ensuring efficient operation of SATs requires robust detection and diagnosis mechanisms for SAT faults. We present a machine learning framework for implementing real-time SAT fault detection and classification. Our implementation of the proposed framework reliably identifies measurements taken from a test PV system undergoing emulated SAT faults relative to state-of-the-art algorithms and produces nearly zero false positives on our testing days. Code and data are available at https://pvpmc.sandia.gov/tools.

Fault classification↗
DOE OSTI2022

Particle classification by image analysis improves understanding of corn stover degradation mechanisms during deconstruction

Biomass feedstock heterogeneity is a principal roadblock to implementation of the biorefinery concept. Even within an identical cultivar of corn stover, different bales contain not only varying abundance moisture, ash, glucan, and other chemical compounds, but also varying abundance of tissue anatomies (e.g., leaf, husk, cob, or stalk). These different anatomical components not only differ in their response to pretreatment and enzymatic hydrolysis to glucose, but also vary in their mechanical and conveyance properties. Although this heterogeneous nature of corn stover feedstock has been identified as a challenge, a fundamental knowledge gap of how these tissues behave during biorefining processing remains. Here, we demonstrate the use of a commercial fiber image analyzer typically used for wood fiber characterization to monitor the particle size and shapes of non-woody feedstock during milling, pretreatment, and hydrolysis. Additionally, we present novel use of Gaussian process classification to distinguish bundle, parenchyma, and fiber particles to an accuracy of 96.4%. Quantitative probability distribution plots for characteristics such as length and roundness allow elucidation of particle morphology as pretreatment and enzymatic hydrolysis progress. In both stalk pith and stalk rind, particles peel into individual cells whose walls are subsequently fragmented during enzymatic hydrolysis.

09 BIOMASS FUELS↗
DOE OSTI2022

Multiscale petrophysical characterization and flow unit classification of the Minnelusa eolian sandstones

Integration of petrophysical and geological information is critical to simulation of subsurface carbon storage (GCS). In this sense, two depositional facies were identified from the core description and well-log interpretation, namely massive (MS) and cross-bedded (CB) facies groups. Additionally, pore-scale characteristics were studied by a combination of techniques, e.g. Nuclear Magnetic Resonance (NMR) and mercury intrusion capillary pressure (MICP). Scanning electron microscope (SEM) and petrographic analyses show that the pore structure is dominantly controlled by the depositional environment and dolomite cementation. NMR-T 2 distributions of MS and CB facies show triple and quadruple modes, respectively. In addition, MICP of high- and low-permeability MS facies samples, and their CB facies group mixtures were collected. The MS sample pore-throat size distribution is uni-modal, while the triple-modal characteristic of the mixtures indicates heterogeneous pore structures at the sub-core scale for CB facies. The reliably estimates of porosity and permeability for both facies groups via NMR techniques and the MLR (Multiple Linear Regression) approach demonstrate the applicability of these techniques to eolian sandstone. Moreover, irreducible water saturation via the T 2 -cutoff method correlates strongly with T 2LM instead of porosity. Finally, the rock quality index and flow zone indicator were calculated based on Combinable Magnetic Resonance (CMR) log interpretations. This provides direct connection to properties measured in the well. Four flow units were classified for both facies groups. Finally, results show that better reservoir quality with significant heterogeneities is observed in the CB facies. This study highlights the importance integrating multiscale petrophysical properties including facies, pore architecture and diagenesis analysis with core- to log-scale property characterization. The results herein validate our reservoir characterization and flow unit classification in eolian reservoirs.

58 GEOSCIENCES↗
DOE OSTI2024

Dual X-ray computed tomography-aided classification of melt pool boundaries and flaws in crept additively manufactured parts

In metal additive manufacturing (AM), understanding the process-structure-performance relationships requires a combination of multi-scale characterization techniques that allows for the measurement of the melt pool shape and boundary and classifying various defects and flaws in the AM parts. Such approaches can be destructive, only 2D in nature, or have a small field of view and can be complex to co-register and analyze. Here, in this work, we present a non-destructive 3D inspection technique that employs dual-energy X-ray computed tomography (XCT) along with a model-based iterative reconstruction (MBIR) and a new segmentation algorithm. The proposed approach and algorithm are not only capable of classifying and quantifying flaws such as pores, cracks, and inclusions, but they also allow for the extraction of microstructural features such as melt pool boundaries (MPB) and melt pool regions (MPR), that can help understand process-structure-performance relationships for alloys under study. As an exemplar application, we employed the method for characterization of an additively manufactured aluminum alloy crept under tensile stress at 300 °C for 1064 h. Our results demonstrate high quality segmentation and classification of various flaws and MPB and MPR, for the first time, using 3D X-ray CT inspection. The delineated MPB and MPR in the crept samples reveal the preferential growth paths of cracks that formed during creep deformation. The technique was used for successfully quantifying the characteristics (number of defects, their density, volume fraction, etc.) of the manufacturing-induced pores and creep-induced cracks, which is necessary to better understand the creep failure mechanisms of the material.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Grain boundary slip transfer classification and metric selection with artificial neural networks

An artificial neural network is used to evaluate the effectiveness of six metrics and their combinations to assess whether slip transfers across grain boundaries in coarse-grained oligocrystalline Al foils. This approach extends the one- or two-dimensional projections formerly applied to analyze slip transfer. The accuracy of this binary classification reaches around 87% for the best single metric and around 90% when considering two or more metrics simultaneously. Here, the results suggest slip transfer mostly depends on the geometric relationship between grains. Training a double-layer network having 10 nodes per hidden layer with 40 measurements is sufficient to render the maximum accuracy.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Classification of Adsorbed Hydrocarbons Based on Bonding Configurations of the Adsorbates and Surface Site Stabilities

The design of heterogeneous catalysts can be accelerated by identifying relevant descriptors that accurately and effectively link the binding and activation energies to reactivity. Herein, we investigated scaling relations between binding energies of various hydrocarbon-based adsorbates on three different Pt surfaces and metal binding energies estimated via the recently developed α-scheme model. In this study, we find that the scaling slopes are similar for certain groups of adsorbates, which then can be classified based on their spatial and electronic structure enabling fast description of binding strengths for each member of the class. Hence, our findings show that the binding energies of simple hydrocarbons CH x , x = {0,1,2,3,4}, and CHCH 2 can be used to identify the binding energies of more complex hydrocarbon-based adsorbates. We introduce this classification to establish a generalizable scheme in which complex hydrogenation/dehydrogenation processes of higher hydrocarbons can be predicted via the binding energies of simpler hydrocarbon-based species and ultimately through surface site stabilities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

An Explainable Classification Framework for Determining and Understanding the Suitability of Solvent Extraction for Bioproduct Recovery

Lignocellulosic biomass is an abundant feedstock for producing sustainable fuels and chemicals. However, a key challenge in most biomass utilization strategies is the recovery of products from a dilute, typically aqueous, phase. In this respect, liquid–liquid extraction, which relies on a solvent to transfer a product of interest from one liquid phase to another (solvent-rich) phase, is a technology that can reduce the energy requirements for product recovery. To reduce solvent consumption, liquid–liquid extraction needs to be combined with another separation method (e.g., distillation) to recycle the solvent. Despite the research on solvent extraction, there are limited system-wide methods that allow us to determine when extraction is well suited to carry out a specific separation. Accordingly, we present a classification framework to predict whether extraction, coupled with distillation, is feasible and more economical than distillation. Our framework is based on features such as feed composition, liquid–liquid equilibrium constants, relative volatilities, and solvent price, and leads to trained classifiers that show good prediction accuracy. We further study how specific features influence the suitability of extraction. Furthermore, to showcase the applicability of the framework, we use it to analyze the separation of acetic acid from water.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Quantum graph learning and algorithms applied in quantum computer sciences and image classification

Graph and network theory play a fundamental role in quantum computer sciences, including quantum information and computation. Random graphs and complex network theory are pivotal in predicting novel quantum phenomena, where entangled links are represented by edges. Quantum algorithms have been developed to enhance solutions for various network problems, giving rise to quantum graph computing and quantum graph learning (QGL). Here, in this review, we explore graph theory and graph learning methods as powerful tools for quantum computers to generate efficient solutions to problems beyond the reach of classical systems. We delve into the development of quantum complex network theory and its applications in quantum computation, materials discovery, and research. We also discuss quantum machine learning (QML) methodologies for effective image classification using qubits, quantum gates, and quantum circuits. Additionally, the paper addresses the challenges of QGL and algorithms, emphasizing the steps needed to develop flexible QGL solvers. This review presents a comprehensive overview of the fields of QGL and QML, highlights recent advancements, and identifies opportunities for future research.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

Plasma confinement state classification via FPP relevant microwave diagnostics

We present a parsimonious and robust machine learning approach for identifying plasma confinement states in fusion power plants (FPPs) where reliable identification of the low-confinement and high-confinement regimes is critical for safe and efficient operation. Unlike research-oriented devices, FPPs must operate with a severely constrained set of diagnostics. To address this challenge, we demonstrate that a minimalist model, using only electron cyclotron emission (ECE) signals, can achieve accurate and reliable state classification. ECE provides electron temperature profiles without the engineering or survivability issues of in-vessel probes, making it a primary candidate for FPP-relevant diagnostics. Our framework employs ECE as input, extracts features using radial basis functions, and applies a gradient boosting classifier, achieving a test accuracy of 96% (correct predictions). Robustness analysis and feature importance analyzes confirm the approach’s reliability. These results demonstrate that state-of-the-art performance is attainable from a restricted diagnostic set, paving the way for minimalist yet resilient plasma control architectures for FPPs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

STag. II. Classification of Serendipitous Supernovae Observed by Galaxy Redshift Surveys

With the number of supernovae observed expected to drastically increase thanks to large-scale surveys like the Dark Energy Spectroscopic Instrument (DESI), it is necessary that the tools we use to classify these objects keep up with this increase. We previously created Supernova Tagging and Classification (STag) to address this problem by employing machine learning techniques alongside logistic regression in order to assign “tags” to spectra based on spectral features. STag II is a continuation of this work, which now makes use of model supernova spectra combined with real DESI spectra in order to train STag to better deal with realistic data. Furthermore, we also make use of the rlap score as a trustworthiness cut, making for a more robust and accurate supernova classifier than before.

Astrostatistics techniques↗