Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “classification models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Quantum field theory of topological spin dynamics

Here, we develop a field theory of quantum magnets and magnetic (semi)metals, which is suitable for the analysis of their universal and topological properties. The systems of interest include collinear, coplanar, and general noncoplanar magnets. At the basic level, we describe the dynamics of magnetic moments using smooth vector fields in the continuum limit. Dzyaloshinskii-Moriya interaction is captured by a non-Abelian vector gauge field, and chiral spin couplings related to topological defects appear as higher-rank antisymmetric tensor gauge fields. We distinguish type-I and type-II magnets by their equilibrium response to the non-Abelian gauge flux, and characterize the resulting lattices of skyrmions and hedgehogs, the spectra of spin waves, and the chiral response to external perturbations. The general spin-orbit coupling of electrons is similarly described by non-Abelian gauge fields, including higher-rank tensors related to the electronic Berry flux. Itinerant electrons and local moments exchange their gauge fluxes through Kondo and Hund interactions. Hence, by utilizing gauge fields, this theory provides a unifying physical picture of “intrinsic” and “topological” anomalous Hall effects, spin-Hall effects, and other correlations between the topological properties of electrons and moments. We predict “topological” magnetoelectric effect in materials prone to hosting hedgehogs. Links to experiments and model calculations are provided by deriving the couplings and gauge fields from generic microscopic models, including the Hubbard model with spin-orbit interactions. Much of the formal analysis is generalized to d spatial dimensions in order to access the $π_{d–1}(S^{d–1})$ homotopy classification of the magnetic hedgehog topological defects, and establish the possibility of novel quantum spin liquids that exhibit a fractional magnetoelectric effect. However, we emphasize the form of all results in the physically relevant $\textit{d}$ = 3 dimensions, and discuss a few applications to topological magnetic conductors like Mn 3 Sn and Pr 2 Ir 2 O 7 .

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Neural network-based classification and regression of magnetohydrodynamic modes in tokamaks

We present a machine learning-based magnetohydrodynamic (MHD) classifier and regressor that utilizes real or complex-valued 3D magnetic sensor array data to determine neoclassical tearing mode (NTM) onset times in tokamaks with millisecond accuracy. The input dataset consists of poloidal profiles of complex Fourier amplitudes with an n = 1 toroidal mode number from 144 human-labeled ITER Baseline Scenario discharges in the DIII-D tokamak, spanning both tearing-dominated and sawtooth-dominated regimes. Since m, n = 2,1 NTMs frequently emerge alongside sawteeth at the same frequency in this scenario, the focus is on isolating the m = 1 and m = 2 components of the n = 1 MHD mode near the tearing onset. To improve model regularization and prediction stability, singular value decomposition was applied to balance the sawtooth and tearing datasets. The enriched datasets facilitated training neural networks that learn the key distinguishing features of sawtooth and tearing modes in the poloidal profiles of their magnetic amplitude and phase. When the modes occur independently, the networks achieve perfect classification due to the modes’ distinct characteristics and low measurement noise. In the more experimentally relevant case where both modes coexist, the networks maintain exceptional performance across key metrics. Tests on synthetic data with known ground truth demonstrate the superior accuracy of the neural network trained on complex-valued input compared to models using real amplitude, phase, or pseudo-complex data, achieving both a mean time delay and standard deviation below 1 ms. Notably, standard linear regression methods fitting the dominant singular modes to the data closely match the neural network’s performance. Applying these methods across a broad range of H-mode scenarios will enable future studies to systematically identify dominant NTM triggers as scenario-specific variables, paving the way for more effective tearing mode avoidance strategies in future fusion reactor designs.

machine learning↗
DOE OSTI2023

Digital Modeling on Large Kernel Metamaterial Neural Network

Deep neural networks (DNNs) utilized recently are physically deployed with computational units (e.g., CPUs and GPUs). Such a design might lead to a heavy computational burden, significant latency, and intensive power consumption, which are critical limitations in applications such as Internet of Things (IoT), edge computing, and usage of drones. Recent advances in optical computational units (e.g., metamaterial) have shed light on energy-free and light-speed neural networks. However, the digital design of the metamaterial neural network (MNN) is fundamentally limited by its physical limitations, such as precision, noise, and bandwidth during fabrication. Moreover, the unique advantages of MNN’s (e.g., light-speed computation) are not fully explored via standard 3×3 convolution kernels. In this paper, we propose a novel large kernel metamaterial neural network (LMNN) that maximizes the digital capacity of the state-of-the-art (SOTA) MNN with model re-parametrization and network compression, while also considering the optical limitation explicitly. The new digital learning scheme can maximize the learning capacity of MNN while modeling the physical restrictions of meta-optics. With the proposed LMNN, the computation cost of the convolutional front-end can be offloaded to fabricated optical hardware. The experimental results on two publicly available datasets demonstrate that the optimized hybrid design improved classification accuracy while reducing computational latency. In conclusion, the development of the proposed LMNN is a promising step towards the ultimate goal of energy-free and light-speed AI.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Loops and trees in generic EFTs

We consider aspects of tree and one-loop behavior in a generic 4d EFT of massless scalars, fermions, and vectors, with a particular eye to the high-energy limit of the Standard Model EFT at operator dimensions 6 and 8. First, we classify the possible Lorentz structures of operators and the subset of these that can arise at tree-level in a weakly coupled UV completion, extending the tree/loop classification through dimension 8 using functional methods. Second, we investigate how operators contribute to tree and one-loop helicity amplitudes, exploring the impact of non-renormalization theorems through dimension 8. We further observe that many dimension 6 contributions to helicity amplitudes, including rational parts, vanish exactly at one-loop level. This suggests the impact of helicity selection rules extends beyond one loop in non-supersymmetric EFTs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

One-shot gas detection with transformer paired neural networks in Mako collected longwave infrared hyperspectral imagery

To date, careful data treatment workflows and statistical detectors are used to perform hyperspectral image (HSI) detection of any gas contained in a spectral library, which is often expanded with physics models to incorporate different spectral characteristics. In general, surrounding evidence or known gas-release parameters are used to provide confidence in or confirm detection capability, respectively. This makes quantifying detection performance difficult as it is nearly impossible to develop an absolute ground truth for gas target pixel presence in collected HSI. Consequently, developing and comparing new detection methods, especially machine learning (ML)-based methods, is susceptible to subjectivity in derived detection map quality. Here, in this work, we demonstrate the first use of transformer-based paired neural networks (PNNs) for one-shot gas target detection for multiple gases while providing quantitative classification and detection metrics for their use on labeled data. Terabytes of training data are generated from a database of long-wave infrared HSI obtained from historical Mako sensor campaigns over Los Angeles. By incorporating labels, singular signature representations, and a model development pipeline, we can tune and select PNNs to detect multiple gas targets that are not seen in training on a quantitative basis. We additionally assess our test set detections using interpretability techniques widely employed with ML-based predictors, but less common with detection methods relying on learned latent spaces.

Hyperspectral imaging↗
DOE OSTI2023

Life history strategies among soil bacteria—dichotomy for few, continuum for many

Abstract Study of life history strategies may help predict the performance of microorganisms in nature by organizing the complexity of microbial communities into groups of organisms with similar strategies. Here, we tested the extent that one common application of life history theory, the copiotroph-oligotroph framework, could predict the relative population growth rate of bacterial taxa in soils from four different ecosystems. We measured the change of in situ relative growth rate to added glucose and ammonium using both 18O–H2O and 13C quantitative stable isotope probing to test whether bacterial taxa sorted into copiotrophic and oligotrophic groups. We saw considerable overlap in nutrient responses across most bacteria regardless of phyla, with many taxa growing slowly and few taxa that grew quickly. To define plausible life history boundaries based on in situ relative growth rates, we applied Gaussian mixture models to organisms’ joint 18O–13C signatures and found that across experimental replicates, few taxa could consistently be assigned as copiotrophs, despite their potential for fast growth. When life history classifications were assigned based on average relative growth rate at varying taxonomic levels, finer resolutions (e.g., genus level) were significantly more effective in capturing changes in nutrient response than broad taxonomic resolution (e.g., phylum level). Our results demonstrate the difficulty in generalizing bacterial life history strategies to broad lineages, and even to single organisms across a range of soils and experimental conditions. We conclude that there is a continued need for the direct measurement of microbial communities in soil to advance ecologically realistic frameworks.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Effects of Substance Use and Antisocial Personality on Neuroimaging-Based Machine Learning Prediction of Schizophrenia

Abstract Background and hypothesis Neuroimaging-based machine learning (ML) algorithms have the potential to aid the clinical diagnosis of schizophrenia. However, literature on the effect of prevalent comorbidities such as substance use disorder (SUD) and antisocial personality (ASPD) on these models’ performance has remained unexplored. We investigated whether the presence of SUD or ASPD affects the performance of neuroimaging-based ML models trained to discern patients with schizophrenia (SCH) from controls. Study design We trained an ML model on structural MRI data from public datasets to distinguish between SCH and controls (SCH = 347, controls = 341). We then investigated the model’s performance in two independent samples of individuals undergoing forensic psychiatric examination: sample 1 was used for sensitivity analysis to discern ASPD (N = 52) from SCH (N = 66), and sample 2 was used for specificity analysis to discern ASPD (N = 26) from controls (N = 25). Both samples included individuals with SUD. Study results In sample 1, 94.4% of SCH with comorbid ASPD and SUD were classified as SCH, followed by patients with SCH + SUD (78.8% classified as SCH) and patients with SCH (60.0% classified as SCH). The model failed to discern SCH without comorbidities from ASPD + SUD (AUC = 0.562, 95%CI = 0.400–0.723). In sample 2, the model’s specificity to predict controls was 84.0%. In both samples, about half of the ASPD + SUD were misclassified as SCH. Data-driven functional characterization revealed associations between the classification as SCH and cognition-related brain regions. Conclusion Altogether, ASPD and SUD appear to have effects on ML prediction performance, which potentially results from converging cognition-related brain abnormalities between SCH, ASPD, and SUD.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

How Do Visual Explanations Foster End Users' Appropriate Trust in Machine Learning?

We investigated the effects of different visual explanations on users' trust in machine learning classification. We proposed three forms of visual explanations of a classification based on identifying relevant training instances. We conducted a user study to evaluate these visual explanations as well as a no explanation condition. We measured users' trust of a classifier, quantified the effects of these three forms of explanations, and assessed the changes in users' trust. We found that participants trust a classifier appropriately when an explanation is available. The combination of human, classification algorithm and understandable explanation makes better decisions than the classifier and human alone.This work advances the state-of-the-art closer to building trust-able machine learning models and informs the design and appropriate use of automated systems.

Yang, Fumeng↗
DOE OSTI2023

Discriminative analysis of schizophrenia patients using graph convolutional networks: A combined multimodal MRI and connectomics analysis

Introduction Recent studies in human brain connectomics with multimodal magnetic resonance imaging (MRI) data have widely reported abnormalities in brain structure, function and connectivity associated with schizophrenia (SZ). However, most previous discriminative studies of SZ patients were based on MRI features of brain regions, ignoring the complex relationships within brain networks. Methods We applied a graph convolutional network (GCN) to discriminating SZ patients using the features of brain region and connectivity derived from a combined multimodal MRI and connectomics analysis. Structural magnetic resonance imaging (sMRI) and resting-state functional magnetic resonance imaging (rs-fMRI) data were acquired from 140 SZ patients and 205 normal controls. Eighteen types of brain graphs were constructed for each subject using 3 types of node features, 3 types of edge features, and 2 brain atlases. We investigated the performance of 18 brain graphs and used the TopK pooling layers to highlight salient brain regions (nodes in the graph). Results The GCN model, which used functional connectivity as edge features and multimodal features (sMRI + fMRI) of brain regions as node features, obtained the highest average accuracy of 95.8%, and outperformed other existing classification studies in SZ patients. In the explainability analysis, we reported that the top 10 salient brain regions, predominantly distributed in the prefrontal and occipital cortices, were mainly involved in the systems of emotion and visual processing. Discussion Our findings demonstrated that GCN with a combined multimodal MRI and connectomics analysis can effectively improve the classification of SZ at an individual level, indicating a promising direction for the diagnosis of SZ patients. The code is available at https://github.com/CXY-scut/GCN-SZ.git .

Chen, Xiaoyi↗
DOE OSTI2022

Deep Learning for In-Situ Layer Quality Monitoring during Laser-Based Directed Energy Deposition (LB-DED) Additive Manufacturing Process

Defects are a leading issue for the rejection of parts manufactured through the Directed Energy Deposition (DED) Additive Manufacturing (AM) process. In an attempt to illuminate and advance in situ quality monitoring and control of workpieces, we present an innovative data-driven method that synchronously collects sensing data and AM process parameters with a low sampling rate during the DED process. The proposed data-driven technique determines the important influences that individual printing parameters and sensing features have on prediction at the inter-layer qualification to perform feature selection. Three Machine Learning (ML) algorithms including Random Forest (RF), Support Vector Machine (SVM), and Convolutional Neural Network (CNN) are used. During post-production, a threshold is applied to detect low-density occurrences such as porosity sizes and quantities from CT scans that render individual layers acceptable or unacceptable. This information is fed to the ML models for training. Training/testing are completed offline on samples deemed “high-quality” and “low-quality”, utilizing only features recorded from the build process. CNN results show that the classification of acceptable/unacceptable layers can reach between 90% accuracy while training/testing on a “high-quality” sample and dip to 65% accuracy when trained/tested on “low-quality”/“high-quality” (respectively), indicating over-fitting but showing CNN as a promising inter-layer classifier.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Sim-to-real supervised domain adaptation for radioisotope identification

Machine learning has the potential to improve the speed and reliability of radioisotope identification using gamma spectroscopy. However, meticulously labeling an experimental dataset for training is often prohibitively expensive, while training models purely on synthetic data is risky due to the domain gap between simulated and experimental measurements. In this research, we demonstrate that supervised domain adaptation can substantially improve the performance of radioisotope identification models by transferring knowledge between synthetic and experimental data domains. We consider two domain adaptation scenarios: (1) a simulation-to-simulation adaptation, where we perform multi-label proportion estimation using simulated high-purity germanium detectors, and (2) a simulation-to-experimental adaptation, where we perform multi-class, single-label classification using measured spectra from handheld lanthanum bromide (LaBr) and sodium iodide (NaI) detectors. We begin by pretraining a spectral classifier on synthetic data using a custom transformer-based neural network. After subsequent fine-tuning on just 64 labeled experimental spectra, we achieve a test accuracy of 96% in the sim-to-real scenario with a LaBr detector, far surpassing a synthetic-only baseline model (75%) and a model trained from scratch (80%) on the same 64 spectra. Furthermore, we demonstrate that domain-adapted models learn more human-interpretable features than experiment-only baseline models. Overall, our results highlight the potential for supervised domain adaptation techniques to bridge the sim-to-real gap in radioisotope identification, enabling the development of accurate and explainable classifiers even in real-world scenarios where access to experimental data is limited.

Lalor, Peter W.↗
DOE OSTI2026

Creating a Training Dataset for Semantic Segmentation of Canal Networks for Irrigation Modernization

Canal infrastructure has provided critical irrigation water to the western United States for over a century. To continue providing vital water resources to the semi-arid West, irrigation systems must undergo maintenance and modernization. Many canal companies are resource-constrained, and because funding opportunities often require detailed knowledge of existing infrastructure, they can struggle to secure financial capital. We address this problem by creating training data for a semantic segmentation deep learning model to map canal networks throughout the western United States. To create a diverse and robust training dataset, we labelled 1-m NAIP imagery with the locations of no canals, wet canals, and dry/vegetated canals. Since creating these datasets is time consuming, we first developed a preprocessing methodology to identify canals within our four study areas. We used NAIP imagery and provided canal centerline data to buffer, standardize, and cluster the imagery, automating the labeling process as much as possible. However, this still required manual cleaning and manual classification of canal type. Challenges arose when canals were interrupted (e.g., road culverts or piped sections) or when nearby features shared similar characteristics (e.g., irrigated fields, trees, and shadows). Combining automated preprocessing with manual refinement produced four detailed canal masks to be used in the semantic segmentation model developed by Richard Tapia.

13 - HYDRO ENERGY↗
DOE OSTI2023

The active CGCG 077-102 NED02 galaxy within the Abell 2063 galaxy cluster

Context.Within the framework of investigating the link between the central super massive black holes in the cores of galaxies and the galaxies themselves, we detected a variable X-ray source in the center of CGCG 077-102 NED02, which is a member of the CGCG 077-102 galaxy pair within the Abell 2063 cluster of galaxies. Aims.Our goal is to combine X-ray and optical data to demonstrate that this object harbors an active super massive black hole in its core, and to relate this to the dynamical status of the galaxy pair within the Abell 2063 cluster. Methods.We usedChandraandXMM-Newtonarchival data to derive the X-ray spectral shape and variability. We also obtained optical spectroscopy to detect the expected emission lines that are typically found in active galactic nuclei. Finally, we used public ZTF imaging data to investigate the optical variability. Results.There is no evidence of multiple X-ray sources or extended components within CGCG 077-102 NED02. Single X-ray spectral models fit the source well. We detect significant, nonrandom inter-observation 0.5–10 keV X-ray flux variabilities, for observations separated by ∼4 days for short-term variations and by up to ∼700 days for long-term variations. Optical spectroscopy points toward a passive galaxy for CGCG 077-102 NED01 and a Seyfert for CGCG 077-102 NED02. The classification of CGCG 077-102 NED02 is also consistent with its X-ray luminosity of over 10 42 erg s −1 . We do not detect short-term variability in the optical ZTF light curves. However, we find a significant long-term stochastic variability in theg-band that can be well described by the damped random walk model with a best-fit characteristic damping timescale ofτ DRW = 30 −12 +28 days. Finally, the CGCG 077-102 galaxy pair is deeply embedded within the Abell 2063 potential, with a long enough history within this massive structure to have been affected by the influence of this cluster for a long time. Conclusions.Our observations point toward a moderately massive black hole in the center of CGCG 077-102 NED02 of ∼10 6 M ⊙ . As compared to another similar pair in the literature, CGCG 077-102 NED02 is not heavily obscured, perhaps because of the surrounding intracluster medium ram-pressure stripping.

Astronomy & Astrophysics↗
DOE OSTI2022

Design of a graphical user interface for few-shot machine learning classification of electron microscopy data

The recent growth in data generation by modern electron microscopes requires rapid, scalable, and flexible approaches to image segmentation and analysis. Few-shot machine learning, which can richly classify images from a handful of user-provided examples, is a promising route to high-throughput analysis. However, current command-line implementations of such approaches can be slow and unintuitive to use, lacking the real-time feedback necessary to perform effective classification. Here we report on the development of a Python-based graphical user interface that enables end users to easily conduct and visualize the output of few-shot learning models. This interface is portable and can be hosted locally or on the web, providing the opportunity to reproducibly conduct, share, and crowd-source few-shot analyses.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

ChemEcho v1.0

ChemEcho is a tool that converts tandem mass spectra into embeddings used to build machine learning (ML) models with fully explainable predictions. It provides an API for transforming raw tandem mass spectral data into embeddings, along with functions for training and validating ML models. Additionally, it includes utilities for retrieving and cleaning training data. ChemEcho is broadly applicable in ML pipelines that use tandem mass spectra for a variety of tasks, such as chemical classification or bioactivity mining. While there are existing methods to generate embeddings from fragmentation data, ChemEcho's approach ensures that predictions remain interpretable, enabling experts to evaluate results and generate hypotheses about the underlying data.

Harwood, Thomas [Lawrence Berkeley National Labora↗
DOE OSTI2021

IoT Intrusion Detection Taxonomy, Reference Architecture, and Analyses

This paper surveys the deep learning (DL) approaches for intrusion-detection systems (IDSs) in Internet of Things (IoT) and the associated datasets toward identifying gaps, weaknesses, and a neutral reference architecture. A comparative study of IDSs is provided, with a review of anomaly-based IDSs on DL approaches, which include supervised, unsupervised, and hybrid methods. All techniques in these three categories have essentially been used in IoT environments. To date, only a few have been used in the anomaly-based IDS for IoT. For each of these anomaly-based IDSs, the implementation of the four categories of feature(s) extraction, classification, prediction, and regression were evaluated. We studied important performance metrics and benchmark detection rates, including the requisite efficiency of the various methods. Four machine learning algorithms were evaluated for classification purposes: Logistic Regression (LR), Support Vector Machine (SVM), Decision Tree (DT), and an Artificial Neural Network (ANN). Therefore, we compared each via the Receiver Operating Characteristic (ROC) curve. The study model exhibits promising outcomes for all classes of attacks. The scope of our analysis examines attacks targeting the IoT ecosystem using empirically based, simulation-generated datasets (namely the Bot-IoT and the IoTID20 datasets).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Reprocessing Models for the Optical Light Curves of Hypervariable Quasars from the Sloan Digital Sky Survey Reverberation Mapping Project

We explore reprocessing models for a sample of 17 hypervariable quasars, taken from the Sloan Digital Sky Survey Reverberation Mapping project, which all show coordinated optical luminosity hypervariability with amplitudes of factors ≳2 between 2014 and 2020. We develop and apply reprocessing models for quasar light curves in simple geometries that are likely to be representative of quasar inner environments. In addition to the commonly investigated thin-disk model, we include the thick-disk and hemisphere geometries. The thick-disk geometry could, for instance, represent a magnetically elevated disk, whereas the hemisphere model can be interpreted as a first-order approximation for any optically thick out-of-plane material caused by outflows/winds, warped/tilted disks, and so on. Of the 17 quasars in our sample, 11 are best-fitted by a hemisphere geometry, five are classified as thick disks, and both models fail for just one object. We highlight the successes and shortcomings of our thermal reprocessing models in case studies of four quasars that are representative of the sample. While reprocessing is unlikely to explain all of the variability that we observe in quasars, we present our classification scheme as a starting point for revealing the likely geometries of reprocessing for quasars in our sample and hypervariable quasars in general.

79 ASTRONOMY AND ASTROPHYSICS↗