Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Labeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

PMU Data Quality and Sensor Health Monitoring

Phasor Measurement Units (PMUs) play a critical role in the evolution of the electric power industry by providing high-precision, real-time monitoring of essential power system metrics. However, effectively detecting abnormalities and critical events from PMU data is a complex task, complicated by intricate temporal patterns, a scarcity of labeled data for training algo- rithms, and constraints on online computational power. In this study, we apply TranAD, an innovative algorithm that combines transformer architectures with the refinement of adversarial learning, to both synthetic and real-world PMU datasets for developing a data quality and sensor online health monitoring platform for utilities. Our findings reveal that TranAD not only provides efficient detection and localization but also enhances the detail with which abnormalities are detected, marking a a significant step forward in the field of clean data acquisition processes for power system monitoring

deep neural network, machine learning (ML)↗
DOE OSTI2024

Online Dynamic Cyber-Attack Diagnosis in Power Electronics Systems Based on Few-Shot Learning

With increasing exposure to software-based sensing and control, power electronics systems are facing higher risks of cyber-physical attacks. To ensure system stability and minimize potential economic losses, it is critical to monitor the operating states and detect those attacks at the early stage. However, anomaly detection and diagnosis of attacks are still challenging, especially when labeled anomaly data is difficult or even infeasible to obtain. To overcome this problem, we propose a Few-Shot Learning (FSL) based approach for cyber-attack diagnosis leveraging the waveform data. To the best of our knowledge, this work is the first attempt at leveraging FSL for cyber-attack diagnosis in power electronics systems. Extensive experimental results demonstrate that our proposed approach can achieve comparable diagnosis accuracy with the state-of-the-art data-driven methods using less than 0.04% of the training samples.

Li, Qi↗
DOE OSTI2023

Model Agnostic Bayesian Framework for Online Anomaly/Event Detection in PMU Data

Phasor measurement units (PMU) are integral to the modernization and automation plan of the electric power industry. A PMU data signature contains system-level events (e.g., faults, generation/load change, etc.) and any measurement/device-related errors. Therefore, the reliable and resilient operation of power systems is equivalent to the quality of the PMU data and the situation awareness provided by its data signature. Despite recent progress, current state-of-the-art methods are not fool-proof and have certain limitations tracing an error/abnormality to sensor sub-components and grid systems. This is because of technical challenges imposed by the scarcity of the labeled information, loss of data quality, and non-stationarity of data. In this paper, we consider the online PMU data stream as an output of a stochastic process and pose the anomaly/event detection as a changepoint detection problem dealing with detecting parameter changes in the underlying stochastic processes. The proposed model-agnostic framework relies on: (a) feature extraction utilizing the minimum volume enclosing ellipsoids (MVEE) method from raw PMU observations and (b) a Bayesian framework of changepoint detection. The validity of the proposed methodology is discussed through numerical experiments on real-world utility-scale PMU data.

Hossain, Ramij Raja↗
DOE OSTI2023

Characterizing Quantum Classifier Utility in Natural Language Processing Workflows

Quantum Natural Language Processing (QNLP) develops natural language processing (NLP) models for deployment on quantum computers. We explore feature and data prototype selection techniques to address challenges posed by encoding high dimensional features. Our study builds quantum circuit classifiers that includes classical feature pre-processing, quantum embedding and quantum model training. The quantum models are built on 4 or 6 qubits and the quantum neural network (QNN) uses the established bricklayer design. We compare the dependence of model performance (in terms of accuracy and F1 scores) on feature length, embedding gates and parameterized unitary design. We compare the performance of quantum machine learning models to classical convolution neural network model (CNN) on binary and multi-class classification tasks using two datasets of synthetic features and labels. The first is the ECP-CANDLE P3B3 dataset a corpus of synthetically generated cancer pathology reports. The second dataset is extracted from well-known benchmark dataset (MADELON) - features are generated with a combination of informative, repeated and uninformative features. Both datasets are used for binary classification and multi-class classification with 3 classes. We observe robust, accurate performance from all models on the binary classification tasks, but multiclass classification is a challenge for the quantum models-there is a notable decrease in accuracy when using 3 classes. Overall the performance is comparable in terms of recall and accuracy between QNNs and CNNs, even with large datasets. These results provide a point of comparison between quantum and classical models on real-world datasets.

Hamilton, Kathleen↗
DOE OSTI2025

A Weakly Supervised Machine Learning Procedure for Magnet Quench Diagnostics

Voltage taps remain the standard and reliable diagnostic tool for detecting quenches in superconducting magnets. However, they identify a quench only at the time of voltage rise and do not provide information on earlier physical precursors. In this work, we investigate whether acoustic emission data can reveal precursor activity that occurs before conventional voltage detection using machine learning techniques. We introduce an event selection method and a weakly supervised machine learning procedure to learn data-driven criteria for identifying potential acoustic precursors to quenches. Two Convolutional Neural Network (CNN) architectures are trained: one on acoustic sensor events from our selection procedure and one on the Fast Fourier Transforms (FFTs) of these events. Both networks are trained iteratively using confidence-weighted loss functions to associate certain subsets of training data with a precursor label. We evaluate the performance of these models by examining the time distribution of events classified as potential precursors relative to the quench onset. Results indicate that the proposed approach can possibly distinguish acoustic emission events occurring closer to the quench from earlier acoustic activity during ramping, suggesting the potential for flagging quench precursors in acoustic data.

Khan, Maira [Fermilab] (ORCID:0009000891602387)↗
DOE OSTI2022

Light-Duty Vehicle Trip Classification Using One-Class Novelty Detection and Exhaustive Feature Extraction

Travel mode classification within travel survey data sets, especially light-duty vehicle (LDV) trips, is foundational, though nontrivial, to emerging mobility systems, travel behavior analysis, and fuel consumption estimation. Current travel mode detection approaches require well-sampled and balanced data sets with ground truth travel mode labels. The detection approaches are rarely applied and validated on large-scale, real-world data sets, which may not satisfy the dataset requirements. This work proposes an LDV trip detection model as a supplement to current travel mode detection methods, for the case when the training set is highly (and/or completely) unbalanced, to the extent that classical machine-learning approaches become difficult or impossible to deploy. The proposed model uses a novelty detection technique - one-class support vector machines (OCSVMs) - and a novel exhaustive feature extraction (EFE) technique on continuous time series data (i.e., Global Positioning System [GPS] speed profiles) for single-mode trip trajectories. Training and validation of the model are conducted on a large-scale, real-world data set. The proposed method accurately identifies LDV trips from a broad set of multimodal trips by leveraging a wealth of preexisting in-vehicle GPS travel data. Additional sensitivity analysis sheds light on the optimal training size and feature selection, which will benefit applications limited by highly imbalanced data. The paper also discusses performance comparison with regular machine-learning approaches, the model's robustness, and the potential to extend the proposed model to multi-modal trip prediction.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Spatio-Temporal Deep Graph Network for Event Detection, Localization, and Classification in Cyber-Physical Electric Distribution System

This work proposes a deep graph learning framework to identify, locate, and classify power, cyber, and cyber power events at the distribution system level. The proposed algorithm jointly exploits spatial, temporal, and node-level cyber and physical data features. The developed graph neural network, together with a deep autoencoder, utilizes physical measurements from distribution level phasor measurement units and cyber data from communication network logs. The spatial structure of the synchrophasor measurements and network is incorporated through a weighted adjacency matrix. The temporal structure is incorporated by defining a spatial operation in the gated recurrent unit. This spatio-temporal learning element resides inside a power event detection, localization, and classification module that provides the degree of confidence for an event label. To accurately pinpoint the location of an event to the nearest bus equipped with a measurement unit, a combination of squared error and proximity score is utilized. Also included is a cyber event detection module that employs heteroskedasticity to analyze the significance of various cyber features during different types of attacks. Finally, a dual-bit cyber-power decision table determines the nature of the event. The proposed method is validated on two distribution systems modeled in OPAL-RT/Hypersim with limited phasor measurement units for different possible physical and cyber events. Further analyses include comparison with other state-of-the-art methods and validation in the presence of measurement noise. As a result, our method outperforms existing approaches and achieves an average detection accuracy of 97.97%, F1-score of 96.88%, precision of 96.53%, and recall of 98.57%.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Self-Supervised and Interpretable Anomaly Detection Using Network Transformers

Machine learning and deep neural networks (DNNs) have been proposed as a tool to identify anomalies in computer network communications. However, due the obfuscated nature of off-the-shelf machine learning models, their output often does not provide enough information to isolate the source of the anomaly to take corrective measures. In this article, we introduce the network transformer (NeT), a DNN model for anomaly detection that incorporates the graph structure of the communication network in order to improve interpretability. Further, the presented approach has the following advantages: first, enhanced interpretability by incorporating the graph structure of computer networks; second, provides a hierarchical set of features that enables analysis at different levels of granularity; second, self-supervised training that does not require labeled data. The NeT model was evaluated on a set of anomalous scenarios executed in a real industrial control system. The presented approach successfully identified the anomalies, the devices affected, and the specific connections causing the anomalies, providing a data-driven hierarchical approach to analyze the behavior of a cyber network.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

INSURE: An Information Theory iNspired diSentanglement and pURification modEl for Domain Generalization

Domain Generalization (DG) aims to learn a generalizable model on the unseen target domain by only training on the multiple observed source domains. Although a variety of DG methods have focused on extracting domain-invariant features, the domain-specific class-relevant features have attracted attention and been argued to benefit generalization to the unseen target domain. To take into account the class-relevant domain-specific information, in this paper we propose an Information theory iNspired diSentanglement and pURification modEl (INSURE) to explicitly disentangle the latent features to obtain sufficient and compact (necessary) class-relevant feature for generalization to the unseen domain. Specifically, we first propose an information theory inspired loss function to ensure the disentangled class-relevant features contain sufficient class label information and the other disentangled auxiliary feature has sufficient domain information. Additionally, we further propose a paired purification loss function to let the auxiliary feature discard all the class-relevant information and thus the class-relevant feature will contain sufficient and compact (necessary) class-relevant information. Moreover, instead of using multiple encoders, we propose to use a learnable binary mask as our disentangler to make the disentanglement more efficient and make the disentangled features complementary to each other. We conduct extensive experiments on five widely used DG benchmark datasets including PACS, VLCS, OfficeHome, TerraIncognita, and DomainNet. The proposed INSURE achieves state-of-the-art performance. We also empirically show that domain-specific class-relevant features are beneficial for domain generalization. The code is available at https://github.com/yuxi120407/INSURE .

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Generation of Synthetic Data for a Radiation Detection Algorithm Competition

This paper details the generation of synthetic radiation data using large-scale Monte Carlo transport models to evaluate radiation search detection algorithms. Modular 3-D Monte Carlo models spanning multiple city blocks were constructed, loosely based on downtown Knoxville, TN, containing buildings composed of multiple materials (brick, granite, and concrete), sidewalks, a four-lane road, side streets, parking lots, and grassy fields. Background and simulated source detector response calculations from these models were used to create synthetic list mode data sets for a 2"×4"×16" NaI(Tl) detector moving through a city street at a constant speed. For the background simulations, major isotopes were computed individually so that background composition and variability could be computed efficiently outside Monte Carlo. The source detector response included six simulated sources placed at 15 source locations. Detector response was developed to be periodic through the city street so that a detector path could begin at one end of the model and wrap around to the other. This framework allowed for the creation of diverse data sets, each with its own unique background and simulated source detector response. Synthetic data allows for high-quality labels, which are useful in developing data-driven radiation detection algorithms. This methodology was used to create synthetic data sets which were released as part of a public data competition to spur the development of new radiation detection algorithms for radiological search applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Power System Event Identification Based on Deep Neural Network With Information Loading

Online power system event identification and classification are crucial to enhancing the reliability of transmission systems. In this study, we develop a deep neural network (DNN) based approach to identify and classify power system events by leveraging real-world measurements from hundreds of phasor measurement units (PMUs) and labels from thousands of events. Two innovative designs are embedded into the baseline model built on convolutional neural networks (CNNs) to improve the event classification accuracy. First, we propose a graph signal processing based PMU sorting algorithm to improve the learning efficiency of CNNs. Second, we deploy information loading based regularization to strike the right balance between memorization and generalization for the DNN. Numerical results based on real-world dataset from the Eastern Interconnection of the U.S power transmission grid show that the combination of PMU based sorting and the information loading based regularization techniques help the proposed DNN approach achieve highly accurate event identification and classification results.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

SigTime: Learning and Visually Explaining Time Series Signatures

Understanding and distinguishing temporal patterns in time series data is essential for scientific discovery and decision-making. For example, in biomedical research, uncovering meaningful patterns in physiological signals can improve diagnosis, risk assessment, and patient outcomes. However, existing methods for time series pattern discovery face major challenges, including high computational complexity, limited interpretability, and difficulty in capturing meaningful temporal structures. Here, to address these gaps, we introduce a novel learning framework that jointly trains two Transformer models using complementary time series representations: shapelet-based representations to capture localized temporal structures and traditional feature engineering to encode statistical properties. The learned shapelets serve as interpretable signatures that differentiate time series across classification labels. Additionally, we develop a visual analytics system—SigTime—with coordinated views to facilitate exploration of time series signatures from multiple perspectives, aiding in useful insights generation. We quantitatively evaluate our learning framework on eight publicly available datasets and one proprietary clinical dataset. Additionally, we demonstrate the effectiveness of our system through two usage scenarios along with the domain experts: one involving public ECG data and the other focused on preterm labor analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Plant roots stimulate the decomposition of complex, but not simple, soil carbon

Roots release carbon into soil and can alleviate energy limitation of microbial organic matter decomposition. We know little about the effects of roots on microbial decomposition of different organic matter substrates, despite the importance for soil carbon stocks and turnover. Through implementing root-microbe interactions, the Carbon, Organisms, Rhizosphere, and Protection in the Soil Environment (CORPSE) model was previously shown to represent dynamics of total soil carbon in temperate forest field experiments. However, the model permits alternative hypotheses concerning microbial-substrate affinity. We investigated how root inputs affect decomposition of soil organic carbon (SOC) with variable decomposability. We simulated SOC stocks in CORPSE and compared microbial degradation of two substrates types with varying root-microbe interactions under two alternative hypotheses that varied in microbial-substrate affinity. We compared our modeled hypotheses to a forest field experiment where we quantified decomposition of isotopically-labeled starch and leaf tissues in soils with manipulated root access to microbes. Here, we tested the hypothesis that decomposition of leaves would be more sensitive to root inputs than decomposition of starch, corresponding to the alternative model hypothesis. In the field study, leaf decomposition increased with root density while starch decomposition was unchanged by root density. Microbial biomass and enzyme activity consistently increased with root inputs in CORPSE and the field study. Our field experiment supported the CORPSE simulations with high microbial-substrate affinity. Roots stimulated microbial growth and enzyme production, which increased degradation of more complex substrates such as leaf tissues. Substrates that were easily decomposed, such as starch, may already be degrading at a maximum rate in the absence of rhizosphere influence because their decomposition rate was unchanged by root inputs. We found that the degree to which roots stimulate microbial decomposition depends on the substrate being decomposed, and that root-microbe interactions influenced SOC stocks in both our model and field experiment. Environmental changes that alter root-microbe interactions could, therefore, alter soil C stocks and biogeochemical cycling, and models of these interactions should incorporate differential influence of rhizosphere inputs on different substrates.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Early-life atomic-bomb irradiation accelerates immunological aging and elevates immune-related intracellular reactive oxygen species

Reactive oxygen species (ROS) play an important role in immune responses; however, their excessive production and accumulation increases the risk of inflammation-related diseases. Although irradiation is known to accelerate immunological aging, the underlying mechanism is still unclear. To determine the possible involvement of ROS in this mechanism, we examined 10,023 samples obtained from 3752 atomic-bomb survivors in Hiroshima and Nagasaki, who participated in repeated biennial examinations from 2008 to 2016, for the effects of aging and radiation exposure on intracellular ROS (H 2 O 2 and O 2 •- ) levels, percentages of T-cell subsets, and the effects of radiation exposure on the relationship between cell percentages and intracellular ROS levels in T-cell subsets. The cell percentages and intracellular ROS levels in T-cell subsets were measured using flow cytometry, with both fluorescently labeled antibodies and the fluorescent reagents, carboxy-DCFDA and hydroethidine. The percentages of naïve CD4 + and CD8 + T cells decreased with increasing age and radiation dose, while the intracellular O 2 •- levels in central and effector memory CD8 + T cells increased. Additionally, when divided into three groups based on the percentages of naïve CD4 + T cells, intracellular O 2 •- levels of central and effector memory CD8 + T cells were significantly elevated with the lowest radiation dose group in the naïve CD4 + T cells. Thus, the radiation exposure-induced decrease in the naïve CD4 + T cell pool size may reflect decreased immune function, resulting in increased intracellular ROS levels in central and effector memory CD8 + T cells, and increased intracellular oxidative stress.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗
DOE OSTI2020

Pore-scale view of microbial turnover: combining 14 C imaging, μCT, and zymography after adding soluble carbon to soil pores of specific sizes

The location of microorganisms and substrates within soil pore networks plays a crucial role for organic carbon (C) processing, its microbial utilization and turnover, and has direct consequences for C and nutrient cycling. An optimal approach to quantify responses to new C inputs from microorganisms residing in specific pores is the addition of new C to pores of target sizes in undisturbed soil cores. We used the matric potential approach to add 14 C labeled glucose to small (< 40 μm, root free) or large (60-180 μm, potentially inhabited by roots) pores of undisturbed soil cores. Localization of glucose-derived C via 14 C imaging was related to pore size distributions and connectivity, characterized via X-ray computed micro-tomography (μCT), and to β-glucosidase activity, characterized via zymography. After two-week incubations, 1.3 times more glucose was mineralized ( 14 CO 2 ) when it was added to the large pores, however more 14 C remained in microbial biomass when glucose was added to the small pores. Consequently, while utilizing the same amounts of easily available C, the microorganisms localized in the large pores had faster turnover compared to microorganisms in small pores. Stronger associations between β-glucosidase activity and glucose-derived C were observed when glucose was added to the large pores. We conclude that 1) the matric potential approach allows placing, albeit not exactly, soluble substrates into pores of target diameter range, and 2) microorganisms localized in large pores respond to new C inputs with faster turnover, greater growth, and more intensive enzyme production compared to those inhabiting the small pores.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Roots selectively decompose litter to mine nitrogen and build new soil carbon

Abstract Plant–microbe interactions in the rhizosphere shape carbon and nitrogen cycling in soil organic matter (SOM). However, there is conflicting evidence on whether these interactions lead to a net loss or increase of SOM. In part, this conflict is driven by uncertainty in how living roots and microbes alter SOM formation or loss in the field. To address these uncertainties, we traced the fate of isotopically labelled litter into SOM using root and fungal ingrowth cores incubated in a Miscanthus x giganteus field. Roots stimulated litter decomposition, but balanced this loss by transferring carbon into aggregate associated SOM. Further, roots selectively mobilized nitrogen from litter without additional carbon release. Overall, our findings suggest that roots mine litter nitrogen and protect soil carbon.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Warming and elevated CO 2 promote rapid incorporation and degradation of plant‐derived organic matter in an ombrotrophic peatland

Abstract Rising temperatures have the potential to directly affect carbon cycling in peatlands by enhancing organic matter (OM) decomposition, contributing to the release of CO 2 and CH 4 to the atmosphere. In turn, increasing atmospheric CO 2 concentration may stimulate photosynthesis, potentially increasing plant litter inputs belowground and transferring carbon from the atmosphere into terrestrial ecosystems. Key questions remain about the magnitude and rate of these interacting and opposing environmental change drivers. Here, we assess the incorporation and degradation of plant‐ and microbe‐derived OM in an ombrotrophic peatland after 4 years of whole‐ecosystem warming (+0, +2.25, +4.5, +6.75 and +9°C) and two years of elevated CO 2 manipulation (500 ppm above ambient). We show that OM molecular composition was substantially altered in the aerobic acrotelm, highlighting the sensitivity of acrotelm carbon to rising temperatures and atmospheric CO 2 concentration. While warming accelerated OM decomposition under ambient CO 2 , new carbon incorporation into peat increased in warming × elevated CO 2 treatments for both plant‐ and microbe‐derived OM. Using the isotopic signature of the applied CO 2 enrichment as a label for recently photosynthesized OM, our data demonstrate that new plant inputs have been rapidly incorporated into peat carbon. Our results suggest that under current hydrological conditions, rising temperatures and atmospheric CO 2 levels will likely offset each other in boreal peatlands.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Indoor air quality in California homes with code-required mechanical ventilation

Data were collected in 70 detached houses built in 2011-2017 in compliance with the mechanical ventilation requirements of California's building energy efficiency standards. Each home was monitored for a 1-week period with windows closed and the central mechanical ventilation system operating. Pollutant measurements included time-resolved fine particulate matter (PM 2.5 ) indoors and outdoors and formaldehyde and carbon dioxide (CO 2 ) indoors. Time-integrated measurements were made for formaldehyde, NO 2 , and nitrogen oxides (NO X ) indoors and outdoors. Operation of the cooktop, range hood, and other exhaust fans was continuously recorded during the monitoring period. Onetime diagnostic measurements included mechanical airflows and envelope and duct system air leakage. All homes met or were very close to meeting the ventilation requirements. On average, the dwelling unit ventilation fan moved 50% more airflow than the minimum requirement. Pollutant concentrations were similar to or lower than those reported in a 2006-2007 study of California new homes built in 2002-2005. Mean and median indoor concentrations were lower by 44% and 38% for formaldehyde and 44% and 54% for PM 2.5 . Ventilation fans were operating in only 26% of homes when first visited, and the control switches in many homes did not have informative labels as required by building standards.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗