Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “anomalies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Capsule network-based semantic segmentation model for thermal anomaly identification on building envelopes

Thermography technology is widely used to inspect thermal anomalies in building façade systems. Computer vision-based techniques provide opportunities to autonomously detect such heat anomalies to significantly improve the efficiency of decision-making for building envelope retrofitting and maintenance. Here, in this work, we propose a novel Capsule Network-based deep learning model – CapsLab – that detects and identifies thermal anomalies by semantic segmentation. CapsLab is built based on our proposed prediction-tuning capsule (PT-Capsule) layer. Different from a traditional capsule layer, which consists of part-whole transformation and capsule-routing process, the proposed layer is composed of a prediction and tuning process, which helps decreasing the number of model parameters significantly. While the applicability of traditional Capsule Networks (CapsNets) has been limited to simpler tasks and smaller datasets due to their scalability issue, we can leverage the lightweight of the proposed PT-Capsule layer, and apply it to the semantic segmentation task. In this work, we also employ our previously presented performance metric, referred to as the Anomaly Identification Metric (AIM) (Kakillioglua et al. 2021), to evaluate the segmentation outputs. Traditional performance metrics do not accurately reflect the true performance of the segmentation models in thermal anomaly identification due to the high subjectivity in the annotation process and higher overlap ratio sensitivity of the standard metrics. AIM, on the other hand, is robust to these drawbacks. Experimental results show, both qualitatively and quantitatively, that our proposed segmentation method can effectively segment the thermal anomalies. Specifically, our model provides 9.38% and 13.53% improvements over the baseline model – DeepLabV3+ – based on traditional mIoU score and the AIM score, respectively, while requiring less model parameters and less computation at the same time. In addition, the scores that the AIM metric generates better align with the scores provided by building performance experts.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The value of human data annotation for machine learning based anomaly detection in environmental systems

Anomaly detection is the process of identifying unexpected data samples in datasets. Automated anomaly detection is either performed using supervised machine learning models, which require a labelled dataset for their calibration, or unsupervised models, which do not require labels. While academic research has produced a vast array of tools and machine learning models for automated anomaly detection, the research community focused on environmental systems still lacks a comparative analysis that is simultaneously comprehensive, objective, and systematic. This knowledge gap is addressed for the first time in this study, where 15 different supervised and unsupervised anomaly detection models are evaluated on 5 different environmental datasets from engineered and natural aquatic systems. To this end, anomaly detection performance, labelling efforts, as well as the impact of model and algorithm tuning are taken into account. As a result, our analysis reveals the relative strengths and weaknesses of the different approaches in an objective manner without bias for any particular paradigm in machine learning. Most importantly, our results show that expert-based data annotation is extremely valuable for anomaly detection based on machine learning.

54 ENVIRONMENTAL SCIENCES↗

Monte Carlo Dropout Uncertainty Quantification of Long Short-Term Memory Autoencoder Anomaly Detection in a Liquid Sodium Cold Trap

Advanced high-temperature fluid reactors, such as sodium-cooled fast reactors (SFRs) and molten salt–cooled reactors (MSCRs), require coolant purification systems to prevent fluid contamination and local freezing that can lead to plugging. Liquid sodium purification can be achieved with a cold trap, where the sodium temperature is reduced to a near-freezing point to precipitate out impurities. Automation of monitoring of the cold trap performance with machine learning algorithms can aid in early detection of incipient anomalies. An efficient approach to loss-of-coolant–type anomaly detection in a cold trap monitored with more than two dozen thermal-hydraulic sensors consists of a long short-term memory (LSTM) autoencoder. This work develops the uncertainty quantification of the LSTM autoencoder performance for cold trap anomaly detection using the Monte Carlo (MC) dropout method. The MC dropout methodology creates a distribution of sister distributions that all slightly differ from each other because of random neurons being turned off for testing. The variances of the sister network distributions are used to make an uncertainty interval. Our analysis shows that the uncertainty in the autoencoder performance is largest near the peak of the anomaly signal. Using the MC dropout method, we investigate the uncertainty in the anomaly detection with missing sensor inputs. This capability allows the reactor operator to evaluate resilience of the anomaly detection system and to make informed decisions about continuity of operation in the event of sensor failure.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Platform for Automated Anomaly Detection in the Mercury Process System at the Target System in the Spallation Neutron Source

The Spallation Neutron Source (SNS) at Oak Ridge National Laboratory accelerates proton beams, which are directed toward a mercury target to generate the world’s most intense neutron beams via spallation. The target system consists of several interconnected subsystems and accounts for a major share of the facility’s overall downtime. Early detection of anomalies in the target system response can thus provide the possibility of taking corrective actions to reduce downtime. Accelerator facilities have largely focused on the beam side for data-driven fault prognostics. On the target side, SNS relies on operational shift technicians (OSTs), who respond to alarms and manually flag anomalies onto the System Tracking and Reliability (STAR) platform. This paper presents one of the first studies of using machine learning (ML) to automate anomaly detection in the target system. The study focused on the mercury process system as the first use case and employed reconstruction-based anomaly detection on minutely sampled time series signals. The pipeline was integrated into the STAR platform to autonomously rank and flag anomalies every week. The STAR platform provides a user interface for the OSTs to evaluate the flagged anomalies, thereby incorporating human feedback.

Anomaly detection↗

Annual Solar Irradiance Anomaly Features Over the USA During 1998-2017 Using NSRDB V3

Annual solar irradiance anomalies (or departures from the long-term mean annual value) have a direct impact on various phases of solar energy projects, from prefeasibility studies to technical deployment decisions. Anomalies can happen because of normal climate variability or exceptional weather patterns. This study investigates such anomalies for both global horizontal irradiance (GHI) and direct normal irradiance (DNI) using Version 3 of the National Solar Radiation Database (NSRDB V3) and surface irradiance measurements at eight U.S. locations. At each site, the annual anomaly is analyzed here by evaluating the irradiance deviation from the long-term average for each specific year from 1998–2017. A positive/negative anomaly indicates that the solar resource was higher/lower than the long-term average during that specific year. The results show that in most cases the anomaly is within ±5% for GHI and ±10% for DNI using either ground-based irradiance measurements or modeled data from the NSRDB.

41 EE - Solar Energy Technologies Office (EE-4S)↗

RX-ADS: Interpretable Anomaly Detection Using Adversarial ML for Electric Vehicle CAN Data

Recent year has brought considerable advancements in Electric Vehicles (EVs) and associated infrastructures/ communications. Intrusion Detection Systems (IDS) are widely deployed for anomaly detection in such critical infrastructures. This paper presents an Interpretable Anomaly Detection System (RX-ADS) for intrusion detection in CAN protocol communication in EVs. Contributions include: 1) window based feature extraction method; 2) deep Autoencoder based anomaly detection method; and 3) adversarial machine learning based explanation generation methodology. The presented approach was tested on two benchmark CAN datasets: OTIDS and Car Hacking. The anomaly detection performance of RX-ADS was compared against the state-of-the-art approaches on these datasets: HIDS and GIDS. The RX-ADS approach presented performance comparable to the HIDS approach (OTIDS dataset) and has outperformed HIDS and GIDS approaches (Car Hacking dataset). Further, the proposed approach was able to generate explanations for detected abnormal behaviors arising from various intrusions. Furthermore, these explanations were later validated by information used by domain experts to detect anomalies. Other advantages of RX-ADS include: 1) the method can be trained on unlabeled data; 2) explanations help experts in understanding anomalies and root course analysis, and also help with AI model debugging and diagnostics, ultimately improving user trust in AI systems.

42 ENGINEERING↗

A Pattern Dictionary Method for Anomaly Detection

In this paper, we propose a compression-based anomaly detection method for time series and sequence data using a pattern dictionary. The proposed method is capable of learning complex patterns in a training data sequence, using these learned patterns to detect potentially anomalous patterns in a test data sequence. The proposed pattern dictionary method uses a measure of complexity of the test sequence as an anomaly score that can be used to perform stand-alone anomaly detection. We also show that when combined with a universal source coder, the proposed pattern dictionary yields a powerful atypicality detector that is equally applicable to anomaly detection. The pattern dictionary-based atypicality detector uses an anomaly score defined as the difference between the complexity of the test sequence data encoded by the trained pattern dictionary (typical) encoder and the universal (atypical) encoder, respectively. We consider two complexity measures: the number of parsed phrases in the sequence, and the length of the encoded sequence (codelength). Specializing to a particular type of universal encoder, the Tree-Structured Lempel–Ziv (LZ78), we obtain a novel non-asymptotic upper bound, in terms of the Lambert W function, on the number of distinct phrases resulting from the LZ78 parser. This non-asymptotic bound determines the range of anomaly score. As a concrete application, we illustrate the pattern dictionary framework for constructing a baseline of health against which anomalous deviations can be detected.

97 MATHEMATICS AND COMPUTING↗

Tensor Decomposition Analysis for UAV Anomaly Detection

Vibrational anomalies can provide valuable insights into the health status of an unmanned aerial vehicle, potentially indicating system degradation including propeller, motor, or sensor damage, as well as environmental anomalies such as strong wind gusts and turbulence. However, many causes for vibrational anomalies are not related to vehicle health, such as sharp shifts in velocity or direction of flight. Thus, depending strictly on vibration signals to detect anomalies can result in false positives for failures. Hence, it is important to include additional telemetries in detecting and diagnosing in-flight anomalies. This paper considers an approach to anomaly detection based on tensor decompositions that incorporates information from vibration signals, as well as additional flight data such as velocity, current draw, voltage drop, and attitude. Using experimental flight data collected by the University of Notre Dame, we construct third-order tensors then apply the CANDECOMP/PARAFAC decomposition to identify trends within each flight and classify flights as nominal or anomalous.

unmanned aviation↗

Autoencoder-Based Anomaly Detection System for Online Data Quality Monitoring of the CMS Electromagnetic Calorimeter

The CMS detector is a general-purpose apparatus that detects high-energy collisions produced at the LHC. Online data quality monitoring of the CMS electromagnetic calorimeter is a vital operational tool that allows detector experts to quickly identify, localize, and diagnose a broad range of detector issues that could affect the quality of physics data. A real-time autoencoder-based anomaly detection system using semi-supervised machine learning is presented enabling the detection of anomalies in the CMS electromagnetic calorimeter data. A novel method is introduced which maximizes the anomaly detection performance by exploiting the time-dependent evolution of anomalies as well as spatial variations in the detector response. The autoencoder-based system is able to efficiently detect anomalies, while maintaining a very low false discovery rate. The performance of the system is validated with anomalies found in 2018 and 2022 LHC collision data. In addition, the first results from deploying the autoencoder-based system in the CMS online data quality monitoring workflow during the beginning of Run 3 of the LHC are presented, showing its ability to detect issues missed by the existing system.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The gallium anomaly

In order to test the end-to-end operations of gallium solar neutrino experiments, intense electron-capture sources were fabricated to measure the responses of the radiochemical SAGE and GALLEX/GNO detectors to known fluxes of low-energy neutrinos. Such tests were viewed at the time as a cross-check, given the many tests of 71 Ge recovery and counting that had been routinely performed, with excellent results. However, the four 51 Cr and 37 Ar source experiments yielded rates below expectations, a result commonly known as the Ga anomaly. As the intensity of the electron-capture sources can be measured to high precision, the neutrino lines they produce are fixed by known atomic and nuclear rates, and the neutrino absorption cross section on 71 Ga is tightly constrained by the lifetime of 71 Ge, no simple explanation for the anomaly has been found. To check these calibration experiments, a dedicated experiment BEST was performed, utilizing a neutrino source of unprecedented intensity and a detector optimized to increase statistics while providing some information on counting rate as a function of distance from the source. The results BEST obtained are consistent with the earlier solar neutrino calibration experiments, and when combined with those measurements, yield a Ga anomaly with a significance of approximately 4𝜎, under conservative assumptions. But BEST found no evidence of distance dependence and thus no explicit indication of new physics. In this review we describe the extensive campaigns carried out by SAGE, GALLEX/GNO, and BEST to demonstrate the reliability and precision of their experimental procedures, including 71 Ge recovery, counting, and analysis. We also describe efforts to define uncertainties in the neutrino capture cross section, which now include estimates of effects at the ≲ 0.5% level such as radiative corrections and weak magnetism. With the results from BEST, an anomaly remains even if one retains only the transition to the 71 Ge ground state, whose strength is fixed by the known lifetime of 71 Ge. We then consider the new-physics solution most commonly suggested to resolve the Ga anomaly, oscillations into a sterile fourth neutrino, 𝜈 𝑒 → 𝜈 𝑠 . We find such a solution generates substantial tension with several null experiments, owing to the large mixing angle required. While this does not exclude such solutions – the sterile sector might include multiple neutrinos as well as new interactions – it shows the need for more experimental constraints, if we are to make progress in resolving the Ga and other low-energy neutrino anomalies. We conclude by consider the role future low-energy electron-capture sources could play in this effort.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Trace anomaly form factors from lattice QCD

The hadron mass can be obtained through the calculation of the trace of the energy-momentum tensor in the hadron which includes the trace anomaly and sigma terms. The anomaly due to conformal symmetry breaking is believed to be an important ingredient for hadron mass generation and confinement. In this work, we will present the calculation of the glue part of the trace anomaly form factors of the pion up to Q 2 ∼ 4.3 GeV 2 and the nucleon up to Q 2 ∼ 1 GeV 2 . The calculations are performed on a domain wall fermion ensemble with overlap valence quarks at seven valence pion masses varying from ∼ 250 to ∼ 540 MeV , including the unitary point ∼ 340 MeV . We calculate the radius of the glue trace anomaly for the pion and the nucleon from the z expansion. By performing a two-dimensional Fourier transform on the glue trace anomaly form factors in the infinite momentum frame with no energy transfer, we also obtain their spatial distributions for several valence quark masses. The results are qualitatively extrapolated to the physical valence pion mass with systematic errors from the unphysical sea quark mass, discretization effects in the renormalization sum rule, and finite-volume effects to be addressed in the future. We find the pion’s form factor changes sign, as does its spatial distribution, for light quark masses. This explains how the trace anomaly contribution to the pion mass approaches zero toward the chiral limit. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

High-Fidelity Dataset Generation for Sensor Anomalies in Power Grids using Hardware-in-the-Loop Testbed

Sensor anomalies in power grids can have significant impacts on the operation of the grid due to the increased reliance of the grid operation on data-driven applications. However, there is a lack of datasets that accurately capture these anomalies as many of the anomalies go undetected using the current bad data detectors. High-fidelity labeled datasets are essential for developing robust applications that can detect and mitigate the impacts of anomalies. In this paper, we propose a hardware-in-the-loop testbed model that can emulate the grid behavior with high-fidelity. This testbed is used to inject anomalies at various levels in the grid architecture and generate labeled datasets. These high-fidelity datasets can be used for development and validation of data-driven applications for detection and mitigation of anomalies in grids and other cyber-physical systems.

Hyder, Burhan↗

The Influence of Large-Scale Radiation Anomalies on Tropical Cyclone Frequency

Abstract The response of tropical cyclone (TC) frequency to sea surface warming is uncertain in climate models. We hypothesize that one source of uncertainty is the anomalies of large-scale atmospheric radiation in response to climate change, and whose influence on TC frequency is investigated. Given two atmospheric models with opposite TC frequency responses to uniform sea surface warming, we interchange their atmospheric radiation anomalies in experiments with prescribed radiative heating rates. The largest model discrepancy occurs in the western North Pacific, where the TC frequency tends to increase with anomalous large-scale ascent caused by prescribed positive radiation anomalies, while the TC frequency tends to decrease with anomalous large-scale descent caused by prescribed negative radiation anomalies. The model spread in TC frequency response is approximated by the model spread in the frequency response of pre-TC vortices (seeds), which is explained by changes in the large-scale circulation using a downscaling formula known as the seed propensity index. We further generalize the index to predict the influence of large-scale radiation anomalies on TC seed frequency. The results show that model spread in TC and seed frequency response can be reduced when constraining the large-scale radiation anomalies. Significance Statement It is difficult to predict whether tropical cyclones will occur more or less frequently in the future and by how much. We show that tropical cyclone frequency is strongly influenced by the global pattern of heating and cooling due to radiation, a process that has been neglected in existing theories. Our theory improves understanding of how tropical cyclones respond to climate change, explaining why one model may predict a frequency increase while a different but equally realistic model may predict a frequency decrease. One reason for the difficulty in predicting tropical cyclone frequency is found to be the difficulty in predicting how global cloud distribution will change in the future.

54 ENVIRONMENTAL SCIENCES↗

Revisiting the Role of Ocean Circulation Changes in Polar Ocean Heat Transport Anomalies under Global Warming

In response to greenhouse gas forcing, climate models predict that poleward ocean heat transport (OHT) weakens in the Southern Ocean but increases in the Arctic. The role of ocean circulation changes in this OHT response has been evaluated by decomposing OHT anomalies into a dynamic component (holding ocean temperature fixed while circulation evolves) and a thermodynamic component (holding ocean circulation fixed while temperature evolves). However, ocean temperature changes are themselves shaped by circulation changes through redistribution of the existing heat reservoir and subsequent effects on air–sea heat fluxes. The thermodynamic component can therefore be influenced by circulation changes, making the standard thermodynamic–dynamic decomposition incomplete for isolating the role of circulation changes in OHT anomalies. To address this issue, we use a passive–active decomposition to assess the relative contributions of ocean circulation and passive ocean temperature changes to polar OHT anomalies in a fully coupled climate model. Passive temperature changes are defined as those thermally forced by the atmosphere in the absence of circulation changes. In this passive–active decomposition, an advective term involving both circulation and passive temperature changes remains ambiguous—classifying it as active implies circulation changes dominate Southern Ocean OHT anomalies, whereas classifying it as passive implies temperature changes dominate. However, both interpretations imply that ocean circulation changes have a much weaker effect on polar OHT anomalies than inferred from the standard decomposition. In conclusion, these results help reconcile conclusions from studies using the standard decomposition with those using passive tracer methods to assess the role of circulation changes in polar OHT anomalies.

Arctic↗

Lieb-Schultz-Mattis, Luttinger, and 't Hooft - anomaly matching in lattice systems

We analyze lattice Hamiltonian systems whose global symmetries have ’t Hooft anomalies. As is common in the study of anomalies, they are probed by coupling the system to classical background gauge fields. For flat fields (vanishing field strength), the nonzero spatial components of the gauge fields can be thought of as twisted boundary conditions, or equivalently, as topological defects. The symmetries of the twisted Hilbert space and their representations capture the anomalies. We demonstrate this approach with a number of examples. In some of them, the anomalous symmetries are internal symmetries of the lattice system, but they do not act on-site. (We clarify the notion of “on-site action.”) In other cases, the anomalous symmetries involve lattice translations. Using this approach we frame many known and new results in a unified fashion. In this work, we limit ourselves to 1+1d systems with a spatial lattice. In particular, we present a lattice system that flows to the c=1 c = 1 compact boson system with any radius (no BKT transition) with the full internal symmetry of the continuum theory, with its anomalies and its T-duality. As another application, we analyze various spin chain models and phrase their Lieb-Shultz-Mattis theorem as an ’t Hooft anomaly matching condition. We also show in what sense filling constraints like Luttinger theorem can and cannot be viewed as reflecting an anomaly. As a by-product, our understanding allows us to use information from the continuum theory to derive some exact results in lattice model of interest, such as the lattice momenta of the low-energy states.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Supplementary notes on sea-surface temperature anomalies and model-generated meteorological histories

A numerical experiment was made on the Mintz-Arakawa two-level global general circulation model, investigating the effects of a transient one-month sea-surface temperature (SST) anomaly and of a persistent three-month SST anomaly. The time histories are compared with a control run that lacked the anomaly pattern. After one month, the anomaly and control synoptic patterns were as uncorrelated as any two random fields. It is found that the transient SST anomaly can alter the monthly and seasonal temperature and precipitation in the eastern U.S. by as much as two class intervals. The question of whether the real atmosphere is as sensitive to such an anomaly is raised but cannot be settled at this time.

Spar, J.↗

On the origin of the Bangui magnetic anomaly, central African empire

A large magnetic anomaly was recognized in satellite magnetometer data over the Central African Empire in central Africa. They named this anomaly the Bangui magnetic anomaly due to its location near the capital city of Bangui, C.A.E. Because large crustal magnetic anomalies are uncommon, the origin of this anomaly has provoked some interest. The area of the anomaly was visited to make ground magnetic measurements, geologic observations, and in-situ magnetic susceptibility measurements. Some rock samples were also collected and chemically analyzed. The results of these investigations are presented.

Marsh, B. D.↗

On isostatic geoid anomalies

In regions of slowly varying lateral density changes, the gravity and geoid anomalies may be expressed as power series expansions in topography. Geoid anomalies in isostatically compensated regions can be directly related to the local dipole moment of the density-depth distribution. This relationship is used to obtain theoretical geoid anomalies for different models of isostatic compensation. The classical Pratt and Airy models give geoid height-elevation relationships differing in functional form but predicting geoid anomalies of comparable magnitude. The thermal cooling model explaining ocean floor subsidence away from mid-ocean ridges predicts a linear age-geoid height relationship of 0.16 m/m.y. Geos 3 altimetry profiles were examined to test these theoretical relationships. A profile over the mid-Atlantic ridge is closely matched by the geoid curve derived from the thermal cooling model. The observed geoid anomaly over the Atlantic margin of North America can be explained by Airy compensation. The relation between geoid anomaly and bathymetry across the Bermuda Swell is consistent with Pratt compensation with a 100-km depth of compensation.

Haxby, W. F.↗