Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Anomaly Detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Enabling Mission Flexibility to Battery Driven Deep Space Endeavors With Generalized Battery-Health-Monitoring Using Physics-Based and Data-Driven Reduced-Order Models

The needs and requirements for an electrochemical energy storage for deep space exploration is well explored. It is often understood that different mission sites and environmental conditions require different battery chemistries or technologies. Additionally, various engineering solutions are deployed to overcome specific chemical challenges. One often overlooked need is the “health” monitoring of an electrochemical storage system. The term generalized health monitoring, as envisioned in this work, refers to the monitoring of various aspects such as electrode health, electrolyte health, reaction pathway health, cooling system health, sensor health, and BMS health [1]. Generalized health monitoring allows mission leads, engineers, and scientists to incorporate flexibility in mission designs, make on-the-fly mission changes, and extend the duration of science missions. Moreover, it enables automation and data-driven decision-making without compromising safety and performance. Recently, our group developed a hierarchy of thermal reduced-order models (TROM) by combining a physics-based modeling approach and data-driven model reduction techniques applied to flight data [2]. The resulting TROMs were found to be not only accurate but also identifiable from the flight data. Consequently, the coefficient of variance of the model parameters is small over the course of hundreds of flights, allowing for monitoring the parameter evolution trajectories as the battery ages and degrades. These parameters constitute the metrics of the generalized health of a battery. Monitoring their evolution allows such models to be used for anomaly detection and prognostics, improving early detection of abnormal behavior and thus enabling timely maintenance, longer battery life, and enhanced battery safety. For this presentation, the practicality of the thermal model will be validated on a pack of 14cells under various topology configurations such as 1S14P, 2P7S, 7S2P, and 1P14S. It is well known that manufacturing and non-uniform aging lead to variability in the performance of a cell, which is exacerbated by cell balancing during active load. Additionally, in extreme scenarios, the paramount objective is to complete the mission, regardless of the stresses on the battery. Topology-induced balancing issues further stress the battery. The goal of this study is to determine if the noise (identifiability) in the reduced-order thermal model parameters is sensitive to topology, cell spacing, cooling strategy, and manufacturing or age variability. The variability in cells is considered by assuming a multimodal distribution for microscopic parameters of a cell (such as porosity, tortuosity, reaction kinetics, volumetric thermal conductivity, and volumetric heat capacity). The compounded effect of manufacturing variability, topological selection, cooling strategies, and cell balancing ages each cell in a battery differently. The study aims to clarify whether the challenge in extracting maximum information depends on the minimum number of sensors or models used for data extraction.

Automation↗

Prognostics and Life Beyond 60 for Nuclear Power Plants

Safe, secure, reliable and sustainable energy supply is vital for advanced and industrialized life styles. To meet growing energy demand there is interest in longer term operation (LTO) for the existing nuclear power plant fleet and enhancing capabilities in new build. There is increasing use of condition based maintenance (CBM) for active components and periodic in service inspection (ISI) for passive systems: there is growing interest in deploying on-line monitoring. Opportunities exist to move beyond monitoring and diagnosis based on pattern recognition and anomaly detection to and prognostics with the ability to provide an estimate of remaining useful life (RUL). The adoption of digital I&C systems provides a framework within which added functionality including on-line monitoring can be deployed, and used to maintain and even potentially enhance safety, while at the same time improving planning and reducing both operations and maintenance costs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Reference Based Analysis Framework for Analyzing System Call Traces

Reference based analysis (RBA) is a novel data mining tool for exploring a test data set with respect to a reference data set. The power of RBA lies in it ability to transform any complex data type, such as symbolic sequences and multi-variate categorical data instances, into a multivariate continuous representation. The transformed representation not only allows visualization of the complex data, which cannot be otherwise visualized in its original form, but also allows enhanced anomaly detection in the transformed feature space. We demonstrate the application of the RBA framework in analyzing system call traces and show how the transformation results in improved intrusion detection performance over state of art data mining based intrusion detection methods developed for system call traces.

99 GENERAL AND MISCELLANEOUS↗

Power electronics reliability.

The project's goals are: (1) use experiments and modeling to investigate and characterize stress-related failure modes of post-silicon power electronic (PE) devices such as silicon carbide (SiC) and gallium nitride (GaN) switches; and (2) seek opportunities for condition monitoring (CM) and prognostics and health management (PHM) to further enhance the reliability of power electronics devices and equipment. CM - detect anomalies and diagnose problems that require maintenance. PHM - track damage growth, predict time to failure, and manage subsequent maintenance and operations in such a way to optimize overall system utility against cost. The benefits of CM/PHM are: (1) operate power conversion systems in ways that will preclude predicted failures; (2) reduce unscheduled downtime and thereby reduce costs; and (3) pioneering reliability in SiC and GaN.

25 ENERGY STORAGE↗

PROCESS MONITORING FOR SAFEGUARDS VIA EVENT GENERATION, INTEGRATION, AND INTERPRETATION

There is a recognized safeguards benefit from using process monitoring (PM) on nuclear facilities to complement nuclear materials accountancy. We introduce a model-based approach for PM in which the assessment regarding the state of the monitored system is conducted at a system-centric level. The proposed architecture integrates both time-driven and event-driven data integration and analysis for decision-making. While the time-driven layers of the proposed architecture encompass more traditional PM methods based on time series data and analysis, the event-driven layers encompass operation monitoring methods based on discrete event data integration and analysis. By integrating process- and operation-related information and methodologies within an unified modeling and monitoring framework that includes not only current but also past plant behaviors, the task of anomaly detection is greatly improved because this decision-making approach can benefit from not only known time-series relationships among measured signals but also from known event sequence relationships among generated events. Building from the proposed system-centric PM architecture, we briefly introduce methods that can be used to implement its different components. The application of the proposed approach is then demonstrated via simulation experiments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Diverse Power Iteration Embeddings and Its Applications

Abstract—Spectral Embedding is one of the most effective dimension reduction algorithms in data mining. However, its computation complexity has to be mitigated in order to apply it for real-world large scale data analysis. Many researches have been focusing on developing approximate spectral embeddings which are more efficient, but meanwhile far less effective. This paper proposes Diverse Power Iteration Embeddings (DPIE), which not only retains the similar efficiency of power iteration methods but also produces a series of diverse and more effective embedding vectors. We test this novel method by applying it to various data mining applications (e.g. clustering, anomaly detection and feature selection) and evaluating their performance improvements. The experimental results show our proposed DPIE is more effective than popular spectral approximation methods, and obtains the similar quality of classic spectral embedding derived from eigen-decompositions. Moreover it is extremely fast on big data applications. For example in terms of clustering result, DPIE achieves as good as 95% of classic spectral clustering on the complex datasets but 4000+ times faster in limited memory environment.

97 MATHEMATICS AND COMPUTING↗

FN-DFE: Fuzzy-Neural Data Fusion Engine for Enhanced State-Awareness of Resilient Hybrid Energy System

Resiliency and improved state-awareness of modern critical infrastructures, such as energy production and industrial systems, is becoming increasingly important. As control systems become increasingly complex, the number of inputs and outputs increase. Therefore, in order to maintain sufficient levels of state-awareness, a robust system state monitoring must be implemented that correctly identifies system behavior even when one or more sensors are faulty. Furthermore, as intelligent cyber adversaries become more capable, incorrect values may be fed to the operators. To address these needs, this paper proposes a Fuzzy-Neural Data Fusion Engine (FN-DFE) for resilient state-awareness of control systems. The designed FN-DFE is composed of a three-layered system consisting of: 1) traditional threshold based alarms, 2) anomalous behavior detector using self-organizing fuzzy logic system, and 3) artificial neural network based system modeling and prediction. The improved control system state-awareness is achieved via fusing input data from multiple sources and combining them into robust anomaly indicators. In addition, the neural network based signal predictions are used to augment the resiliency of the system and provide coherent state-awareness despite temporary unavailability of sensory data. The proposed system was integrated and tested with a model of the Idaho National Laboratory’s (INL) hybrid energy system facility know as HYTEST. Experimental results demonstrate that the proposed FN-DFE provides timely plant performance monitoring and anomaly detection capabilities. It was shown that the system is capable of identifying intrusive behavior significantly earlier than conventional threshold based alarm systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Automated Analysis of Renewable Energy Datasets ('EE/RE Data Mining')

This poster illustrates methods to substantially improve the understanding of renewable energy data sets and the depth and efficiency of their analysis through the application of statistical learning methods ('data mining') in the intelligent processing of these often large and messy information sources. The six examples apply methods for anomaly detection, data cleansing, and pattern mining to time-series data (measurements from metering points in buildings) and spatiotemporal data (renewable energy resource datasets).

97 MATHEMATICS AND COMPUTING↗

Situ

Rapidly discovering novel and sophisticated cyber attacks and providing situation aware-ness to analysts are unsolved problems in cyber security. We have developed a platform that scores events in real-time based on probabilistic models to define how typical an event is. This anomaly detection approach is based on unsupervised, probabilistic modeling of data at multiple scales. Scoring events based on multiple scales allows the system to 1) score anomalousness at different levels to detect important events that would otherwise be hidden, and 2) explain to users why an event is anomalous, not just that it is. The system was designed to address several challenges: 1) scaling to very high volume, heterogeneous, streaming data, and 2) minimizing the time from observation to discovery to understanding. The prototype has the real-time framework for pushing scored events to a web-based visualization.

Source record↗

A Visual Atlas on Strategic Trade

Strategic trade concerns global trade flows of items with strategic military value. Items include goods with exclusive military use, but also dual-use items that can have both military and civil uses. Many countries require licenses for trade in strategic items as a measure of non-proliferation. For example, items listed for trade control by multilateral export control arrangements, such as the Nuclear Suppliers Group (NSG), typically are considered strategic goods. Analysts and officials involved in strategic trade control often lack quantitative global understanding of relevant trade patterns that would help them focus control and enforcement efforts, select companies for outreach and audit, target transactions for verification and inspection, and assess the potential economic impact of trade control policies. Many are unaware of available open source data on international trade that can inform these issues. Many do not know how to make use of such data or lack the tools necessary to do so. A book of charts dubbed a ‘Strategic Trade Atlas’ was developed to illustrate global trade flows of strategic goods and raise awareness of the availability and utility of open source trade data. The Atlas was prepared for the World Customs Organization (WCO) and its Member States to support their planning and execution of Strategic Trade Control Enforcement (STCE) operations. It offers macroscopic graphical representations of global trade flows classified under Harmonized System (HS) codes associated by the WCO with commodities described in its STCE Implementation Guide. While these HS codes are understood to also encompass many non-strategic items, they nevertheless provide a good overview of potentially strategic trade flows. These include HS codes covering nuclear and nuclear-related commodities listed by the NSG, such as uranium, heavy water, graphite, carbon fiber, nickel powder, beryllium, aluminum tubes, vacuum pumps, valves, machine tools, cameras, and many others. The Atlas uses trade data from the Base pour l’Analyse du Commerce International (BACI), a statistical elaboration of public UN Comtrade data. BACI data reconciles trade flows, taking into account asymmetries in import and export trade valuation. The data visualization approach facilitates rapid sense making, pattern recognition, and anomaly detection. Country-based profiles summarize vast amounts of data into readily understandable graphical representations of each country’s primary strategic imports and exports and their main trading partners. Commodity-based profiles provide a global view of major exporters, importers, and trade patterns for each commodity. These insights can inform the risk management approach employed by customs to allocate enforcement and compliance efforts.

customs controls↗

Machine Learning Approaches for Nuclear Material Accounting Data from Irradiation and Reprocessing

We are currently exploring data analysis methods for their ability to strengthen the synthesis and evaluation of information generated within domestic and international safeguard regimes. Safeguard data typically includes rich heterogenous datasets amenable to advanced data analytics methods, such as machine learning. We have converted transactional data containing both numerical and categorical attributes from a domestic nuclear material control and accountability (NMC&A) system into a low-dimensional numerical structure via linear principal component analysis. This data representation allows for global structure discovery via cluster analysis, which can characterize the typical behavior of each of the primary types of transaction events. Furthermore, the structure of the top principal components captures the “typical behavior” of the data and is thus amenable to anomaly detection through statistical hypothesis testing. We explored this capability by generating erroneous permutations of the data and computing the Q-residual quantity increase associated with the information loss when these data are projected into the low-dimensional principal component analysis space representative of typical transactions.Future work will focus on identifying data transformations (e.g., graph networks) that more closely align with the inherent structure of these transactions to explain more salient information and disambiguate the underlying nuclear process—in this case, irradiation and reprocessing—from artifacts of NMC&A system transactional record keeping data.

Drescher, Adam↗

Constraining Kick Signals Through Advanced Multi-Phase Data

<ul><li>Re-designed ambient experimental apparatus constructed and operational</li><li>Finalized design of elevated experiments w/ LSU</li><li>Shakedown reveals that current sensors do not respond to changes in gas content</li><li>Designing surrogate sensor(s) w/ LSU</li><li>Implemented a sequence anomaly detection algorithm to identify kicks</li></ul>

Carney, Janine↗

Using Machine Learning to Track Objects Across Cameras

Video surveillance is one of the most important technologies used by the International Atomic Energy Agency in international safeguards. At large, complicated facilities, multiple surveillance cameras are deployed to monitor the transfer of safeguards-relevant objects across the site. During inspections, all surveillance videos are reviewed to ensure the objects are not manipulated or diverted during transfer, a laborious, time-consuming task. This work describes using deep machine learning algorithms to track objects automatically across multiple cameras, greatly improving the efficiency of the review process. The fundamental problem in this object tracking task across multiple cameras is how to associate the same object, which may show extreme intra-class variations, such as viewpoints, occlusions, and various scales, in different and even non-overlapped cameras. Object re-identification (Re-ID) in nuclear facility video surveillance is even more challenging than classic person or vehicle Re-ID problems because different instances in the same category may display an identical appearance. One observation from nuclear facility surveillance videos is that all objects must be carted (e.g., via forklift) to move. Therefore, the spatial context information of an object, which provides the feature from the carrier, is critical for the object Re-ID task. This work proposes a two-stream convolutional neural networks model that takes features of objects and their surrounding regions into account. Moreover, the custom videos usually are gleaned from different scenes from the training data, which may have extreme variations in illumination changes and/or cluttered backgrounds. Directly applying the trained model to custom videos will dramatically decrease the performance. To tackle this problem, an advanced domain adaptation technique is proposed to mitigate the gap between the data taken from different scenes. The proposed framework will track objects of interest across a nuclear complex. The resulting tracks can be used in further analyses, such as event/activity recognition, anomaly detection, etc.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Accurate surface estimation from high-resolution 3D microwave images

Active millimeter and microwave imaging techniques can be used to create a high-resolution 3D image volume of a target’s reflectivity. Millimeter-wave imaging is commonly used for personnel security screening and numerous other applications. Backprojection based image reconstruction techniques form a 3D complex-valued volume. The complex-valued volume is commonly reduced to a real-valued volume by taking the magnitude. For anomaly detection and cross image registration of an object it is beneficial to generate an accurate representation of an object’s surface. Extracting a smooth and accurate surface from a magnitude only image is challenging. One difficulty is the magnitude image has limited resolution in the depth direction which normally limits precision to a moderate fraction of the depth resolution. Another difficulty is that the magnitude of the image depends heavily on the geometry and orientation of the object being imaged. The phase information in a complex-valued image volume provides a means to decouple the magnitude of the image from the geometry of an object and provide precision much finer than the depth resolution would indicate. This enables the generation of a smooth and accurate point cloud representation of the surface of an imaged object. A method to extract a point cloud from the phase information in a 3D complex-valued millimeter-wave image volume is developed and results with simulated and experimental data are presented.

Clark, Richard T.↗

BOOSTR: A Dataset for Accelerator Control Systems

The Booster Operation Optimization Sequential Time-series for Regression (BOOSTR) dataset was created to provide a cycle-by-cycle time series of readings and settings from instruments and controllable devices of the Booster, Fermilab's Rapid-Cycling Synchrotron (RCS) operating at 15~Hz. BOOSTR provides a time series from 55 device readings and settings that pertain most directly to the high-precision regulation of the Booster's gradient magnet power supply (GMPS). To our knowledge, this is one of the first well-documented datasets of accelerator device parameters made publicly available. We are releasing it in the hopes that it can be used to demonstrate aspects of artificial intelligence for advanced control systems, such as reinforcement learning and autonomous anomaly detection.

43 PARTICLE ACCELERATORS↗

Machine Learning for Improved Availability of the SNS Klystron High Voltage Converter Modulators

Beam availability has increased at the SNS, however, the targeted availability is greater than 95 %, while the SNS has failed to meet lower targets in the past. The HVCM used to power the linac klystrons have been one source of lost beam time and was chosen to explore using AI/ML techniques to improve reliability. Among the possibilities being explored are automating the tuning of HVCMs and predicting component failures such as capacitor aging, rectifier assemblies containing hundreds of diodes, and insulating oil degradation. The methodology pursued includes data cleaning, de-noising, post-analysis data labeling, and machine learning model development. We explore using Long Short-Term Memory and autoencoders for anomaly detection and prognostication used to schedule maintenance. We evaluate the use of model regularizers and constraints to improve the performance of the model and investigate methods to estimate the uncertainty of the models to provide a robust prediction with statistical interoperability. This paper describes the operational experience and known failures of the HVCMs and the proposed ML methodology and the preliminary results of training the AI/ML algorithms.

Pappas, Chris↗

Development of an end state vision to implement digital monitoring in nuclear plants

Transitioning from an onsite Maintenance & Diagnostics Center to cloud-based services offers many new opportunities with computing power and storage, but also new challenges in terms of networking and security. This report will cover everything required for that transition including data processing and uploading to cloud services, feature selection, model creation, and result visualization for decision making. Although there are several other cloud-based services (e.g. Amazon Web Services and Google Cloud), this report explores Microsoft Azure to simplify nomenclature and maintain a consistent focus. Many of the services offered by Microsoft Azure are also available in the other cloud-based services, and their differences have been recorded in other literature. The Azure services most important to a nuclear power plant including networking & security, storage & databases, and Artificial Intelligence (AI) are reviewed here. Networking covers all aspects related to communication to Azure resources including security, privacy, and redundancy. Storage & databases includes data storage, upgrading, patching, backups, and monitoring. The AI services allows the user access to the machine learning (ML) techniques developed with Azure including automated ML, anomaly detection, computer vision, and natural language processing. This report summaries the features, capabilities, and challenges when using cloud-based services in a user-friendly manner.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗