Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bad data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Anomaly Detection in Power System State Estimation: Review and New Directions

Foundational and state-of-the-art anomaly-detection methods through power system state estimation are reviewed. Traditional components for bad data detection, such as chi-square testing, residual-based methods, and hypothesis testing, are discussed to explain the motivations for recent anomaly-detection methods given the increasing complexity of power grids, energy management systems, and cyber-threats. In particular, state estimation anomaly detection based on data-driven quickest-change detection and artificial intelligence are discussed, and directions for research are suggested with particular emphasis on considerations of the future smart grid.

42 ENGINEERING↗

Smart Grid Integrity Attacks: Characterizations and Countermeasures

Real power injections at loads and generators, and real power flows on selected lines in a transmission network are monitored, transmitted over a SCADA network to the system operator, and used in state estimation algorithms to make dispatch, re-balance and other energy management system [EMS] decisions. Coordinated cyber attacks of power meter readings can be arranged to be undetectable by any bad data detection algorithm. These unobservable attacks present a serious threat to grid operations. Of particular interest are sparse attacks that involve the compromise of a modest number of meter readings. An efficient algorithm to find all unobservable attacks [under standard DC load flow approximations] involving the compromise of exactly two power injection meters and an arbitrary number of power meters on lines is presented. This requires O(n2m) flops for a power system with n buses and m line meters. If all lines are metered, there exist canonical forms that characterize all 3, 4, and 5-sparse unobservable attacks. These can be quickly detected in power systems using standard graph algorithms. Known secure phase measurement units [PMUs] can be used as countermeasures against an arbitrary collection of cyber attacks. Finding the minimum number of necessary PMUs is NP-hard. It is shown that p + 1 PMUs at carefully chosen buses are sufficient to neutralize a collection of p cyber attacks.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Reliability concerns with logical constants in Xilinx FPGA designs

In Xilinx Field Programmable Gate Arrays logical constants, which ground unused inputs and provide constants for designs, are implemented in SEU-susceptible logic. In the past, these logical constants have been shown to cause the user circuit to output bad data and were not resetable through off-line rcconfiguration. In the more recent devices, logical constants are less problematic, though mitigation should still be considered for high reliability applications. In conclusion, we have presented a number of reliability concerns with logical constants in the Xilinx Virtex family. There are two main categories of logical constants: implicit and explicit logical constants. In all of the Virtex devices, the implicit logical constants are implemented using half latches, which in the most recent devices are several orders of magnitudes smaller than configuration bit cells. Explicit logical constants are implemented exclusively using constant LUTs in the Virtex-I and Virtex-II, and use a combination of constant LUTs and architectural posts to the ground plane in the Virtex-4. We have also presented mitigation methods and options for these devices. While SEUs in implicit and some types of explicit logical constants can cause data corrupt, the chance of failure from these components is now much smaller than it was in the Virtex-I device. Therefore, for many cases, mitigation might not be necessary, except under extremely high reliability situations.

97 MATHEMATICS AND COMPUTING↗

Using State Estimation Residuals to Detect Abnormal SCADA Data

Detection of manipulated supervisory control and data acquisition (SCADA) data is critically important for the safe and secure operation of modern power systems. In this paper, a methodology of detecting manipulated SCADA data based on state estimation residuals is presented. A framework of the proposed methodology is described. Instead of using original SCADA measurements as the bad data sources, the residuals calculated based on the results of the state estimator are used as the input for the outlier detection process. The BACON algorithm is applied to detect outliers in the state estimation residuals. The IEEE 118-bus system is used as a test case to evaluate the effectiveness of the proposed methodology. The accuracy of the BACON method is compared with that of the 3-σ method for the simulated SCADA measurements and residuals.

SCADA, BACON algorithm, state estimation, outlier ↗

Need for an (n,α) Apparatus at the LANSCE

There is an urgent need for a new (n,α) measurement capability at the Los Alamos Neutrons Science Center (LANSCE) for several reasons. First, it has been shown that (n,α) measurements on medium- to heavy-mass nuclides can provide some of the best constraints on some of the most important reaction rates for explosive nucleosynthesis studies. A few such measurements have been made, but many more are needed. Second, there are a few (n,p) and (n,α) cross sections on lighter nuclides of importance to nuclear astrophysics that remain unmeasured. Third, it has been shown that (n,α) measurements can constrain photon strength functions (PSFs) at very low energies. This is important because recent experiments, theory, and astrophysical calculations have demonstrated that enhanced PSFs at these energies can have large impacts on nucleosynthesis occurring in explosive environments. Also, enhanced low-energy PSFs could have significant impact on (n,γ) cross sections of interest to radiochemical diagnostics of nuclear devices. However, the shape of PSFs at low energies is a subject of considerable controversy, so new data are badly needed. Fourth, previous (n,α) data have revealed a number of puzzles and hints of exotic atomic-nuclear interactions. In addition to being interesting in their own light, these interactions could be important for understanding high-energy-density environments such as in nuclear explosion and at the National Ignition Facility. Simulations indicate that the high neutron flux at the Manuel Lujan Jr. Neutron Scattering Center (MLNSC) at the LANSCE will make many more of the needed measurements feasible. Hence, a new (n,α) instrument at the MLNSC would enable a wide range of important and interesting basic and applied science.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

An Evaluation of Cosmological Models from the Expansion and Growth of Structure Measurements

Here, we compare a large suite of theoretical cosmological models to observational data from the cosmic microwave background, baryon acoustic oscillation measurements of expansion, Type Ia supernova measurements of expansion, redshift space distortion measurements of the growth of structure, and the local Hubble constant. Our theoretical models include parametrizations of dark energy as well as physical models of dark energy and modified gravity. We determine the constraints on the model parameters, incorporating the redshift space distortion data directly in the analysis. To determine whether models can be ruled out, we evaluate the p-value (the probability under the model of obtaining data as bad or worse than the observed data). In our comparison, we find the well-known tension of H 0 with the other data; no model resolves this tension successfully. Among the models we consider, the large-scale growth of structure data does not affect the modified gravity models as a category particularly differently from dark energy models; it matters for some modified gravity models but not others, and the same is true for dark energy models. We compute predicted observables for each model under current observational constraints, and identify models for which future observational constraints will be particularly informative.

79 ASTRONOMY AND ASTROPHYSICS↗

Nuclear Data 101: The Good, The Bad, and The Ugly

This lecture is an attempt to cover in one hour the fundamentals of what nuclear data are, where they come from and how they affect nuclear science applications.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

3D Visualisation of Un-georeferenced, Coordinate-poor Spatial Data in Complex D and D and WM Environments - 18294

This paper describes the development of an algorithm-based utility tool using Visual Basic that examines un-georeferenced or GPS-deprived spatial datasets (3D datasets lacking one or more of the key x, y and z components). Taking into account any known geometrical parameters which are input via a user-friendly front-end, the new code automatically evaluates attributes, including any spatial coordinate components, detects invalid survey data points and fills in bad or missing data points utilising data-specific interpolation (e.g. cubic or linear spline) of valid data points, such that local extrema are not created. Previously troublesome 2D data can be easily converted to realistic 3D contour display, integrated with other time-series data to create 4D movies, and incorporated into other existing 3D datasets. More importantly those processed and 'more complete' data can be easily stored in 3D or 4D spatial database management systems for future interrogation by using clear, realistic and intuitive 3D visualisation. Test cases are presented to demonstrate the value and versatility of the newly developed utility tool which include the 3D visualisation of: surveyed wall thicknesses of a helical coil, radiation mapping of a plant and aerial survey mapping of radiation in a region near Fukushima. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The good, the bad, and the ugly: Data-driven load profile discord identification in a large building portfolio

Reducing the overall energy consumption and associated greenhouse gas emissions in the building sector is essential for meeting our future sustainability goals. Recently, smart energy metering facilities have been deployed to enable monitoring of energy consumption data with hourly or subhourly temporal resolution. This unprecedented data collection has created various opportunities for advanced data analytics involving load profiles (e.g., building energy benchmarking programs, building-to-grid integration, and calibration of urban-scale energy models). These applications often need preprocessing steps to detect daily load profile discords, such as: 1) outliers due to system malfunctions (the bad) and 2) irregular energy consumption patterns, such as those resulting from holidays (the ugly) compared to normal consumption patterns (the good). However, current preprocessing methods predominantly focus on filtering using statistical threshold values, which fail to capture the contextual discords of daily profiles. In addition, discord detection algorithms in building research are often aimed at finding individual building-level discords, which are not suitable at a large scale. Thus, here, we develop a method for automated load profile discord identification (ALDI) in a large portfolio of buildings (more than 100 buildings). Specifically, ALDI 1) uses the matrix profile (MP) method to quantify the similarities of daily subsequences in time series meter data, 2) compares daily MP values with typical-day MP distributions using the Kolmogorov-Smirnov test, and 3) identifies daily load profile discords in a large building portfolio. We evaluate ALDI using the metering data of both an academic campus and a residential neighborhood. Our results demonstrate that ALDI efficiently discovers measurement errors by system malfunctions and low energy consumption days in the academic campus portfolio, and it detects unique load shape patterns likely driven by occupant behavior and extreme weather conditions in the residential neighborhood.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Real-Time Distribution Feeder Performance Monitoring, Advisory Control, and Health Management System

New data collection system equipment was installed in Xcel Energy substations and data was collected from 6 substations and 20 feeders. During Phase I, ABB collected and analyzed 793 real-time events to date from 6 Xcel Energy substations and continues today. The development and integration of several applications was completed during the course of this project, including a model-based faulted segment identification algorithm, with very positive results validated with field-gathered data discussed and included in this report. For mostly underground feeders, the success rate is 90% and the overreach rate is 90%. For mostly overhead feeders, the success rate is 74% and the overreach rate is 50%. The developed method is producing very accurate results for mostly underground feeders. For mostly overhead feeders, due to the bad OMS data quality and varying fault resistance when arcing, the developed method is producing good results but with much room for improvement. One area where the algorithm can be improved is the accuracy for sub-cycle fault events. In these cases, the accuracy of the conventional signal processing methods suffers due to most of these methods being based on a one-cycle processing window. By improving the signal processing accuracy, the accuracy of the faulted segment identification algorithm will also improve significantly. ABB intends to devote research in this area in the near future to help solve this problem.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Prompt and Delayed Inelastic Scattering Reactions from Fission Neutron PGAA - First Results of FaNGaS

The new instrument Fast Neutron Gamma Spectroscopy (FaNGaS) has been installed at the SR10 beam line of the FRM II Research Reactor in Garching and tested successfully. Complimentary to cold neutron PGAA, with FaNGaS inelastic scattering reactions induced by fission neutrons can be studied. Gamma lines from (n,n'γ) reactions up to now have been rarely studied and no adequate compilation of the emitted gamma energies exist. In developing nondestructive analytical techniques using neutron generator based PGAA such data are badly needed for quantification of heavy metals and actinides in e.g. nuclear waste or safeguards samples. A number of elements and relevant actinides have been irradiated in the fast neutron beam SR10 at the FRM II reactor in Garching, Germany. A heavily shielded 50% eff. HPGe detector perpendicular to the beam is looking at the samples exposed to 2.3 E8 cm{sup -2}s{sup -1} fission neutrons. Prompt gamma spectra have been taken and evaluated using the available data in scattered sources. Additional gamma lines have been detected and are being compiled to create a data base for (n,n') reactions. Particular emphasis is given on actinides including {sup 238}U, {sup 232}Th, {sup 237}Np, {sup 242}Pu and {sup 241}Am. Some examples will be given and first results will be discussed in this contribution. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A Game-Theoretic Data-Driven Approach for Pseudo-Measurement Generation in Distribution System State Estimation

In this paper, we present an efficient computational framework with the purpose of generating weighted pseudo-measurements to improve the quality of distribution system state estimation (DSSE) and provide observability with advanced metering infrastructure (AMI) against unobservable customers and missing data. The proposed technique is based on a game-theoretic expansion of relevance vector machines (RVMs). This platform is able to estimate the nodal power consumption and quantify its uncertainty while reducing the prohibitive computational burden of model training for large AMI datasets. To achieve this objective, the large training set is decomposed and distributed among multiple parallel learning entities. The resulting estimations from the parallel RVMs are then combined using a game-theoretic model based on the idea of repeated games with vector payoff. It is observed that through this approach and by exploiting the seasonal changes in customers’ behavior the accuracy of pseudo-measurements can be considerably improved, while introducing robustness against bad training data samples. The proposed pseudo-measurement generation model is integrated into a DSSE using a closed-loop information system, which takes advantage of a branch current state estimator (BCSE) to further improve the performance of the designed machine learning framework. This method has been tested on a practical distribution feeder model with smart meter data for verification.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Multi-area parameter error identification for large power systems

Power grid model parameters may contain errors due to various reasons. Detecting and correcting parameter errors typically requires significant computational effort due to the size and complexity of the parameter database. While the normalized Lagrange multiplier (NLM) method can effectively detect, identify and correct parameter errors, its computational burden could rapidly grow with increasing system size. This paper addresses this issue by proposing a multi-area parameter error identification method. Each area has its own outlier detection tool for detecting the incorrect parameters and measurements within the area. On the other hand, due to the reduced redundancy at area boundaries, parameter errors on branches incident to boundary buses may not be detected. Such errors are subsequently detected by a coordination level estimator completing the system-wide parameter detection procedure. In conclusion, performance of the developed method is demonstrated using the IEEE 118-bus and 2000-bus Texas synthetic systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Power System Dynamic State Estimation: Motivations, Definitions, Methodologies and Future Work

This paper summarizes the technical activities of the Task Force on Power System Dynamic State and Parameter Estimation. This Task Force was established by the IEEE Working Group on State Estimation Algorithms to investigate the added benefits of dynamic state and parameter estimation for the enhancement of the reliability, security, and resilience of electric power systems. The motivations and engineering values of dynamic state estimation (DSE) are discussed in detail. Then, a set of potential applications that will rely on DSE is presented and discussed. Furthermore, a unified framework is proposed to clarify the important concepts related to DSE, forecasting-aided state estimation, tracking state estimation and static state estimation. An overview of the current progress in DSE and dynamic parameter estimation is provided. The paper also provides future research needs and directions for the power engineering community.

task force, dynamic state estimation, Parameter Es↗

A robust dynamic state estimation approach against model errors caused by load changes

Dynamic state estimation (DSE) plays an important role in power system security monitoring and online control. In practice, there are two approaches to implementing DSE. The first approach is distributed DSE, which is based on the assumption that the terminal bus of each generator can be measured by PMUs (phasor measurement units). The assumption cannot be satisfied currently, however, because PMUs usually are installed at important high-voltage buses such as 500-kV buses installed in portions of the grid overseen by the Western Electricity Coordinating Council. Another issue of this approach is that performance of DSE is vulnerable to bad measurement data. The reason for this vulnerability is that DSE is performed separately through measurements at each terminal bus, and measurements at terminal buses are the only measurement upon which DSE can rely. Therefore, important redundant measurements are not included in this approach. The second approach is centralized DSE. This approach does not have the requirement for PMU location, and redundant measurements can be considered fully. However, load changes and grid topology changes impact centralized DSE. In this paper, we propose a new approach for handling the impact of load changes on DSE. We have developed a new algorithm that includes two sequential steps. In the first step, errors caused by load changes are detected by analyzing the difference between prediction results and measured results. In the second step, once model error is detected, a model optimization procedure is run to correct the error so the state estimation error can be mitigated. Simulation results from the IEEE 68 bus system show that the proposed approach can effectively handle model errors caused by load changes.

robust dynamic state estimation, load change, powe↗

Robust Distributed State Estimator for Interconnected Transmission and Distribution Networks (Final Report RPPR-1)

This project’s objective is to develop a combined transmission and distribution state estimator which accounts for very large system size and model complexity (by way of distributing the computations) and large number of solar PV units connected to the distribution system on multiple feeders. The project not only provides a robust formulation and solution to this problem but also tests the solution by implementing it on a well-established large utility system. It introduces several improvements with respect to the state of the art in existing state estimation software: (a) The developed state estimator (SE) allows robust and accurate monitoring of bidirectional flows in distribution systems which result due to the distributed energy sources which are not observable and thus not incorporated in generation dispatch; (b) Large utility systems with tens of thousands of transmission buses and hundreds of thousands of distribution nodes are difficult to model as a single integrated system. This shortcoming is addressed by developing a “scalable distributed computational framework” which allows splitting the ultra large system models into several small subsystems and coordinating their solution by a robust and practical state estimation formulation; (c) Measurement errors irrespective of their locations are detected and removed by the developed state estimator. Historically, transmission and distribution systems were analyzed and operated as two independent systems. Given the non-transposed short feeder sections, unevenly loaded phases, strictly radial configuration and unidirectional power flows in the absence of remote generation, distribution system analysis was customized to account for these characteristics. However, some of these assumptions are no longer valid (non-radial configuration, bidirectional power flows) and thus distribution system analysis should be revisited. Furthermore, in the past, the interaction between the transmission and distribution systems was quite passive, where distribution substations were modeled as lumped loads in the transmission system model. With substantial generation injected by renewable generation located in the distribution systems, such modeling will no longer be accurate. The developed state estimator facilitates proper monitoring of the interactions between the transmission and distribution systems and enables smart dispatch of these units which are made observable by the state estimator.

24 POWER TRANSMISSION AND DISTRIBUTION↗