Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Operator learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Production Facility Prototype Blower 1000 Hour Test Results II

Long duration tests of the Aerzen GM 12.4 roots style blower in a closed loop configuration provides valuable data and lessons learned for long-term operation at the Mo-99 production facility. The blower was operated in a closed loop configuration with the flow conditions anticipated in plant operation with a Mo-100 target inline. The additional thermal energy generated from beam heating of the Mo-100 disks were not included in these tests. Five 1000 hour tests have been completed since the first test was performed in January of 2016. All five 1000 hour tests have proven successful in exposing preventable issues related to oil and helium leaks. All blower tests to this date have resulted in stable blower performance and consistency. A summary of the results for each test, including a review of the first and second tests, are included in this report.

42 ENGINEERING↗
DOE OSTI2020

High operating temperature heat transfer fluids for solar thermal power generation. Final report

This is the final technical report for the DOE MURI project on developing high-operating temperature heat transfer fluids for solar thermal power generation. This project aimed to evaluate liquid metals as a heat-transport fluid and potential energy storage medium for concentrated solar powered (CSP) systems. The project consisted of five phases, starting with fluid selection and screen and ending with potential CSP integration. The initial fluid selection arrived at heavy liquid metals as candidate fluids such as lead bismuth eutectic (LBE) as the prime liquid-alloy candidate to be studied, given the conditions above. Fifty-seven liquid compositions were initially identified with liquidus temperatures lower than 200°C, composed of elements that provide no driving force to the reduction of Cr 2 O 3 or Al 2 O 3 passivation layers in pipe material which is required for corrosion prevention. LBE was identified as the primary candidate fluid after these compositions were compared against computational thermodynamic modeling to screen all of the selected systems that would be compatible with our design objectives. Twenty-eight of these compositions were also investigated with the rapid characterization methods; the accuracies of the liquidus temperature and the specific heats predicted by the computations were better than 3 percent and 9 percent, respectively. We conducted numerus corrosion tests of various Fe-Cr-Al based steels in LBE and its variants at temperate as high as 800°C. It was found that minor additions to the liquid did not provide sufficient corrosion protection to warrant their use in real applications. Furthermore, we investigated the detailed mechanism of corrosion between heavy liquid metal and the pipe material at these very high temperatures. A liquid metal loop was constructed to operate at these high temperatures. The loop construction and operation lead to valuable lessons learned that will be needed for industrial scale loops. Furthermore, we learned that electromagnetic pumps at these extreme temperatures will have to be reengineered and redesigned to be used for CSP applications.

14 SOLAR ENERGY↗
DOE OSTI2017

Holistic Approach to Data Center Energy Efficiency

This presentation discusses NREL's Energy System Integrations Facility and NREL's holistic design approach to sustainable data centers that led to the world's most energy-efficient data center. It describes Peregrine, a warm water liquid cooled supercomputer, waste heat reuse in the data center, demonstrated PUE and ERE, and lessons learned during four years of operation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2012

Reactor Design and Decommissioning - An Overview of International Activities in Post Fukushima Era1 - 12396

Accidents at the Fukushima Dai-ichi reactors as a result of the devastating earthquake and tsunami of March 11, 2011 have not only dampened the nuclear renaissance but have also initiated a re-examination of the design and safety features for the existing and planned nuclear reactors. Even though failures of some of the key site features at Fukushima can be attributed to events that in the past would have been considered as beyond the design basis, the industry as well as the regulatory authorities are analyzing what features, especially passive features, should be designed into the new reactor designs to minimize the potential for catastrophic failures. It is also recognized that since the design of the Fukushima BWR reactors which were commissioned in 1971, many advanced safety features are now a part of the newer reactor designs. As the recovery efforts at the Fukushima site are still underway, decisions with respect to the dismantlement and decommissioning of the damaged reactors and structures have not yet been finalized. As it was with Three Mile Island, it could take several decades for dismantlement, decommissioning and clean up, and the project poses especially tough challenges. Near-term assessments have been issued by several organizations, including the IAEA, the USNRC and others. Results of such investigations will lead to additional improvements in system and site design measures including strengthening of the anti-tsunami defenses, more defense-in-depth features in reactor design, and better response planning and preparation involving reactor sites. The question also arises what would the effect be on the decommissioning scene worldwide, and what would the effect be on the new reactors when they are eventually retired and dismantled. This paper provides an overview of the US and international activities related to recovery and decommissioning including the decommissioning features in the reactor design process and examines these from a new perspective in the post Fukushima -accident era. Accidents at the Fukushima Daiichi reactors in the aftermath of the devastating earthquake and tsunami of March 11, 2011 have slowed down the nuclear renaissance world-wide and may have accelerated decommissioning either because some countries have decided to halt or reduce nuclear, or because the new safety requirements may reduce life-time extensions. Even in countries such as the UK and France that favor nuclear energy production existing nuclear sites are more likely to be chosen as sites for future NPPs. Even as the site recovery efforts continue at Fukushima and any decommissioning decisions are farther into the future, the accidents have focused attention on the reactor designs in general and specifically on the Fukushima type BWRs. The regulatory authorities in many countries have initiated a re-examination of the design of the systems, structures and components and considerations of the capability of the station to cope with beyond-design basis events. Enhancements to SSCs and site features for the existing reactors and the reactors that will be built will also impact the decommissioning phase activities. The newer reactor designs of today not only have enhanced safety features but also take into consideration the features that will facilitate future decommissioning. Lessons learned from past management and operation of reactors as well as the lessons from decommissioning are incorporated into the new designs. However, in the post-Fukushima era, the emphasis on beyond-design-basis capability may lead to significant changes in SSCs, which eventually will also have impact on the decommissioning phase. Additionally, where some countries decide to phase out the nuclear power, many reactors may enter the decommissioning phase in the coming decade. While the formal updating and expanding of existing guidance documents for accident cleanup and decommissioning would benefit by waiting until the Fukushima project has progressed sufficiently for that experience to be reliably interpreted, the development of structured on-line sharing of information and especially the creation of an on-line compendium of methods, tools, and techniques by which damaged fuel and other unique situations have been addressed can be addressed sooner and maintained as new problems and solutions arise and are resolved. The IAEA's new 'WEB 2.0 tool' CONNECT is expected to play a significant role in this and related information-sharing activities. The trend in some countries such as the United States has been to re-license the existing reactors for additional twenty years, beyond the original design life. Given the advances in technology over the past four decades, and considering that the newer designs incorporate significant improvements in safety systems, it may not be economical or technically feasible to retrofit enhancements into some of the older reactors. In such cases, the reactors may be retired from service and decommissioned. Overall, the energy demand in the world continues to rise, with sharp increases in the Asian countries, and nuclear power's role in the world's energy supply is expected to continue. Events at Fukushima have led to a re-examination on many fronts, including reactor design and regulatory requirements. Further changes may occur in these areas in the post-Fukushima era. These changes in turn will also impact the world-wide decommissioning scene and the decommissioning phase of the future reactors. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Chapter Nine - Automated Optimal Control in Energy Systems: The Reinforcement Learning Approach

With the development of smart grid technologies an increasing number of new devices and participants have joined modern energy systems and are inevitably making them more complicated and interdependent than ever. Optimally controlling such a complex energy system and maintaining its operation in a high-efficient, secure, and resilient manner are challenging tasks to the system operators. Fortunately, the revolution in deep learning and artificial intelligence (AI), both from hardware and algorithms perspectives, has provided new ideas and solutions to many previously intractable problems. As a result, this advance in computer science also sparked great research interests in utilizing AI in solving engineering problems related to the modern energy systems. Among many AI techniques, deep reinforcement learning (DRL) has demonstrated great potential for solving sequential optimization problems, which are very common in the engineering domains. Its ability to handle nonlinearity and stochasticity in controlled systems has out-competed many traditional optimal control algorithms. Therefore in this chapter, we focus on the state-of-the-art of DRL concepts and related algorithms, compare their pros and cons with traditional optimal control approaches and discuss the typical workflow for leveraging RL in solving complex problems in modern energy systems.

artificial intelligence↗
DOE OSTI2025

Novel artificial neural network model for instantaneous power losses and operational efficiency mapping of MW-scale vanadium redox flow battery for improved technoeconomic analysis

A novel data-driven, machine-learning-based method for modeling the instantaneous power losses of a distribution-sited 2 MW/8MWh vanadium redox flow battery (VRFB), a grid-scale electrochemical storage technology, is introduced and compared against benchmark empirical modeling approaches, including symmetric and asymmetric models, as well as a recent convex hull modeling approach. The novel loss modeling method introduces several advantages over the benchmark models and over simplistic efficiency estimates, the most significant of which is that the model can accurately reflect the stepwise and non-linear parasitic losses associated with the duty cycles of mechanical auxiliary systems like pump motor drives and blower fans. Residuals of the models are compared; the proposed data driven model features significantly improved accuracy over the benchmark models. The model's coefficient of determination is also improved relative to that of the benchmark models. Furthermore, a novel method for visualization of operational efficiency of the grid-scale storage technology is introduced. To demonstrate the benefits of the novel data-driven method for modeling the VRFB, the benchmark models and the proposed models are embedded into an Open DSS distribution network model to study two applications of the grid-scale electrical storage system: load leveling for grid support and energy arbitrage. This article demonstrates that the accuracy of the instantaneous power loss model significantly impacts the understanding of the state of charge of the VRFB. In turn, the accuracy of the efficiency modeling of the VRFB impacts the understanding of the potential economic value and technical benefits to the distribution network operators. In conclusion, the presented power loss modeling approach is, therefore, highly relevant for utility-stakeholders, battery asset owners, system engineers, system designers, and financial planners interested in evaluating or optimizing the operation of grid-scale VRFBs.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Cross-domain digital twin architecture for predictive maintenance via machine learning and Large Language Models

This research introduces a comprehensive framework for creating and deploying a digital twin platform for continuous monitoring and predictive maintenance within industrial settings. Through utilizing advanced technologies, including Unreal Engine 5, Unity 3D, the Message Queue Telemetry Transport protocol, Random Forest machine learning algorithms, and Large Language Models (LLMs), we establish a platform that digitally reproduces physical equipment and translates digital controls into real-world actions. This facilitates preventive maintenance approaches and improves operational effectiveness. The digital twin platform gathers sensor data from operational equipment, analyzes it using machine learning, and delivers practical insights to prevent potential malfunctions and enhance equipment performance. Furthermore, the incorporation of a web portal enables efficient monitoring and access to historical data, educational materials, and equipment status information. Preliminary findings indicate that digital twins can transform industrial equipment management and maintenance methodologies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Real-time deep-learning inversion of seismic full waveform data for CO 2 saturation and uncertainty in geological carbon storage monitoring

Deep-learning inversion has recently drawn attention in geological carbon storage research due to its potential of imaging and monitoring carbon storage in real time, significantly improving efficiency and safety of carbon storage operations. We present a deep-learning full waveform inversion method that after the neural network has been trained can image CO 2 saturation and its uncertainty in real time. Our deep-learning inversion method is based on the U-Net architecture with the neural network trained on pairs of synthetic seismic data and CO 2 saturation models. Accordingly, our training establishes a mapping relationship between seismic data and CO 2 saturation models and once fully trained directly estimates CO 2 saturation as a function of subsurface location. We further quantify uncertainties of CO 2 saturation estimates using the Monte Carlo dropout method and a bootstrap aggregating method. For this proof-of-concept study, the CO 2 training models and data are derived from the Kimberlina 1.2 model, a hypothetical 3D geological carbon storage model that is constructed based on various geological and hydrological data from the Southern San Joaquin Basin, California. We perform deep-learning inversion experiments using noise-free and noisy training and test data sets and compare the results. Our modelling experiments show that (1) the deep-learning inversion can estimate 2D distributions of CO 2 fairly well even in the presence of Gaussian random noise and (2) both CO 2 saturation imaging and uncertainty quantification can be done in real time. Our results suggest that the deep-learning inversion method can serve as a robust real-time monitoring tool for geological carbon storage and/or other time-varying reservoir/aquifer properties that result from injection, extraction, and/or other subsurface transport phenomena.

58 GEOSCIENCES↗
DOE OSTI2025

Particle hit clustering and identification using point set transformers in liquid argon time projection chambers

Liquid argon time projection chambers are often used in neutrino physics and dark-matter searches because of their high spatial resolution. The images generated by these detectors are extremely sparse, as the energy values detected by most of the detector are equal to 0, meaning that despite their high resolution, most of the detector is unused in a particular interaction. Instead of representing all of the empty detections, the interaction is usually stored as a sparse matrix, a list of detection locations paired with their energy values. Traditional machine learning methods that have been applied to particle reconstruction such as convolutional neural networks (CNNs), however, cannot operate over data stored in this way and therefore must have the matrix fully instantiated as a dense matrix. Operating on dense matrices requires a lot of memory and computation time, in contrast to directly operating on the sparse matrix. We propose a machine learning model using a point set neural network that operates over a sparse matrix, greatly improving both processing speed and accuracy over methods that instantiate the dense matrix, as well as over other methods that operate over sparse matrices. Compared to competing state-of-the-art methods, our method improves classification performance by 14%, segmentation performance by more than 22%, while taking 80% less time and using 66% less memory. Compared to state-of-the-art CNN methods, our method improves classification performance by more than 86%, segmentation performance by more than 71%, while reducing runtime by 91% and reducing memory usage by 61%.

calibration and fitting methods↗
DOE OSTI2023

Towards operational atmospheric correction of airborne hyperspectral imaging spectroscopy: Algorithm evaluation, key parameter analysis, and machine learning emulators

Atmospheric correction of airborne hyperspectral imaging spectroscopy (AHIS) to obtain high-quality surface reflectance is the prerequisite for remote sensing applications. Over the last decades, different atmospheric correction methods have been developed based on radiative transfer models (RTMs), however, the relative performances of different algorithms are unclear. Automated operational atmospheric correction methods to process large-volume AHIS data in a high-accurate and high-throughput manner are still lacking. Therefore, this study proposed an operational atmospheric correction pipeline for deriving surface reflectance from AHIS data. To ensure the accuracy and efficiency of the pipeline, we focused on three specific aspects: (1) selecting a suitable RTM for the development of atmospheric lookup tables (LUTs) by comparing the commercial MODerate resolution atmospheric TRANsmission (MODTRAN) and open-sourced Library for Radiative TRANsfer (LibRadTRAN) models, where the widely-used software, Atmospheric/Topographic Correction for Airborne Imagery (ATCOR), was used as benchmarks; (2) identifying key atmospheric correction parameters and determining suitable sources for parameter retrievals including AHIS, Moderate Resolution Imaging Spectroradiometer (MODIS), and AErosol RObotic NETwork (AERONET); and (3) testing the performance of using machine learning emulators to speed up the RTM-based atmospheric correction. Results indicate that (1) atmospheric correction based on MODTRAN LUTs can produce surface reflectance accurately with mean absolute errors < 0.05 and cosine similarities > 0.98 compared to field measurements, which is comparable to the software ATCOR and slightly outperforms the LibRadTRAN LUTs; (2) sobol global sensitivity analysis demonstrates that in the atmospheric correction, visibility and water vapor are two key parameters that can be accurately derived from AHIS in contrast to MODIS or AERONET data; and (3) Random Forest emulators can produce accurate estimations of surface reflectance with mean absolute errors < 0.03 and cosine similarities > 0.98 for higher processing efficiency and determine a suitable set of wavelengths for retrieving atmospheric visibility and water vapor. In conclusion, the proposed atmospheric correction pipeline also improved the four-stream radiative transfer theory for airborne applications by considering adjacent effects from airborne surrounding pixels and can also be applied for atmospheric correction of hyperspectral data from spaceborne missions.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

HPC Analytics of Fused Thermal Plants Data to Optimize Operating Envelope

In this project, ORNL extensively reviewed the ORAP RAM data, and it guided us to develop machine learning models that can predict time to next failures and forecast failure trends, which will be useful for optimizing power plant operation strategies. More specifically, we trained multiple random forest models and evaluated the model accuracy to validate with 10+ years of historical data. In addition, we implemented a web-based graphical user interface system for the models to show how our models can be used in more intuitive ways. This proof of concept allowed exploration of model use with power plant operators in mind. Developed machine learning models will be helpful for managing risks, planning maintenance and operation, ultimately reducing the down time and increasing the service hours. For future work, there are several interesting research topics including but not limited to model enhancement, creating synergy with traditional failure modeling approaches, and data-driven actionable recommendation and suggestions.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2024

Toward a Machine Learning Approach to Interpreting X-ray Spectra of Trace Impurities by Converting XANES to EXAFS

The fact that the photoabsorption spectrum of a material contains information about the atomic structure, commonly understood in terms of multiple scattering theory, is the basis of the popular extended X-ray absorption spectroscopy (EXAFS) technique. How much of the same structural information is present in other complementary spectroscopic signals is not obvious. Here we use a machine learning approach to demonstrate that within theoretical models that accurately predict the EXAFS signal, the extended near-edge region does indeed contain the EXAFS-accessible structural information. We do this by exhibiting deep operator neural networks (DeepONets) that have learned the relationship between the extended and near edge portions of the X-ray absorption spectrum to predict the former from the latter. We find that we can accurately predict the EXAFS spectrum between 6 and 14 Å –1 from the first 6 Å –1 (≈100 eV) of the absorption spectrum of Cu 2 + substitutional defects in the Fe 3+ mineral hematite (α-Fe 2 O 3 ). This surprising finding implies that theoretical analyses of X-ray absorption spectra could be implemented that extract the same conclusions as high-quality EXAFS studies from spectra collected over a much smaller range of photon energies. This relaxes a host of experimental limitations related to the X-ray source and measurement sample, including collection time, minimum dopant concentration, source brilliance, and energy range. We describe the theoretical data sets and DeepONet construction and show that the resulting DeepONets produce EXAFS that recovers linear combination fits to experimental data with accuracy approaching the original ab initio calculations. We discuss the implications of our findings for minor constituent characterization and for understanding the information content of spectroscopic data more broadly, including how this approach might be applied to measured experimental spectra. In conclusion, to encourage similar efforts, the simulated X-ray spectra, machine learning, and fitting code are publicly available.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Decentralised Reinforcement Learning for Dynamic Cyberattack Response in Microgrid Networks

Microgrids rely on communication networks for reliable operation, which makes them inherently vulnerable to cyberattacks. Such attacks can destabilise system dynamics and drive states away from their nominal operating trajectories. Although several physics-informed and machine learning-based strategies have been developed to counter these threats, the rapidly evolving cyber landscape enables adversaries to bypass static defences or rules-based mitigation approaches. This paper proposes a dynamic, online-trained and fully decentralised reinforcement learning (RL)-based cyberattack response framework to protect microgrids from evolving cyberattacks. The proposed framework deploys multiple deep Q-networks (DQNs), each associated with a distributed energy resource (DER), to enable localised and adaptive attack mitigation. In this framework, each DQN processes local voltage and frequency measurements—combined with intrusion detection system (IDS) alerts—as observations and rewards to guide decision-making. Extensive simulation studies demonstrate the robustness of the proposed framework under diverse attack scenarios and varying IDS-induced detection delays. Comparative analysis highlights its superiority over existing static or preexisting rules-based mitigation approaches. Finally, we present an analysis that shows the framework's scalability to real-life microgrids with more interacting agents.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Machine Learning for Sustainable Energy Systems

In recent years, machine learning has proven to be a powerful tool for deriving insights from data. In this review, we describe ways in which machine learning has been leveraged to facilitate the development and operation of sustainable energy systems. We first provide a taxonomy of machine learning paradigms and techniques, along with a discussion of their strengths and limitations. We then provide an overview of existing research using machine learning for sustainable energy production, delivery, and storage. Finally, we identify gaps in this literature, propose future research directions, and discuss important considerations for deployment.

Environmental Sciences & Ecology↗
DOE OSTI2024

Holographic pseudoentanglement and the complexity of the AdS/CFT dictionary

The `quantum gravity in the lab' paradigm suggests that quantum computers might shed light on quantum gravity by simulating the CFT side of the AdS/CFT correspondence and mapping the results to the AdS side. This relies on the assumption that the duality map (the `dictionary') is efficient to compute. In this work, we show that the complexity of the AdS/CFT dictionary is surprisingly subtle: there might be cases in which one can efficiently apply operators to the CFT state (a task we call 'operator reconstruction') without being able to extract basic properties of the dual bulk state such as its geometry (which we call 'geometry reconstruction'). Geometry reconstruction corresponds to the setting where we want to extract properties of a completely unknown bulk dual from a simulated CFT boundary state. We demonstrate that geometry reconstruction may be generically hard due to the connection between geometry and entanglement in holography. In particular we construct ensembles of states whose entanglement approximately obey the Ryu-Takayanagi formula for arbitrary geometries, but which are nevertheless computationally indistinguishable. This suggests that even for states with the special entanglement structure of holographic CFT states, geometry reconstruction might be hard. This result should be compared with existing evidence that operator reconstruction is generically easy in AdS/CFT. A useful analogy for the difference between these two tasks is quantum fully homomorphic encryption (FHE): this encrypts quantum states in such a way that no efficient adversary can learn properties of the state, but operators can be applied efficiently to the encrypted state. We show that quantum FHE can separate the complexity of geometry reconstruction vs operator reconstruction, which raises the question whether FHE could be a useful lens through which to view AdS/CFT.

FOS: Physical sciences↗
DOE OSTI2019

Safeguards Lessons Learned from the Rokkasho Reprocessing Plant - 19502

Once operational, the Rokkasho Reprocessing Plant (RRP) will have an operating throughput of 800 MT of uranium in irradiated LWR fuel per year. In order to establish effective and efficient safeguards at RRP, the safeguards discussion with the IAEA was initiated in 1988. However, at that time there were no available models or guidelines that could be used as a reference and multiple difficulties were recognized for the implementation of safeguards into a large scale reprocessing plant. Therefore, from 1988 to 1992, a multinational forum, referred to as LASCAR (Large Scale Reprocessing Plant Safeguards) [1], provided the recommendations on how an effective safeguards approach could be implemented into a large scale reprocessing plant while efficiently using existing resources. During the course of safeguards discussions between the IAEA, the State, and JNFL, the use of operator's equipment and measurement systems (by signal splitting with authentication) for inspections was studied. JNFL also examined incorporating inspection requirements into the process design: to reduce the costs associated with system installation and future system maintenance and to ensure effective, efficient, and credible safeguards implementation into the RRP (this approach has essentially become the 'Safeguards by Design (SBD)' process). From these studies and JNFL's experience of implementing safeguards into a new plant [2], JNFL established and applied signal splitting from operator's equipment as a means for providing inspectors required safeguards information. In addition, the LASCAR findings were utilized to establish the safeguards implemented into the RRP. Safeguards implementation into RRP commenced March 31, 2006. On June 4, 2008, the IAEA approved the 'integrated safeguards approach' for RRP. This paper provides a high level overview of the major safeguards implemented at RRP and the lessons learned from this implementation that can be applied to existing or future similar facilities. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

An Analysis of Post Attack Impacts and Effects of Learning Parameters on Vulnerability Assessment of Power Grid

Due to the increasing number of heterogeneous devices connected to electric power grid, the attack surface increases the threat actors. Game theory and machine learning are being used to study the power system failures caused by external manipulation. Most of existing works in the literature focus on one-shot process of attacks and fail to show the dynamic evolution of the defense strategy. In this paper, we focus on an adversarial multistage sequential game between the adversaries of the smart electric power transmission and distribution system. We study the impact of exploration rate and convergence of the attack strategies (sequences of action that creates large scale blackout based on the system capacity) based on the reinforcement learning approach. We also illustrate how the learned attack actions disrupt the normal operation of the grid by creating transmission line outages, bus voltage violations, and generation loss. This simulation studies are conducted on IEEE 9 and 39 bus systems. The results show the improvement of the defense strategy through the learning process. The results also prove the feasibility of the learned attack actions by replicating the disturbances created in simulated power system.

attack impacts↗