Results for “Operator learning” — Page 49

DOE OSTI2023

Hierarchical Flexibility Offering Strategy for Integrated Hybrid Resources in Real-time Energy Markets

This paper proposes a hierarchical model for determining the energy flexibility offering strategy of integrated hybrid resources (IHRs) in power distribution systems to participate in real-time energy markets. The proposed model utilizes the scalability, fast response time, and uncertainty observation of deep reinforcement learning (DRL) to overcome the scalability issue of operating numerous flexible resources and deliverability of energy flexibility to the real-time markets in the presence of the network constraints. To that end, the power distribution system is divided into multiple IHRs, where different types of flexible loads, energy storage systems, and solar plants with controllable inverters are operated through local IHR controllers, trained by deep deterministic policy gradient (DDPG) algorithm. Active power request and reactive power capacity of IHRs are then transmitted to a central flexibility controller, where a quadratic optimization model ensures the deliverability of the energy flexibility to the real-time energy market by satisfying the distribution network constraints. The proposed model is implemented on the 123-bus test power distribution system, demonstrating the capability of DRL-based hierarchical model for scalable operation of IHRs in order to offer deliverable energy flexibility to the real-time energy market.

Majidi, Majid↗

DOE OSTI2020

Moving the Mission Forward with Renewable Energy

Presentation gives an overview of proven examples of renewable energy technologies. Learn how to properly utilize renewable energy technologies; research, select, fund, and deploy renewable technologies; best operate and maintain the federal government’s fleet of on-site solar photovoltaic (PV) systems; and learn best practices to detect and address performance issues with a PV system.

distributed energy↗

DOE OSTI2022

A Scalable Method for Decarbonizing Modular Building Solutions: Preprint

The decarbonization movement emphasizes the shift in focus from energy efficiency to directly reducing global-warming impact. Blokable, LLC, a vertically integrated modular builder with an all-electric portfolio, worked with NREL on a roadmap to decarbonize its high-performance building product at a relative cost advantage by utilizing the learning curves of mass production. Previous decarbonization literature focused on either i) lifecycle assessments, or ii) efficiency measures. These decarbonization exercises were bespoke to individual building projects and did not consider positive feedback loops of builder experience or process repetition. Vertically integrated, prefab builders possess the unique ability to leverage learning and repetition to decarbonize their design-build-operate process. This collaboration between Blokable and NREL resulted in a decarbonization strategy utilizing the company's scaling and production efficiencies, on-site renewable energy and storage, and the projected evolution of building components over time based on trends and emerging legislation. The method developed here encompasses a growing business model, lifecycle carbon assessment, and projected changes in product and grid emissions over time due to existing trends and emerging legislation. This methodology incorporates learning-curve efficiencies gleaned from scaled manufacturing, as well as open-source tools integration for energy and carbon accounting. The output projects and compares cost and carbon savings per modular unit as production increases to 10,000 dwelling units annually over 15 years. The resulting roadmap illustrates a path to roughly 60% carbon savings and beyond-net-zero-energy performance at no incremental cost by 2030. The methodology can be mapped to other integrated or productized builders for methodical decarbonization.

affordable housing↗

DOE OSTI2022

A Scalable Method for Decarbonizing Modular Building Solutions

The decarbonization movement emphasizes the shift in focus from energy efficiency to directly reducing global-warming impact. Blokable, LLC, a vertically integrated modular builder with an all-electric portfolio, worked with NREL on a roadmap to decarbonize its high-performance building product at a relative cost advantage by utilizing the learning curves of mass production. Previous decarbonization literature focused on either i) lifecycle assessments, or ii) efficiency measures. These decarbonization exercises were bespoke to individual building projects and did not consider positive feedback loops of builder experience or process repetition. Vertically integrated, prefab builders possess the unique ability to leverage learning and repetition to decarbonize their design-build-operate process. This collaboration between Blokable and NREL resulted in a decarbonization strategy utilizing the company's scaling and production efficiencies, on-site renewable energy and storage, and the projected evolution of building components over time based on trends and emerging legislation. The method developed here encompasses a growing business model, lifecycle carbon assessment, and projected changes in product and grid emissions over time due to existing trends and emerging legislation. This methodology incorporates learning-curve efficiencies gleaned from scaled manufacturing, as well as open-source tools integration for energy and carbon accounting. The output projects and compares cost and carbon savings per modular unit as production increases to 10,000 dwelling units annually over 15 years. The resulting roadmap illustrates a path to roughly 60% carbon savings and beyond-net-zero-energy performance at no incremental cost by 2030. The methodology can be mapped to other integrated or productized builders for methodical decarbonization.

affordable housing↗

DOE OSTI2024

ION Work Reduction Opportunity Realization Demonstration

The purpose of this research was to realize one of the advanced training work reduction opportunities first presented in the Idaho National Laboratory (INL) report, “Process for Significant Nuclear Work Function Innovation Based on Integrated Operations Concepts” (INL/EXT-21-64134) [1], with a nuclear power plant (NPP) research partner. Researchers modernized two trainings: (1) an accredited instructor-led training (ILT) overview course on Westinghouse DS 480-volt (V) circuit breakers to a multimedia-focused computer-based-training (CBT) learning module, and (2) an on-demand chaptered video on how to properly rack and un-rack a Westinghouse DS 480-V circuit breaker. These modernized work products were developed and implemented in a manner consistent with the industry guidelines found in Institution of Nuclear Power Operations (INPO) Teaching and Learning 23-001 [2]. Researchers calculated that the modernized accredited training course reduced the time necessary to prepare and deliver the training material by a factor of 8:1. The amount of time learners spend in class could be reduced by this same factor. In other words, if a course took 8 hours to deliver a class, the new CBT instruction would take just over 1 hour. The researchers noted that the requirement for any practicum training by the learners with the instructor(s) would remain in place. But through interviews with new and experienced learners, the researchers discovered that the confidence of these learners in performing the racking and un-racking of the circuit breaker improved as a result of using the new modernized CBT process. Additionally, the learners who tested the modernized work products enjoyed the modernized CBT and the learning video significantly more than current in-class learning methods. These are encouraging results for the nuclear industry, as this modernization of training can be applied to other classes and is scalable across the industry. In line with the Integrated Operations for Nuclear (ION) model, positive workload analysis supports the investment of resources in modernizing NPP training processes and infrastructure. Implementation of the advanced training technologies in this report is likely to result in substantive long-term workload benefits to instructors and learners and result in hard-dollar savings on contractor spends. Additionally, investment in these modernized training processes will result in improved learner proficiency. The results of this research can be applied to additional operator, technical, and general training topics to provide additional workload and learning benefits in addition to what was explored.

42 ENGINEERING↗

DOE OSTI2020

Considerations for using Privacy Preserving Machine Learning Techniques for Safeguards

In international nuclear safeguards, the International Atomic Energy Agency (IAEA) is tasked with inspecting and verifying nuclear facilities and their activities. Data analytics and machine learning to support inspections require large amounts of data that nuclear facility operators may consider proprietary or sensitive, so the IAEA may not have full access. Allowing computation over private data without compromising its security therefore has value for safeguards inspections and analysis. Privacy-preserving machine learning (PPML) consists of security-focused techniques that allow data analytics and machine learning algorithms to run on sensitive data without revealing it. This includes ideas like homomorphic encryption (HE), secure multiparty computation (SMPC), and secure enclaves. HE allows algorithms and mathematical operations to be conducted directly on the encrypted data instead of first decrypting it. With SMPC, multiple entities collaboratively compute over distributed data such that no party is able to directly view any others’ original data. Secure enclaves allow computation to take place in a separate and heavily blocked-off section of a CPU. Techniques like these allow for several potential use cases in which the security of data is essential. With SMPC, machine learning models can be trained over the input data from multiple entities, resulting in a model that all users can benefit from without leaking the input data from any particular entity. With SMPC or a zero-knowledge proof (ZKP), an algorithm returning some single answer or truth value can be run on someone else’s data without ever needing to see that data, potentially allowing for verification or proof of some underlying question. HE can allow for outsourcing computation on data to a hostile or untrusted environment. Although most of the research in this field resides within the health and financial domains, tools from PPML may have similar applications in nuclear safeguards. Allowing the IAEA to compute over proprietary information, such as process models and raw sensor data using PPML techniques, provides the baseline for running complex analytics without needing direct unencrypted access to the underlying data, maintaining its privacy. Important limitations to consider for these techniques include the efficiency and level of security required. The security of HE and SMPC come at the cost of speed—the significant amount of overhead means that algorithms implemented in these protocols and encryption schemes are slower than when run on plaintext. Additionally, several important parameters determine what techniques or protocols are used based on the security requirements. SMPC protocols may need to be selected for resistance against a party that attempts to deviate from the protocol to distort the result or gain access to additional information, and a protocol secure against these attacks may further increase the overhead of the algorithm.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2012

A watt-class 1-THz backward-wave oscillator based on sine waveguide

A novel backward wave oscillator was proposed by utilizing a concise sine waveguide slow-wave structure combined with sheet electron beam to operate at terahertz frequency band. First, the design method was described, and the dispersion curve and interaction impedance of the sine waveguide were calculated, then the device oscillation frequency and operating voltage were determined. Next, the circuit transmission losses were learned over the tunable frequency range. Finally, the particle-in-cell simulation method was applied to predict its signal generation performance. The investigation results show that, the backward wave oscillator can produce over 1.9 -W peak power output at the central operating frequency of 1-THz under 27-kV operating voltage and 5-mA beam current. And the interaction efficiency at 1-THz is more than 1.4% with a circuit length of 7.2-mm. It, therefore, will be considered as a promising watt-class terahertz radiation source.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2016

Integrated Predictive Systems for Solar Energy with Modeling, Post Processing and Machine Learning

Explore the source record for details and available documents.

14 SOLAR ENERGY↗

DOE OSTI2020

Deep Reinforcement Learning for Residential HVAC Control with Consideration of Human Occupancy

The Artificial Intelligence (AI) development described herein uses model-free Deep Reinforcement Learning (DRL) to minimize energy cost during residential heating, ventilation, and air conditioning (HVAC) operation. Building cooling loads and HVAC operation are difficult to accurately model due to complexity, lack of measurements and data, and model specific performance, so online machine learning is used to allow for real-time readjustment in performance. Energy costs for the multi-zone cooling unit shown in this work are minimized by scheduling on/off commands around dynamic prices. By taking advantage of precooling events that take place when the price is low, the agent is able to reduce operational cost without violating user comfort. The DRL controller was tested in simulation where the learner achieved a 43.89% cost reduction when compared to traditional, fixed-setpoint operation. The system is now ready for the next phase of testing in a live, real-time home environment.

Mckee, Evan↗

DOE OSTI2022

Multivariate Time Series Anomaly Detection with Few Positive Samples

Given the scarcity of anomalies in real-world applications, the majority of literature has been focusing on modeling normality. The learned representations enable anomaly detection as the normality model is trained to capture certain key underlying data regularities under normal circumstances. In practical settings, particularly industrial time series anomaly detection, we often encounter situations where a large amount of normal operation data is available along with a small number of anomaly events collected over time. This practical situation calls for methodologies to leverage these small number of anomaly events to create a better anomaly detector. In this paper, we introduce two methodologies to address the needs of this practical situation and compared them with recently developed state of the art techniques. Our proposed methods anchor on representative learning of normal operation with autoregressive (AR) model along with loss components to encourage representations that separate normal versus few positive examples. We applied the proposed methods to two industrial anomaly detection datasets and demonstrated effective performance in comparison with approaches from literature. Our study also points out additional challenges with adopting such methods in practical applications.

Xue, Feng↗

DOE OSTI2021

Machine Intelligence to Detect, Characterise, and Defend against Influence Operations in the Information Environment

Social media has enabled a new era of manipulation in the information and cognitive domains. Deceptive content—misleading, falsified, and fabricated—is routinely created and spread in the modern social media environment with the intent to create confusion and widen political and social divides, and exploit the societal conflict exacerbated by these divides in the real-world (aka physical domain). Such disinformation campaigns demonstrate a threat to the integrity of economic, political, cultural, public health, and national security institutions around the world. In this work we overview our artificial intelligence (AI) capabilities to detect, describe, and defend against information operations on Twitter as an example social platform to understand the influence of misleading and falsified content diffusion and better enable those charged with defending against such manipulation to enable responsive parties to counter it. We first present novel linguistically-informed deep learning (DL) models for misinformation and disinformation detection, and present an in-depth linguistic analysis of psycho-linguistic markers across broad deception categories. We then demonstrate how our models perform in the multilingual and multimodal setting and categorize falsified and misleading content based on the intent to deceive. We also provide a large-scale analysis to describe user behavior and spread patterns while engaging with deceptive content and report novel findings about the immediate diffusion of deceptive content by characterizing the vulnerable sub-populations and their demographics, and explicitly measuring speed and scale of deception spread to uncover who shares deceptive content, how quickly, how much, and how evenly. In addition, we measure audience reactions to misinformation and disinformation at scale, distinguishing the reactions of users identified as bots versus humans. Finally, we take advantage of deep translation and generation models to create unique solutions for real-time defense against digital deception and discuss how to apply causal inference to prescribe and intervene into strategic communications jointly across information, cognitive, and physical domains.

artificial intelligence, deep learning, neural lan↗

DOE OSTI2026

Short-term electricity load forecasting: Application-driven evaluation of machine learning models across spatial and temporal scales

As we transition towards a decarbonized economy, the integration of variable renewable energy resources and new demands (e.g., electric vehicles, heat pumps) into the electricity grid places unprecedented pressure on grid operators to effectively anticipate and manage peak load. In this context, machine learning algorithms are proving to be indispensable for accurate short-term load forecasting, a crucial task to address these challenges. This study benchmarks 6 machine learning algorithms, including three neural networks and three tree-based algorithms, across various levels of spatial aggregation and time horizons (1, 4, 8, 24, and 48 h). The central contribution of this work is the comparison and analysis of load forecasting models not only based on statistical metrics, but also based on a novel error metric, which evaluates the cost implications of forecast errors for power system stakeholders. Results show that tree-based models outperform neural networks, based on statistical metrics, and yield less skewed error distributions for most spatial scales. However, through the lens of the novel error metric, neural networks are the more competitive choice, especially for forecast horizons that exceed 8 h. The study concludes with actionable recommendations to grid operators and highlights the need for the development of error metrics that link forecasting accuracy to operational costs. To promote transparency and open science, the datasets and Python code are open-sourced via a supplementary repository.

Houben, Nikolaus↗

DOE OSTI2016

Innovative Approach for Technetium-99 Disposal Reduces Operational Impacts - 16460

The Environmental Management Waste Management Facility (EMWMF) on the Oak Ridge Reservation began receiving and disposing waste with elevated technetium-99 (Tc-99) activities on November 11, 2013. Prior to receipt, the Tennessee Department of Environment and Conservation expressed concerns about potential releases of this highly mobile radionuclide into the environment and requested additional safeguards to minimize potential releases. Several additional requirements were negotiated to address these concerns and allow this waste lot to be safely disposed at EMWMF. Because of the 130-cm (51-inch) annual average precipitation at the landfill, the potential release of Tc-99 (above the release criterion) to surface water during the EMWMF water management activities was of the greatest concern. The EMWMF Operations staff developed an innovative approach to resolve regulator concerns regarding disposal of low-level waste containing elevated levels of Tc-99 at EMWMF. This approach minimized the spread of contamination and the generation of water that contacted the Tc-99 waste. Lessons learned and recommendations are being implemented for the next, more challenging elevated Tc-99 waste from the K-27 Building, currently scheduled for early 2016. These lessons learned are also applicable to other sites looking to minimize operational impacts from disposal of waste with elevated activities of Tc-99 or other highly mobile contaminants. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2023

Enhancing Cyber Resilience of Networked Microgrids using Vertical Federated Reinforcement Learning

This paper presents a novel federated reinforcement learning (Fed-RL) methodology to inject sufficient resiliency into the operations of the network of microgrids. We consider adversarial actions to the voltage and power control loop reference signals at the grid forming (GFM) inverters in the microgrids which are essential to integrate renewable resources. Therefore, we formulate a resilient reinforcement learning training setup that uses these adversarial injections to generate episodic trajectories and train the RL agents to alleviate their impact on performance. To circumvent the concerns about data-sharing and privacy for different owners of the microgrids in the networked setting, we bring in the aspects of the federated operation to propose novel Fed-RL algorithms. As the dynamics of each microgrid are coupled due to electrical interlinks, the conventional federated RL approaches using decoupled independent environments are not applicable, which leads us to propose a multi-agent vertically federated variation of actor-critic algorithms, namely federated soft actor-critic (FedSAC). We have performed numerical simulations on an IEEE 123-bus benchmark test feeder with three microgrids by creating a customized simulation setup by encapsulating the microgrid dynamic simulations in GridLAB-D/HELICS co-simulation platform with the OpenAI Gym environment and validated the proposed resilient and secured learning methodology.

Artificial Intelligence (AI), reinforcement learni↗

DOE OSTI2022

Deep Reinforcement Learning From Demonstrations to Assist Service Restoration in Islanded Microgrids

Microgrids can be operated in island mode during utility grid outages to support service restoration and improve system resilience. To schedule and dispatch distributed energy resources (DERs) in an islanded microgrid, conventional model-based methods rely on accurate distribution network models and lack generalization and adaptability. Data-driven methods are promising for DER coordination but face practical challenges such as potential hazards to microgrids during online training and insufficient online training opportunities due to low outage rates. This paper presents a novel two-stage learning framework that builds on the deep deterministic policy gradient from demonstrations to identify an optimal restoration strategy. At the pre-training stage, imitation learning is applied to equip the control agent with expert experiences to guarantee acceptable initial performance. At the online training stage, action clipping, reward shaping, and expert demonstrations are leveraged to ensure safe exploration while accelerating the training process. In conclusion, the proposed method is illustrated using the IEEE 123-node system and compared with a representative model-based method and the standard deep deterministic policy gradient method to prove solution accuracy and demonstrate increased computational efficiency.

Du, Yan↗

DOE OSTI2016

MO-A-BRB-00: TG191: Clinical Use of Luminescent Dosimeters

This presentation will highlight the upcoming TG-191 report: Clinical Use of Luminescent Dosimeters. Luminescent dosimetry based on TLD and OSLD is a practical, accurate, and precise technique for point dosimetry in medical physics applications. The charges of Task Group 191 were to detail the methodologies for practical and optimal luminescent dosimetry in a clinical setting. This includes (1) To review the variety of TLD/OSL materials available, including features and limitations of each. (2) To outline the optimal steps to achieve accurate and precise dosimetry with luminescent detectors and to evaluate the uncertainty induced when less rigorous procedures are used. (3) To develop consensus guidelines on the optimal use of luminescent dosimeters for clinical practice. (4) To develop guidelines for special medically relevant uses of TLDs/OSLs (e.g., mixed field i.e. photon/neutron dosimetry, particle beam dosimetry, skin dosimetry). While this report provides general guidelines for arbitrary TLD and OSLD processes, the report, and therefore this presentation, provide specific guidance for TLD-100 (LiF:Ti,Mg) and nanoDot (Al2O3:C) dosimeters because of their prevalence in clinical practice. Learning Objectives: Understand the available dosimetry systems, and basic theory of their operation Understand the range of dose determination methodologies and the uncertainties associated with them Become familiar with special considerations for TLD/OSLD relevant for special clinical situations Learn recommended commissioning and QA procedures for these dosimetry systems.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2016

MO-A-BRB-01: TG191: Clinical Use of Luminescent Dosimeters

This presentation will highlight the upcoming TG-191 report: Clinical Use of Luminescent Dosimeters. Luminescent dosimetry based on TLD and OSLD is a practical, accurate, and precise technique for point dosimetry in medical physics applications. The charges of Task Group 191 were to detail the methodologies for practical and optimal luminescent dosimetry in a clinical setting. This includes (1) To review the variety of TLD/OSL materials available, including features and limitations of each. (2) To outline the optimal steps to achieve accurate and precise dosimetry with luminescent detectors and to evaluate the uncertainty induced when less rigorous procedures are used. (3) To develop consensus guidelines on the optimal use of luminescent dosimeters for clinical practice. (4) To develop guidelines for special medically relevant uses of TLDs/OSLs (e.g., mixed field i.e. photon/neutron dosimetry, particle beam dosimetry, skin dosimetry). While this report provides general guidelines for arbitrary TLD and OSLD processes, the report, and therefore this presentation, provide specific guidance for TLD-100 (LiF:Ti,Mg) and nanoDot (Al2O3:C) dosimeters because of their prevalence in clinical practice. Learning Objectives: Understand the available dosimetry systems, and basic theory of their operation Understand the range of dose determination methodologies and the uncertainties associated with them Become familiar with special considerations for TLD/OSLD relevant for special clinical situations Learn recommended commissioning and QA procedures for these dosimetry systems.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2013

Best Practices Guide for High-Performance Indian Office Buildings

This document provides best practice guidance and energy- efficiency recommendations for the design, construction, and operation of high-performance office buildings in India. Through a discussion of learnings from exemplary projects and inputs from experts, it provides recommendations that can potentially help achieve (1) enhanced working environments, (2) economic construction/faster payback, (3) reduced operating costs, and (4) reduced greenhouse gas (GHG) emissions. It also provides ambitious (but achievable) energy performance benchmarks, both as adopted targets during building modeling (design phase) and during measurement and verification (operations phase). These benchmarks have been derived from a set of representative best-in-class office buildings in India. The best practices strategies presented in this guide would ideally help in delivering high-performance in terms of a triad—of energy efficiency, cost efficiency, and occupant comfort and well-being. These best practices strategies and metrics should be normalized—that is, corrected to account for building characteristics, diversity of operations, weather, and materials and construction methods.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗