Results for “Setpoints” — Page 8

DOE OSTI2023

Adaptive Data-Driven Model Predictive Control for Heat Pipe Microreactors

To establish a technical basis for self-regulating microreactors, a model predictive control (MPC) system is investigated to proactively respond to anomalies and disturbances in anticipation of potential deviations from operating setpoints. Due to the difficulty of developing a physics-based surrogate model that can accurately match plant data in various operating conditions, machine learning algorithms are used in MPC, which allow for learning from both simulation and operation data, thus efficiently describing the targeted transient with arbitrary accuracy. However, one of the biggest concerns in applying ML algorithms like artificial neural networks (ANNs) is that the predictive capabilities of ANN are limited by training data. If there are gaps between the training and target domain, the accuracy of an ANN can degrade significantly when it is used to predict unseen data. To improve the predictive capability of ANN and enable a confident use of data-driven MPCs outside the training data, this study proposes an adaptive data-driven MPC framework. The system will monitor the discrepancy between plant responses and surrogate predictions, fine-tune the ANN-based surrogate when a large discrepancy is detected, and continue MPC operation with updated surrogates. The framework is demonstrated on a point kinetic model for microreactors. The hyperparameters of the update strategy, including layers to update, error thresholds, learning rate discount, and number of data points used for fine-tuning, are optimized so the simulated microreactor is able to follow changes in setpoint with the smallest of deviations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

Validation of Interconnection and Interoperability of Grid-Forming Inverters Sourced by Hydrogen Technologies in View of 100% Renewable Microgrids

Grid-forming assets are required in microgrids to act as voltage-frequency masters. These grid-forming assets can operate in two modes of operation: grid-following mode and grid-forming mode. In grid-following mode of operation, these assets will follow real power and reactive power setpoints and in grid-forming mode of operation these assets will follow voltage and frequency setpoints. Traditionally, diesel generators or natural gas-based generators are widely used to act as a voltage-frequency master. However, many utilities are aiming to replace generators with grid forming-inverters supplied by solar photovoltaics (PV), batteries or fuel cells. Since grid-forming assets need a long-term reliable energy source, fuel cells are a reasonable and viable choice to supply the grid-forming inverters, but some of the challenges facing the wide deployment of grid-forming fuel cell inverters need to be addressed. Specifically, in our proposed work, we aim to focus on the interconnection and interoperability requirements of grid-forming fuel cell inverters. Currently, state-of-the-art fuel cell inverters follow the general interconnection requirements of distributed energy resources (DERs) and general interoperability requirements of DERs, but these requirements were built with PV and battery systems in mind. Fuel cells have different operational requirements, and therefore these requirements need to be appropriately modified for the grid operators to use. These additional steps add to the investment and operational cost to the grid operators. Through the ARIES platform, this proposed project aims to bridge this gap and use power hardware-in-the-loop (PHIL) and controller hardware-in-the-loop (CHIL) experiments to inform the creation of open-source interconnection and interoperability information that can aid in faster and cheaper installation and operation of grid-forming fuel cell inverters.

grid-forming↗

DOE OSTI2023

Adaptable Data Driven Model Predictive Control for Heat Pipe Microreactors

To establish a technical basis for self-regulating microreactors, a model predictive control (MPC) system is investigated to proactively respond to anomalies and disturbances in anticipation of potential deviations from operating setpoints. Due to the difficulty of developing a physics-based surrogate model that can accurately match plant data in various operating conditions, machine learning algorithms are used in MPC, which allow for learning from both simulation and operation data, thus efficiently describing the targeted transient with arbitrary accuracy. However, one of the biggest concerns in applying ML algorithms like artificial neural networks (ANNs) is that the predictive capabilities of ANN are limited by training data. If there are gaps between the training and target domain, the accuracy of an ANN can degrade significantly when it is used to predict unseen data. To improve the predictive capability of ANN and enable a confident use of data-driven MPCs outside the training data, this study proposes an adaptive data-driven MPC framework. The system will monitor the discrepancy between plant responses and surrogate predictions, fine-tune the ANN-based surrogate when a large discrepancy is detected, and continue MPC operation with updated surrogates. The framework is demonstrated on a point kinetic model for microreactors. The hyperparameters of the update strategy, including layers to update, error thresholds, learning rate discount, and number of data points used for fine-tuning, are optimized so the simulated microreactor is able to follow changes in setpoint with the smallest of deviations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

Control systems and methods to enable autonomous drilling

A system or method for drilling includes autonomously controlling a rotary or percussive drilling process as it transitions through multiple materials with very different dynamics. The method determines a drilling medium based on real-time measurements and comparison to prior drilling data, and identifies the material type, drilling region, and approximately optimal setpoint based on data from at least one operating condition. The controller uses these setpoints initially to execute an optimal search to maximize performance by minimizing mechanical specific energy. Near-bit depth-of-cut estimations are performed using a machine learning prediction deployed in an embedded processor to provide high-speed ROP estimates. The sensing capability is coupled with a near-bit clutching mechanism to support drilling dysfunction mitigation.

Buerger, Stephen↗

DOE OSTI2023

Development of A Hardware-In-the-Loop (HIL) Testbed for Cyber-Physical Security in Smart Buildings

As smart buildings move towards open communication technologies, providing access to the Building Automation System (BAS) through the building's intranet, or even remotely through the Internet, has become a common practice. However, BAS was historically developed as a closed environment and designed with limited cyber-security considerations. Thus, smart buildings are vulnerable to cyber-attacks with the increased accessibility. This study introduces the development and capability of a Hardware-in-the-Loop (HIT) testbed for testing and evaluating the cyber-physical security of typical BASs in smart buildings. The testbed consists of three subsystems: (1) a real-time HIL emulator simulating the behavior of a virtual building as well as the Heating, Ventilation, and Air Conditioning (HVAC) equipment via a dynamic simulation in Modelica; (2) a set of real HVAC controllers monitoring the virtual building operation and providing local control signals to control HVAC equipment in the HIL emulator; and (3) a BAS server along with a web-based service for users to fully access the schedule, setpoints, trends, alarms, and other control functions of the HVAC controllers remotely through the BACnet network. The server generates rule-based setpoints to local HVAC controllers. Based on these three subsystems, the HIL testbed supports attack/fault-free and attack/fault-injection experiments at various levels of the building system. The resulting test data can be used to inform the building community and support the cyber-physical security technology transfer to the building industry.

Li, Guowen↗

DOE OSTI2024

Validation of Interconnection and Interoperability of Grid-Forming Inverters Sourced by Hydrogen Technologies in View of 100% Renewable Microgrids

Grid-forming assets are required in microgrids to act as voltage-frequency masters. These grid-forming assets can operate in two modes of operation: grid-following mode and grid-forming mode. In grid-following mode of operation, these assets will follow real power and reactive power setpoints and in grid-forming mode of operation these assets will follow voltage and frequency setpoints. Traditionally, diesel generators or natural gas-based generators are widely used to act as a voltage-frequency master. However, many utilities are aiming to replace generators with grid forming-inverters supplied by solar photovoltaics (PV), batteries or fuel cells. Since grid-forming assets need a long-term reliable energy source, fuel cells are a reasonable and viable choice to supply the grid-forming inverters, but some of the challenges facing the wide deployment of grid-forming fuel cell inverters need to be addressed. Specifically, in our proposed work, we aim to focus on the interconnection and interoperability requirements of grid-forming fuel cell inverters. Currently, state-of-the-art fuel cell inverters follow the general interconnection requirements of distributed energy resources (DERs) and general interoperability requirements of DERs, but these requirements were built with PV and battery systems in mind. Fuel cells have different operational requirements, and therefore these requirements need to be appropriately modified for the grid operators to use. These additional steps add to the investment and operational cost to the grid operators. Through the ARIES platform, this proposed project aims to bridge this gap and use power hardware-in-the-loop (PHIL) and controller hardware-in-the-loop (CHIL) experiments to inform the creation of open-source interconnection and interoperability information that can aid in faster and cheaper installation and operation of grid-forming fuel cell inverters.

controller hardware-in-the-loop↗

DOE OSTI2024

Digital twin advanced distribution management systems (ADMS) and methods

Advanced Distribution Management Systems not generally optimize over the entire feeder because there are few high-fidelity distribution circuit models and real-time distribution-connected sensors are rare. The limited observability at the distribution level makes it difficult to globally optimize distribution operations and issue control setpoints to power systems equipment or Distributed Energy Resources (DER) to perform grid-support services. For example, setpoints can be issued to DER based on results from an optimization module that incorporates a static or time-series feeder simulation. Feeder simulation initial conditions are populated with photovoltaic (PV) and load forecasts, state estimation results, and/or digital twin measurements or state output. The real-time (RT) digital twin runs a model of the feeder to generate state estimation pseudo-measurements since there are limited live feeder measurements.

Johnson, Jay Tillay↗

DOE OSTI2020

Impact analysis of personalized thermostat demand response

Demand response (DR) aims to curtail peak electric load to avoid running inefficient power plants, reduce costly transmission capacity increases, and improve grid reliability. One method of DR for residential settings involves the utility or third part remotely adjusting thermostat temperatures. Cooling setpoints may be increased 2°F – 6°F for hours, irrespective of occupant comfort. To maintain their comfort, occupants override these setpoint changes impacting the reliability of DR services provided to the grid. This paper presents a preliminary impact analysis of replacing the current DR approach of uniform thermostat setbacks for an entire population with personalized and context aware DR based on a dynamic model of occupant thermal comfort behavior. Over 151k interactions with ecobee thermostats are analyzed to predict the impact of such personalized DR on overrides, energy curtailment magnitude, and reliability.

Kane, Michael↗

DOE OSTI2026

A Physics-Informed Reinforcement Learning Framework for Economic-Thermal Co-Optimization of Crypto Mining Data Centers: Preprint

The rapid expansion of cryptocurrency mining has created a new class of high-density data centers characterized by extreme thermal flux and high sensitivity to volatile economic markets. Traditional thermal management strategies, typically reliant on rule-based control, maintain static setpoints that fail to account for fluctuating electricity prices and cryptocurrency values - factors critical to mining profitability. To address this, we present a physics-informed reinforcement learning (PIRL) framework for economic-thermal co-optimization in crypto mining data centers. This framework consists of a proximal policy optimization (PPO) agent, a virtual testbed powered by high-fidelity physics-based models, and an interactive frontend dashboard. The PPO agent is trained using the virtual testbed and strict hardware safety limits. This physics-informed approach allows the agent to learn a stochastic policy that dynamically balances mining revenue against operational costs by co-optimizing HVAC cooling setpoints and IT computational hashrate. The simulation results demonstrate that the integrated framework achieved an 8.62% increase in net operational profit compared to traditional baseline strategies while strictly adhering to safety-critical temperature constraints (coolant supply temperature < 32 degrees C). This work provides a scalable template for the deployment of reinforcement learning in mission critical facilities where economic volatility and physical safety must be managed simultaneously.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

A method to generate heating and cooling schedules based on data from connected thermostats

Internet-connected thermostats are a promising new source of temperature and operational data in homes because they record inside temperatures, setpoints, and HVAC runtimes every five minutes. Over 20 million Internet-connected thermostats have already been installed in American homes. Data from about 20,000 connected thermostats were collected and organized by climate zone, number of occupants, floor area, and day type. A method was developed to create up to 40 representative temperature schedules which, together, can more accurately capture the diversity of heating and cooling behaviors. These results are suitable for input into schedules for building energy simulation models. This information enables more realistic simulations of American heating and cooling behavior, leading to more accurate estimates of energy consumption and savings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2023

Dilated causal convolutional neural networks for forecasting zone airflow to estimate short-term energy consumption

Here this paper investigates the use of dilated causal convolutional neural networks for fine- grained temporal forecasting of building zone states. Specifically, we build and evaluate models using a small set of exogenous features (e.g., external temperature) to autoregressively predict zone airflow setpoints every minute for a 24-hour prediction window. We carefully explore the trade-off between generality and specificity in these models, training and evaluating them based on zone, zone type, month, season, and combinations thereof. When evaluated for a commercial office building in Eastern Washington with 16 zones served by variable air volume air handling units, we find that the highest performance comes from a zone-specific, season-agnostic approach; with it, we obtain an R 2 of 0.704 (averaged over zones) and an average normalized root mean square error (nRMSE) of 0.111. In contrast, the most general model (trained across all zones and seasons) yields an R 2 of only 0.416 and a nRMSE of 0.168, while a baseline zone-specific reduced order model obtains 0.443 R 2 and 0.159 nRMSE. We also report on factors affecting airflow forecasting performance, on the ability of models trained on a specific zone to generalize to other zones, and on the capability of those models trained on a specific month to generalize to other months.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

Implementation and Operation of Power Flow Control Solutions for Transmission Systems

Power-flow controls (PFCs) technologies provide a suite of alternatives to more-efficiently direct the flow of power on the grid, improving flexibility and enabling the grid to be more responsive and resilient. PFCs can be used in many cases to mitigate overloads and consequently defer the installation of grid-expansion projects. They can also be suitable options in situations where new transmission lines cannot be built because of environmental constraints, land use, or other types of restrictions. Other uses include mitigation of loop or unintended flows, forcing of contractual or scheduled flows, reduction of congestion, and mitigation solutions during large maintenance or construction projects. While many studies have demonstrated the potential economic benefits of PFC for different types of applications, the implementation implications of using multiple PFCs for system operation and reliability have not been analyzed in detail. The lack of information and practical experience on these aspects hinders adoption of this technology. One use case would be that multiple PFCs are required to coordinate congestion management. In such cases, multiple PFCs are deployed in a meshed power system to control power flows across a wide area. The challenges are associated with PFC interaction—namely, the self and mutual power-flow sensitivity of each PFC, which must be accounted for in the calculation of the respective operating setpoints. This report analyzes implementation and operation that must be considered in evaluating transmission solutions using PFCs. The report first analyzes attributes with which PFC-based solutions should comply, based on the objective and characteristics of each particular use case. It then describes different approaches for coordinated control of multiple PFC devices for different applications, including options to avoid adverse interactions and reduce risks due to inappropriate coordination. Control and operation are illustrated through case studies performed on both generic and actual power system models. This report provides insights for transmission planners and operation engineers about the implementation of PFC-based transmission solutions; consequently, it will help them make informed decisions about the adoption of the technology.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Reinforcement Learning for Intelligent Building Energy Management System Control *

A building energy management system (BEMS) is a computer-based system designed to monitor and control a building's energy needs. Modern BEMS rely on the sensing and connectivity capabilities of Internet of Things (IoT) technology to intelligently adjust the energy consumption to reduce cost while respecting the consumers' preferences. Increasingly, control decisions are made based on predictions by models trained using supervised machine learning methods, which still requires control policies to be formulated in a rule-based fashion. When using reinforcement learning (RL) instead, control policies are learned by observing the utility in terms of cost and comfort associated with actions such as a change in the heating system's setpoint. The resulting RL-based controllers can capture not only the dynamics of the building and the associated electrical devices, but also fluctuations in electricity prices and user demand, avoiding the need to combine multiple predictive models with tailored control policies. This chapter will provide an overview of RL-based approaches for BEMS. After sketching the taxonomy of general RL methods, we discuss the implications of relying on the individual methods in a BEMS context. Existing work applying RL is presented along the key devices controlled by BEMS systems. Finally, we summarize the state-of-the-art and sketch limitations and open research directions.

Kotevska, Olivera↗

DOE OSTI2026

Computationally inexpensive part-scale thermal history of additive friction-stir deposition

This study presents an analytical model for steady-state power generation and tool heat loss in additive friction-stir deposition (AFSD), developed to enable part-scale thermal simulation while remaining computationally inexpensive. The model predicts total generated power, yielding 3.7–4.7 kW across deposition temperature setpoints of 400–460 °C for the deposition of AA6061 with a Be-Cu tool. This corresponds to 90–95% of the reported spindle power. Tool heat loss is experimentally determined by calibrating a steady-state energy balance between the generated power, the substrate-deposition thermal gradient, and a temperature dependent tool heat loss term: q tool (T) = a + b (T - 400°C) with a = 2.7 x 10 6 Wm -2 and b = 9.5 x 10 3 Wm -2 K -1 . The calibration indicates that about 69% of the generated heat is conducted into the tool for this configuration, which is much higher than previously reported. The calibrated heat-source is implemented in finite element software (Adamantine) to simulate the transient thermal history of a 100 cm 3 representative build in 8 min on a standard desktop (at 0.635 mm build-height resolution). For the first three layers, the substrate temperatures between simulation and experiment are within 10% mean absolute percentage error. Sensitivity analysis indicates that uncertainties in average deposition temperature and deformation localization (stir-zone geometry, depth, and spatial dependance of strain-rate and flow stress) dominate model variance, motivating additional experimental verification.

Additive Friction-Stir Deposition↗

DOE OSTI2018

Calculating the Starting Currents of Electric Motors in 0.4 kV Auxiliary Networks of Nuclear Power Plants

Consideration is given to the effect of the resistance of the cable supplying power to the electric motor in the 0.4 kV auxiliary network of a nuclear (thermal) power plant on the starting current and, hence, on the current setpoint for the circuit breaker, on its sensitivity to short-circuit current, and on the cable size. It is shown that accounting for the resistance of the power cable of the motor that is commensurable with the starting resistance of the latter allows using a cable of smaller size compared with that determined regardless of its resistance.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2017

The laboratory environmental algae pond simulator (LEAPS) photobioreactor: Validation using outdoor pond cultures of Chlorella sorokiniana and Nannochloropsis salina

A bench-scale photobioreactor system, the Laboratory Environmental Algae Pond Simulator (LEAPS), was designed and constructed to simulate outdoor pond cultivation for a wide range of geographical locations and seasons. The LEAPS consists of six well-mixed glass column photobioreactors submerged in a temperature controlled waterbath (-2 °C to >60 °C) and illuminated from above by a programmable multicolor LED lighting system (0 to 2,500 µmol/m 2 -sec). Measured incident light intensities and water temperatures deviated from the respective light and temperature setpoints on average only 2.3% and 0.9%, demonstrating accurate simulation of light and temperature conditions measured in outdoor ponds. In order to determine whether microalgae strains cultured in the LEAPS exhibit the same linear phase biomass productivity as in outdoor ponds, Chlorella sorokiniana and Nannochloropsis salina were cultured in the LEAPS bioreactors using light and temperature scripts measured previously in the respective outdoor pond studies. For Chlorella sorokiniana, the summer season biomass productivity in the LEAPS was 6.6% and 11.3% lower than in the respective outdoor ponds in Rimrock, Arizona, and Delhi, California; however, these differences were not statistically significant. For Nannochloropsis salina, the winter season biomass productivity in the LEAPS was 9.2% higher than in the respective outdoor ponds in Tucson, Arizona, a difference shown to be not statistically significant. Potential reasons for the positive or negative divergence in LEAPS performance, relative to outdoor ponds, are discussed. To demonstrate the utility of the LEAPS in predicting productivity, two other strains – Scenedesmus obliquus and Stichococcus minor – were evaluated using the summer season script for Rimrock, Arizona. For both strains, the productivity was around 11.6 g/m 2 -day at 25 cm culture depth. In conclusion, the LEAPS is an accurate pond simulator and thus offers a reliable, fast, and cost-effective way to screen microalgae strains and operating conditions for high biomass productivity and co-product yields.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Pressurizer dynamic model and emulated programmable logic controllers for nuclear power plants cybersecurity investigations

This work demonstrates the functionality of the pressurizer using a fast-running three regions, non-equilibrium model and control programs of emulated PLCs. The state variables from an integrated model of primary loop in a representative PWR plant are communicated to the pressurizer’s emulated PLCs using a synchronized data transfer function. In turn, the PLCs communicate back instructions to the pressurizer model to adjust the pressure and water level to remain within preprogramed setpoints. Pressurizer model simultaneously solves the coupled mass and energy conservation equations in the saturated vapor and saturated and subcooled liquid regions using fixed step solver. Results demonstrate the response of the pressurizer model linked to an emulated pressure and water level PLCs in a simulated transient involving surge-in and surge-out events. The 50 ms response delay time for the emulated PLC insignificantly affects operation and predictions of the pressurizer model.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Estimation of the time for steam generator trip due to cyber intrusions

The time required to trip a pressurized water reactor (PWR) by inserting malicious signals into its steam generator (SG) control system has been studied using the Generic PWR (GPWR) Simulator. A semi-analytical model is developed to approximately reproduce the simulator response and understand the dynamics of the control unit. A series of two proportional-integral controllers determines control action according to preset constants, the readings from the feedwater level sensor, and those from feedwater and steam flowrate transmitters. It is observed that the most important factor that determines whether a trip will occur is how much additional water is added to or withheld from the SG over time compared to normal operating conditions. In order to determine the effects of control action on the SG, changes in mass inventory are considered. This approach models the SG water level as a function of mass inventory and has a backward temporal memory. A Python interface is developed for the GPWR framework to automatically simulate different spoofing scenarios and post-process the related data. We observe that the trip times predominantly depend on flow mismatch and/or level errors. Controller parameters, including the integral time and gain constants, either speed up or slow down the rate of progression to a trip setpoint but do not cause a trip by themselves. The reactor can trip on a high-level signal when the reading crosses above 78%, increased from its reference level of 57%, or a low-level reading when it is below 25%. The present results show roughly how long the operators would have to respond to an attack, given a specific set of spoofing signals within the issue space analyzed. Furthermore, we have generated a simple surface by fitting a combination of exponential functions to the data obtained from the GPWR Simulator. In general, trips on a low level have been observed to occur faster than those on a high level.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗