SEARCH · Engineering Papers

Results for “closed loop simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Model predictive control of KSTAR equilibrium parameters enabled by TRANSP

Due to the complex behavior of tokamak plasmas and the importance of optimizing performance while avoiding instabilities and machine limits, plasma control algorithms are becoming increasingly dependent on sophisticated model-based control approaches. It is anticipated that the use of integrated modeling codes in the model-based control design process will reduce the amount of experimental time needed to implement new control algorithms by facilitating development of control-oriented models and enabling higher-fidelity closed-loop simulations. In this work, a reduced model is developed from a series of TRANSP simulations and is used to develop a model predictive control (MPC) algorithm for controlling important equilibrium parameters in KSTAR [1] discharges. The control algorithm uses the KSTAR neutral beam injection system and the target plasma current and plasma boundary as actuators, and optimizes the plasma stored energy, loop voltage, and internal inductance while avoiding constraints that could lead to disruptions. Higher fidelity testing of the control algorithm is performed using a flexible framework for enabling external processes to actively control plasma parameters in TRANSP simulations. Furthermore, closed-loop simulations demonstrate the ability of the control algorithm to respond to disturbances in density and confinement, handle actuator failures, and move the discharge to high non-inductive fraction conditions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2020

An encoder–decoder LSTM-based EMPC framework applied to a building HVAC system

Numerous studies have demonstrated the benefit of economic model predictive control (EMPC) applied to building heating, ventilation, and air conditioning (HVAC) systems. However, the construction and training of predictive models for building HVAC systems are widely recognized as a key technological barrier preventing large-scale adoption of EMPC for buildings. In this work, an encoder–decoder long short-term memory-based EMPC framework is developed. The key advantage of the approach is that a model may be automatically generated from a list of inputs and outputs. From the definition of inputs and outputs, the constructed model may be trained and automatically embedded into the EMPC framework for real-time estimation and control. The overall end-to-end EMPC framework from model training to on-line estimation and control are described. To this end, the encoder–decoder model provides a natural framework for state estimation (encoder), which is required to provide an initial condition for the predictive model of EMPC (decoder). Closed-loop simulations using EnergyPlus are performed to demonstrate the approach. The simulated closed-loop system consists of a building zone from a multi-zone building, which is served by an air handling unit-variable air volume HVAC system. For the HVAC example considered, the trained encoder–decoder model can predict the indoor air temperature and HVAC sensible cooling rate of a building zone over a two-day horizon with high accuracy. Overall, we find that considering a time-of-use electric rate structure, the EMPC, which manipulates the zone temperature setpoint, can reduce the HVAC power consumption cost relative to keeping the zone temperature setpoint at its maximum value (i.e., minimum energy approach).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2023

Multi-Timescale Integrated Dynamics and Scheduling for Solar (MIDAS-Solar) (Final Technical Report)

Solar photovoltaic (PV) installations have experienced unprecedented growth in the United States. PV will become not only an energy producer but also a necessary provider of ancillary services at multiple timescales. Conventional methods to simulate power systems operations - such as long-term production simulation (which typically considers schedules from hours to minutes by using an optimization framework) and short-term transient studies (which simulate dynamics from seconds to sub-seconds using state variables and differential equations) - are not sufficient for studying the multiple-timescale variation of solar generation and its impact on system reliability. Long-term system economics and short-term system dynamics are highly coupled, particularly when the penetration level of renewable generation is extremely high, because the uncertainty and variability of solar generation will impact both power system steady-state and dynamic performance. This project helps meet and exceed the U.S. Department of Energy Office of Energy Efficiency and Renewable Energy Solar Energy Technologies Office goal of systems integration by directly addressing this stability and reliability challenge for power grid planning and operation. We have developed a temporally comprehensive, closed-loop simulation model, named Multi-timescale Integrated Dynamics and Scheduling (MIDAS), that seamlessly simulates power system operations from economic scheduling (day-ahead to hours) to dynamic response analysis (seconds to sub-seconds). For schedules with very high levels of inverter-based resources (IBRs), up to and including 100%, the stability of grid controls has been evaluated through electromagnetic transient (EMT) simulations and power-hardware-in-the-loop (PHIL) simulations of key transient events at key schedule points. Specifically, MIDAS provides: 1) a closed-loop simulation framework for simulating timescales from economic scheduling to dynamic stability analysis; 2) machine learning-based stability assessment; 3) EMT modeling and analysis for large-scale power systems; 4) MIDAS PHIL test bed. We worked with Hawaii Electric Companies to apply the MIDAS study framework to a Maui grid study. The entire island's transmission system was modeled in detail - from a yearly scheduling model, to a second-level frequency dynamic model, down to a sub-second-scale EMT model to address critical stability issues. The project demonstrated how MIDAS can help system planners and operators assess system reliability and stability while the power grid is marching toward a high-renewable, high-IBR future. In this Maui grid study, we found that 100% instantaneous IBR operation is achievable in EMT simulation and PHIL testing, and grid planners and operators might need new analysis/simulation tools to assess grid reliability and stability in the scheduling stage. MIDAS will bring Maui and other systems closer to 100% clean and stable energy futures. (In this study, we examined transient stability. Other topics necessary for 100% IBR operation, such as protection and resource adequacy, were not examined.)

100% Renewables↗

DOE OSTI2021

Deep Learning Explicit Differentiable Predictive Control Laws for Buildings

We present a differentiable predictive control (DPC) methodology for learning constrained control laws for unknown nonlinear systems. DPC poses an approximate solution to multiparametric programming problems emerging from explicit nonlinear model predictive control (MPC). Contrary to approximate MPC, DPC does not require supervision by an expert controller. Instead, a system dynamics model is learned from a small dataset of recorded observations of the perturbed system's dynamics and the control law is optimized offline by interaction with the learned system model. The DPC method is based on two sequential steps, i) system identification using a constrained neural state-space model, and ii) optimization of an explicit control law parametrized by another neural network in closed-loop simulation with the identified neural state-space model. The combination of a differentiable closed-loop system and penalty methods for constraint handling of system outputs and inputs allows us to optimize the control law's parameters directly by backpropagating economic MPC loss through the learned system model. By incorporating domain knowledge and leveraging established techniques from optimal control, our method leverages deep neural networks as nonlinear function approximators for system identification and control while avoiding concomitant costs of intractably large datasets, and computationally expensive over-parametrized models. The scalability, data efficiency, and constrained optimal control capability of the proposed DPC method are demonstrated in simulation using a multi-zone building emulator.

Drgona, Jan↗

DOE OSTI2022

Neural net modeling of equilibria in NSTX-U

Neural networks (NNs) offer a path towards synthesizing and interpreting data on faster timescales than traditional physics-informed computational models. In this work we develop two NNs relevant to equilibrium and shape control modeling, which are part of a suite of tools being developed for the National Spherical Torus Experiment-Upgrade for fast prediction, optimization, and visualization of plasma scenarios. The networks include Eqnet, a free-boundary equilibrium solver trained on the EFIT01 (Equilibrium FITtting 01) reconstruction algorithm, and Pertnet, which is trained on the Gspert code and predicts the non-rigid plasma response, a nonlinear term that arises in shape control modeling. The NNs are trained with different combinations of inputs and outputs in order to offer flexibility in use cases. In particular, Eqnet can use magnetic diagnostics as inputs and act as an EFIT-like reconstruction algorithm, or, by using pressure and current profile information the NN can act as a forward Grad–Shafranov equilibrium solver. This forward-mode version is envisioned to be implemented in the suite of tools for simulation of plasma scenarios. The reconstruction-mode version gives some performance improvements compared to the online reconstruction code real-time EFIT, especially when vessel eddy currents are significant. Here, we report strong performance for all NNs indicating that the models could reliably be used within closed-loop simulations or other applications. Some limitations are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2020

Optimal pumping schedule with high-viscosity gel for uniform distribution of proppant in unconventional reservoirs

Hydrocarbon recovery from a hydraulic-fractured unconventional reservoir can be enhanced by replacing slickwater with non-Newtonian high-viscosity gel as a fracturing fluid. However, in the literature, the role of gel rheology on hydrocarbon production from a fractured reservoir is not very well understood. This lack of understanding makes it difficult for the industry to choose appropriate viscosity parameters of fracturing gels. Motivated by these limitations, first, we have developed a high-fidelity model of non-Newtonian fluid flow to simulate fracture propagation, fluid leak-off, and gel flowback processes to predict the oil production from a hydraulic fractured reservoir. Simulation results of the high-fidelity model show how fracture geometry, formation damage, and gel cleanup process varies with the fracturing fluid rheology. Therefore, the developed model is used to understand the effect of gel rheology on hydrocarbon production via a sensitivity analysis, which provides a set of rheological parameters that maximize the cumulative amount of oil production. Finally, utilizing this optimal high-viscosity gel, a model predictive controller is designed to obtain an optimal pumping schedule necessary for producing a target fracture geometry and proppant concentration. The closed-loop simulation results demonstrate that the obtained pumping schedule successfully achieved the desired fracture geometry and proppant concentration at the end of pumping, leading to the maximum oil production from an unconventional reservoir.

13 HYDRO ENERGY↗

DOE OSTI2020

Multi-Timescale Integrated Dynamic and Scheduling Model (MIDAS-Solar)

Solar photovoltaic (PV) installations have experienced unprecedented growth in the United States. PV will become not only an energy producer but also a necessary provider of ancillary services at multiple timescales. Conventional methods to simulate power system operations - such as long-term production simulation (which typically considers schedules from hours to minutes by using an optimization framework) and short-term transient studies (which simulate dynamics from seconds to sub-seconds using state variables and differential equations) are not sufficient for studying the multiple-timescale variation of solar generation and its impact on system reliability. Long-term system economics and short-term system dynamics are highly coupled, particularly when the penetration level of renewable generation is extremely high, because the uncertainty and variability of solar generation will impact both power systems steady-state and dynamic performance. This project helps meet and exceed the Solar Energy Technologies Office goal of systems integration by directly addressing this stability and reliability challenge for electric grid planning and operation. This will be accomplished by developing temporally comprehensive, closed-loop simulation models that seamlessly simulate power systems operations from economic scheduling (day-ahead to hours) to dynamic response analysis (seconds to sub-seconds). Both a multi-timescale grid model and an integrated PV model will be developed in this project to accurately study the impacts of PV variability and uncertainty on system reliability at multiple timescales. Using quasi-dynamic simulation methods and data-driven security assessment (DSA) criteria will allow the dynamic characteristics of PV to be fed forward into longer-timescale scheduling models for a complete understanding of the effect of short-term PV dynamics on bulk systems operations (e.g., reserve scheduling and deployment). Upon completion of the proposed model, this project will help operators accurately assess system reliability by deploying energy and reserve scheduling under critical contingency conditions and studying interactions among all types of essential reliability services provided by modern PV power plants.

14 SOLAR ENERGY↗

DOE OSTI2025

Machine learning modeling and model predictive control of a closed-circuit reverse osmosis system

Closed-circuit reverse osmosis (CCRO) offers a flexible and energy-efficient alternative to conventional reverse osmosis by operating in a semi-batch mode that recycles brine, enabling higher recovery rates and reduced specific energy consumption (SEC). However, developing accurate, system-level dynamic models for CCRO remains challenging due to its nonlinear, multi-phase operation and sensitivity to variable feed water conditions. Traditional modeling approaches, such as NARMAX (nonlinear autoregressive moving average with exogenous inputs), often struggle to generalize across varying inlet feed concentrations, necessitating frequent parameter re-estimation and limiting their utility for real-time control applications. To address these limitations, we developed a long short-term memory (LSTM) neural network model trained on an extensive experimental data set from a CCRO pilot plant. The model accepts three inputs, feed flow rate, recirculation flow rate, and initial feed conductivity, and predicts three key outputs: reject conductivity, feed pump power draw, and recirculation pump power draw. We validated the LSTM model against experimental data, demonstrating its ability to distinguish between different feed conductivities and adapt to variable flow rates. Subsequently, we incorporated the LSTM model within a nonlinear model predictive control (MPC) scheme and conducted closed-loop simulations to optimize the integrated SEC (iSEC). In conclusion, the results project up to a 6% reduction in iSEC by using MPC to optimize performance over the entire experiment duration, without requiring any random excitation for data collection or parameter re-estimation.

Desalination↗

DOE OSTI2024

Divertor-safe nonlinear burn control based on a SOLPS parameterized core-edge model for ITER

Abstract For ITER operations, the range of desirable burning-plasma regimes with high fusion power output will be restricted by various operational constraints. These constraints include the saturation of ITER’s various heating and fueling actuators such as the neutral beam injectors, the ion and electron cyclotron heating systems, the gas puffing system, and the deuterium–tritium pellet injectors. In addition to these actuator constraints, the H-mode power threshold, divertor detachment, and the heat load on the divertor targets may apply limitations to ITER’s operational space. In this work, Plasma Operation Contour (POPCON) plots that map the aforementioned constraints to the temperature-density space are used to investigate which constraints are most limiting towards accessing regimes with high fusion power output. The presented POPCON plots are based on a control-oriented core-edge model that couples the nonlinear density and energy response models for the core-plasma region with SOLPS4.3 parameterizations for conditions in the edge-plasma regions (scrape-off-layer and divertor). Using this control-oriented core-edge model, a nonlinear burn controller, which aims to regulate the plasma temperature and density in the core-plasma region, is constructed in this work. This controller is augmented with an online optimization scheme that governs the control references such that the plasma can be guided towards regimes with high fusion powers while protecting the divertor targets from dangerously high heat loads. A closed-loop simulation study illustrates the capability of this burn control scheme.

Physics↗

DOE OSTI2020

A Control Scheme to Mitigate the Dead-Time Effects in a Wireless Power Transfer System

In practice, a dead-time is always provided between the complementary switching instances of the inverter phase-leg devices. At higher operating frequencies, the dead-time issues in wireless power transfer (WPT) systems become critical, especially as the power level increases. In certain operating conditions, the dead-time effect in wireless power transfer system affects the switching characteristics. Consequently, the switching losses in the power semiconductor devices increase and also impact the efficiency of the overall system. In this paper, a simple control scheme is proposed to eliminate the dead-time effect (or voltage polarity reversal) in the WPT inverter. The proposed control scheme monitors the inverter output voltage, and the switching frequency is auto-tuned to eliminate the undesired switching instances in the inverter voltage. The proposed control scheme is validated using the closed-loop simulations in PLECS, and the experimental results on a 5.6 kW WPT prototype are also presented. After eliminating the voltage-polarity-reversal at the inverter output, the inverter losses were reduced by ~40%, and the overall system losses were reduced by ~17%.

Kavimandan, Utkarsh↗

DOE OSTI2022

Data-Enabled Predictive Control for Building HVAC Systems

Model predictive control is widely used as a control technology for the computation of optimal control inputs of building heating, ventilating, and air conditioning (HVAC) systems. However, both the benefits and widespread adoption of model predictive control (MPC) are hindered by the effort of model creation, calibration, and accuracy of the predictions. In this paper, we apply the data-enabled predictive control (DeePC) algorithm for designing controls for building HVAC systems. The algorithm solely depends on input/output data from the system to predict future state trajectories without the need for system identification. The algorithm relies on the idea that a vector space of all input–output trajectories of a discrete-time linear time-invariant (LTI) system is spanned by time-shifts of a single measured trajectory, given the input signal is persistently exciting. Closed-loop simulations using EnergyPlus are performed to demonstrate the approach. The simulated building modeled in EnergyPlus is a modified commercial large office prototype building served by an air handling unit-variable air volume HVAC system. Temperature setpoints of zones are used as control variables to minimize the HVAC energy cost of the building considering a time-of-use electricity rate structure. Furthermore, sensitivity analysis is conducted to gain insights into the effect of parameter tuning on DeePC performance. Simulation results are used to illustrate the performance of the algorithm and compare the algorithm with model-based MPC and occupancy-based setpoint controller. Overall, DeePC achieves similar performance compared to MPC for lower engineering effort.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2022

Pareto Optimal and Dual-Objective Geometric and Structural Design of an Underwater Kite for Closed-Loop Flight Performance

This paper presents the formulation and results for a control-aware optimization of the combined geometric and structural design of an energy-harvesting underwater kite. Because kite-based energy-harvesting systems, both airborne and underwater, possess strong coupling between closed-loop flight control, geometric design, and structural design, consideration of all three facets of the design within a single codesign framework is highly desirable. However, while prior literature has addressed one or two attributes of the design at a time, this work constitutes the first comprehensive effort aimed at addressing all three. In particular, focusing on the goals of power maximization and mass minimization, we present a codesign formulation that fuses a geometric optimization tool, structural optimization tool, and closed-loop flight efficiency map. The resulting integrated codesign tool is used to address two mathematical optimization formulations that exhibit subtle differences: a Pareto optimal formulation and a dual-objective formulation that focuses on a weighted power-to-mass ratio as the techno-economic metric of merit. Further, based on the resulting geometric and structural designs, using a mediumfidelity closed-loop simulation tool, the proposed formulation is shown to achieve more than three times the powerto-mass ratio of a previously published, unoptimized benchmark design.

42 ENGINEERING↗

DOE OSTI2026

Applying Particle Swarm Optimization and Extended Kalman Filtering to Model Kaplan Generation Dynamics for Hydropower Systems

Variable renewable generation is increasing the need for hydropower plants to provide fast and flexible grid support, which places new demands on plant-level dynamic models used for monitoring, control, and operational decision-making. This need is especially important for hydroelectric systems, where turbine and generator dynamics are strongly coupled, nonlinear, and time-varying, making accurate real-time representation difficult. To address this problem, this paper develops a digital twin (DT) framework for a synchronous generator–Kaplan turbine system using an explicit separation of slow turbine dynamics and fast generator dynamics. The turbine subsystem is represented by a six-coefficient model, whose parameters are identified offline using particle swarm optimization, while the generator subsystem is updated online through an extended Kalman filter for real-time state and parameter estimation. These models are integrated within a closed-loop simulation that includes a proportional–integral–derivative–double-derivative governor and excitation system, allowing the DT to track plant behavior under realistic operating conditions. Unlike prior studies that treat turbine and generator modeling separately or rely mainly on simulated inputs, the proposed framework is validated using real operational data from a hydropower plant. Results show that the DT reproduces terminal voltage, active power, and reactive power with a normalized root mean square error of approximately 5%. This hybrid offline–online formulation constitutes the main contribution of the work, providing an adaptive and practically deployable DT for hydropower systems with direct relevance to control improvement, performance monitoring, and grid-support applications under high renewable penetration.

13 HYDRO ENERGY↗

DOE OSTI2023

COMSOL Models and Simulation Results for Closed-Loop Geothermal Systems with Thermal Enhancements

The Closed-Loop Geothermal Working Group and the National Renewable Energy Laboratory (NREL) have studied the performance of disc-shaped and linear thermal enhancements (conductive material introduced around a wellbore) in closed-loop geothermal systems. COMSOL models were developed to investigate the increase in heat production in systems with thermal enhancements compared to those without, across a range of scenarios. This dataset includes two example COMSOL models, a summary of the simulation results, and a link to an accompanying paper. Studied are idealized versions of two thermal enhancement designs: (1) existing or newly created fractures surrounding the wellbore, filled with highly conductive material, and (2) a 'fishbone structure,' where short wellbores are drilled radially outward from the main wellbore and filled with highly conductive material.

15 GEOTHERMAL ENERGY↗

DOE OSTI2021

An Integrated High-performance Computing and Digital Real-time Simulation Testbed to Benchmark Closed-loop Load Shedding Algorithms in Power Systems

An integrated testbed using digital real-time simulator (DRTS) and a high-performance computing (HPC) cluster is presented here to compare speed and performance of computational schemes to mitigate time-critical issues in electric power systems. The first approach in this testbed validation is taken by running a set of closed-loop load shedding algorithms to compare and contrast two paradigms of arresting cascading failure propagation. Two algorithms involve solving DC and AC power flow model-based optimization problems to compute load shedding at different buses, while a model-based stochastic search using parallel computing provides a viable alternative. The algorithms are implemented in the DRTS-HPC testbed for the IEEE 14-bus benchmark transmission system. As a proof of the concept, simulation results are presented for implementation of closed-loop load-shedding algorithms for cascading failures in the DRTS-HPC testbed

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

A CHIL Validation of Machine Learning-Assisted Methods for Real-Time Controls of Solar PV for Grid Services

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been proposed; however, these technologies lack comprehensive validation under real-world application scenarios. This paper addresses this gap by designing and developing a controller-hardware-in-the-loop framework to evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. Simulation results indicate the superior performance of an ML-based approach compared to the conventional reference-control grouping-based approach, showcasing its potential to support grid stability and operational efficiency.

closed-loop validation↗

DOE OSTI2024

A CHIL Validation of Machine Learning-Assisted Methods for Real-Time Controls of Solar PV for Grid Services: Preprint

closed-loop validation↗

DOE OSTI2023

Closed Loop Geothermal Working Group: GeoCLUSTER App, Subsurface Simulation Results, and Publications

To better understand the heat production, electricity generation performance, and economic viability of closed-loop geothermal systems in hot-dry rock, the Closed-Loop Geothermal Working Group -- a consortium of several national labs and academic institutions has tabulated time-dependent numerical solutions and levelized cost results of two popular closed-loop heat exchanger designs (u-tube and co-axial). The heat exchanger designs were evaluated for two working fluids (water and supercritical CO2) while varying seven continuous independent parameters of interest (mass flow rate, vertical depth, horizontal extent, borehole diameter, formation gradient, formation conductivity, and injection temperature). The corresponding numerical solutions (approximately 1.2 million per heat exchanger design) are stored as multi-dimensional HDF5 datasets and can be queried at off-grid points using multi-dimensional linear interpolation. A Python script was developed to query this database and estimate time-dependent electricity generation using an organic Rankine cycle (for water) or direct turbine expansion cycle (for CO2) and perform a cost assessment. This document aims to give an overview of the HDF5 database file and highlights how to read, visualize, and query quantities of interest (e.g., levelized cost of electricity, levelized cost of heat) using the accompanying Python scripts. Details regarding the capital, operation, and maintenance and levelized cost calculation using the techno-economic analysis script are provided. This data submission will contain results from the Closed Loop Geothermal Working Group study that are within the public domain, including publications, simulation results, databases, and computer codes. GeoCLUSTER is a Python-based web application created using Dash, an open-source framework built on top of Flask that streamlines the building of data dashboards. GeoCLUSTER provides users with a collection of interactive methods for streamlining the exploration and visualization of an HDF5 dataset. The GeoCluster app and database are contained in the compressed file geocluster_vx.zip, where the "x" refers to the version number. For example, geocluster_v1.zip is Version 1 of the app. This zip file also contains installation instructions. **To use the GeoCLUSTER app in the cloud, click the link to "GeoCLUSTER on AWS" in the Resources section below. To use the GeoCLUSTER app locally, download the geocluster_vx.zip to your computer and uncompress this file. When uncompressed this file comprises two directories and the geocluster_installation.pdf file. The geo-data app contains the HDF5 database in condensed format, and the GeoCLUSTER directory contains the GeoCLUSTER app in the subdirectory dash_app, as app.py. The geocluster_installation.pdf file provides instructions on installing Python, the needed Python modules, and then executing the app.

15 GEOTHERMAL ENERGY↗