Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “control framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Load altering attack-tolerant defense strategy for load frequency control system

Cyber attacks are emerging threats to every information-oriented energy management system. By violating the cyber systems, the hacker can disrupt the security and stability due to the strong coupling between the cyber and physical facilities. In this paper, one type of cyber attacks designated as the load altering attack is studied for the power system frequency control, and corresponding defense strategies are proposed to improve the frequency control performance. Considering the difficulty of the application of model-based controller into large-scale power systems, a novel model-free defense framework is for the first time presented. Under this framework, both active defense and passive defense strategies are designed. The former assumes that the defender has the initiative to learn different attack scenarios. Adaptive defense strategies are implemented using the online attack identification information and off-line trained strategy pool. The latter assumes that the defender passively tolerates various attack scenarios via the pre-trained off-line strategy. Both approaches prove to be effective through validation based on the IEEE benchmark systems. The proposed defense framework and defense strategies can be extended to other energy control systems to enhance their attack tolerance capability.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Nonlinear multiobjective and dynamic real-time predictive optimization for optimal operation of baseload power plants under variable renewable energy

Considering the increase of disruptive variable renewable energy penetration into the power grid, this article focuses on the investigation of a multiobjective and dynamic real-time optimization framework to address the cycling of large-scale power plants under renewable penetration. In this framework, a parallelized particle swarm optimization step is first performed to generate feasible initial points. Then, a multiobjective and dynamic real-time optimization formulation generates optimal trajectories. Further, the benefit of predictive capability is investigated for the dynamic component, which introduces the novel nonlinear multiobjective and dynamic real-time predictive optimization approach. Two multiobjective formulations to obtain Pareto front optimal in real time are explored: the modified Tchebycheff-based weighted metric and ϵ-constraint methods. Economic and environmental objectives are considered in this study. A novel topical discussion on the intersection of dynamic real-time optimization with model predictive control is also presented. The developed framework is successfully applied to a baseload coal-fired power plant with postcombustion CO 2 capture. Results indicate that the approach can be deployed for a large-scale system if automatic differentiation, model reduction, and parallelization are adopted to improve computational tractability, with computational improvement up to 120-folds after performing these steps. Finally, market and carbon policies showed an impact on the optimal compromise between the objectives with an additional 63 ton of CO 2 captured under favorable market conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Attention Enabled Multi-Agent DRL for Decentralized Volt-VAR Control of Active Distribution System Using PV Inverters and SVCs

This paper proposes attention enabled multi-agent deep reinforcement learning (MADRL) framework for active distribution network decentralized Volt-VAR control. Using the unsupervised clustering, the whole distribution system can be decomposed into several sub-networks according to the voltage and reactive power sensitivity relationships. Then, the distributed control problem of each sub-network is modeled as Markov games and solved by the improved MADRL algorithm, where each sub-network is modeled as an adaptive agent. An attention mechanism is developed to help each agent focus on specific information that is mostly related to the reward. All agents are centrally trained offline to learn the optimal coordinated Volt-VAR control strategy and executed in a decentralized manner to make online decisions with only local information. Compared with other distributed control approaches, the proposed method can effectively deal with uncertainties, achieve fast decision makings, and significantly reduce the communication requirements. Comparison results with model-based and other data-driven methods on IEEE 33-bus and 123-bus systems demonstrate the benefits of the proposed approach.

distribution network↗
DOE OSTI2025

Deconvoluting sources of variability in aerosol jet printing using light scattering measurements

Aerosol jet printing (AJP) is a digital additive manufacturing technique for hybrid and conformal electronics, where its contactless deposition readily enables patterning over 3D surface topography. However, the complexity of aerosol transport physics makes deposition rate sensitive to process variability, hindering widespread industry adoption. Light scattering measurements have recently been demonstrated as a capable tool for measuring deposition rate in real time, enabling closed-loop control and in-situ qualification frameworks. These inline optical measurements present further opportunity as a diagnostic tool to understand the effects of secondary process parameters affecting vapor–liquid equilibrium and heat and mass transport during deposition. Downstream of the optical measurement cell, changing the sheath gas flow rate, increasing temperature via an inline heater, and adding solvent vapor via a sheath gas bubbler were observed to alter drying physics during sheath-collimation, and thereby impaction efficiency. Further upstream, the introduction of solvent vapor via a carrier gas bubbler and liquid build-up in the printhead were seen to affect the quantitative relationship between the light scattering data and the true deposition rate. Using this information, tightened controls of meaningful secondary parameters were implemented to improve the batch-to-batch consistency for printing a dielectric ink. In addition to advancing AJP process reliability for production, this work demonstrates the capability of inline optical measurements to provide insight into process physics and deconvolute competing mechanisms that underly variability.

additive manufacturing↗
DOE OSTI2023

How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system

Both model predictive control (MPC) and deep reinforcement learning control (DRL) have been presented as a way to approximate the true optimality of a dynamic programming problem, and these two have shown significant operational cost saving potentials for building energy systems. Furthermore, there is still a lack of in-depth quantitative studies on their approximation levels to the true optimality, especially in the building energy domain. To fill in the gap, this paper provides a numerical framework that enables the evaluation of the optimality levels of different controllers for building energy systems. This framework is then used to comprehensively compare the optimal control performance of both MPC and DRL controllers with given computation budgets for a single zone fan coil unit system. Note the optimality is estimated based on a user-specific selection of trade-off weights among energy costs, thermal comfort and control slew rates. Compared with the best optimality we can find through expensive optimization simulations, the best DRL agent can maximally approximate the optimality by 96.54%, which outperforms the best MPC whose optimality level is 90.11%. However, due to the stochasticity, the DRL agent is only expected to approximate the optimality by 90.42%, which is almost equivalent to the best MPC. Except for Proximal Policy Optimization (PPO), all DRL agents can have a better approximation to the optimality than the best MPC, and are expected to have better approximation than the MPC with a prediction horizon of 32 steps (15 min per step). In terms of reducing energy cost and thermal discomfort, MPC can outperform the rule-based control (RBC) by 18.47%–25.44%. DRL can be expected to outperform RBC by 18.95%–25.65% ,and the best DRL control policy can outperform RBC by 20.29%–29.72%. Although the comparison of the optimality level is performed in a perfect setting, e.g., MPC assumes perfect models, and DRL assumes a perfect offline training process and online deployment process, this can shed insight on their capabilities of approximating to the original dynamic programming problem.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Medium-induced radiative kernel with the Improved Opacity Expansion

We calculate the fully differential medium-induced radiative spectrum at next-to-leading order (NLO) accuracy within the Improved Opacity Expansion (IOE) framework. This scheme allows us to gain analytical control of the radiative spectrum at low and high gluon frequencies simultaneously. The high frequency regime can be obtained in the standard opacity expansion framework in which the resulting power series diverges at the characteristic frequency ω c ~ q^L 2 . In the IOE, all orders in opacity are resumed systematically below ωc yielding an asymptotic series controlled by logarithmically suppressed remainders down to the thermal scale T « ω c , while matching the opacity expansion at high frequency. Furthermore, we demonstrate that the IOE at NLO accuracy reproduces the characteristic Coulomb tail of the single hard scattering contribution as well as the Gaussian distribution resulting from multiple soft momentum exchanges. Finally, we compare our analytic scheme with a recent numerical solution, that includes a full resummation of multiple scatterings, for LHC-inspired medium parameters. Furthermore, we find a very good agreement both at low and high frequencies showcasing the performance of the IOE which provides for the first time accurate analytic formulas for radiative energy loss in the relevant perturbative kinematic regimes for dense media.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Co-simulation Framework for Community-scale Building-grid Integration [SWR-21-75]

Distributed energy resources (DERs), including rooftop solar, energy storage, and flexible loads, are gaining popularity as costs decline and as building owners and utilities realize their benefits. DERs can improve distribution system efficiency, help prevent the need for expensive grid upgrades, and increase the resilience of local communities. However, they can also cause difficulties in grid operations and can require controls to achieve their benefits. To address this challenge, NREL researchers have developed a community-scale solution that assesses the impacts of DERs and their control strategies on a distribution system. The framework has been shown to reduce solar photovoltaic (PV) curtailment to 0%, mitigate the adverse impact of solar variability on the distribution voltage, and provide up to 5-day critical load support during emergency events. Utilizing 5 different modules representing the feeder, buildings, home energy management systems, an aggregator, and a utility controller, NREL expects this simulation technology to play a critical role in the continued integration of DERs. According to the Energy Information Administration (EIA), solar curtailments accounted for 94% of the total energy curtailed in the California Independent System Operator (CAISO) in 2020. By enabling Independent System Operators (ISOs) and utility operators to bring solar curtailments to 0%, the electrical grid can become less dependent on fossil-fueled power generation sources. NREL's co-simulation framework contains five major components: Distribution Feeder Model: describes the distribution feeder topology using OpenDSS, including the locations of all DERs. Residential Building Model: simulates a large number of buildings at a high resolution using OCHRETM. The model is equipped to control equipment based on signals from an external module. The model includes major household appliances such as HVAC and a water heater, non-dispatchable load models, a distributed PV system, and a home battery system. Home Energy Management System: optimizes the controls for the devices in a home using foreseeTM. The control can adjust based on the user preferences including cost, comfort, and convenience. In hierarchical control scenarios, where the houses follow signals from an aggregator, the home energy management system provides a flexibility band with a range of power and follows the dispatch signals received from aggregator. Community-Level Aggregator: solves for optimal energy dispatch based on the flexibility bands received from each home and the grid service signal received from the utility controller. Utility-Level Controller: provides grid signals for voltage control using Distributed Energy Resources (DERs), such as solar systems, in the community.

Balamurugan, Sivasathya Pradha↗
DOE OSTI2022

Deep reinforcement learning with online data augmentation to improve sample efficiency for intelligent HVAC control

Deep Reinforcement Learning (DRL) has started showing success in real-world applications such as building energy optimization. Much of the research in this space utilized simulated environments to train RL-agent in an offline mode. Very few research have used DRL-based control in real-world systems due to two main reasons: 1) sample efficiency challenge---DRL approaches need to perform a lot of interactions with the environment to collect sufficient experiences to learn from, which is difficult in real systems, and 2) comfort or safety related constraints---user's comfort must never or at least rarely be violated. In this work, we propose a novel deep Reinforcement Learning framework with online Data Augmentation (RLDA) to address the sample efficiency challenge of real-world RL. We used a time series Generative Adversarial Network (TimeGAN) architecture as a data generator. We further evaluated the proposed RLDA framework using a case study of an intelligent HVAC control. With a ≈28% improvement in the sample efficiency, RLDA framework lays the way towards increased adoption of DRL-based intelligent control in real-world building energy management systems.

Kurte, Kuldeep↗
DOE OSTI2022

A Data-Driven Algorithm for Enabling Delay Tolerance in Resilient Microgrid Controls Using Dynamic Mode Decomposition

The increased implementation of smart grid technologies in the power distribution grid presents unique opportunities that enable resiliency, but also brings challenges motivating needs for novel solutions and mitigation techniques. The bi-directional power and data flow allow for the grid to operate with increased resiliency, which is the ability to avoid discontinuity of service to end-use loads during extreme events. However, in applications where control of the distribution grid or microgrid relies on communication networks, the degradation of communication systems in the form of loss or high latency can cause maloperation and result in loss of end-use loads. Here this paper presents a novel framework to enable delay tolerance of centralized microgrid control schemes to mitigate communication system latency impacts and guarantee successful control action. We demonstrate the delay tolerance on a control scheme that operates a battery energy storage system (BESS) to offset the sudden loss of generation and maintain system frequency. During periods of severely degraded communication system performance, the proposed delay-tolerant algorithm compensates for the latency by utilizing a data-driven model generated at the device level using dynamic mode decomposition (DMD) to determine the performance of the communications. The DMD technique predicts the system’s frequency using device-level terminal measurements and provides updated control signals. The HELICS cosimulation platform evaluates the cyber-physical interaction of the power system model in GridLAB-D, the centralized control agent in Python, and the discrete network model in NS-3. The framework is tested and validated on the IEEE-123 node system modified to represent a networked remote microgrid model, and the results show an improvement in the dynamic performance

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Nuclear microreactor transient and load-following control with deep reinforcement learning

The economic feasibility of nuclear microreactors will depend on minimizing operating costs through advancements in autonomous control, especially when these microreactors are operating alongside other types of energy systems (e.g., renewable energy). This study explores the application of deep reinforcement learning (RL) for real-time drum control in microreactors, exploring performance in regard to load-following scenarios. By leveraging a point kinetics model with thermal and xenon feedback, we first establish a baseline using a single-output RL agent, then compare it against a traditional proportional–integral–derivative (PID) controller. This study demonstrates that RL controllers, including both single- and multi-agent RL (MARL) frameworks, can achieve similar or even superior load-following performance as traditional PID control across a range of load-following scenarios. In short transients, the RL agent was able to reduce the tracking error rate in comparison to PID by one half to one third. Over extended 300-minute load-following scenarios in which xenon feedback becomes a dominant factor, PID maintained better accuracy, but RL still remained within a 1% error margin despite being trained only on short-duration scenarios. This highlights RL’s strong ability to generalize and extrapolate to longer, more complex transients, affording substantial reductions in training costs and reduced overfitting. Furthermore, when control was extended to multiple drums, MARL enabled independent drum control as well as maintained reactor symmetry constraints without sacrificing performance---an objective that standard single-agent RL could not learn. We also found that, as increasing levels of Gaussian noise were added to the power measurements, the RL controllers were able to maintain lower error rates than PID, and to do so with at least 10% and upwards of 150% less control effort. These findings illustrate RL's potential for autonomous nuclear reactor control, laying the groundwork for future integration into high-fidelity simulations and experimental validation efforts.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Tuning transition metal nanoparticles on a non-traditional support via experimental design

The ability to control metal nanoparticle size and morphology on supported catalysts is crucial for optimizing catalytic performance in targeted applications. Here, this work presents a systematic approach for tuning Ni particle and crystallite size on an unconventional, low-porosity silica fume support through select thermal treatments. The catalyst was synthesized via the deposition of nickelocene onto silica fume, resulting in well-dispersed Ni nanoparticles. A face-centered central composite design was employed to systematically assess the effects of time, temperature, and sintering gas environment on metal particle growth. The results demonstrate that the sintering gas environment is the primary factor governing particle and crystallite evolution, with temperature as the next most significant influence. Nickel nanoparticles sintered at temperatures of 650 °C and above under inert conditions exhibited substantial growth and polycrystalline structures, whereas samples treated in oxidative environments formed NiO, restricting particle mobility. Minimally oxidative (500 ppm O₂) environments facilitated rapid sintering while effectively removing residual ligands from the one-step nickelocene deposition process. Extensive structural characterization via a combination of scanning transmission electron microscopy, X-ray diffraction, hydrogen temperature programmed reduction, and small-angle X-ray scattering revealed that oxidative treatments enhanced metal-support interactions, as evidenced by increased reduction temperatures and narrower particle size distributions. These findings establish quantitative relationships between sintering parameters and Ni nanoparticle characteristics, providing a framework for rational catalyst design through controlled thermal treatments. This methodology is broadly applicable to other catalytic systems and provides a quantitative foundation for catalyst design.

CVD↗
DOE OSTI2021

CPS Testbed Architectures for WAMPAC using Industrial Substation and Control Center Platforms and Attack-Defense Evaluation

Advanced persistent threats and cyberattacks can impact wide-area monitoring, protection, and control (WAMPAC) system operation. Many cyber-physical system (CPS) testbeds have been developed for attack-defense experimentation and attack-resiliency tools evaluation for WAMPAC, but they are limited to a simulation-and-emulation based environment. This paper presents a quasi-realistic CPS attack-defense testbed-based framework for WAMPAC applications using the industrial substation and control center platforms such as eTerra integrated with the hardware-in-the-loop CPS smart grid testbed available at Iowa State University. The proposed framework includes various combinations of industry-grade substation and control center platforms, communication topologies, real-time digital simulators, and a novel cyber-physical distributed intrusion-and-anomaly detection system (D-IADS) for WAMPAC applications. The D-IADS includes a master at the control center and geographically distributed sensor devices at each substation. Each D-IADS sensor deployed at a substation or control center network monitors ingress and egress traffic, detect intrusions, and dispatch alerts to the D-IADS master. The D-IADS master centrally monitors and analyze the alerts and controls D-IADS sensors. We considered an EMP60 synthetic CPS grid as a case study to demonstrate the framework and proposed D-IADS for WAMPAC applications against cyberattack vectors such as Man-in-the-Middle DNP3 attack, denial-of-service, and data-integrity attacks.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Autonomous Closed-Loop Experimental Characterization and Dynamic Model Validation of a Scaled Underwater Kite

This paper presents the closed-loop experimental framework and dynamic model validation for a 1/12-scale underwater kite design. The pool-based tow testing framework described herein, which involves a fully actuated, closed-loop controlled kite and flexible tether, significantly expands upon the capabilities of any previously developed open-source framework for experimental underwater kite characterization. Specifically, the framework has allowed for the validation of three closed-loop flight control strategies, along with a critical comparison between dynamic model predictions and experimental results. In this paper, we provide a detailed presentation of the experimental tow system and kite setup, describe the control algorithms implemented and tested, and quantify the level of agreement between our multi-degree-of-freedom kite dynamic model and experimental data. Finally, we also present a sensitivity analysis that helps to identify the most influential parameters to kite performance and further explain the remaining mismatches between the model and data.

42 ENGINEERING↗
DOE OSTI2026

Safe Deep Reinforcement Learning for Active Distribution System Model Predictive Control with EVs and DERs

The temporal and spatial mismatch between PV generation and electric vehicle (EV) charging and discharging may cause voltage violations in active distribution networks. Despite the widespread use of deep reinforcement learning (DRL) in power system optimization and control, it lacks guarantees on constraint satisfaction during both training and deployment. This paper proposes a Lagrangian-based safe DRL approach for model predictive control (MPC) of active distribution systems with large-scale integration of PVs, EVs, and energy storage systems (ESSs). A Transformer-LSTM time-series model is proposed to forecast EV charging demand, which is then formulated as a constraint to ensure charging requirements are met. Using this prediction, a Lagrangian-based safe soft actor-critic (SAC) framework is developed for real-time control in a three-phase unbalanced distribution system, enforcing voltage safety constraints while optimizing the cumulative net reward. By integrating the forecasting model with multi-period constraints, the proposed framework jointly coordinates PV systems, EV charging and discharging, and ESS scheduling within the MPC horizon. Numerical experiments on a modified IEEE 123-bus system with real-world data show that, under a high PV penetration scenario, the proposed method increases the net reward by 30.74% and reduces average voltage violations from 0.0011 p.u. to 0.0002 p.u. compared with standard SAC. Compared with the optimal power flow (OPF) approach, it achieves similar voltage security while yielding lower line losses. It also maintains real-time control capability, reducing operation latency to 53.21 ms per 15-minute control interval. The proposed method remains effective under varying PV/EV penetrations and load conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Defect Termination in the UiO-66 Family of Metal–Organic Frameworks: The Role of Water and Modulator

The defect concentration in the prototypical metal–organic framework UiO-66 can be well controlled during synthesis, leading to precisely tunable physicochemical properties for this structure. However, there has been a long-standing debate regarding the nature of the compensating species present at the defective sites. Here, we present unambiguous spectroscopic evidence that the missing-linker defect sites in an ambient environment are compensated with both carboxylate and water (bound through intermolecular hydrogen bonding), which is further supported by ab initio calculations. In contrast to the prevailing assumption that the monocarboxylate groups (COO – ) of the modulators form bidentate bonding with two Zr 4+ sites, COO – is found to coordinate to an open Zr 4+ site in an unidentate mode. The neighboring Zr 4+ site is terminated by a coordinating H 2 O molecule, which helps to stabilize the COO – group. Lastly, this finding not only provides a new understanding of defect termination in UiO-66, but also sheds light on the origin of its catalytic activity.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Impedance Emulation Control of Wave Energy Converters

Modeling and control of wave energy conversion (WEC) systems for maximum power extraction is challenging due to complex multiphysics that include fluids, mechanics, and machine drives. To uncover an intuitive model that clearly depicts WEC system operation, we utilize a force-current equivalent circuit framework which then enables us to design an impedance emulation control strategy. To provide context for our framework, we focus on a standard reference model-3 (RM3) point absorber device coupled to a permanent magnet synchronous generator. After the proposed extremum seeking controller is computed, we experimentally validate its performance on a platform that consists of two back-to-back connected inverters that emulate the WEC system.

wave energy conversion, impedance emulation, machi↗
DOE OSTI2020

Thermally Activated Adsorption in Metal–Organic Frameworks with a Temperature‐Tunable Diffusion Barrier Layer

Abstract Modification of the external surfaces of metal–organic frameworks offers a new level of control over their adsorption behavior. It was previously shown that capping of MOFs with ethylenediamine (EDA) can effectively retain small gaseous molecules at room temperature. Reported here is a temperature‐induced variation in the capping‐layer gate‐opening mechanism through a combination of in situ infared experiments and ab initio simulations of the capping layer. An atypical acceleration and increase in the loading of weakly adsorbed molecules upon raising the temperature above room temperature is observed. These findings show the discovery of novel temperature‐dependent kinetics that goes beyond standard kinetics and suggest a new avenue for tailoring selective adsorption by thermally tuning the surface barrier.

Tan, Kui↗
DOE OSTI2020

Thermally activated adsorption in metal–organic frameworks with a temperature–tunable diffusion barrier layer

Modification of the external surfaces of metal organic frameworks offers a new level of control over their adsorption behavior. Here, we have previously shown that capping of MOFs with ethylenediamine (EDA) can effectively retain small gaseous molecules at room temperature. Here, we report a temperature–induced variation in the capping–layer gate opening mechanism through a combination of in situ IR experiments and ab initio simulations of the capping layer. We find an atypical acceleration and increase in the loading of weakly adsorbed molecules upon raising the temperature above room temperature. Our findings show the discovery of a novel temperature–dependent kinetics that goes beyond standard kinetics and suggest a new avenue for tailoring selective adsorption by thermally tuning the surface barrier.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗