SEARCH · Engineering Papers

Results for “control framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

All sources NASA NTRS DOE OSTI

NASA NTRS1989

Integrated structure/control law design by multilevel optimization

A new approach to integrated structure/control law design based on multilevel optimization is presented. This new approach is applicable to aircraft and spacecraft and allows for the independent design of the structure and control law. Integration of the designs is achieved through use of an upper level coordination problem formulation within the multilevel optimization framework. The method requires the use of structure and control law design sensitivity information. A general multilevel structure/control law design problem formulation is given, and the use of Linear Quadratic Gaussian (LQG) control law design and design sensitivity methods within the formulation is illustrated. Results of three simple integrated structure/control law design examples are presented. These results show the capability of structure and control law design tradeoffs to improve controlled system performance within the multilevel approach.

Gilbert, Michael G.↗

NASA NTRS2002

The Design of Collectives of Agents to Control Non-Markovian Systems

The 'Collective Intelligence' (COIN) framework concerns the design of collectives of reinforcement-learning agents such that their interaction causes a provided 'world' utility function concerning the entire collective to be maximized. Previously, we applied that framework to scenarios involving Markovian dynamics where no re-evolution of the system from counter-factual initial conditions (an often expensive calculation) is permitted. This approach sets the individual utility function of each agent to be both aligned with the world utility, and at the same time, easy for the associated agents to optimize. Here we extend that approach to systems involving non-Markovian dynamics. In computer simulations, we compare our techniques with each other and with conventional-'team games'. We show whereas in team games performance often degrades badly with time, it steadily improves when our techniques are used. We also investigate situations where the system's dimensionality is effectively reduced. We show that this leads to difficulties in the agents' ability to learn. The implication is that 'learning' is a property only of high-enough dimensional systems.

Lawson, John W.↗

NASA NTRS2004

The Design of Collectives of Agents to Control Non-Markovian Systems

The Collective Intelligence (COIN) framework concerns the design of collectives of reinforcement-learning agents such that their interaction causes a provided "world" utility function concerning the entire collective to be maximized. Previously, we applied that framework to scenarios involving Markovian dynamics where no re-evolution of the system from counter-factual initial conditions (an often expensive calculation) is permitted. This approach sets the individual utility function of each agent to be both aligned with the world utility, and at the same time, easy for the associated agents to optimize. Here we extend that approach to systems involving non-Markovian dynamics. In computer simulations, we compare our techniques with each other and with conventional "team games". We show whereas in team games performance often degrades badly with time, it steadily improves when our techniques are used. We also investigate situations where the system's dimensionality is effectively reduced. We show that this leads to difficulties in the agents ability to learn. The implication is that learning is a property only of high-enough dimensional systems.

Lawson, John W.↗

NASA NTRS2014

Extending the Capabilities of Closed-loop Distributed Engine Control Simulations Using LAN Communication

Distributed Engine Control (DEC) is an enabling technology that has the potential to advance the state-of-the-art in gas turbine engine control. To analyze the capabilities that DEC offers, a Hardware-In-the-Loop (HIL) test bed is being developed at NASA Glenn Research Center. This test bed will support a systems-level analysis of control capabilities in closed-loop engine simulations. The structure of the HIL emulates a virtual test cell by implementing the operator functions, control system, and engine on three separate computers. This implementation increases the flexibility and extensibility of the HIL. Here, a method is discussed for implementing these interfaces by connecting the three platforms over a dedicated Local Area Network (LAN). This approach is verified using the Commercial Modular Aero-Propulsion System Simulation 40k (C-MAPSS40k), which is typically implemented on one computer. There are marginal differences between the results from simulation of the typical and the three-computer implementation. Additional analysis of the LAN network, including characterization of network load, packet drop, and latency, is presented. The three-computer setup supports the incorporation of complex control models and proprietary engine models into the HIL framework.

propulsion simulation↗

DOE OSTI2022

Optimising response to an introduction of African swine fever in wild pigs

African swine fever virus (ASFv) is a virulent pathogen that threatens domestic swine industries globally and persists in wild boar populations in some countries. Persistence in wild boar can challenge elimination and prevent disease-free status, making it necessary to address wild swine in proactive response plans. In the United States, invasive wild pigs are abundant and found across a wide range of ecological conditions that could drive different epidemiological dynamics among populations. Information on the size of the control areas required to rapidly eliminate the ASFv in wild pigs and how this area should change with management constraints and local ecology is needed to optimize response planning. We developed a spatially explicit disease transmission model contrasting wild pig movement and contact ecology in two ecosystems in Southeastern United States. We simulated ASFv spread and determined the optimal response area (reported as the radius of a circle) for eliminating ASFv rapidly over a range of detection times (when ASFv was detected relative to the true date of introduction), culling capacities (proportion of wild pigs in the culling zone removed weekly) and wild pig densities. Large radii for response areas (14 km) were needed under most conditions but could be shortened with early detection (≤ 8 weeks) and high culling capacities (≥ 15% weekly). Under most conditions, the ASFv was eliminated in less than 22 weeks using optimal control radii, although ecological conditions with high rates of wild pig movement required higher culling capacities (≥ 10% weekly) for elimination within 1 year. The results highlight the importance of adjusting response plans based on local ecology and show that wild pig movement is a better predictor of the optimal response area than the number of ASFv cases early in the outbreak trajectory. Furthermore, our framework provides a tool for determining optimal control plans in different areas, guiding expectations of response impacts, and planning resources needed for rapid elimination.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2026

Collaborative: Fundamental studies of how water influences the synthesis and behavior of zeolite catalysts for reactions in the circular carbon economy (Final Technical Report)

This project established a computational framework to predict and interpret how synthesis conditions control active site location in MFI zeolites and how those site distributions influence catalytic reactivity. The Hibbitts Group led the theoretical effort, applying periodic DFT calculations to quantify (i) SDA–framework–heteroatom interactions during crystallization and (ii) the energetics and mechanisms of arene methylation reactions within distinct MFI environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS2022

L1 Adaptive Control with Switched Reference Models: Application to Learn-to-Fly

Learn-to-Fly (L2F) is a new framework that aims to replace the traditional iterative development paradigm for aerial vehicles with a combination of real-time aerodynamic modeling, guidance, and learning control. To ensure safe learning of the vehicle dynamics on the fly, this paper presents an L1 adaptive control (L1AC) based scheme, which actively estimates and compensates for the discrepancy between the intermediately learned dynamics and the actual dynamics. First, to incorporate the periodic update of the learned model within the L2F framework, this paper extends the L1AC architecture to handle a switched reference system subject to unknown time-varying parameters and disturbances. The paper also includes analysis of both transient and steady-state performance of the L1AC architecture in the presence of non-zero initialization error for the state predictor. Second, the paper presents how the proposed L1AC scheme is integrated into the L2F framework, including its interaction with the baseline controller and the real-time modeling module. Finally, flight tests on an unmanned aerial vehicle (UAV) validate the efficacy of the proposed control and learning scheme.

Steven Snyder↗

DOE OSTI2025

Proposed Classifications of Remote Operations for Nuclear Reactors Based on Physical and Cybersecurity Considerations

The incorporation of remote operations into reactor operations is a topic of high interest among advanced and small modular reactor (A/SMR) vendors, with some considering it essential to the success of their business models. However, remote operations are a concept novel to the nuclear industry. While various technical aspects of remote operations have been explored, a significant gap remains in understanding the security implications of integrating remote operations into reactor designs, particularly concerning the security requirements for remote-operations facilities and infrastructure. This report aims to address this gap by first defining classes of remote operation based on the extent of remote access to reactor control systems and grounded in the existing regulatory framework with compatible terminology. Secondly, the report outlines the physical and cybersecurity requirements applicable to remote-operations facilities and infrastructure at each defined class. These requirements are based on existing licensing frameworks provided by 10 Code of Federal Regulations (CFR) Part 50 and 10 CFR Part 52, as well as the upcoming A/SMR licensing framework in the proposed Part 53. The assessment focuses specifically on security regulations, such as 10 CFR Part 73, which includes provisions for both cybersecurity (§ 73.54) and physical security (§ 73.55). This report proposes five classes of remote reactor operations. Class 1 involves remote monitoring only, with no control over reactor systems. Class 2 allows for the remote issuance of allowlisted commands to the reactor facility. Class 3 extends control to non-safety-significant, non-safety-related, or not important to safety systems and equipment. Class 4 permits remote control of safety-significant systems. Finally, Class 5 allows remote control of safety-related systems. It is important to note that these classes were defined purely with functionality in mind, without considering the practicality or feasibility of implementation for each class under current or upcoming regulatory guidance. The intention behind this approach is to enable an assessment of which security requirements apply to each class, allowing readers to evaluate the implementation possibilities for their specific use cases. Following the definition of remote-operation classes, the report assesses the specific physical and cybersecurity requirements applicable to the remote-operations facility and infrastructure within each defined class. This includes defining the types and locations of operators that are possible at each class of operation and, based on operator type and location, as well as functionality within each class, outlining the physical and cybersecurity requirements. By detailing the security requirements by class, the report provides readers with the information needed to determine the type of security program they may need to implement for their desired concept of operation. The next contribution of this report was to assess the practicality of implementing each proposed class of remote operations based upon the security requirement assessment. In short, three of the five proposed remote-operation classes were found to possibly have a practical path forward to implementation under the U.S. regulatory framework. Class 1 remote operations are currently in use in the U.S. while Class 2 and 3 remote operations may be logistically possible to implement under the U.S. regulatory framework. The final two Classes, 4 and 5, would likely be logistically difficult, if not infeasible to implement within the current U.S. physical- and cybersecurity regulatory framework. Given the results of the feasibility assessment, an example architecture is proposed for both Class 2, remote allowlisted commands, and Class 3, remote control of non-safety systems as well as security implication assessments of each architecture. These example implementations are not meant to be prescriptive in terms of how Class 2 or Class 3 remote operations should be deployed; instead, they are intended to be informative to stakeholders on how Class 2 or Class 3 could potentially be applied in order to inform their system design. An example architecture for Class 1 remote monitoring was not provided as Class 1 in already in use in U.S. nuclear operations. Example architectures for Class 4 and Class 5 were not provided due to their assessment of being likely infeasible to implement. The final contribution is an assessment of the physical- and cybersecurity implications of introducing autonomous operations into an A/SMR. What was found was that the security implications can be separated into two cases. Autonomous operations supported by SSCs located only at the reactor site, and autonomous operations supported by SSCs outside of the reactor site. For the first case, the introduction of autonomous systems will likely not change the facility’s requirement to comply with existing cyber and physical security regulation

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2024

Towards intelligent emergency control for large-scale power systems: Convergence of learning, physics, computing and control

Here, this paper has delved into the pressing need for intelligent emergency control in large-scale power systems, which are experiencing significant transformations and are operating closer to their limits with more uncertainties. Learning-based control methods are promising and have shown effectiveness for intelligent power system control. However, when they are applied to large-scale power systems, there are multifaceted challenges such as scalability, adaptiveness, and security posed by the complex power system landscape, which demand comprehensive solutions. The paper first proposes and instantiates a convergence framework for integrating power systems physics, machine learning, advanced computing, and grid control to realize intelligent grid control at a large scale. Our developed methods and platform based on the convergence framework have been applied to a large (more than 3000 buses) Texas power system, and tested with 56 000 scenarios. Our work achieved a 26% reduction in load shedding on average and outperformed existing rule-based control in 99.7% of the test scenarios. The results demonstrated the potential of the proposed convergence framework and DRL-based intelligent control for the future grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Reinforcement Learning‐Based Adaptation of Grid Following Inverter's Internal Controller to Networked Microgrids' Strengths

The varying topological configurations, generator commitments and dispatches, and dynamic load demand lead to changing system's strengths during the operations of networked microgrids. When the system's strengths significantly change, the fixed control gains at large devices may result in unsatisfactory system performance; this necessitates the tuning of the control gains at large devices to adapt to the changing system's strengths. In this paper, observer-based reinforcement learning (RL) is utilised to automatically tune the proportional-integral (PI) gains of phase lock loop (PLL) controller of grid-following (GFL) inverters to adapt to the changing strengths of microgrids and networked microgrids. The RL agent in this framework augments an observer predicting system's strengths, from which the RL control policy will adjust accordingly to tune the PLL controller's gains towards the system's strengths. Also, to enhance the control performance, the recently introduced Barrier function-based RL framework is leveraged for the design of reward function to prevent the high frequency nadir. An operational 26 kV electric distribution system, which is modelled as networked microgrids, is used to illustrate the need and effectiveness of the proposed RL-tuned control.

frequency response↗

DOE OSTI2025

Toward particle accelerator machine state embeddings as a modality for large language models

Understanding and diagnosing the state of a particle accelerator requires navigating high-dimensional control system data, often involving hundreds of interdependent parameters. We propose a novel multimodal embedding framework that jointly learns representations of machine states from both numerical control system readouts and natural language descriptions. This enables the translation of complex machine conditions into human-readable summaries while maintaining fidelity to the underlying physical system. The obtained embeddings are subsequently adapted to an open-weights large language model via cross-attention conditioning. We demonstrate a first implementation trained on European XFEL machine state data. This work covers the embedding model architecture, training methodology, and presents initial examples demonstrating the model's capabilities in action. Due to the general concept of machine state, the model can be easily adapted to other facilities and control system environments.

Accelerator Physics↗

NASA NTRS1992

Integrated health monitoring and controls for rocket engines

Current research in intelligent control systems at the Lewis Research Center is described in the context of a functional framework. The framework is applicable to a variety of reusable space propulsion systems for existing and future launch vehicles. It provides a 'road map' technology development to enable enhanced engine performance with increased reliability, durability, and maintainability. The framework hierarchy consists of a mission coordination level, a propulsion system coordination level, and an engine control level. Each level is described in the context of the Space Shuttle Main Engine. The concept of integrating diagnostics with control is discussed within the context of the functional framework. A distributed real time simulation testbed is used to realize and evaluate the functionalities in closed loop.

Merrill, W. C.↗

NASA NTRS1992

Integrated health monitoring and controls for rocket engines

Merrill, W. C.↗

NASA NTRS1987

A framework for real-time distributed expert systems: On-orbit spacecraft fault diagnosis, monitoring and control

Control of on-orbit operation of a spacecraft requires retention and application of special purpose, often unique, knowledge of equipment and procedures. Real-time distributed expert systems (RTDES) permit a modular approach to a complex application such as on-orbit spacecraft support. One aspect of a human-machine system that lends itself to the application of RTDES is the function of satellite/mission controllers - the next logical step toward the creation of truly autonomous spacecraft systems. This system application is described.

Mullikin, Richard L.↗

DOE OSTI2024

Beyond Price-Taker: Multiscale Optimization of a Wind-Battery Integrated Energy System within the Wholesale Electricity Market

This work presents the optimization of a wind-battery IES using the multiscale optimization framework proposed in our previous work to quantify errors from the price-taker assumption. The framework, built over Prescient (an open-source package for solving production cost models), is applied to the RTS-GMLC dataset, an open-source dataset that is representative of the southwest U.S. wholesale electricity market. The framework provides detailed bidding, market clearing, and control processes of an IES, and it can quantify how the IES interacts with the market. In this work, we use the retrofit of a wind farm with a battery storage system as an example to show the difference in the market outcomes and revenues obtained from both price-taker and multiscale optimization approaches. Our work goes beyond price-taker and deep dives into quantifying IES-market interaction in optimizing IES. This framework enables users to explore how different design and operation decisions of energy systems interact with the market and provides a more accurate evaluation than the price-taker assumption.

Chen, Xinhe↗

DOE OSTI2021

A Data-Driven Global Sensitivity Analysis Framework for Three-Phase Distribution System with PVs

Global sensitivity analysis (GSA) of distribution systems with respect to stochastic PV and load variations plays an important role in designing optimal voltage control schemes. This paper proposes a data-driven framework for GSA of distribution systems. In particular, two representative surrogate modeling-based approaches are developed, including the traditional Gaussian process-based and the analysis of variance (ANOVA) kernel ones. The key idea is to develop a surrogate model that captures the hidden global relationship between voltage and real and reactive power injections from the historical data. With the surrogate model, the Sobol indices can be conveniently calculated through either the sampling-based method or the analytical method to assess the global sensitivity of voltage to variations of PV and load power injections. The sampling-based method approximates the Sobol indices using Monte Carlo simulations while the analytical method calculates them by resorting to the ANOVA expansion framework. Comparison results with other model-based GSA methods on the unbalanced three-phase IEEE 37-bus and 123-bus distribution systems show that the proposed framework can achieve much higher computational efficiency with negligible loss of accuracy. The results on a real 240-node distribution system using actual smart meter data further validate the feasibility and scalability of the proposed framework.

14 SOLAR ENERGY↗

DOE OSTI2021

Distributed Wind Controls: A Research Roadmap for Microgrids, Infrastructure Resilience, and Controls Launchpad (MIRACL)

The Microgrids, Infrastructure Resilience, and Advanced Controls Launchpad (MIRACL) project’s controls research area aims to expand the benefits from distributed wind (DW) generation assets beyond solely providing low cost power directly to consumers. To make distributed wind turbines operate more effectively there is a need for more advanced ways to control them, allowing power companies, businesses, and energy consumers to take advantage of the unique characteristics of wind energy. DW can contribute to the safe and secure operation of grid by providing services such as voltage regulation, frequency regulation, spinning reserves, and even black start capabilities. In the larger DER context where much of the research has focused around solar technologies, the inertia available in wind technologies has generally not been considered. For wind turbines to provide these services in an optimal and expanded way, development and demonstration of control methods and communication interfaces within a grid and microgrid framework are required. In this document, NREL led the literature review in collaboration with SNL, of DER controls-focused integration research to establish a baseline for the controls research under the MIRACL project to identify specific control functions to be focused on throughout this project. This literature review focused primarily on the control functions of variable distributed generation, largely pulling from past solar PV and battery controls works, with a specific focus on applicability for distributed wind energy systems. The goal of this document is to identify a research roadmap based on the open literature and past national laboratory works to inform advanced wind turbine and power electronics control functions for four use cases: 1) distributed wind in isolated systems, 2) grid-connected microgrids (wind-hybrid systems and islanded operation), 3) behind-the-meter distributed wind applications in the power distribution systems, and 4) front-of-the-meter distributed wind applications in the power distribution systems.

17 WIND ENERGY↗

NASA NTRS1988

A reusable rocket engine intelligen control

An intelligent control system for reusable space propulsion systems for future launch vehicles is described. The system description includes a framework for the design. The framework consists of an execution level with high-speed control and diagnostics, and a coordination level which marries expert system concepts with traditional control. A comparison is made between air breathing and rocket engine control concepts to assess the relative levels of development and to determine the applicability of air breathing control concepts to future reusable rocket engine systems.

Merrill, Walter C.↗