Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Predictive Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Offline Arterial Signal Timing Optimization based on Virtual Phase Link Model - A Real-world Case Study

Conventional signal timing for arterial usually takes bottom-up approaches. Engineers optimize each individual intersection first and then coordinate them by adjusting the offsets. This work is based on the Virtual Phase-Link (VPL) model, a street traffic model designed for online traffic model predictive control, to obtain a top-down offline arterial signal timing. We Studied the Shallowford Rd. in Chattanooga, TN and found that the inconsistency in intersection capacities along the arterial could lead to some intersections becoming bottlenecks. Signal timing is a significant factor that affect the intersection capacities. We realized that the VPL-based model can guarantee the consistency in intersections along an arterial. We therefore adopted the VPL-based model and developed an offline signal timing optimization approach. The proposed timing derived from the VPL-based offline signal timing optimization showed very good results in simulation. The Chattanooga Department of Transportation adopted the optimized timing obtained from the proposed approach and gave positive feedbacks to the research team. We also collected field experiment data, which demonstrated overall energy reductions and speed improvements on some sections of the Shallowford Rd. arterial. We will continue the experiment when the COVID-19 pandemic impact subsides to have a more robust quantitative evaluation.

Wang, Qichao↗
DOE OSTI2020

Cutting the Deployment Costs of Physics-Based MPC in Buildings by Simulation-Based Imitation Learning

It has been shown that model predictive control (MPC) is a promising solution for energy-efficient building operations. However, the deployment of MPC in a large portion of the building stock has not been possible partially because of high installation costs. Every building is unique and requires a tailored MPC solution. The best performing solutions are often based on physics-based modeling, which is, however, computationally expensive and requires dedicated software. A promising direction that tackles this problem is to train a neural network-based optimal control policy to imitate the behavior of physics-based MPC from the simulation data generated offline. The neural networks give control actions that closely approximate those produced by physics-based MPC, but with a fraction of the computational and memory requirements and without the need for licensed software. The main advantage of the proposed approach stems from simple evaluation at execution time, leading to low computational footprints and easy deployment on embedded HW platforms. In the case study, we present the energy savings potential of physics-based MPC applied to an office building in Belgium. We demonstrate how neural network approximators can be used to cut the implementation and maintenance costs of MPC deployment without compromising performance. We also critically assess the presented approach by pointing out the remaining challenges and open research questions.

Drgona, Jan↗
DOE OSTI2022

Real-Time Ecodriving Control in Electrified Connected and Autonomous Vehicles Using Approximate Dynamic Programing

Connected and automated vehicles (CAVs), particularly those with a hybrid electric powertrain, have the potential to significantly improve vehicle energy savings in real-world driving conditions. In particular, the ecodriving problem seeks to design optimal speed and power usage profiles based on available information from connectivity and advanced mapping features to minimize the fuel consumption over an itinerary. This paper presents a hierarchical multilayer model predictive control (MPC) approach for improving the fuel economy of a 48 V mild-hybrid powertrain in a connected vehicle environment. Approximate dynamic programing (DP) is used to solve the receding horizon optimal control problem, whose terminal cost is approximated with the base policy obtained from the long-term optimization. The controller was tested virtually (with deterministic and Monte Carlo simulation) across multiple real-world routes, demonstrating energy savings of more than 20%. The controller was then deployed on a test vehicle equipped with a rapid prototyping embedded controller. In-vehicle testing confirm the energy savings obtained in simulation and demonstrate the real-time ability of the controller.

Automation & Control Systems↗
NASA NTRSDate not supplied

Adaptive Optimization for System Performance and Combined Bernstein Polynomial, Optimal Reciprocal Collision Avoidance, Differential Dynamic Programming for Trajectory Replanning and Collision Avoidance for UAM Vehicles

The emerging urban air mobility (UAM) sector in aerospace is driving development of unconventional multi-modal vehicle configurations and autonomous flight. The combination of multi-modal vehicle dynamics, complex environment, requirements to deal with flight contingencies in an efficient and safe manner, as well as necessity for precise trajectory following and performance, are the driving influence behind adaptive optimization for system performance. We are interested in trajectory optimization algorithm that would system parameter estimation and identifying the optimal switching time between modes of hybrid dynamical systems. This presentation discusses a parameterized optimal control trajectory optimization algorithm that is an extended and generalized version of Differential Dynamic Programming (DDP), titled Parameterized Differential Dynamic Programming (PDDP). DDP is an efficient trajectory optimization algorithm relying on second order approximations of a system’s dynamics and cost function and has recently been applied to optimize systems with time invariant parameters. Experiments are presented applying PDDP to solve model predictive control (MPC) and moving horizon estimation (MHE) tasks simultaneously. In particular, PDDP is used to determine the optimal transition point between flight regimes of a complex urban air mobility (UAM) class vehicle exhibiting multiple phases of flight and to identify and compensate for actuation faults.

optimization↗
NASA NTRS1987

Controls-structures-electromagnetics interaction program

A technology development program is described involving Controls Structures Electromagnetics Interaction (CSEI) for large space structures. The CSEI program was developed as part of the continuing effort following the successful kinematic deployment and RF tests of the 15 meter Hoop/Column antenna. One lesson learned was the importance of making reflector surface adjustment after fabrication and deployment. Given are program objectives, ground based test configuration, Intelsat adaptive feed, reflector shape prediction model, control experiment concepts, master schedule, and Control Of Flexible Structures-II (COFS-II) baseline configuration.

Grantham, William L.↗
DOE OSTI2023

Cold Climate Integrated Heat Pump with Energy Storage for Grid-Responsive Control

An air-source integrated heat pump (ASIHP) is a multifunctional unit, capable of space cooling, space heating, and water heating. We developed a packaged cold climate ASIHP, using a multi-stage compressor, capable of working down to -25°C, and providing 100% rated capacity down to -15°C with a heating COP > 2.2. An innovative system configuration and related controls were developed to solve charge balance in the integrated heat pump, smooth charge migration, and mode transition among multiple working modes. Extensive laboratory investigations for individual modes were performed to verify the performance. Its integrated heating capability provides speedy water heating to meet domestic hot water use and store heating energy in a phase change material ceiling/panel. The heating energy storage can be used to shift the load when the electricity price is high. Based on the performance data and a calibrated model from the laboratory testing, we conducted building energy simulations driven by a model predictive control, using EnergyPlus in one U.S. cold climate zone to investigate the grid-responsive control strategy and estimate the utility cost reduction potential.

Shen, Bo↗
NASA NTRS2010

Reactive Collision Avoidance Algorithm

The reactive collision avoidance (RCA) algorithm allows a spacecraft to find a fuel-optimal trajectory for avoiding an arbitrary number of colliding spacecraft in real time while accounting for acceleration limits. In addition to spacecraft, the technology can be used for vehicles that can accelerate in any direction, such as helicopters and submersibles. In contrast to existing, passive algorithms that simultaneously design trajectories for a cluster of vehicles working to achieve a common goal, RCA is implemented onboard spacecraft only when an imminent collision is detected, and then plans a collision avoidance maneuver for only that host vehicle, thus preventing a collision in an off-nominal situation for which passive algorithms cannot. An example scenario for such a situation might be when a spacecraft in the cluster is approaching another one, but enters safe mode and begins to drift. Functionally, the RCA detects colliding spacecraft, plans an evasion trajectory by solving the Evasion Trajectory Problem (ETP), and then recovers after the collision is avoided. A direct optimization approach was used to develop the algorithm so it can run in real time. In this innovation, a parameterized class of avoidance trajectories is specified, and then the optimal trajectory is found by searching over the parameters. The class of trajectories is selected as bang-off-bang as motivated by optimal control theory. That is, an avoiding spacecraft first applies full acceleration in a constant direction, then coasts, and finally applies full acceleration to stop. The parameter optimization problem can be solved offline and stored as a look-up table of values. Using a look-up table allows the algorithm to run in real time. Given a colliding spacecraft, the properties of the collision geometry serve as indices of the look-up table that gives the optimal trajectory. For multiple colliding spacecraft, the set of trajectories that avoid all spacecraft is rapidly searched on-line. The optimal avoidance trajectory is implemented as a receding-horizon model predictive control law. Therefore, at each time step, the optimal avoidance trajectory is found and the first time step of its acceleration is applied. At the next time step of the control computer, the problem is re-solved and the new first time step is again applied. This continual updating allows the RCA algorithm to adapt to a colliding spacecraft that is making erratic course changes.

Scharf, Daniel↗
DOE OSTI2023

Adaptive Cyber-Physical Resilience for Building Control Systems

The main goal of the project is to develop an AI-based process layer cybersecurity suite for detection, isolation and mitigation of cyber-attack effects on operation of building energy management systems (BEMS). The following constituent key technologies were developed under the program towards fulfilling the program objectives: (1) developed a high fidelity BEMS testbed for generation of training data and validation of developed technologies; (2) developed a physics informed ML based attack detection and localization module (ADL) capable of detecting high impact stealthy attacks (HISA - attacks causing 30% energy utilization but no immediate visible impact otherwise) with 98% accuracy; (3) developed a methodology to determine ’representative days’ to limit the data required for training; (4) developed a virtual sensing system that can reconstruct affected sensors with 10% error for the same HISA set; (5) developed a resilient model predictive control system that can continue operation of the BEMS without jeopardizing stability for the HISA set; and (6) integrated and deployed all the constituent modules and demonstrated the efficacy of the technology in real-time in a hardware in loop simulation.

42 ENGINEERING↗
DOE OSTI2022

Seamlessly Fuel Flexible Heat Pump with Optimal Model-based Control Strategies to Reduce Peak Demand, Utility Cost and CO2 Emission

This research develops a novel hybrid fuel heat pump system for space heating of residential and small commercial buildings with built-in optimization and control. Whereas conventional dual fuel systems either run on gas or electricity at any given moment, the proposed seamlessly fuel flexible heat pump (SFFHP) simultaneously consumes gas and electricity and continuously optimizes the proportion of each. The building air flows across the heat pump condenser first and then flows across the furnace coil, and this reduces the heat pump temperature lift. The SFFHP delivers energy savings by allowing each subsystem (gas furnace and electric heat pump) to operate where it performs best to improve energy efficiency, minimize energy cost, and minimize carbon footprint. The capacities of the electric heat pump and gas furnace are continuously adjusted based on ambient conditions, utility price signals, and marginal grid emission signals. An optimal model predictive control strategy was developed with the goal of minimizing utility cost and minimizing CO2 emission. Two case studies were conducted to simulate the performance of SFFHP during the heating season in Chicago and Los Angeles, respectively. Compared with a conventional electric heat pump, SFFHP yields 33% utility cost reduction and 49% CO2 emission reduction in Chicago. Similarly, it achieves 23% utility cost reduction and 17% CO2 emission reduction in Los Angeles. Case studies demonstrate that SFFHP can deliver significant reductions in peak demand, utility cost, and CO2 emission. Due to the hybrid fuel nature of this novel equipment, user comfort will always be maintained. The fuel flexibility makes it an attractive option for demand response programs.

Li, Zhenning↗
NASA NTRS2018

Piloted Simulator Evaluation Results of Flight Physics Based Stall Recovery Guidance

In recent studies, it has been observed that loss of control in flight is the most frequent primary cause of accidents. A significant share of accidents in this category can be remedied by upset prevention if possible, and by upset recovery if necessary, in this order of priorities. One of the most important upsets to be recovered from is stall. Recent accidents have shown that a correct stall recovery maneuver remains a big challenge in civil aviation, partly due to a lack of pilot training. A possible strategy to support the flight crew in this demanding context is calculating a recovery guidance signal, and showing this signal in an intuitive way on one of the cockpit displays, for example by means of the flight director. Different methods for calculating the recovery signal, one based on fast model predictive control and another using an energy based approach, have been evaluated in four relevant operational scenarios by experienced commercial as well as test pilots in the Vertical Motion Simulator at NASA Ames Research Center. Evaluation results show that this approach could be able to assist the pilots in executing a correct stall recovery maneuver.

Lombaerts, Thomas↗
DOE OSTI2020

Quantification of Load Flexibility in Residential Buildings Using Home Energy Management Systems

With increasing penetration of renewable energy resources, the flexibility of operating behind-the-meter (BTM) resources plays a key role in enhancing grid reliability and resilience. Residential buildings with home energy management systems (HEMS) can provide desired flexibility for the distribution system operator (DSO) while considering customer comfort and preferences. This paper discusses a methodology to quantify the flexibility of BTM resources of residential buildings using HEMS. First, we propose a model predictive control framework to formulate the flexibility band comprising nominal, upper, and lower demand profiles. Second, the paper proposes a dispatch method for HEMS to compute the control signals for each BTM resource (e.g., air conditioner, water heater, home battery system) upon receiving a flexibility service request from the DSO. The case study provides insight into the flexibility provided at the whole-home level with different user preferences and seasons. The results demonstrate that HEMS is capable of providing flexibility service at the request of the DSO while delivering primary services to the building occupants.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2022

Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement Learning

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency control to maintain system reliability and security. Towards this end, great progress has been made in developing deep reinforcement learning (DRL) based grid control solutions in recent years. However, existing DRL-based solutions have two main limitations: 1) they cannot handle well with a wide range of grid operation conditions, system parameters, and contingencies; 2) they generally lack the ability to fast adapt to new grid operation conditions, system parameters, and contingencies, limiting their applicability for real-world applications. Here, in this paper, we mitigate these limitations by developing a novel deep meta-reinforcement learning (DMRL) algorithm. The DMRL combines the meta strategy optimization together with DRL, and trains policies modulated by a latent space that can quickly adapt to new scenarios. We test the developed DMRL algorithm on the IEEE 300-bus system. We demonstrate fast adaptation of the meta-trained DRL polices with latent variables to new operating conditions and scenarios using the proposed method, which achieves superior performance compared to the state-of-the-art DRL and model predictive control (MPC) methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Deep Reinforcement Learning for Autonomous Water Heater Control

Electric water heaters represent 14% of the electricity consumption in residential buildings. An average household in the United States (U.S.) spends about USD 400–600 (0.45 ¢/L–0.68 ¢/L) on water heating every year. In this context, water heaters are often considered as a valuable asset for Demand Response (DR) and building energy management system (BEMS) applications. To this end, this study proposes a model-free deep reinforcement learning (RL) approach that aims to minimize the electricity cost of a water heater under a time-of-use (TOU) electricity pricing policy by only using standard DR commands. In this approach, a set of RL agents, with different look ahead periods, were trained using the deep Q-networks (DQN) algorithm and their performance was tested on an unseen pair of price and hot water usage profiles. The testing results showed that the RL agents can help save electricity cost in the range of 19% to 35% compared to the baseline operation without causing any discomfort to end users. Additionally, the RL agents outperformed rule-based and model predictive control (MPC)-based controllers and achieved comparable performance to optimization-based control.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Optimal Control of an Oscillating Surge Wave Energy Converter

During this project, we experimentally investigated the hydrodynamics and performance of a laboratory-scale oscillating surge wave energy converter (OSWEC).We looked at how flap buoyancy and driveline losses (primarily in the form of stiction) affected the dynamics and performance of the device. In addition, we assessed the influence of flap profile (rounded vs. square edges) on OSWEC hydrodynamics. Through this, we were able to develop a deeper understanding of OSWEC performance and provide guidance on strategies to counteract artifacts that may be present in laboratory models, but are absent in field-scale devices. To do this, we tested a laboratory-scale OSWEC in the Sea Wave Environmental Lab (SWEL) wave tank at the National Renewable Energy Laboratory (NREL). We ran several types of experiments to investigate the hydrodynamics and performance of the device. Overall, we achieved the overall goal of experimentally investigating the hydrodynamics and performance of this device. We discovered important and unexpected trends in performance, and collected time-resolved data to help us further investigate the underlying hydrodynamics responsible for these trends. In addition, we are currently using the time-resolved data from these experiments to build data-driven models of the dynamics, which can in turn be used to inform data-driven model predictive control of this device and address this objective in the future.

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

A Robust Data-Driven Approach for Mechanical Serial Sectioning

Mechanical serial sectioning (MSS) provides detailed microstructural information across large length scales. By repeatedly removing thin layers of material and imaging the exposed surface, a 3D representation of a specimen’s internal structure can be constructed, enabling failure analysis and feature identification that are otherwise inaccessible via conventional 2D or nondestructive evaluation techniques. Achieving consistent and accurate material removal can be challenging due to system variability, requiring an experienced operator to manually adjust parameters, prolonging data collection times and necessitating post-processing routines to standardize the data. Here, to address these challenges, this paper presents the employment of a one-step model predictive control (MPC) framework tailored to a run-to-run (R2R) controller. The R2R-MPC controller automates the parameter selection process, improving the consistency of material removal through iterative feedback for disturbance rejection and accurate tracking of the target removal rate. Using a data-driven approach, the controller robustly adapts to changing material characteristics. The effectiveness of the R2R-MPC controller is demonstrated through simulation and experimental results and compared to previous data collection procedures.

3D Materials Science↗
DOE OSTI2024

Machine learning models of intermittent operation of RO wellhead water treatment for salinity reduction and nitrate removal

Machine learning models were developed for intermittent multi-mode operation of a wellhead reverse osmosis water purification and desalination system to predict salt passage, nitrate passage, and permeate flux. The models, based on long short-term memory (LSTM) recurrent neural network (RNN) architecture, included an attention mechanism to increase model performance in proximity of the regulatory limit for nitrate. Training and testing of the models for the Startup, Production, Shutdown and Flushing operational modes were based on operational data (consisting of 22 process variables per data sample) acquired every 2–5 s over a six-month period. The significant sets of model input attributes for the different operational modes were assessed via Spearman ranking correlation, Self-Organizing Map (SOM) analysis and feed forward feature selection (FFFS). Although the variability of nitrate passage, salt passage and permeate flux was significant over the four operational modes, prediction performance for the three outcomes were with R2 and Average Absolute Relative Error (AARE) of 0.78–0.95 and 2.96–6.16 %, respectively. Model updates post membrane elements replacement demonstrated similar levels of prediction accuracy. The study results suggest that there is merit in exploring the utility of multi-mode models for sensor fault detection, data imputation, and for potential use in model-predictive control.

Intermittent RO operation↗
DOE OSTI2021

Impact of Controlled Storage Conditions on the Hydrolysis and Surface Morphology of Amorphous-UO 3

The hydration and morphological effects of amorphous (A)-UO 3 following storage under varying temperature and relative humidity have been investigated. This study provides valuable insight into U-oxide speciation following aging, the U-oxide quantitative morphological data set, and, overall, the characterization of nuclear material provenance. A-UO 3 was synthesized via the washed uranyl peroxide synthetic route and aged based on a 3-factor circumscribed central composite design of experiment. Target aging times include 2.57, 7.00, 14.0, 21.0, and 25.4 days, temperatures of 5.51, 15.0, 30.0, 45.0, and 54.5 °C, and relative humidities of 14.2, 30.0, 55.0, 80.0, and 95.8% were examined. Following aging, crystallographic changes were quantified via powder X-ray diffraction and an internal standard Rietveld refinement method was used to confirm the hydration of A-UO 3 to crystalline schoepite phases. The particle morphology from scanning electron microscopy images was quantified using both the Morphological Analysis of MAterials software and machine learning. Results from the machine learning were processed via agglomerative hierarchical clustering analysis to distinguish trends in morphological attributes from the aging study. Significantly hydrated samples were found to have a much larger, plate-like morphology in comparison to the unaged controls. Predictive modeling via a response surface methodology determined that while aging time, temperature, and relative humidity all have a quantifiable effect on A-UO 3 crystallographic and morphological changes, relative humidity has the most significant impact.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗