Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “predictive control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Power System Frequency Dynamics Modeling, State Estimation, and Control using Neural Ordinary Differential Equations (NODEs) and Soft Actor-Critic (SAC) Machine Learning Approaches

With the global energy transition of the electric power system, grid control, supervision, and protection is becoming more challenging. With the increasing integration of renewable energy sources (RES), the system dynamics are changing, causing traditional power system dynamic modeling with swing equation-based modeling approaches to fail. Additionally, the converter-dominated power grid is decreasing the system inertia, making the power system more fragile to the frequency swings. This paper first investigates and compares the application of a model-based Kalman filter state estimation approach with (i) a model-free machine learning approach --- neural ordinary differential equations (NODEs) --- and (ii) a data-driven system identification (SysId) approach to model and infer critical state values of the power system frequency dynamics. Then a model predictive control (MPC) framework is compared to a model-free Soft Actor-Critic (SAC) reinforcement learning (RL) control algorithm in providing efficient fast frequency response (FFR) to the power system frequency dynamics. The approaches are compared in terms of their performance goals as well as their per-timestep computational efficiency. Furthermore, the comparative study for state estimation shows that for the model-free requirement, both NODEs and SysId can provide accurate state estimates; however, with increasing model complexity, NODEs can be a better choice for model identification. Similarly, the results from the FFR comparative study show that the SAC RL-based FFR, once trained, outperforms MPC with better control signals and faster computation time, making the SAC RL-based FFR better option for providing FFR to the power system.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Symmetry-breaking in patch formation on triangular gold nanoparticles by asymmetric polymer grafting

Synthesizing patchy particles with predictive control over patch size, shape, placement and number has been highly sought-after for nanoparticle assembly research, but is fraught with challenges. Here we show that polymers can be designed to selectively adsorb onto nanoparticle surfaces already partially coated by other chains to drive the formation of patchy nanoparticles with broken symmetry. In our model system of triangular gold nanoparticles and polystyrene-b-polyacrylic acid patch, single- and double-patch nanoparticles are produced at high yield. These asymmetric single-patch nanoparticles are shown to assemble into self-limited patch-patch connected bowties exhibiting intriguing plasmonic properties. To unveil the mechanism of symmetry-breaking patch formation, we develop a theory that accurately predicts our experimental observations at all scales—from patch patterning on nanoparticles, to the size/shape of the patches, to the particle assemblies driven by patch-patch interactions. Both the experimental strategy and theoretical prediction extend to nanoparticles of other shapes such as octahedra and bipyramids. Our work provides an approach to leverage polymer interactions with nanoscale curved surfaces for asymmetric grafting in nanomaterials engineering.

42 ENGINEERING↗
DOE OSTI2022

Seamlessly Fuel Flexible Heat Pump with Optimal Model-based Control Strategies to Reduce Peak Demand, Utility Cost and CO2 Emission

This research develops a novel hybrid fuel heat pump system for space heating of residential and small commercial buildings with built-in optimization and control. Whereas conventional dual fuel systems either run on gas or electricity at any given moment, the proposed seamlessly fuel flexible heat pump (SFFHP) simultaneously consumes gas and electricity and continuously optimizes the proportion of each. The building air flows across the heat pump condenser first and then flows across the furnace coil, and this reduces the heat pump temperature lift. The SFFHP delivers energy savings by allowing each subsystem (gas furnace and electric heat pump) to operate where it performs best to improve energy efficiency, minimize energy cost, and minimize carbon footprint. The capacities of the electric heat pump and gas furnace are continuously adjusted based on ambient conditions, utility price signals, and marginal grid emission signals. An optimal model predictive control strategy was developed with the goal of minimizing utility cost and minimizing CO2 emission. Two case studies were conducted to simulate the performance of SFFHP during the heating season in Chicago and Los Angeles, respectively. Compared with a conventional electric heat pump, SFFHP yields 33% utility cost reduction and 49% CO2 emission reduction in Chicago. Similarly, it achieves 23% utility cost reduction and 17% CO2 emission reduction in Los Angeles. Case studies demonstrate that SFFHP can deliver significant reductions in peak demand, utility cost, and CO2 emission. Due to the hybrid fuel nature of this novel equipment, user comfort will always be maintained. The fuel flexibility makes it an attractive option for demand response programs.

Li, Zhenning↗
DOE OSTI2021

Deep Reinforcement Learning for Autonomous Water Heater Control

Electric water heaters represent 14% of the electricity consumption in residential buildings. An average household in the United States (U.S.) spends about USD 400–600 (0.45 ¢/L–0.68 ¢/L) on water heating every year. In this context, water heaters are often considered as a valuable asset for Demand Response (DR) and building energy management system (BEMS) applications. To this end, this study proposes a model-free deep reinforcement learning (RL) approach that aims to minimize the electricity cost of a water heater under a time-of-use (TOU) electricity pricing policy by only using standard DR commands. In this approach, a set of RL agents, with different look ahead periods, were trained using the deep Q-networks (DQN) algorithm and their performance was tested on an unseen pair of price and hot water usage profiles. The testing results showed that the RL agents can help save electricity cost in the range of 19% to 35% compared to the baseline operation without causing any discomfort to end users. Additionally, the RL agents outperformed rule-based and model predictive control (MPC)-based controllers and achieved comparable performance to optimization-based control.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement Learning

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency control to maintain system reliability and security. Towards this end, great progress has been made in developing deep reinforcement learning (DRL) based grid control solutions in recent years. However, existing DRL-based solutions have two main limitations: 1) they cannot handle well with a wide range of grid operation conditions, system parameters, and contingencies; 2) they generally lack the ability to fast adapt to new grid operation conditions, system parameters, and contingencies, limiting their applicability for real-world applications. Here, in this paper, we mitigate these limitations by developing a novel deep meta-reinforcement learning (DMRL) algorithm. The DMRL combines the meta strategy optimization together with DRL, and trains policies modulated by a latent space that can quickly adapt to new scenarios. We test the developed DMRL algorithm on the IEEE 300-bus system. We demonstrate fast adaptation of the meta-trained DRL polices with latent variables to new operating conditions and scenarios using the proposed method, which achieves superior performance compared to the state-of-the-art DRL and model predictive control (MPC) methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Optimal Control of an Oscillating Surge Wave Energy Converter

During this project, we experimentally investigated the hydrodynamics and performance of a laboratory-scale oscillating surge wave energy converter (OSWEC).We looked at how flap buoyancy and driveline losses (primarily in the form of stiction) affected the dynamics and performance of the device. In addition, we assessed the influence of flap profile (rounded vs. square edges) on OSWEC hydrodynamics. Through this, we were able to develop a deeper understanding of OSWEC performance and provide guidance on strategies to counteract artifacts that may be present in laboratory models, but are absent in field-scale devices. To do this, we tested a laboratory-scale OSWEC in the Sea Wave Environmental Lab (SWEL) wave tank at the National Renewable Energy Laboratory (NREL). We ran several types of experiments to investigate the hydrodynamics and performance of the device. Overall, we achieved the overall goal of experimentally investigating the hydrodynamics and performance of this device. We discovered important and unexpected trends in performance, and collected time-resolved data to help us further investigate the underlying hydrodynamics responsible for these trends. In addition, we are currently using the time-resolved data from these experiments to build data-driven models of the dynamics, which can in turn be used to inform data-driven model predictive control of this device and address this objective in the future.

16 TIDAL AND WAVE POWER↗
DOE OSTI2022

Resolving Salt-Induced Agglomeration of Laponite Suspensions Using X-ray Photon Correlation Spectroscopy and Molecular Dynamics Simulations

Linking the physics of the relaxation behavior of viscoelastic fluids as they form arrested gel states to the underlying chemical changes is essential for developing predictive controls on the properties of the suspensions. In this study, 3 wt.% laponite suspensions are studied as model systems to probe the influence of salt-induced relaxation behavior arising from the assembly of laponite nanodisks. X-ray Photon Correlation Spectroscopy (XPCS) measurements show that laponite suspensions prepared in the presence of 5 mM concentrations of CaCl2, MgCl2 and CsCl salts accelerate the formation of arrested gel states, with CaCl2 having a significant impact followed by CsCl and MgCl2 salts. The competing effects of ion size and charge on relaxation behavior are noted. For example, the relaxation times of laponite suspensions in the presence of Mg2+ ions are slower compared to Cs+ ions despite the higher charge, suggesting that cation size dominates in this scenario. The faster relaxation behavior of laponite suspensions in the presence of Ca2+ ions compared to Cs+ ions shows that a higher charge dominates the size of the ion. The trends in relaxation behavior are consistent with the cluster formation behavior of laponite suspensions and the electrostatic interactions predicted from MD simulations. Charge balance is achieved by the intercalation of the cations at the negatively charged surfaces of laponite suspensions. These studies show that the arrested gel state of laponite suspensions is accelerated in the presence of salts, with ion sizes and charges having a competing effect on relaxation behavior.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Molecular concentration field design using closed-form steady-state solutions

Control over spatial concentration fields represents a fundamental challenge in designing synthetic biological systems and programmable soft materials. While nature creates morphogen gradients that orchestrate complex developmental processes, synthetic approaches have largely relied on empirical optimization and computationally intensive simulations. Here, we present an analytical framework for steady-state concentration fields generated by finite-sized localized sources in diffusion–degradation systems and derive closed-form solutions for one-, two-, and three-dimensional geometries. By expressing these solutions in dimensionless form, we show that gradient steepness and spatial structure are organized by the Thiele modulus, which captures the competition between diffusion and degradation length scales. The analysis reveals distinct design regimes: in degradation-dominated systems, gradient shape is governed by exponential decay and becomes dimension-independent, whereas in diffusion-dominated systems, gradient magnitude and extent follow dimension-dependent power-law scaling. Building on these results, we introduce a quantitative design strategy that uses threshold-based criteria to program concentration ranges by tuning physically accessible parameters, most directly the production rate, while holding transport and degradation properties fixed. Comparisons with numerical solutions and reported experimental systems demonstrate consistency with the predicted scaling behavior. Together, this work provides a generalizable and physically transparent framework for designing steady-state concentration fields in synthetic biological and soft matter systems, enabling predictive control of gradient-mediated organization without reliance on extensive numerical optimization.

Kim, Dong Woo [Johns Hopkins University, Baltimore↗
DOE OSTI2023

Deep generative models for vehicle speed trajectories

Generating realistic vehicle speed trajectories is a crucial component in evaluating vehicle fuel economy and in predictive control of self-driving cars. Traditional generative models rely on Markov chain methods and can produce accurate synthetic trajectories but are subject to the curse of dimensionality. They do not allow to include conditional input variables into the generation process. In this paper, we show how extensions to deep generative models allow accurate and scalable generation. Proposed architectures involve recurrent and feed-forward layers and are trained using adversarial techniques. Our models are shown to perform well on generating vehicle trajectories using a model trained on GPS data from Chicago metropolitan area.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Nonlinear multiobjective and dynamic real-time predictive optimization for optimal operation of baseload power plants under variable renewable energy

Considering the increase of disruptive variable renewable energy penetration into the power grid, this article focuses on the investigation of a multiobjective and dynamic real-time optimization framework to address the cycling of large-scale power plants under renewable penetration. In this framework, a parallelized particle swarm optimization step is first performed to generate feasible initial points. Then, a multiobjective and dynamic real-time optimization formulation generates optimal trajectories. Further, the benefit of predictive capability is investigated for the dynamic component, which introduces the novel nonlinear multiobjective and dynamic real-time predictive optimization approach. Two multiobjective formulations to obtain Pareto front optimal in real time are explored: the modified Tchebycheff-based weighted metric and ϵ-constraint methods. Economic and environmental objectives are considered in this study. A novel topical discussion on the intersection of dynamic real-time optimization with model predictive control is also presented. The developed framework is successfully applied to a baseload coal-fired power plant with postcombustion CO 2 capture. Results indicate that the approach can be deployed for a large-scale system if automatic differentiation, model reduction, and parallelization are adopted to improve computational tractability, with computational improvement up to 120-folds after performing these steps. Finally, market and carbon policies showed an impact on the optimal compromise between the objectives with an additional 63 ton of CO 2 captured under favorable market conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

A Robust Data-Driven Approach for Mechanical Serial Sectioning

Mechanical serial sectioning (MSS) provides detailed microstructural information across large length scales. By repeatedly removing thin layers of material and imaging the exposed surface, a 3D representation of a specimen’s internal structure can be constructed, enabling failure analysis and feature identification that are otherwise inaccessible via conventional 2D or nondestructive evaluation techniques. Achieving consistent and accurate material removal can be challenging due to system variability, requiring an experienced operator to manually adjust parameters, prolonging data collection times and necessitating post-processing routines to standardize the data. Here, to address these challenges, this paper presents the employment of a one-step model predictive control (MPC) framework tailored to a run-to-run (R2R) controller. The R2R-MPC controller automates the parameter selection process, improving the consistency of material removal through iterative feedback for disturbance rejection and accurate tracking of the target removal rate. Using a data-driven approach, the controller robustly adapts to changing material characteristics. The effectiveness of the R2R-MPC controller is demonstrated through simulation and experimental results and compared to previous data collection procedures.

3D Materials Science↗
DOE OSTI2025

Parallel derivative-free optimization for simulation-based design of behind-the-meter energy systems

In this work, the integrated design and dispatch of behind-the-meter or distributed resources (e.g. stationary battery storage and solar PV generation) is considered. A simulation-based framework is employed, generating high-fidelity results with closed-loop predictive control at a fine resolution, at the expense of high computational cost (several minutes to a few hours per design point). To address this challenge, parallel derivative-free design methods are considered. Four methods are compared, including state-of-the-art surrogate-based methods (Radial-Basis Functions and Gaussian processes) and sampling strategies, an evolutionary-based method, and a simple sequential grid refinement method. As a case study, two types of design problem with increasing complexity are considered, namely, the design of behind-the-meter resources (three design variables) and the inclusion of grid capacity (four design variables). The second yields a constrained design problem for which violations can only be determined after solving the computationally expensive simulation. For the three-dimensional case, all methods present a good performance, achieving a solution within 1% of the optimum after the first iteration, with the sequential grid refinement exhibiting the fastest convergence and achieving the best final objective value. This indicates that the parallel evaluation of multiple sampling points may be more important than the choice of method for small decision spaces. For the four-dimensional constrained case, the Genetic Algorithm presents the best tradeoff between performance and computational effort, while the rough objective function terrain generated by constraint violation penalties reduces the performance of surrogate-based methods. Contour plots with flat regions indicate flexibility in the optimal design and highlight the importance of characterizing the solution space.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Machine learning models of intermittent operation of RO wellhead water treatment for salinity reduction and nitrate removal

Machine learning models were developed for intermittent multi-mode operation of a wellhead reverse osmosis water purification and desalination system to predict salt passage, nitrate passage, and permeate flux. The models, based on long short-term memory (LSTM) recurrent neural network (RNN) architecture, included an attention mechanism to increase model performance in proximity of the regulatory limit for nitrate. Training and testing of the models for the Startup, Production, Shutdown and Flushing operational modes were based on operational data (consisting of 22 process variables per data sample) acquired every 2–5 s over a six-month period. The significant sets of model input attributes for the different operational modes were assessed via Spearman ranking correlation, Self-Organizing Map (SOM) analysis and feed forward feature selection (FFFS). Although the variability of nitrate passage, salt passage and permeate flux was significant over the four operational modes, prediction performance for the three outcomes were with R2 and Average Absolute Relative Error (AARE) of 0.78–0.95 and 2.96–6.16 %, respectively. Model updates post membrane elements replacement demonstrated similar levels of prediction accuracy. The study results suggest that there is merit in exploring the utility of multi-mode models for sensor fault detection, data imputation, and for potential use in model-predictive control.

Intermittent RO operation↗
DOE OSTI2021

A systematic solution to quantify economic values of vehicle grid integration

We report Vehicle-Grid-Integration (VGI) supplies one of the potential benefit extensions for electric vehicles (EVs) to make use of their parking time, which enables the EVs to provide grid services while still meeting consumer driving needs. However, the costs, benefits and risks of VGI still remain unclear, which limits the development of the VGI to promote the interaction between the EV and grid. In this study, we propose an integrated framework to quantify and utilize the aggregate flexibility of the EVs to supply the grid services in electricity markets. The integrated solution includes five sub-modules that cover end-to-end functionalities from individual EV energy consumption estimation to final monetary values calculation of providing grid services. Both wholesale market and local level charging management are formulated in the optimization module. A predictive control algorithm is proposed to allocate power to individual vehicles in real time, considering uncertainties from dispatch signal and travel behavior. Simulation results from 10,000 EVs indicate that the proposed optimization methods can significantly reduce the system cost in both wholesale market and retail market. Local tariff optimization reduces the electricity cost by 24.4% compared to uncontrolled charging. Wholesale market optimization results show that $\$$691 and $\$$255 revenues can be captured by each EV in ERCOT and CAISO markets per year, although with a conservative assumption on battery throughput cost at 0.16$\$$/kWh.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Architected mesoporous crystalline magnesium silicates with ordered pore structures

Novel approaches to harness earth abundant silicates as building blocks for carbon dioxide removal, capture, utilization, and storage are gaining increasing attention in the context of sustainable and low carbon energy and resource recovery. Advancing a calibrated understanding of these fluid-silicate interactions is essential for developing scalable processes. One of the challenges in developing predictive controls over these interactions is the compositional and morphological heterogeneity of naturally occurring, heterogeneous magnesium silicate minerals. To address this challenge, the synthesis of architected mesoporous crystalline magnesium silicate (Mg 2 SiO 4 ) is proposed. While synthesis routes for producing amorphous mesoporous magnesium silicates have been developed via sol-gel methods, approaches to synthesize crystalline magnesium silicates with well-controlled pore size distributions have not been explored. The conventional approaches of converting matter that is amorphous to crystalline states at elevated temperatures results in a heterogeneous pore size distribution. To develop controls on pore size distribution, amorphous mesoporous magnesium silicates are coated with carbon. This approach preserves the pore size distributions during the amorphous to crystalline transformations of Mg-silicates at elevated temperatures. The carbon coating is removed on heating. Magnesium silicate particles produced using this approach have highly ordered pores around 2.58 nm and a specific surface area of 124.25 m 2 /g. In this study, we report the chemical compositions, morphologies, phase transitions, and pore structures of the intermediate materials produced during the synthesis of crystalline mesoporous magnesium silicates. The transitions, and pore structures of the intermediate materials produced during the synthesis of crystalline mesoporous magnesium silicates. Furthermore, the synthesis routes discussed in this study can be applied translationally to produce metal silicates with ordered mesoporous structures.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Economic NMPC for a Reversible Solid Oxide Cell

Reversible solid oxide fuel cells (rSOCs) offer the flexibility to operate in tandem with the electric grid by switching between fuel cell and electrolysis modes based on real-time electricity prices. However, their complex, tightly coupled dynamic behavior poses significant challenges in determining optimal operating strategies. In this work, we present an economic nonlinear model predictive control (E-NMPC) framework to optimize the operation of rSOCs. The proposed E-NMPC is applied to a detailed rSOC flowsheet model that includes a utility scale rSOC module as well as balance-of-plant equipment necessary for thermal management. Our results demonstrate that in fuel cell mode, the E-NMPC strategy reduces hydrogen consumption compared to conventional set-point tracking NMPC, while maintaining the same level of electricity output. Also, in electrolysis mode, the E-NMPC yields a marginal improvement in hydrogen production. In addition, we explore the integration of a battery with the rSOC system to enhance flexibility in meeting electricity production and consumption targets.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Impact of Controlled Storage Conditions on the Hydrolysis and Surface Morphology of Amorphous-UO 3

The hydration and morphological effects of amorphous (A)-UO 3 following storage under varying temperature and relative humidity have been investigated. This study provides valuable insight into U-oxide speciation following aging, the U-oxide quantitative morphological data set, and, overall, the characterization of nuclear material provenance. A-UO 3 was synthesized via the washed uranyl peroxide synthetic route and aged based on a 3-factor circumscribed central composite design of experiment. Target aging times include 2.57, 7.00, 14.0, 21.0, and 25.4 days, temperatures of 5.51, 15.0, 30.0, 45.0, and 54.5 °C, and relative humidities of 14.2, 30.0, 55.0, 80.0, and 95.8% were examined. Following aging, crystallographic changes were quantified via powder X-ray diffraction and an internal standard Rietveld refinement method was used to confirm the hydration of A-UO 3 to crystalline schoepite phases. The particle morphology from scanning electron microscopy images was quantified using both the Morphological Analysis of MAterials software and machine learning. Results from the machine learning were processed via agglomerative hierarchical clustering analysis to distinguish trends in morphological attributes from the aging study. Significantly hydrated samples were found to have a much larger, plate-like morphology in comparison to the unaged controls. Predictive modeling via a response surface methodology determined that while aging time, temperature, and relative humidity all have a quantifiable effect on A-UO 3 crystallographic and morphological changes, relative humidity has the most significant impact.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗