Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “optimal control theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Optimization of Magnesium‐Doped Lithium Metal Anode for High Performance Lithium Metal Batteries through Modeling and Experiment

Abstract Lithium (Li)‐magnesium (Mg) alloy with limited Mg amount, which can also be called Mg‐doped Li (Li‐Mg), has been considered as a potential alternative anode for high energy density rechargeable Li metal batteries. However, the optimum doping‐content of Mg in Li‐Mg anode and the mechanism of the improved performance are not well understood. Herein, density functional theory (DFT) calculations are used to investigate the effect of Mg amount in Li‐Mg anode. The Li‐Mg with about 5 wt. % Mg (abbreviated as Li‐Mg5) has the lowest absorption energy of Li, thus all the surface area can be “controlled” by Mg atoms, leading to the smooth and continuous deposition of Li on the surface around the Mg center. A localized high concentration electrolyte enables Li‐Mg5 to exhibit the best cycling stability in Li metal batteries with high‐loading cathode and lean electrolyte under 4.4 V high‐voltage, which is approaching the demand of practical application. This electrolyte also helps generate an inorganic‐rich solid electrolyte interphase, which leads to smooth, compact and less corrosion layer on the Li‐Mg5 surface. Both theoretical simulations and experimental results prove that Li‐Mg5 has optimum Mg content and gives best battery cycling performance.

Gao, Peiyuan↗
DOE OSTI2024

Optimizing Nonaqueous Sodium–Polysulfide Redox-Flow Batteries: The Role of Solvation Effects with Glyme Solvents

Nonaqueous redox-flow batteries (NARFBs) that use economical alkali metals and the corresponding metal polysulfides are highly attractive for grid-scale energy storage. Although sodium–sulfur systems have been recognized as promising candidates and have been the focus of many studies due to their high earth abundance and energy density, an understanding of the role of the solvation chemistry of commonly used glyme solvents is missing. Herein, we report a systematic investigation into the solvation effects of glyme-based Na-S electrolytes through comprehensive physiochemical experiments and Density Functional Theory (DFT) simulations. Our findings revealed, on one hand, that an optimal coordination strength between glymes and Na + could maintain a relatively smooth Na + diffusion. On the other hand, glyme solvents with extended chain lengths shift the reduction potential of S 8 2– negatively to elevate the formation barrier of undesirable short-chain polysulfides (S n 2– , n ≤ 4) that have high membrane permeability. This solvation phenomenon not only mitigates capacity fading but also extends the operational longevity of the Na-S NARFBs. In conclusion, the results underscore the critical roles of balanced solvent–cation interactions and controlled redox potentials in improving the stability and efficiency of Na-S NARFB systems, marking a significant advancement in the development of sustainable energy storage solutions.

25 ENERGY STORAGE↗
DOE OSTI2025

Exploration of Electronic and Magnetic Properties of Ceria for Applications of Microwave Assisted Catalysis

This was presented at APS Global Physics Summit 2025 in Anaheim, CA. This study focuses on characterizing how vacancies and other dopants influence the electronic and magnetic properties of ceria and exploring the potential mechanisms by which these properties affect or control its catalytic behavior under microwave radiation. By examining ceria’s electronic response to external electromagnetic fields, specifically magnetic fields within the microwave range, the work aims to uncover insights into how microwaves might optimize catalytic effects. The study also includes a comparative analysis of different functionals to refine understanding of ceria’s electronic behavior and catalytic efficacy in these applications.

ammonia synthesis↗
DOE OSTI2021

Controlling and Optimizing Photoinduced Charge Transfer across Ultrathin Silica Separation Membrane with Embedded Molecular Wires for Artificial Photosynthesis

Ultrathin amorphous silica membranes with embedded organic molecular wires (oligo( p -phenylenevinylene), three aryl units) provide chemical separation of incompatible catalytic environments of CO 2 reduction and H 2 O oxidation while maintaining electronic and protonic coupling between them. For an efficient nanoscale artificial photosystem, important performance criteria are high rate and directionality of charge flow. Here, the visible-light-induced charge flow from an anchored Ru bipyridyl light absorber across the silica nanomembrane to Co 3 O 4 water oxidation catalyst is quantitatively evaluated by photocurrent measurements. Charge transfer rates increase linearly with wire density, with 5 nm -2 identified as an optimal target. Accurate measurement of wire and light absorber densities is accomplished by the polarized FT-IRRAS method. Guided by density functional theory (DFT) calculations, four wire derivatives featuring electron-donating (methoxy) and -withdrawing groups (sulfonate, perfluorophenyl) with highest occupied molecular orbital (HOMO) potentials ranging from 1.48 to 0.64 V vs NHE were synthesized and photocurrents evaluated. Charge transfer rates increase sharply with increasing driving force for hole transfer from the excited light absorber to the embedded wire, followed by a decrease as the HOMO potential of the wire moves beyond the Co 3 O 4 valence band level toward more negative values, pointing to an optimal wire HOMO potential around 1.3 V vs NHE. Comparison with photocurrents of samples without nanomembrane indicates that silica layers with optimized wires are able to approach undiminished electron flux at typical solar intensities. Combined with the established high proton conductivity and small-molecule blocking property, the charge transfer measurements demonstrate that oxidation and reduction catalysis can be efficiently integrated on the nanoscale under separation by an ultrathin silica membrane.

photocurrent measurements↗
DOE OSTI2024

Alloying Effects on the Transport Properties of Refractory High-entropy Alloys

Additive Manufacturing (AM) has opened new frontiers for the design of refractory high-entropy alloys (HEAs) for high-temperature applications. The thermal conductivity of the AM feedstock is among the most important thermo-physical properties that control the melting and solidification process. Despite its significance, there remains a notable gap in both computational and experimental research concerning the thermal conductivity of HEAs. Here, we use density functional theory (DFT) to systematically investigate the alloying effects on the transport properties of Ti-Cr-Mo-W-V-Nb-Ta RHEAs, including electrical and thermal conductivities and Seebeck coefficient. The relaxation time of charge carriers is a key underlying parameter determining thermal conductivity that is exceedingly challenging to predict from first principles alone, and we thus follow the approach by Mukherjee, Satsangi, and Singh [Chem Mater 32, 6507 (2022)] to optimize the relaxation time for RHEAs. Here we validated thermal conductivity predictions on elemental solids, binary and ternary alloys, and RHEAs and compared them against thermodynamic (CALPHAD) predictions and our experiments with good correlations. To understand observed trends in thermal conductivity, we assessed the phase stability, electronic structure, phonon, and intrinsic- and tensile strength of down-selected RHEAs. Our electronic structure and phonon results connect well with the observed compositional trends for thermal transport in RHEAs. Our DFT assessment and CALPHAD predictions provide a unique design guide for RHEAs with tailored thermal conductivity, a critical consideration for AM and thermal-management applications.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Growth of Low-Defect WSe 2 Film via High-Purity van der Waals Crystal Precursor

Two-dimensional (2D) semiconducting transition metal dichalcogenides (TMDs) exhibit exceptional electrical and optical properties, empowering their promising prospects for future nanoelectronics. Despite major advances in n-type 2D semiconductors, the field has yet to synthesize high-mobility p-type 2D TMDs, in particular WSe 2 , and systematically query the influence of defects. In this study, we unveil the pivotal role of substitutional impurity defects vis-à-vis the precursor used and growth method employed in defining the quality of 2D p-type WSe 2 . Density functional theory calculations suggest the adverse effect of Fe-, Co-, Ni- and Si-substituted W impurity defects on the mobility of WSe 2 , whereas defects such as O-, S-substituted Se and Mo-substituted W pose negligible impact. Guided by the theory, we pinpoint van der Waals (vdW) crystals, commonly used in mechanical exfoliation, as the optimal precursor, and develop a facile vdW crystal physical vapor deposition (PVD) method to grow high-purity monolayer 2D WSe 2 film (VPVD-WSe 2 ) that is continuous across a centimeter scale. A suite of spectroscopies confirms the markedly reduced defect density of the as-synthesized WSe 2 compared to those by typical chemical vapor deposition methods, and by PVD with commercial or hydrothermal precursors. Scanning tunneling microscopy further evidence the ultralow substitutional impurity defect density of VPVD-WSe 2 , greatly outperforming the control samples and approaching the mechanically exfoliated counterparts. The VPVD-WSe 2 based field-effect transistors exhibit notable electrical performance with record-high field-effect hole mobility up to 112 cm 2 V –1 s –1 at room temperature, exceeding the best-reported monolayer WSe 2 synthesized by chemical vapor deposition and rivaling the mechanically exfoliated 2D WSe 2 flakes.

WSe2↗
DOE OSTI2021

Computational Fermi Level Engineering and Doping-Type Conversion of Ga2O3 Via Three-Step Processing

Ga2O3 is being actively explored for power electronics, deep-ultraviolet optoelectronics, and other applications due to its ultra-wide bandgap and low projected fabrication cost of large-size and high-quality crystals. N-type doping of Ga2O3 can be achieved and tuned, but p-type doping faces fundamental obstacles due to deep character of acceptor levels and polaron transport of resulting holes. However, successful engineering of Ga2O3 based devices requires critical control of doping density, Fermi level position, and free carrier concentration, providing opportunities for predictive process simulation. We use first-principles defect theory and defect equilibrium calculations to simulate a 3-step growth-annealing-quench protocol for hydrogen assisted Mg doping in Ga2O3, taking into account the hydrogen-oxygen-water gas phase equilibrium. We predict type conversion to a net p-type regime following O-rich annealing after growth under reducing conditions in the presence of H2. This process is similar to the Mg acceptor activation by H removal in GaN. We show that there is an optimal temperature that maximizes the net acceptor density during the equilibrium annealing step for a given Mg doping level. Quenching of non-equilibrium annealed samples then results in a Fermi level EF below mid-gap down to about EV +1.5 eV, creating a significant number of uncompensated neutral MgGa0 acceptors. The resulting free hole concentration in quenched samples is very low (109 – 1012 cm-3) due to deep energy level of these Mg acceptors, but this type converted Ga2O3 material can create a significant built-in field in a p-n junction with an adjoining n-type material. Additionally, the electron concentration is greatly suppressed in such acceptor-doped Ga2O3, which could enable the use as a current blocking layer to fabricate normally-off (enhancement-mode) vertical Ga2O3 based metal-oxide-semiconductor field effect transistors (MOSFETs), and as a guard ring for edge termination in MOSFETs and Schottky barrier diodes (SBDs) with increased breakdown voltage.

CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS,M↗
DOE OSTI2021

Engineering local strain for single-atom nuclear acoustic resonance in silicon

Mechanical strain plays a key role in the physics and operation of nanoscale semiconductor systems, including quantum dots and single-dopant devices. In this report we describe the design of a nanoelectronic device, where a single nuclear spin is coherently controlled via nuclear acoustic resonance (NAR) through the local application of dynamical strain. The strain drives spin transitions by modulating the nuclear quadrupole interaction. We adopt an AlN piezoelectric actuator compatible with standard silicon metal–oxide–semiconductor processing and optimize the device layout to maximize the NAR drive. We predict NAR Rabi frequencies of order 200 Hz for a single 123Sb nucleus in a wide region of the device. Spin transitions driven directly by electric fields are suppressed in the center of the device, allowing the observation of pure NAR. Using electric field gradient-elastic tensors calculated by the density-functional theory, we extend our predictions to other high-spin group-V donors in silicon and to the isoelectronic 73Ge atom.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Experimental and fuel-surrogates modeling study of the high-pressure pyrolysis of specialty cetane number fuels: implications for fall-off in ethylene unimolecular dissociation

Single pulse shock tube experiments were conducted at 50 atm nominal pressure and 4 ms nominal reaction time over a temperature range of 900–1800 K, to study the pyrolysis speciation of a multi-component jet fuel, F-24, and six cetane number (CN) specialty fuels - CN30, CN35, CN40, CN45, CN50, and CN55. Gas chromatography (GC) was used to qualitatively and quantitatively analyze the post shock gases. The relationship between the formation of key pyrolysis species and the chemically controlled combustion propensity as reflected by the cetane number of each fuel was examined. A surrogate-based mechanism from the CRECK Modelling Group and chemical-functional group based optimized surrogates (CFGO) were used to simulate the pyrolysis speciation results. The model was able to capture the chemistry of most species except two important pyrolysis intermediates – ethylene and acetylene. Chemical kinetic analyses were performed to identify the important reactions which affect the chemistry of these species; however, the rate parameters of critical reactions were found to be unsuitable for simulating the present high-pressure studies. Here, to address this unsuitability, a theory-based fall-off analysis for three reactions representing the decomposition of ethylene and subsequent formation of acetylene was performed, and these are included in an updated version of the CRECK mechanism. This update resolves discrepancies between the experimental results and simulations for ethylene and acetylene. Reaction flux analyses using the updated surrogate model were also performed to identify the important reaction pathways responsible for the formation of crucial species and to provide an analysis of the chemistry of complex multi-component fuel systems. The fundamental reactions responsible for driving pyrolysis chemistry were greatly influenced by the chemical functional groups present in these fuels. In addition to updating the rate parameters of specific reactions to improve modeling, this study also emphasizes the effectiveness of the fuel-surrogate approach, where surrogates representing the chemical functional group composition of the parent fuel serve as a valuable tool for predicting the combustion chemistry of novel fuels.

Chemical Kinetics↗
DOE OSTI2020

Starting-point-independent quantum Monte Carlo calculations of iron oxide

Quantum Monte Carlo (QMC) methods are useful for studies of strongly correlated materials because they are many body in nature and use the physical Hamiltonian. Typical calculations assume as a starting point a wave function constructed from single-particle orbitals obtained from one-body methods, e.g., density functional theory. However, mean-field-derived wave functions can sometimes lead to systematic QMC biases if the mean-field result poorly describes the true ground state. In this study, we examine the accuracy and flexibility of QMC trial wave functions using variational and fixed-node diffusion QMC estimates of the total spin density and lattice distortion of antiferromagnetic iron oxide (FeO) in the ground state B1 crystal structure. We found that for relatively simple wave functions the predicted lattice distortion was controlled by the choice of single-particle orbitals used to construct the wave function, rather than by subsequent wave function optimization techniques within QMC. By optimizing the orbitals with QMC, we then demonstrate starting-point independence of the trial wave function with respect to the method by which the orbitals were constructed by demonstrating convergence of the energy, spin density, and predicted lattice distortion for two qualitatively different sets of orbitals. The results suggest that orbital optimization is a promising method for accurate many-body calculations of strongly correlated condensed phases.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

Lighting Control in Patient Rooms: Understanding Nurses’ Perceptions of Hospital Lighting Using Qualitative Methods

Here, this study differs in its methodological approach from previously published research by interpreting qualitative results against existing literature to understand how nurses conceptualize medical–surgical patient rooms as productive settings in relation to lighting, as well as the ways in which nurses believe these spaces could be enhanced for patient satisfaction. Content analysis was used to interpret themes emerging from nurses’ subjective responses to open-ended items. Three of the facilities had older, traditional lighting systems; one had a contemporary framework. A theme of environmental control over both overhead and task lighting emerged from data from all items. Although controllability was among the “best” lighting attributes, more refinement is necessary for optimal staff productivity and patient satisfaction. Daylighting was also considered to be among the best attributes. Control over light level via additional dimming capability for patients, as well as additional light sources, was prominent across the four hospitals. Unique to the more modern facility, trespassing of light was problematic for nurses considering the experiences of patients—even where modern models exist, more attention can be paid to the ways in which window shades, and light sources outside of rooms, penetrate spaces and affect users. Finally, the finding that nurses and patients desire greater control over the lighting in patient rooms is consistent with Ulrich’s theory of supportive design for healthcare and coincides with advances in lighting technology. Despite differences in the level of sophistication in lighting among the four facilities, control continues to be a primary concern for nurses.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Commercial Building Sensors and Controls Systems: Barriers, Drivers, and Costs

Building sensors and controls systems, including building automation systems, consists of the sensor-based devices installed in buildings and the control and automation of those devices. Optimized sensors and controls systems could lead to 29% annual energy savings in commercial buildings and are integral to the growth of grid-interactive efficient buildings. Only 8% of small commercial buildings, however, have installed sensors and controls systems. This is largely due to cost barriers. This work seeks to increase the transparency of system costs and identify specific barriers and drivers for increased adoption. To gather industry insights, the team reached out to building owners, vendors, and contractors and conducted 20 interviews with the goal of collecting cost data and market characteristics regarding building sensors and controls. The qualitative interview data was analyzed using grounded theory to identify overarching concepts, such as barriers, drivers, and future directions on the field. From this analysis, primary barriers were found to be complexity, a lack of knowledge, and money. Primary drivers were found to be the knowledge of data, savings, and remote access. The qualitative cost data was collected in the form of invoices during the interviews. The cost values were used to develop a percentage-based cost stack which identifies the average fraction of the total cost attributed to each category (hardware, software, labor, fees, and taxes). This greater understanding of costs and barriers associated with commercial building sensors and controls systems lays the groundwork for future steps in increasing system adoption, reducing energy consumption, and market transformation.

advanced building controls↗
DOE OSTI2025

A hybrid surrogate modeling framework for the Digital Twin of a Fluoride-salt-cooled High-temperature Reactor (FHR)

While nuclear energy is a non-greenhouse-gas emitting energy source, expensive operational costs due to the high-level of safety requirements decreases their competitiveness in the sustainable energy market. Advanced reactor concepts paired with Digital Twins aim to increase the commercialization gains of nuclear energy by reducing operational costs, increasing reactor reliability and enhancing power generation. To support Digital Twin tasks such as real-time autonomous control, proactive maintenance monitoring or optimizing power demand operations, a fast and accurate virtual representation of the Nuclear Power Plant (NPP) is required. The computational cost of high-fidelity, physics-based models are unsuitable for real-time analysis or scalability. Here, in this work, a hybrid surrogate modeling framework is developed fora Fluoride-salt-cooled High-temperature Reactor (FHR) that leverages physics-inspired models for key reactor components and uses data-driven methods for rapid system state space prediction. The Xenon reactivity feedback model is integrated to inform the surrogate model about the reactor core and the homologous pump theory model is the basis for representing pump degradation. Using a detailed, two dimensional thermal hydraulics model to generate data on the FHR, we train a network of Vectorized Autoregressive Moving-Average with eXogenous input (VARMAX) models to predict the remaining state values. The result is a surrogate model that provides a detailed reactor state representation of 41 system states and a pump degradation analysis. The framework is applied to Load Follows profiles, yielding high accuracy and a speedup that is more than 4000x faster compared to the higher- fidelity thermal hydraulics model, enabling real-time operational intelligence and applications in long horizon predictions. While the surrogate model framework is demonstrated for the particular case of FHR, the hybrid physical/data-driven modeling approach including the network of surrogates and the underlying modularity has the potential to be applied to other physical asset systems.

Digital Twins↗
DOE OSTI2024

Using interfaces to: create strongly-coupled magnetic-ferroelectrics

Starting at the level of electrons and atoms our long-term goal is to rationally design complex oxide heterostructures and interface-materials with targeted emergent behaviors. This is not a matter of simply optimizing material parameters, but rather begins with understanding a mechanism to control the interplay between the diverse microscopic degrees of freedom prevalent in complex oxides in order to create targeted macroscopic phenomena and ends with the design of new material realizations. These realizations are in turn created with atomic-layer precision, structurally assessed to see that they are the intended realization, and finally their relevant properties are measured. During this program we have developed the scientific ideas necessary to apply this materials-by-design paradigm to the creation of materials offering electrical control of magnetism. At the heart of our approach lies a partnership between theory, synthesis, and characterization. These are the areas of expertise of the three co-PIs, who have worked closely together since their arrival at Cornell. During this project bold ideas on where to put the atoms to provide electrical control of magnetism were met with the latest methods of synthesis science and electron microscopy in an attempt create targeted new multiferroics. Our work applying this materials-by-design methodology to multiferroics has enjoyed multiple successes. The Co-PIs have invented new mechanisms for multiferroics, which provide strong coupling between polarization and magnetism, and reduced them to practice. Specifically, we pioneered multiferroics based on spin-phonon coupling, rotation-driven multiferroicity, and novel geometric multiferroics. Importantly, the latter two of these mechanisms enable the deterministic switching of magnetism by an applied electric field, which is key to the application of multiferroics to future device technologies. Most recently, we performed detailed theoretical analysis on a system involving the combination of magnetoelectric and colossal magnetoresistance behaviors and predict that electrical control of a metal-insulator transition is possible in appropriately strained SmBaMn2O6. The research enabled by this grant led to 63 publications in leading refereed journals including Nature, Nature Materials, Physical Review Letters, and Advanced Materials demonstrating a materials-by-design paradigm to the creation of materials offering electrical control of magnetism.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Boosting the Oxygen Reduction Performance via Tuning the Synergy between Metal Core and Oxide Shell of Metal−Organic Frameworks‐Derived Co@CoO x

Abstract Co core@Co oxide shell (Co@CoO x ) catalysts represent a large family with promising oxygen reduction reaction (ORR) catalytic activity. However, inadequate understanding of Co@CoO x synergy prohibits further pursuit of catalytic performance enhancement. Herein, a Co zeolitic−imidazolate framework was converted into metallic Co, followed by controlled air treatment to form Co@CoO x . The composition and structure evolution as a function of air treatment temperature were studied thoroughly through conventional and synchrotron (both ex‐situ and in‐situ) characterizations, confirming the coexistence of CoO and Co 3 O 4 in the shell. The optimal catalyst showed an ORR half‐wave potential of 0.87 V (vs. RHE) in an alkaline half‐cell and delivered high discharge capacity in an aprotic Li−O 2 battery (7,124 mAh g Cat+C −1 ) and an aqueous Zn−air battery (694 mAh g Zn −1 ) with good performance retention after durability test. Modeling simulation and density functional theory calculation confirmed the charge donation from metal core to oxide shell and shed light on new insights of how metal@metal oxide synergy impacted the ORR via tuning the charge conductivity, oxygen affinity and intermediate transfer pathway. This work opens up a venue to boost ORR catalytic activity from an interfacial synergy perspective.

Wang, Hao↗
DOE OSTI2022

Metal-organic framework supported single-site nickel catalysts for butene dimerization

Homotopic sites in a well-controlled environment are not only ideal systems for mechanistic studies, but also allow optimal control of catalytic transformations. Sites having only a single metal cation and sites consisting of metal oxo complexes with few nickel (Ni) cations supported on the nodes of UiO-66 metal-organic framework (Ni-UiO-66) are studied for 1-butene dimerization. Monomeric Ni sites, which bind to the Zr 6 node via two Zr-OH(µ3) linkages, are active and selective for the dimerization of 1-butene to linear and mono-branched C 8 isomers. Ni oxo complexes with few Ni cations show lower activity and promote the oligomerization of transiently formed C 8 isomers. In conclusion, Kohn-Sham density function theory calculations combined with spectroscopic measurements and kinetic analyses indicate that dimerization follows a Cossee-Arlman reaction mechanism.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Stochastic Strategic Participation of Active Distribution Networks With High-Penetration DERs in Wholesale Electricity Markets

With the increasing penetration of distributed energy resources (DERs), traditional distribution networks as load-serving entities in wholesale electricity markets, now evolve towards active distribution networks (ADNs) which can proactively participate in wholesale markets by optimally controlling the DERs in their networks. A stochastic bilevel optimization model is proposed in this paper for the strategic participation of ADNs and DERs to provide energy and grid services in wholesale electricity markets. The bilevel optimization model can capture the interactions between the ADN and the wholesale energy and ancillary service markets, considering the uncertainties of DERs in the ADN. In the upper-level model, the ADN makes optimal decisions on energy and reserve bidding considering the availability, uncertainties, and flexibility of DERs. The joint energy and reserve market-clearing of the independent system operator (ISO) is modeled as the lower-level problem. Using strong duality theory and Karush-Kuhn Tucker (KKT) conditions, the proposed bilevel optimization problem is reformulated as mathematical programming with equilibrium constraints (MPEC) problem and further converted into a computationally-solvable mixed-integer second-order-cone programming (MISOCP) model. The simulation results demonstrate the effectiveness of the model and the interactions between an ADN and wholesale electricity markets.

active distribution network↗
DOE OSTI2024

A safe reinforcement learning algorithm for supervisory control of power plants

Traditional control theory-based methods require tailored engineering for each system and constant fine-tuning. In power plant control, one often needs to obtain a precise representation of the system dynamics and carefully design the control scheme accordingly. Model-free Reinforcement learning (RL) has emerged as a promising solution for control tasks due to its ability to learn from trial-and-error interactions with the environment. It eliminates the need for explicitly modeling the environment’s dynamics, which is potentially inaccurate. However, the direct imposition of state constraints in power plant control raises challenges for standard RL methods. To address this, we propose a chance-constrained RL algorithm based on Proximal Policy Optimization for supervisory control. Our method employs Lagrangian relaxation to convert the constrained optimization problem into an unconstrained objective, where trainable Lagrange multipliers enforce the state constraints. In conclusion, our approach achieves the smallest distance of violation and violation rate in a load-follow maneuver for an advanced Nuclear Power Plant design.

constrained optimization↗