Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Global Optimal Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

National Smart Manufacturing Strategic Plan: To Facilitate More Rapid Development, Deployment and Adoption of Smart Manufacturing Technologies

Smart manufacturing technologies provide real-time data and insight to improve the productivity, efficiency, and competitiveness of U.S. manufacturing, creating the potential for new jobs in the manufacturing sector. These technologies can support U.S. manufacturers’ ability to increase throughput and energy efficiency, and decrease waste, defects, and costs. A wide range of manufacturing and industrial subsectors, particularly energy-intensive and energy-dependent industries, have the potential to benefit from smart manufacturing technologies. There are technical improvements still needed to reduce the costs and barriers (trained workforce and upskilling, software-hardware integration, cost, and technical barriers to deployment of advanced sensors, computing, and communication technologies for existing manufacturing assets) to the adoption of smart manufacturing technologies, especially to small and medium-sized manufacturers, and subsequently, increase the overall adoption rate of smart manufacturing technologies. This report outlines the Department of Energy’s (DOE) strategic plan to accelerate the development and implementation of smart manufacturing technologies in the United States and the actions DOE has taken to use these technologies in smart manufacturing for the United States. DOE’s plan to facilitate more rapid development, deployment and widespread adoption of smart manufacturing technologies derive from the 2018 Strategy for American Leadership in Advanced Manufacturing. The strategy outlines a vision for America’s leadership in advanced manufacturing including the development of intelligent manufacturing systems to optimize manufacturing facilities and support the manufacturing of transformative materials. DOE’s Clean Energy Smart Manufacturing Innovation Institute (CESMII), a Manufacturing USA Institute, focuses on accelerating the development and adoption of advanced sensors, controls, platforms, and models needed for smart manufacturing. The objective is to enhance U.S. manufacturing productivity and global competitiveness through the research and development of these technologies. Smart manufacturing has the potential to improve the overall performance, energy productivity, and efficiency of manufacturing, fostering the economic competitiveness of the manufacturing sector.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Spatially Adaptive Tunable Lighting Control System with Expanded Wellness and Energy Saving Benefits

Lighting design is becoming increasingly complex, including active dimming for energy savings and spectral tuning for human wellbeing. Modern commercial lighting control systems are already difficult to use, and maintain, and even with so-called Smart Lighting, optimizing light settings is rapidly exceeding the capabilities of direct human control, limiting the adoption of lighting control systems. The growing importance of Occupancy Centric Controls (OCC) for advanced building management systems can be applied to the development of autonomous lighting system controls needed to drive the adoption of advanced lighting controls for improved adaptive “sculpted illumination” for both greater energy savings and broader human wellbeing perspectives. This project, led by Rensselaer Polytechnic Institute, entitled “Spatially adaptive tunable lighting control system with expanded wellness and energy saving benefits” will develop and test an entirely new platform for automated optimized lighting design and control that requires little or no human engagement, yet contours lighting profiles automatically to minimize lighting energy use. We call this approach to lighting control “dynamic light sculpting” since the right amount of illumination is automatically delivered to occupants in real time. Since the system uses new, privacy-preserving occupant position and pose detection technologies developed by Rensselaer for broad OCC building applications, the control system will analyze how to deliver the right amount of the right type of illumination only where and when it is needed based these OCC platforms. To create these powerful autonomous lighting control platforms, the project will integrate evolving augmented reality (AR) and virtual reality (VR) tools with sophisticated lighting and interior design toolkits to create interactive lighting design and control simulators. Using the quickly growing paradigm of digital twins, these tools will integrate light fixture properties, occupancy sensor data, interior design data, and lighting specifications to accurately visualize how various design concepts interact with simulated yet realistic human activities that occur in commercial office buildings of various types. These advanced digital twin design and simulation tools will be combined with a new class of digitally-programmable LED lighting fixtures that can dynamically change the spectral content and direction of light emission. When fully integrated, the new autonomous lighting control system will take all of the guesswork out of optimizing light quality while minimizing energy consumption. Digital twin tools will simplify the design, installation, commissioning, operation, and maintenance of future energy-efficient lighting systems. It should be possible to reduce lighting energy costs from 40% to 70% with OCC based dynamic light sculpting systems. The work will be led by the Center for Lighting Enabled Systems and Applications (LESA) and the Center for Architectural Science and Ecology (CASE), both at Renssealer Polytechnic Institute; Lumileds, a global leader in the development of advanced LED systems; and HKS, a leading global architecture design firm. This interdisciplinary project team’s experience includes all of the design simulation tools, VR/AR digital twin visualization technology, advanced occupancy sensing technology, and complex control system design capabilities that will revolutionize lighting design and control technology to autonomously deliver high-quality lighting that improves human health and wellbeing while simultaneously maximizing lighting energy savings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Exploring the transition from continuous turbulence fluctuations to bursting ELMs in high SOL density regimes

BOUT++ turbulence simulations of the DIII-D reveal that the density profile between the separatrix and pedestal plays a crucial role in the dynamics of edge localized modes (ELMs) and edge plasma turbulent transport. Nonlinear simulations demonstrate that small ELMs in the DIII-D hybrid scenario under high SOL density conditions are predominantly driven by local ballooning modes near the separatrix, stabilizing global instabilities while enhancing localized pressure fluctuations. A key control parameters for ELM dynamics is the separatrix-to-pedestal density ratio, n e,sep /n e,ped . A high ratio indicates a shallow gradient, favoring small ELMs, while a lower ratio signals a steep gradient, which increases the likelihood of large ELMs. Comprehensive parameter scans, including n e,sep /n e,ped , density gradient profiles near the separatrix, and resistivity, reveal the critical role of these parameters in shaping transitions between turbulence-driven transport and ELM bursting. The scans demonstrate that in high SOL density regimes, small ELMs can result from either global resistive MHD instabilities or local ballooning modes near the separatrix, depending on the steepness of the separatrix density gradient. These findings also highlight the transition from continuous turbulence to small ELMs. The post-crash peak in pressure fluctuations, δP rms serves as a critical metric for identifying transition from continuous turbulence fluctuations to ELM bursting. Larger δP rms values correlate with ELM bursts driven by local or global instabilities, whereas smaller values indicate turbulence-dominated transport. Drift-Alfvén and resistive ballooning turbulence enhance the entrainment of fluctuations from the pedestal to the SOL, contributing to the complex interplay of dynamics in this regime. These findings emphasize the importance of separatrix density shaping and pedestal gradient control for optimizing ELM behavior in ITER and future fusion devices.

Li, Nami [Lawrence Livermore National Laboratory (↗
DOE OSTI2021

Observation of fully detached divertor integrated with improved core confinement for tokamak fusion plasmas

Integration of divertor detachment with a high-performance (β N ~ 3, β p > 2, H 98 ~ 1.5) core plasma has been demonstrated in DIII-D high-β p (poloidal beta) plasmas associated with a sustained core internal transport barrier (ITB) and an H-mode edge transport barrier (ETB). Such good core-edge integration has been achieved for both neon and nitrogen seeding, for both favorable and unfavorable B-field directions, independently from the impurity puffing locations, though these variations play important roles on divertor characteristics. Compared to the standard H-mode plasmas, the high-β p plasma exhibits a much wider window of detachment compatible with high confinement core. Fully detached divertor plasmas with low plasma temperature (Te < 5 eV), low particle flux, and low heat flux across the entire divertor target plate were obtained by using nitrogen seeding. This detached high-β p plasma is compatible with a newly developed detachment control system which can help optimize the nitrogen gas flow rate. Several features, i.e., the high edge safety factor in the high-β p scenario, impurity injection, closed divertor and reduced heating power requirement due to the high confinement, facilitate the achievement of full divertor detachment at lower density. Instead of degrading global performance, the divertor detachment facilitates the access to an even stronger ITB at large radius with a relatively weak ETB through self-organized synergy between ITB and ETB, leading to sustained high confinement. The strengthening of the large-radius ITB compensates for the ETB degradation associated with divertor detachment. In addition, a weak ETB naturally has smaller edge localized modes (ELMs). In particular, with neon injection, a long-period no-ELM H-mode phase has been achieved simultaneously with high-performance core and partially detached divertor plasmas. Furthermore, these results demonstrate the possibility of integrating excellent core plasma performance with an effective divertor solution, an essential step toward steady-state operation of reactor-grade plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Land Surface Temperature from GOES-East and GOES-West

Land surface temperature (LST) is an important climate parameter that controls the surface energy budget. For climate applications, information is needed at the global scale with representation of the diurnal cycle. To achieve global coverage there is a need to merge about five independent geostationary (GEO) satellites that have different observing capabilities. An issue of practical importance is the merging of independent satellite observations in areas of overlap. An optimal approach in such areas could eliminate the need for redundant computations by differently viewing satellites. We use a previously developed approach to derive information on LST from GOES-East (GOES-E), modify it for application to GOES-West (GOES-W) and implement it simultaneously across areas of overlap at 5-km spatial resolution. We evaluate the GOES-based LST against in situ observations and an independent MODIS product for the period of 2004–09. The methodology proposed minimizes differences between satellites in areas of overlap. The mean and median values of the differences in monthly mean LST retrieved from GOES-E and GOES-W at 0600 UTC for July are 0.01 and 0.11 K, respectively. Similarly, at 1800 UTC the respective mean and median value of the differences were 0.15 and 1.33 K. These findings can provide guidelines for potential users to decide whether the reported accuracy based on one satellite alone, meets their needs in area of overlap. Since the 6 yr record of LST was produced at hourly time scale, the data are well suited to address scientific issues that require the representation of LST diurnal cycle or the diurnal temperature range (DTR).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Effect of epitope variant co-delivery on the depth of CD8 T cell responses induced by HIV-1 conserved mosaic vaccines

To stop the HIV-1 pandemic, vaccines must induce responses capable of controlling vast HIV-1 variants circulating in the population as well as those evolved in each individual following transmission. Numerous strategies have been proposed, of which the most promising include focusing responses on the vulnerable sites of HIV-1 displaying the least entropy among global isolates and using algorithms that maximize vaccine match to circulating HIV-1 variants by vaccine cocktails of optimized complementing sequences. In this study, we investigated CD8 T cell responses induced by a bi-valent mosaic of highly conserved HIVconsvX regions delivered by a combination of simian adenovirus ChAdOx1 and poxvirus MVA. We compared partially and fully mono- and bi-valent prime-boost regimens and their ability to elicit T cells recognizing natural epitope variants using an interferon-g enzyme-linked immunospot (ELISPOT) assay. We used 11 well-defined CD8 T cell epitopes in two mouse haplotypes and, for each epitope, assessed recognition of the two vaccine forms together with the other most frequent epitope variants in the HIV-1 database. We conclude that for the magnitude and depth of epitope recognition, CD8 T cell responses benefitted in most comparisons from the combined bi-valent mosaic and envisage the main advantage of the bi-valent vaccine during its deployment to diverse populations.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Trends in best-in-class energy-efficient technologies for room air conditioners

Improving the efficiency of room air conditioners (RACs) could provide significant energy and associated emissions savings, particularly in emerging economies with hot climates where the cooling demand is expected to increase dramatically. To help accelerate efficiency improvements, this study identifies “best-in-class” high-efficiency RAC components and products. The findings show that manufacturers tend to minimize manufacturing costs by using RAC designs that are readily available or standardized to their production, and they share components across various models. High-efficiency RAC models use advanced compressor technologies optimized at a low frequency, large heat exchangers with thermodynamically effective materials and designs, highly efficient direct current fan motors, advanced metering devices, and smart sensors for temperature and humidity control. Recently RAC manufacturers have been improving seasonal efficiency – better reflecting part-load operation – especially via variable-speed (inverter) drives for compressor motors. Recent highest-efficiency RAC models use low global warming potential (GWP) refrigerants, having transitioned from conventional high-GWP refrigerants, in regions where RACs that use these low-GWP refrigerants are commercially available. Recently demonstrated innovative technologies show trends toward smart hybrid designs, evaporative cooling, and solid-state materials beyond the conventional vapor-compression technology. This information could help policymakers improve their RAC market-transformation programs to align with the most-efficient global technology.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Data for Controlling Circuitry Underlies the Growth Optimization of Saccharomyces cerevisiae

Microbial growth emerges from coordinated synthesis of various cellular components from limited resources. In Saccharomyces cerevisiae , cyclic AMP (cAMP)-mediated signaling is shown to orchestrate cellular metabolism; however, it remains unclear quantitatively how the controlling circuit drives resource partition and subsequently shapes biomass growth. Here we combined experiment with mathematical modeling to dissect the signaling-mediated growth optimization of S. cerevisiae . We showed that, through cAMP-mediated control, the organism achieves maximal or nearly maximal steady-state growth during the utilization of multiple tested substrates as well as under perturbations impairing glucose uptake. However, the optimal cAMP concentration varies across cases, suggesting that different modes of resource allocation are adopted for varied conditions. Under settings with nutrient alterations, S. cerevisiae tunes its cAMP level to dynamically reprogram itself to realize rapid adaptation. Moreover, to achieve growth maximization, cells employ additional regulatory systems such as the GCN2-mediated amino acid control. This study establishes a systematic understanding of global resource allocation in S. cerevisiae , providing insights into quantitative yeast physiology as well as metabolic strain engineering for biotechnological applications.

Conversion↗
DOE OSTI2023

Modeling Ring Current Proton Fluxes Using Artificial Neural Network and Van Allen Probe Measurements

Abstract Terrestrial ring current dynamics are a critical part of the near‐space environment, in that they directly drive geomagnetic field variations that control particle drifts, and define geomagnetic storms. The present study aims to specify a global and time‐varying distribution of ring current proton using geomagnetic indices and solar wind parameters with their history as input. We train an artificial neural network (ANN) model to reproduce proton fluxes measured by the Radiation Belt Storm Probes Ion Composition Experiment instrument onboard Van Allen Probes. By choosing optimal feature parameters and their history length, the model results show a high correlation and a small error between model specifications and satellite measurements. The modeled results well capture energy‐dependent proton dynamics in association with geomagnetic storms, including inward radial diffusion, acceleration and decay. Our ANN model produces proton fluxes with their corresponding 3D spatiotemporal variations, capturing the latitudinal distribution and local time asymmetry that are consistent with observations and that can further inform theory.

Li, Jinxing↗
DOE OSTI2024

Approximate Dynamic Programming With Enhanced Off-Policy Learning for Coordinating Distributed Energy Resources

Herein this paper proposes an innovative approximate dynamic programming (ADP) method for distributed energy resource coordination with the loss of life of battery energy storage system (BESS) explicitly modeled. The dispatch policy is designed to account for both calendrical and cyclical aging effects on BESS, explicitly modeling the impacts of ambient temperature on BESS lifespan. The proposed ADP employs an adaptive critic method and enhanced off-policy deterministic policy gradient (DPG) strategy, addressing the limitations of the on-policy gradient-based ADP approaches, including inadequate exploration, low data usage, and computational complexity. In particular, a customized policy is proposed to guide the algorithm to explore some promising decisions and thereby improve exploration capability and learning efficiency compared to conventional DPG-based learning approaches, which may struggle to find a global optimum due to random noisy action-based exploration or require expert demonstration with extra effort. The proposed method is illustrated using the IEEE 123-node system and compared with the existing ADP methods to prove solution accuracy and demonstrate the effects of incorporating degradation models into control design. Case studies showed that the proposed ADP effectively coordinates DERs with a 10 times smaller optimization gap compared to existing methods, and the incorporation of the BESS life loss model ensures the expected lifespan and results in significant cost savings.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Itaconic acid production is regulated by LaeA in Aspergillus pseudoterreus

The global regulator LaeA controls secondary metabolism in diverse Aspergillus species. Here we explored its role in regulation of itaconic acid production in Aspergillus pseudoterreus. To understand its role in regulating metabolism, we deleted and overexpressed laeA, and assessed the transcriptome, proteome, and secreted metabolome prior to and during initiation of phosphate limitation induced itaconic acid production. We found that secondary metabolite clusters, including the itaconic acid biosynthetic gene cluster, are regulated by laeA and that laeA is required for high yield production of itaconic acid. Overexpression of laeA improves itaconic acid yield at the expense of biomass by increasing the expression of key biosynthetic pathway enzymes and attenuating the expression of genes involved in phosphate acquisition and scavenging. Increased yield was observed in optimized conditions as well as conditions containing excess nutrients that may be present in inexpensive sugar containing feedstocks such as excess phosphate or complex nutrient sources. This suggests that global regulators of metabolism may be useful targets for engineering metabolic flux that is robust to environmental heterogeneity.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

A New Method for High Resolution Surface Change Detection: Data Collection and Validation of Measurements from UAS at the Nevada National Security Site, Nevada, USA

The use of uncrewed aerial systems (UAS) increases the opportunities for detecting surface changes in remote areas and in challenging terrain. Detecting surface topographic changes offers an important constraint for understanding earthquake damage, groundwater depletion, effects of mining, and other events. For these purposes, changes on the order of 5–10 cm are readily detected, but sometimes it is necessary to detect smaller changes. An example is the surface changes that result from underground explosions, which can be as small as 3 cm. Previous studies that described change detection methodologies were generally not aimed at detecting sub-5-cm changes. Additionally, studies focused on high-fidelity accuracy were either computationally modeled or did not fully provide the necessary examples to highlight the usability of these workflows. Detecting changes at this threshold may be critical in certain applications, such as global security research and monitoring for high-consequence natural hazards, including landslides. Here we provide a detailed description of the methodology we used to detect 2–3 cm changes in an important applied research setting—surface changes related to underground explosions. This methodology improves the accuracy of change detection data collection and analysis through the optimization of pre-field planning, surveying, flight operations, and post-processing the collected data, all of which are critical to obtaining the highest output data resolution possible. We applied this methodology to a field study location, collecting 1.4 Tb of images over the course of 30 flights, and location data for 239 ground control points (GCPs). We independently verified changes with orthoimagery, and found that structure-from-motion, software-reported root mean square errors (RMSEs) for both control and check points underestimated the actual error. We found that 3 cm changes are detectable with this methodology, thereby improving our knowledge of a rock’s response to underground explosions.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

A quantum hamiltonian simulation benchmark

Hamiltonian simulation is one of the most important problems in quantum computation, and quantum singular value transformation (QSVT) is an efficient way to simulate a general class of Hamiltonians. However, the QSVT circuit typically involves multiple ancilla qubits and multi-qubit control gates. In order to simulate a certain class of n-qubit random Hamiltonians, we propose a drastically simplified quantum circuit that we refer to as the minimal QSVT circuit, which uses only one ancilla qubit and no multi-qubit controlled gates. We formulate a simple metric called the quantum unitary evolution score (QUES), which is a scalable quantum benchmark and can be verified without any need for classical computation. Under the globally depolarized noise model, we demonstrate that QUES is directly related to the circuit fidelity, and the potential classical hardness of an associated quantum circuit sampling problem. Under the same assumption, theoretical analysis suggests there exists an ‘optimal’ simulation time t opt ≈ 4.81, at which even a noisy quantum device may be sufficient to demonstrate the potential classical hardness.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Exploration of Electronic and Magnetic Properties of Ceria for Applications of Microwave Assisted Catalysis

This was presented at APS Global Physics Summit 2025 in Anaheim, CA. This study focuses on characterizing how vacancies and other dopants influence the electronic and magnetic properties of ceria and exploring the potential mechanisms by which these properties affect or control its catalytic behavior under microwave radiation. By examining ceria’s electronic response to external electromagnetic fields, specifically magnetic fields within the microwave range, the work aims to uncover insights into how microwaves might optimize catalytic effects. The study also includes a comparative analysis of different functionals to refine understanding of ceria’s electronic behavior and catalytic efficacy in these applications.

ammonia synthesis↗
DOE OSTI2023

Ten questions concerning reinforcement learning for building energy management

As buildings account for approximately 40% of global energy consumption and associated greenhouse gas emissions, their role in decarbonizing the power grid is crucial. The increased integration of variable energy sources, such as renewables, introduces uncertainties and unprecedented flexibilities, necessitating buildings to adapt their energy demand to enhance grid resiliency. Consequently, buildings must transition from passive energy consumers to active grid assets, providing demand flexibility and energy elasticity while maintaining occupant comfort and health. This fundamental shift demands advanced optimal control methods to manage escalating energy demand and avert power outages. Reinforcement learning (RL) emerges as a promising method to address these challenges. Here, in this paper, we explore ten questions related to the application of RL in buildings, specifically targeting flexible energy management. We consider the growing availability of data, advancements in machine learning algorithms, open-source tools, and the practical deployment aspects associated with software and hardware requirements. Our objective is to deliver a comprehensive introduction to RL, present an overview of existing research and accomplishments, underscore the challenges and opportunities, and propose potential future research directions to expedite the adoption of RL for building energy management.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Advanced Anti-Fouling Coatings to Improve the Efficiency of Coal Power Plants

As the total cost of carbon to generate energy has become a global concern, operators are increasingly looking at all parts of the generation cycle to find areas where efficiency gains may be found. It has been long identified that fouling of heat exchangers is a persistent cause of up to 2.5% of global CO 2 emissions. Unfortunately, practice has also demonstrated that unless a powerful economic driver exists to encourage preemptive mitigation of fouling, there will always be a strong tendency for operators to minimize any form of intervention due to high costs and challenges in scheduling downtime. The objective of this proposed research effort was to demonstrate how existing power plants could lower their carbon emissions and significantly improve heat transfer efficiency using new surface treatment materials to control fouling in a variety of heat exchange equipment. The surface treatment material which was optimized and deployed in this effort is now known commercially as HeatX. It is a low-surface energy, water- and oil-repellent, abrasion resistant material which can be applied in-situ to a wide variety of previously worn/used/in-service substrates. Once applied, it provides a barrier against corrosion, scale deposit formation, and biofilm adhesion on the circulating water-containing tube-side. Alternatively, if applied to the tube exterior, the non-wetting nature of the surface was demonstrated to promote dropwise condensation, subsequently lowering condenser backpressure and increasing overall plant efficiency. As part of this cooperative effort, the Department of Energy’s support was crucial to de-risk and demonstrate the concept of HeatX, while validating both the performance and economic benefit in multiple pilot field studies. The HeatX material properties were optimized in this effort for full field applicability to heat exchangers and condensers, and Oceanit developed the necessary procedures and protocols to provide enough material to support extended length, multi-year demonstrations in the power generation, desalination, and refining industries, making this technology broadly applicable and ready for commercial transition. Field deployment case studies at thermal power plants have shown that the HeatX treatment can provide economic savings of up to $15,000 per day for an operator based on avoiding maintenance costs and lowering fuel usage. The complete mitigation of fouling effects can increase the efficiency of equipment by up to 7%, in a field where gains of 0.5% are generally seen as operationally significant. The HeatX treatment has also demonstrated exceptional lifetime and compatibility with a wide variety of seawater and hydrocarbon environments, further increasing both the return on investment and the effective emission reduction. Such efficiency improvements correlate to massive carbon savings. For every 1 GW of capacity, operators can see carbon emissions reductions of 300,000 tons of CO 2 per year. When looking at the bigger picture, improved condenser function across the U.S. has the potential to prevent 221.3 million tons of CO 2 emissions, equivalent to the sequestration capacity of 129 million acres of forest. If applied on a global scale, 1.26 billion metric tons of CO 2 could be averted from the atmosphere, the same amount of carbon sequestrated by 1.5 billion acres of forest annually or 262,000 wind turbines operating annually. As businesses across multiple industries take a more active role in focusing on environmental, social, and governance (ESG) solutions as part of their core business operations, HeatX will be an attractive technology for commercial investment.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2025

Harnessing the power of gradient-based simulations for multi-objective optimization in particle accelerators

Abstract Particle accelerator operation requires simultaneous optimization of multiple objectives. Multi-objective optimization (MOO) is particularly challenging due to trade-offs between the objectives. Evolutionary algorithms, such as genetic algorithms (GAs), have been leveraged for many optimization problems, however, they do not apply to complex control problems by design. This paper demonstrates the power of differentiability for solving MOO problems in particle accelerators using a deep differentiable reinforcement learning (DDRL) algorithm. We compare the DDRL algorithm with model-free reinforcement learning (MFRL), GA, and Bayesian optimization (BO) for simultaneous optimization of heat load and trip rates in the continuous electron beam accelerator facility. The underlying problem enforces strict constraints on both individual states and actions as well as cumulative (global) constraints on energy requirements of the beam. Using historical accelerator data, we develop a physics-based surrogate model which is differentiable and allows for back-propagation of gradients. The results are evaluated in the form of a Pareto-front with two objectives. We show that the DDRL outperforms MFRL, BO, and GA on high dimensional problems.

43 PARTICLE ACCELERATORS↗