Engineering PapersSearch

SEARCH · Engineering Papers

Results for “high dimensional optimal control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Neural network approaches for parameterized optimal control

Here, we consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage to enable rapid decision-making and be able to react to changes in the parameter in the online stage. To tackle the curse of dimensionality arising when the state and/or parameter are high-dimensional, we represent the policy using neural networks. We compare two training paradigms: First, our model-based approach leverages the dynamics and definition of the objective function to learn the value function of the parameterized optimal control problem and obtain the policy using a feedback form. Second, we use actor-critic reinforcement learning to approximate the policy in a data-driven way. Using an example involving a two-dimensional convection-diffusion equation, which features high-dimensional state and parameter spaces, we investigate the accuracy and efficiency of both training paradigms. While both paradigms lead to a reasonable approximation of the policy, the model-based approach is more accurate and considerably reduces the number of PDE solves.

97 MATHEMATICS AND COMPUTING

Refractory-based thermal energy storage for industrial process heat: one-dimensional modeling, control, and optimization

The variable and weather-dependent output of wind and solar power plants present a substantial challenge for planning and operating electricity-systems, particularly in the absence of cost-effective and dispatchable energy storage technologies. This study investigates a high-temperature, electrically heated, refractory-based thermal energy storage (RTES) system that stores electrical energy as sensible heat in dense ceramic bricks over the 950–1800 °C range. The stored heat can be discharged as a controlled hot-gas stream for industrial heating, fuel substitution in high-temperature processes, or electricity generation. The main novelty is a comprehensive modelling, control, mapping, and optimization framework that integrates one-dimensional transient gas–solid heat transfer, fan-assisted discharge, bypass-flow regulation, reheating logic, fan-power evaluation, insulation-loss assessment, and genetic-algorithm-based design optimization. The model uses feedback from outlet temperature and delivered power to regulate discharge, while a two-stage genetic algorithm optimizes brick-channel geometry, gas-flow operation, and multilayer insulation thicknesses. Storage capacities below 50 MWh and discharge powers of 5–30 MW are analyzed to evaluate hold time, thermal delivery, fan-power penalty, heat loss, state-of-charge evolution, and indicative capital cost. Results demonstrate that optimized and well-insulated refractory-based thermal energy storage units can provide stable, efficient, and repeatable heat delivery over multiple discharge cycles. The generated performance and cost maps support modular refractory thermal energy storage as a practical option for large-scale integration of wind and solar generation and for high-temperature industrial process heat.

25 ENERGY STORAGE

Optimizing on-ramp merging for connected and automated vehicles: A hierarchical approach using deep reinforcement learning and optimal control

On-ramp merging for Connected and Automated Vehicles (CAVs) presents significant challenges in dynamic traffic environments. Traditional methods and recent learning-based approaches often fail to simultaneously address decision-making complexity and execution precision under fluctuating conditions. This study introduces a novel hierarchical framework that combines: (1) a high-level Deep Reinforcement Learning (DRL) module that coordinates merging sequences through Virtual Traffic Signals (VTS) with Yield/Green phases and (2) a low-level optimal controller generating collision-free speed trajectories via pseudospectral convex optimization. A convolutional autoencoder compresses high-dimensional traffic states to enhance responsiveness. Extensive simulations demonstrate a 12.5% improvement in mainline throughput a 28% reduction in emergency braking events, and 31.66% lower fuel consumption compared to baseline methods. Furthermore, the framework’s effectiveness in coordinating CAV merges highlights its potential for real-world deployment. Future work will extend validation to multi-lane scenarios with mixed traffic and large-scale multiple merging points.

Connected and automated vehicles

AEOLUS: Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems

Sustained advances in the mathematics of modeling and simulation have resulted in the capability today for routine simulation of a number of large scale complex DOE-relevant systems. As remarkable as this capability for solving the so-called forward problem is, it is typically only the first step-an inner loop within an outer loop that explores the simulation model's parameter space and decision space to characterize uncertainty in the model's predictions, learn unknown model parameters from data, design the most informative experiments, determine optimal control strategies, and create optimal designs. Broadly, what unifies all of these outer loop problems is that they are, in one form or another, optimization problems over parameter/control/design space that are constrained by complex uncertain models. To fully realize the power of scientific simulation as a basis for scientific discovery, technological innovation, and rational decision-making, it is imperative to move beyond simulation to tackle the outer loop of optimization for learning from data, experimental design, and control with complex uncertain models. When the models under consideration are large-scale and complex, and when the optimization variable and uncertain parameter spaces are high (or infinite) dimensional, this constitutes a grand challenge of the highest order, and is intractable with conventional methods. To overcome these challenges, the AEOLUS Center was established to develop a unified mathematical, computational, and statistical framework for (1) Learning predictive models from complex data via Bayesian inference and optimization, and (2) Optimizing experiments, processes, and designs using the resulting uncertain models. These problems are intractable with conventional methods, for several reasons: (1) The simulation problems that govern the inner loops of the optimization problems are expensive to execute (due to severe nonlinearity, heterogeneity, multiphysics/multiscale coupling); (2) The optimization variable and uncertain parameter spaces are high dimensional, often stemming from discretizations of infinite dimensional fields such as initial conditions, sources, or material properties. We argue that the key to overcoming these challenges is to develop new mathematical, computational, and statistical methods that exploit the structure of the Bayesian inference and optimization problems mediated by their underlying complex uncertain models. This structure includes the regularity, sparsity, geometry, low intrinsic dimensionality, and multifidelity nature of the maps from uncertain parameter/optimization variable spaces to the specific objectives targeted: Bayesian inference, optimal experimental design, and optimal control design. Black box methods developed as generic tools are incapable of exploiting this structure. To be successful, we must create, integrate, and cross-fertilize ideas across multiple areas of applied math--including approximation theory, Bayesian inference, data science, experimental design, information theory, machine learning, model reduction, optimal control theory, parallel algorithms, PDE-constrained optimization, randomized algorithms, stochastic optimization, and uncertainty quantification--all while exploiting the structure of the problems at hand. With this goal in mind, we have marshaled a team of leading authorities in these areas. While the methods we develop will be broadly applicable across a wide spectrum of DOE problems in which experiments inform models and the systems those models describe must be optimized under uncertainty, we have chosen a specific area, advanced manufacturing and materials, to drive our work. AMM is characterized by complex models across multiple scales, and is a rich source of challenging problems in inference, experimental design, and optimal control, requiring multifaceted and integrated advances in applied mathematics. As such, AMM serves as an excellent vehicle to motivate and demonstrate the advances in applied mathematics developed by our center.

97 MATHEMATICS AND COMPUTING

Manufacturing Li 2 TiO 3 -based tritium breeder materials by volume-controlled spark plasma sintering with an optimized microstructure

Multifunctional ceramic breeder materials are highly desirable for the deuterium-tritium fusion to achieve high efficiency in breeding tritium through neutron irradiation of lithium-containing blankets. Li 2 TiO 3 displays unique attributes as a potential ceramic breeder material. An optimized microstructure with three-dimensional interconnected pore structure is required for rapid transport of the tritium for effective fuel cycle, which however enviably results in the degradation of the thermal-mechanical properties of the breeding materials. In this work, nanocrystalline porous Li 2 TiO 3 ceramic pellets with controlled porosities of 14% and 20% are manufactured by volume-controlled spark plasma sintering. An optimized 3D interconnected pore structure is achieved consisting of both micro-sized pores and nano-sized pores embedded in nanocrystalline matrix, which could be beneficial to facilitate easy removal of bred T and He. Further, the 3D interconnected porous structure is well maintained upon isothermal annealing of the SPS-fabricated pellets at relevant operation temperature of the solid breeding materials. Single-phasic porous pellets also display enhanced thermal-mechanical properties, superior to current state-of-the-art materials which establish their potential as a promising tritium breeder material for nuclear fusion applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY

Quantum Reinforcement Learning for Volt-VAR Control in Power Distribution Systems

Volt-VAR control (VVC) is crucial in active distribution networks for optimizing voltage profiles and minimizing network losses. While traditional deep reinforcement learning (DRL) algorithms exhibit promise for VVC, they often require extensive computational resources to handle such a high-dimensional problem. As a potential solution, quantum reinforcement learning (QRL) algorithms integrate the computational capabilities of quantum computing into the DRL framework. However, existing QRL algorithms struggle with complex VVC problems due to the limitations of current quantum hardware. To bridge this gap, this paper proposes an innovative QRL algorithm featuring an end-to-end architecture that integrates a classical autoencoder, variational quantum circuits (VQCs), and classical post-processing layers. This design efficiently compresses high-dimensional grid states, enabling VQCs to leverage quantum advantages while producing multiple control device outputs tailored for VVC tasks. Numerical studies on three representative distribution systems verify the effectiveness and scalability of the proposed QRL algorithm, and demonstrate its enhanced performance over classical approaches with only approximately 1% of the parameters. Additionally, the robustness of our developed algorithm is validated through noisy quantum environments.

97 MATHEMATICS AND COMPUTING

Leveraging prior mean models for faster Bayesian optimization of particle accelerators

Tuning particle accelerators is a challenging and time-consuming task that can be automated and carried out efficiently using suitable optimization algorithms, such as model-based Bayesian optimization techniques. One of the major advantages of Bayesian algorithms is the ability to incorporate prior information about beam physics and historical behavior into the model used to make control decisions. In this work, we examine incorporating prior accelerator physics information into Bayesian optimization algorithms by utilizing fast executing, neural network models trained on simulated or historical datasets as prior mean functions in Gaussian process models. We show that in ideal cases, this technique substantially increases convergence speed to optimal solutions in high-dimensional tuning parameter spaces. Additionally, we demonstrate that even in non-ideal cases, where prior models of beam dynamics do not exactly match experimental conditions, the use of this technique can still enhance convergence speed. Finally, we demonstrate how these methods can be used to improve optimization in practical applications, such as transferring information gained from beam dynamics simulations to online control of the LCLS injector, and transferring knowledge gained from experimental measurements across different operating modes, such as accelerating different ion species at the ATLAS heavy ion accelerator.

43 PARTICLE ACCELERATORS

Numerical framework for integrated additive manufacturing-compression molding (AM-CM) of thermoplastic composites

Additive manufacturing-compression molding (AM-CM) has emerged as a transformative technology in advanced composite manufacturing. Additive manufacturing (AM) offers high design flexibility and the ability to produce complex geometries with precisely aligned fibers in the preferred orientation. Compression molding (CM) enhances composite materials by providing excellent dimensional stability, reduced porosity, high production rates, and a smooth surface finish. Despite these advantages, extensive integrated analysis is required to optimize processing conditions for improved fiber orientation distribution (FOD) and porosity control. Here, this study develops a comprehensive numerical model to simulate the AM-CM manufacturing process. The model isolates the effects of both the AM and CM phases while also capturing their integration. Additionally, it accounts for heat transfer, temperature-dependent viscosity, and fiber orientation in the extruded fiber-filled polymer, accurately representing material behavior during processing. This approach enables the analysis of interactions between deposited beads of complex strand shapes and their interface regions after full compression. Moreover, the model predicts key parameters such as polymer flowability, fiber orientation, and temperature evolution in AM-CM parts. By optimizing processing conditions, it facilitates a controlled and predictable microstructure.

36 MATERIALS SCIENCE

Toward memory-efficient melt pool monitoring: a classification framework using event-based imaging and sparse sensing technique

Vision sensors like CMOS and CCD cameras are often used for in-process monitoring of melt pools in laser-based additive and welding processes, but they require transferring large amounts of data and computational processing resources. Event-based neuromorphic imagery, on the other hand, detects only the change in pixel intensity, thus potentially reducing the data amount and latency. With an event imager, this study develops a framework for melt pool condition classification, including image construction, time scale selection, optimal pixel selection, and sparse classification, to achieve a highly memory-efficient scheme. These are based on sparse sensing techniques with singular value decomposition (SVD) and QR pivoting, the two fundamental matrix transformations for linear dimensionality reduction. The framework is then validated by classifying a controlled experiment by exciting various mode shapes of liquid gallium pools of varying depths (3, 6, and 8 mm). At 200 pixels, the classifier can reach overall accuracy of 75%, while at 2000 pixels (0.013% of the total possible pixels), the accuracy is nearly 90% (89.86%). At the same number of pixels, random selection can only achieve 46% and 67%, respectively. The memory savings of the sparsely sampled event data compared to a conventional imager is about 500 times. In addition to performance, implementation and limitations of the framework are also discussed.

42 ENGINEERING

Explainable and Differentiable Reinforcement Learning for Multi-objective Optimization in Particle Accelerators

Operating particle accelerators involves optimizing multiple goals simultaneously, which can be challenging due to trade-offs among objectives. While evolutionary algorithms like the genetic algorithm (GA) have been used for various Multi-Objective Optimization (MOO) tasks, they are not inherently suited for complex control problems. This talk highlights two variations of Reinforcement Learning (RL) for concurrently optimizing heat load and trip rates at the Continuous Electron Beam Accelerator Facility (CEBAF). The problem involves strict constraints on individual states, actions, and overall energy requirements of the beam. First, this talk highlights how differentiability can be harnessed through a Deep Differentiable Reinforcement Learning (DDRL) approach to address MOO issues within particle accelerators. We examine the DDRL method alongside Model Free Reinforcement Learning (MFRL), GA, and Bayesian Optimization (BO). The performance of these methods is assessed by generating a Pareto-front for two objectives. Our findings indicate that DDRL excels in handling high-dimensional problems more effectively than MFRL, BO, and GA. Next, we will show integration of explainable physics-based constraints into RL algorithms to enhance trans- parency and trust in decision-making processes by enabling users to verify that agents adhere to established physical principles. This surrogate function can be modeled using neural networks or sparse dictionary mod- els. By examining the mathematical form of the learned constraint function, we are able to confirm the agent has learned to use the established physics of each environment provided but the surrogate model. In addi- tion, we find that the introduction of a mathematical functional dictionary based surrogate model enables our reinforcement learning algorithms to reliably converge for difficult high-dimensional accelerator controls environments.

Rajput, Kishansingh [Thomas Jefferson National Acc

Impact of toroidal magnetic field direction on integrated ELM-stable operation and divertor power exhaust via boron powder injection in EAST

We report the first in-depth comparison of the impact of toroidal magnetic field direction on solid boron injection used for Edge-Localized Mode (ELM) control, power exhaust, and core high-Z impurity control in the Experimental Advanced Superconducting Tokamak. With favorable ion ∇B drift towards the upper X-point in an upper-single-null configuration, boron injection effectively suppresses ELMs, produces a detachment of the inner divertor target, and leads to improved energy confinement. ELM suppression in this configuration is accompanied by the excitation of an Edge Harmonic Mode. In contrast, with unfavorable ion ∇B drift away from the upper X-point, boron injection also suppresses ELMs but leads to a more symmetric detachment state of both the inner and outer divertor targets, while plasma energy confinement is slightly degraded despite similar boron injection levels; a different low-frequency coherent mode without multiple harmonics is observed. Measurements from toroidally separated views show that the divertor response to boron injection is essentially toroidally symmetric, supporting the use of two-dimensional SOLPS-ITER modeling with a toroidally uniform impurity source. These experimental observations are qualitatively consistent with SOLPS-ITER simulations, which highlight the critical role of E × B drift effects in setting the Bt-dependent in–out asymmetry of detachment and in asymmetrically transporting particles and injected impurities within the scrape-off layer and private-flux region. These findings underscore the importance of drift physics and real-time wall conditioning in controlling low-Z impurity transport and optimizing edge solutions for integrated, ELM-stable, high-performance tokamak operation.

E × B drift

Embedded 3D printing of isotropically enhanced lattice structure with programmable elasticity via three-dimensional fiber alignment

Engineered composites with fiber orientation in a complete three-dimensional (3D) context are highly desired for maximizing structural performance as they mimic the well-organized fiber arrangement in natural composites. However, most fabrication techniques lack the capability for through-plane (z-axis) alignment, limiting the possibility for structural design and performance optimization. In this study, we present an embedded 3D printing approach that enables complete 3D fiber alignment, including region-specific alignment control along the through-plane direction. Our method utilizes the extrusion and suspension of composite inks within a supporting matrix. By regionally adjusting the ink extrusion rate and nozzle translation rate, we locally manipulated the fiber arrangement within the composite 3D architecture. Here, we demonstrate that the 3D alignment of carbon fibers in a structural composite significantly enhances both mechanical properties and thermal conductivity in the in-plane and through-plane directions. Furthermore, by strategically arranging regional fiber orientations within micro-architected materials, we fabricated metamaterial engineered composites with programmable anisotropy ratio and directional moduli.

36 MATERIALS SCIENCE

Optimal Power Management for Large-Scale Battery Energy Storage Systems via Bayesian Inference

Large-scale battery energy storage systems (BESS) have found ever-increasing use across industry and society to accelerate clean energy transition and improve energy supply reliability and resilience. However, their optimal power management poses significant challenges: the underlying high-dimensional nonlinear nonconvex optimization lacks computational tractability in real-world implementation, and the uncertainty of the exogenous power demand makes exact optimization difficult. This paper presents a new solution framework to address these bottlenecks. The solution pivots on introducing power-sharing ratios to specify each cell’s power quota from the output power demand. To find the optimal power-sharing ratios, we formulate a nonlinear model predictive control (NMPC) problem to achieve power-loss-minimizing BESS operation while complying with safety, cell balancing, and power supply-demand constraints. We then propose a parameterized control policy for the power-sharing ratios, which utilizes only three parameters, to reduce the computational demand in solving the NMPC problem. This policy parameterization allows us to translate the NMPC problem into a Bayesian inference problem for the sake of 1) computational tractability, and 2) overcoming the nonconvexity of the optimization problem. We leverage the ensemble Kalman inversion technique to solve the parameter estimation problem. Concurrently, a low-level control loop is developed to seamlessly integrate our proposed approach with the BESS to ensure practical implementation. This low-level controller receives the optimal power-sharing ratios, generates output power references for the cells, and maintains a balance between power supply and demand despite uncertainty in output power. We conduct extensive simulations and experiments on a 20-cell prototype to validate the proposed approach.

Battery energy storage systems (BESSs)

Divertor Plasma Detachment Control Neural Network

DivControlNN is a state-of-the-art software tool that leverages advanced machine learning techniques to predict and control divertor plasma behavior in fusion reactors. Plasma, a highly energetic and electrically charged gas, requires meticulous management to protect reactor components and maintain optimal energy production. Conventional simulation methods, although extremely detailed, typically demand extensive computational time-making them unsuitable for real-time control scenarios. DivControlNN addresses this challenge by learning from tens of thousands of high-fidelity simulations, thereby creating a rapid surrogate model that can deliver near-instantaneous predictions. At the core of its functionality is a sophisticated technique known as latent space mapping, which condenses complex, high-dimensional plasma data into a compact, lower-dimensional representation. This streamlined representation enables the system to quickly forecast essential plasma properties and determine the precise conditions required for effective detachment. Detachment is a crucial process in which the plasma is cooled before reaching the divertor plates, thereby reducing heat loads and mitigating material erosion. In recent experiments conducted on the KSTAR tokamak in South Korea, DivControlNN successfully guided the detachment process without any fine-tuning-even when applied to a new tungsten divertor configuration. By achieving a computational speed-up of over one hundred million times compared to traditional simulation methods while maintaining low prediction errors, DivControlNN stands to significantly enhance real-time control and diagnostic capabilities in future fusion reactors. This breakthrough paves the way for safer, more reliable reactor operation and represents a major advancement toward realizing fusion energy as a practical, sustainable, and clean power source.

Xu, Xueqiao [Lawrence Livermore National Laborator

PDE-constrained high-order mesh optimization

Here, we present a novel framework for PDE-constrained r-adaptivity of high-order meshes. The proposed method formulates mesh movement as an optimization problem, with an objective function defined as a convex combination of a mesh quality metric and a measure of the accuracy of the PDE solution obtained via finite element discretization. The proposed formulation achieves optimized, well-defined high-order meshes by integrating mesh quality control, PDE solution accuracy, and robust gradient regularization. We adopt the Target-Matrix Optimization Paradigm to control geometric properties across the mesh, independent of the PDE of interest. To incorporate the accuracy of the PDE solution, we introduce error measures that control the finite element discretization error. The implicit dependence of these error measures on the mesh nodal positions is accurately captured by adjoint sensitivity analysis. Additionally, a convolution-based gradient regularization strategy is used to ensure stable and effective adaptation of high-order meshes. We demonstrate that the proposed framework can improve mesh quality and reduce the error by up to 10 times for the solution of Poisson and linear elasto-static problems. The approach is general with respect to the dimensionality, the order of the mesh, the types of mesh elements, and can be applied to any PDE that admits well-defined adjoint operators.

Computer science

Exact Fock-State Preparation with $n^{1/4}$ Circuit Depth

Efficient, deterministic, and high-fidelity preparation of large Fock states is essential for scaling bosonic quantum technologies and exploring quantum phenomena at large excitation energies. We introduce a deterministic one-parameter (D1p) protocol that maps Fock-state preparation in an infinite-dimensional Hilbert space onto two-dimensional amplitude amplification. Starting from a coherent state with $|α|\simeq\sqrt{n}$, the initial target-state population scales as $n^{-1/2}$, yielding an iteration count and circuit depth of $\mathcal{O}(n^{1/4})$. Phase matching guarantees unit fidelity in the ideal model; remarkably, preparing $|{10^6}\rangle$ requires only 39 iterations. The protocol uses only displacements and number-selective phase operations, requires no numerical optimization, and further extends to state transfer, general superpositions, finite-dimensional systems, and multipartite entangled states. In the large-amplitude regime, its multi-target form prepares $L$-legged cat states with an iteration count determined only by $L$; cats with up to ten legs require only two iterations, independent of the coherent-state amplitude. This framework provides a broadly applicable route to highly excited bosonic states on platforms supporting these elementary controls.

Roy, Tanay [Fermilab] (ORCID:000000019442862X)

Signal amplification in a solid-state sensor through asymmetric many-body echo

Electronic spins of nitrogen–vacancy centres in diamond constitute a promising system for micro- and nanoscale magnetic sensing, because of their operation under ambient conditions, ease of placement in close proximity to sensing targets and biological compatibility. At high densities, the electronic spins interact through dipolar coupling, which typically limits but can also potentially enhance sensing performance. Here we report the experimental demonstration of many-body signal amplification in a solid-state, room-temperature quantum sensor. Our approach uses time-reversed two-axis-twisting interactions, engineered through dynamical control of the quantization axis and Floquet engineering in a two-dimensional ensemble of nitrogen–vacancy centres. We observe that optimal amplification occurs when the backward evolution time equals twice the forward evolution time, in sharp contrast to the conventional Loschmidt echo. These observations can be understood as resulting from an underlying time-reversed mirror symmetry of the microscopic dynamics, providing key insights into signal amplification and opportunities for practical entanglement-enhanced quantum sensing.

quantum information

Two-Dimensional Perovskite Single-Nanowire Photodetectors

High-performance microphotodetectors require materials that combine strong light–matter interaction, fast charge transport, and ambient stability. Here, we demonstrate single-nanowire devices based on the 2D perovskite (TPA3) 2 PbBr 4 , synthesized via a controlled slow-cooling self-assembly process that yields defect-minimized, anisotropic nanowires with smooth facets. These microphotodetectors exhibit ultralow dark currents (∼10 –15 A), high responsivity (up to 156 mA W –1 ), and exceptional specific detectivity (∼10 11 Jones) under near-UV (405 nm) illumination, with rise and fall times in the millisecond regime. The superior detectivity is primarily driven by the suppression of thermal noise through the material’s ultralow dark current, while the millisecond temporal response is governed by high-intensity trap-filling dynamics. The devices maintain stable operation over 4000 s of continuous on/off cycling and show remarkable ambient stability over weeks, attributed to dense crystal packing and robust organic cation layers. Furthermore, the influence of nanowire thickness on the charge collection efficiency is systematically elucidated through optical penetration depth analysis, highlighting design principles for optimizing low-dimensional perovskite photodetectors. This study introduces single 2D perovskite nanowires as a versatile platform for miniaturized, high-performance optoelectronic devices.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH