Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Dynamic optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Pareto Optimization of Analog Circuits Using Reinforcement Learning

Analog circuit optimization and design presents a unique set of challenges in the IC design process. Many applications require the designer to optimize for multiple competing objectives, which poses a crucial challenge. Motivated by these practical aspects, we propose a novel method to tackle multi-objective optimization for analog circuit design in continuous action spaces. In particular, we propose to (i) extrapolate current techniques in Multi-Objective Reinforcement Learning to continuous state and action spaces and (ii) provide for a dynamically tunable trained model to query user defined preferences in multi-objective optimization in the analog circuit design context.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

CASTELO: clustered atom subtypes aided lead optimization—a combined machine learning and molecular modeling method

Background: Drug discovery is a multi-stage process that comprises two costly major steps: pre-clinical research and clinical trials. Among its stages, lead optimization easily consumes more than half of the pre-clinical budget. We propose a combined machine learning and molecular modeling approach that partially automates lead optimization workflow in silico, providing suggestions for modification hot spots. Results: The initial data collection is achieved with physics-based molecular dynamics simulation. Contact matrices are calculated as the preliminary features extracted from the simulations. To take advantage of the temporal information from the simulations, we enhanced contact matrices data with temporal dynamism representation, which are then modeled with unsupervised convolutional variational autoencoder (CVAE). Finally, conventional and CVAE-based clustering methods are compared with metrics to rank the submolecular structures and propose potential candidates for lead optimization. Conclusion: With no need for extensive structure-activity data, our method provides new hints for drug modification hotspots which can be used to improve drug potency and reduce the lead optimization time. It can potentially become a valuable tool for medicinal chemists.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Increase in the effective viscosity of polyethylene under extreme nanoconfinement

Understanding polymer transport in nanopores is crucial for optimizing heterogeneously catalyzed processes in polymer upcycling and fabricating high-performance nanocomposite films and membranes. Although confined polymer dynamics have been extensively studied, the behavior of polyethylene (PE)—the most widely used commodity polymer—in pores smaller than 20 nm remains largely unexplored. We investigate the effects of extreme nanoconfinement on PE transport using capillary rise infiltration in silica nanoparticle packings with average pore radii ranging from ~1 to ~9 nm. Using in situ ellipsometry and the Lucas–Washburn model, we discover a previously unknown inverse relationship between effective viscosity (η eff ) and average pore radius (R pore ). Additonally, we determine that PE transport under these extreme conditions is primarily governed by physical confinement, rather than pore surface chemistry. We refine an existing theory to provide a generalized formalism to describe the polymer transport dynamics over a wide range of pore radii (from 1 nm and larger). Our results offer valuable insights for optimizing catalyst supports in polymer upcycling and improving infiltration processes for nanocomposite fabrication.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Optimizing on-ramp merging for connected and automated vehicles: A hierarchical approach using deep reinforcement learning and optimal control

On-ramp merging for Connected and Automated Vehicles (CAVs) presents significant challenges in dynamic traffic environments. Traditional methods and recent learning-based approaches often fail to simultaneously address decision-making complexity and execution precision under fluctuating conditions. This study introduces a novel hierarchical framework that combines: (1) a high-level Deep Reinforcement Learning (DRL) module that coordinates merging sequences through Virtual Traffic Signals (VTS) with Yield/Green phases and (2) a low-level optimal controller generating collision-free speed trajectories via pseudospectral convex optimization. A convolutional autoencoder compresses high-dimensional traffic states to enhance responsiveness. Extensive simulations demonstrate a 12.5% improvement in mainline throughput a 28% reduction in emergency braking events, and 31.66% lower fuel consumption compared to baseline methods. Furthermore, the framework’s effectiveness in coordinating CAV merges highlights its potential for real-world deployment. Future work will extend validation to multi-lane scenarios with mixed traffic and large-scale multiple merging points.

Connected and automated vehicles↗
NASA NTRS1989

The PARTY parallel runtime system

In the present automated system for the organization of the data and computational operations entailed by parallel problems, in ways that optimize multiprocessor performance, general heuristics for partitioning program data and control are implemented by capturing and manipulating representations of a computation at run time. These heuristics are directed toward the dynamic identification and allocation of concurrent work in computations with irregular computational patterns. An optimized static-workload partitioning is computed for such repetitive-computation pattern problems as the iterative ones employed in scientific computation.

Saltz, J. H.↗
NASA NTRS1993

Optimization of multiparameter radar estimates of rainfall

The estimates of rainfall rate derived from a multiparameter radar based on reflectivity factor (R sub ZH), differential reflectivity (R sub DR), and specific differential propagation phase (R sub DP) have widely varying accuracies over the dynamic range of the natural occurrence of rainfall. This paper presents a framework to optimally combine the three estimates, R sub zH, R sub DR, and R sub DP, to derive the best estimate of rainfall using coherent multiparameter radars. The optimization procedure is demonstrated for application to multiparameter radar measurements at C band.

Chandrasekar, V.↗
DOE OSTI2025

A bilevel multistage stochastic self-scheduling model with indivisibilities for trading in the continuous intraday electricity market

In this paper, we study the profit maximization problem of a virtual power plant trading in the continuous intraday electricity market. Our virtual power plant model is compatible with renewable, and thermal assets, covering a range of virtual power plants currently participating in energy markets. We model the trading problem as a bilevel multistage stochastic program. The upper level of the problem accounts for the profit maximization of the virtual power plant with explicit modeling of the technical constraints of the operational status of the thermal power plant including minimum start-up and shut-down times, ramp-up and ramp-down rates, and minimum generation level. The upper level also decides which continuous and indivisible (fill-or-kill) orders are submitted to the market. The lower-level problem accounts for the clearing of the continuous intraday market, i.e., matching of buy and sell orders. Because of the presence of fill-or-kill orders, the lower-level problem is mixed-integer, which prevents its direct conversion to a single-level problem using duality. In order to solve this challenging problem, we develop a convex-hull extended formulation for the lower-level problem, apply duality theory to obtain a single-level stochastic equivalent formulation, and employ McCormick envelopes to turn the problem into a multistage stochastic mixed-integer linear problem, which we solve using the stochastic dual dynamic integer programming algorithm. We conduct numerical experiments and analyze the optimal trading behavior of a virtual power plant trading in an ideal continuous market without arbitrage.

Bilevel multistage stochastic programming problem↗
DOE OSTI2022

Numerical and experimental investigation of the flame kernel growth in a methane/air mixture near the lean flammability limit

Lean combustion has the potential to improve the thermal efficiency of spark-ignition engines, but it faces the significant challenge of increased cycle-to-cycle variation due to low mixture reactivity and unstable flame dynamics. Computational fluid dynamics (CFD) employing predictive models can guide engine design and optimize operating strategies for lean combustion. However, ignition and combustion models have rarely been validated at fuel-lean conditions, and a fundamental understanding of the early flame kernel growth process is also lacking for a successful sub-model development. Here, the present study develops a numerical simulation framework used to investigate early flame kernel growth in methane/air mixtures. A nanosecond-pulsed discharge (NPD) approach is employed to effectively decouple the flame kernel growth from the electrical discharge due to their difference in timescales, and equivalence ratios near the experimentally measured lean flammability limit (LFL) are selected to focus on challenging mixture conditions. Three numerical investigations, such as the choice of turbulence modeling, grid size, and grid control strategies, are examined to match both LFL and flame kernel structure measured from experiments. It is demonstrated that a quasi-direct numerical simulation (QDNS) with a fixed grid embedding of 10 μm can predict the LFL as φ CFD =0.61 and match the displacement speed of the kernel’s boundary marked in schlieren images. To predict the LFL and flame kernel shape, a fine grid (Δ≤12.5 μm) is needed to capture the consumption of formaldehyde (CH 2 O) in kernel’s reaction branches attached to the anode, and adaptive mesh refinement is replaced with the fixed embedding due to loss of simulation accuracy. Also, it is found that a large-eddy simulation (LES) using the Dynamic Structure model is not suitable for the NPD-induced flame kernel simulation because artificial sub-grid turbulent kinetic energy induced by shock dynamics alters the flow velocity calculation, resulting in divergence of LES from QDNS. Lastly, the simulation well matches the experimental data for the flame kernel evolution in three mixture conditions (φ = 0.7, 0.61, 0.55), showing toroidal flame kernel expansion and flame kernel growth/extinction.

33 ADVANCED PROPULSION SYSTEMS↗
NASA NTRS1993

Wing design for a civil tiltrotor transport aircraft: A preliminary study

A preliminary study was conducted on the design of the wing-box structure for a civil tiltrotor transport aircraft. The wing structural weight is to be minimized subject to structural and aeroelastic constraints. The composite wing-box structure is composed of skin, stringers, ribs, and spars. The design variables include skin ply thicknesses and orientations and spar cap and stringer cross-sectional areas. With the total task defined, an initial study was conducted to learn more about the intricate dynamic and aeroelastic characteristics of the tiltrotor aircraft and their roles in the wing design. Also, some work was done on the wing finite-element modeling (via PATRAN) which would be used in structural analysis and optimization. Initial studies indicate that in order to limit the wing/rotor aeroelastic and dynamic interactions in the preliminary design, the cruise speed, rotor system, and wing geometric attributes must all be held fixed.

Rais-Rohani, Masoud↗
DOE OSTI2022

Experimental validation of multiphysics model simulations of the thermal response of a cement clinker rotary kiln at laboratory scale

Abstract An increasing demand for buildings, transportation systems and civil infrastructure development has driven expansion of cement consumption world‐wide, producing a significant increase in related global energy demand. With approximately 7% of the world‐wide industrial energy consumption (10.7 exajoules [EJ]), the cement industry is the third most energy intensive industrial processes and a key component for concrete, the most consumed composite material in the global construction industry. In cement manufacturing, the cement kiln accounts for most of the energy consumption in the production process. As the heart of a cement plant, the cement kiln is where the kiln feed primarily containing calcium oxide (CaO), silica (SiO 2 ), alumina (Al 2 O 3 ), and iron (Fe 2 O 3 ) are thermally and chemically transformed into clinker minerals. The presented work developed a multiphysics model, designed and built a laboratory‐scale rotary cement clinker kiln, and produced cement clinker at laboratory‐scale. The model was developed to study the interaction between the various thermal, fluid dynamic and chemical interactions involved in the sintering process used to form Portland cement clinker in an effort to reduce energy use. The analytical model was validated through experimental testing using a unique laboratory‐scale rotary cement kiln developed during the investigation. Also demonstrated was the feasibility of producing clinker at laboratory scale. This modeling and lab scale tests were designed to better understand the clinker sintering process so that operational and quality decisions can be made to optimize energy consumption without compromising cement clinker quality. The computational fluid dynamics modeling was developed in COMSOL Multiphysics 6.0. The characteristics of the combustion fluid flow, concentration of species, temperature and heat transfer were studied for a turbulent flow of methane (CH 4 ) gas and oxygen (O 2 ). Theory suggests that heat transfer impacts the cement production process but the multiphysics model more accurately describes the convection, conduction, and radiant heat transfer in the kilning process and thus allows for a better understanding of the energy exchange driving the chemical reactions that produce Portland cement. Clinker minerals were formed because of appropriate burning conditions implemented during experimental model validation.

Tabares, Juan David↗
DOE OSTI2020

Exponential Decay in the Sensitivity Analysis of Nonlinear Dynamic Programming

In this report, we study the sensitivity of discrete-time dynamic programs with nonlinear dynamics and objective to perturbations in the initial conditions and reference parameters. Under uniform controllability and boundedness assumptions for the problem data, we prove that the directional derivative of the optimal state and control at time $k$, $x^*_k$, and $u^*_k$, with respect to the reference signal at time $i$, $d_i$, will have exponential decay in terms of $|k-i|$ with a decay rate $\rho$ independent of the temporal horizon length. The key technical step is to prove that a version of the convexification approach proposed by Verschueren et al. can be applied to the KKT conditions and results in a convex quadratic program with uniformly bounded data. In turn, Riccati techniques can be further employed to obtain the sensitivity result, borne from the observation that the directional derivatives are solutions of quadratic programs with structure similar to the KKT conditions themselves. We validate our findings with numerical experiments on a small nonlinear, nonconvex, dynamic program.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Microstructure effects on high velocity microparticle impacts of copper

Constitutive models can fail to predict high-rate deformation behavior due to their inability to account for microstructural effects. In part, this is because of a dearth of experimental benchmarking data in the high strain-rate, low pressure regime, since many high-rate experiments also probe a region of strong shockwaves, at which point microstructure effects no longer play a primary role. This work uses laser-induced particle impact testing to quantitatively study high velocity impacts of small, rigid alumina microspheres on flat copper substrates with varying amounts of initial cold work in the weak shock regime, but at very high strain rates up to ~10 7 s –1 . Through paired experiments and numerical simulations, this work shows that the initial microstructure condition can have significant influence on dynamical mechanical properties in this range. Specifically, prior work hardening of the copper substrate leads to increased rebounding of the microparticles (i.e., less plastic dissipation in the impact) as well as smaller craters. Each of these experimental measurables can be converted into a strength measure, i.e., the dynamic yield strength or dynamic hardness, respectively, neither of which is well predicted consistently by existing constitutive laws. The general trend of hardening can be captured by such models by incorporating an existing “pre-strain,” suggesting that future calibration of the materials parameters may yield a good fit over a broader range of conditions. Our results emphasize the importance of reporting the microstructural condition in dynamic studies, as well as the necessity of accounting for these factors when formulating and optimizing constitutive models.

36 MATERIALS SCIENCE↗
NASA NTRS1990

A computational algorithm for spacecraft control and momentum management

Developments in the area of nonlinear control theory have shown how coordinate changes in the state and input spaces of a dynamical system can be used to transform certain nonlinear differential equations into equivalent linear equations. These techniques are applied to the control of a spacecraft equipped with momentum exchange devices. An optimal control problem is formulated that incorporates a nonlinear spacecraft model. An algorithm is developed for solving the optimization problem using feedback linearization to transform to an equivalent problem involving a linear dynamical constraint and a functional approximation technique to solve for the linear dynamics in terms of the control. The original problem is transformed into an unconstrained nonlinear quadratic program that yields an approximate solution to the original problem. Two examples are presented to illustrate the results.

Dzielski, John↗
DOE OSTI2025

LC-Opt: Benchmarking Reinforcement Learning and Agentic AI for End-to-End Liquid Cooling Optimization in Data Centers

Liquid cooling is critical for thermal management in high-density data centers with the rising AI workloads. However, machine learning-based controllers are essential to unlock greater energy efficiency and reliability, promoting sustainability. We present LC-Opt, a Sustainable Liquid Cooling (LC) benchmark environment, for reinforcement learning (RL) control strategies in energy-efficient liquid cooling of high-performance computing (HPC) systems. Built on the baseline of a high-fidelity digital twin of Oak Ridge National Lab's Frontier Supercomputer cooling system, LC-Opt provides detailed Modelica-based end-to-end models spanning site-level cooling towers to data center cabinets and server blade groups. RL agents optimize critical thermal controls like liquid supply temperature, flow rate, and granular valve actuation at the IT cabinet level, as well as cooling tower (CT) setpoints through a Gymnasium interface, with dynamic changes in workloads. This environment creates a multi-objective real-time optimization challenge balancing local thermal regulation and global energy efficiency, and also supports additional components like a heat recovery unit (HRU). We benchmark centralized and decentralized multi-agent RL approaches, demonstrate policy distillation into decision and regression trees for interpretable control, and explore LLM-based methods that explain control actions in natural language through an agentic mesh architecture designed to foster user trust and simplify system management. LC-Opt democratizes access to detailed, customizable liquid cooling models, enabling the ML community, operators, and vendors to develop sustainable data center liquid cooling control solutions.

Naug, Avisek [Hewlett Packard Enterprise]↗
NASA NTRS2002

The Design of Collectives of Agents to Control Non-Markovian Systems

The 'Collective Intelligence' (COIN) framework concerns the design of collectives of reinforcement-learning agents such that their interaction causes a provided 'world' utility function concerning the entire collective to be maximized. Previously, we applied that framework to scenarios involving Markovian dynamics where no re-evolution of the system from counter-factual initial conditions (an often expensive calculation) is permitted. This approach sets the individual utility function of each agent to be both aligned with the world utility, and at the same time, easy for the associated agents to optimize. Here we extend that approach to systems involving non-Markovian dynamics. In computer simulations, we compare our techniques with each other and with conventional-'team games'. We show whereas in team games performance often degrades badly with time, it steadily improves when our techniques are used. We also investigate situations where the system's dimensionality is effectively reduced. We show that this leads to difficulties in the agents' ability to learn. The implication is that 'learning' is a property only of high-enough dimensional systems.

Lawson, John W.↗
NASA NTRS2004

The Design of Collectives of Agents to Control Non-Markovian Systems

The Collective Intelligence (COIN) framework concerns the design of collectives of reinforcement-learning agents such that their interaction causes a provided "world" utility function concerning the entire collective to be maximized. Previously, we applied that framework to scenarios involving Markovian dynamics where no re-evolution of the system from counter-factual initial conditions (an often expensive calculation) is permitted. This approach sets the individual utility function of each agent to be both aligned with the world utility, and at the same time, easy for the associated agents to optimize. Here we extend that approach to systems involving non-Markovian dynamics. In computer simulations, we compare our techniques with each other and with conventional "team games". We show whereas in team games performance often degrades badly with time, it steadily improves when our techniques are used. We also investigate situations where the system's dimensionality is effectively reduced. We show that this leads to difficulties in the agents ability to learn. The implication is that learning is a property only of high-enough dimensional systems.

Lawson, John W.↗
DOE OSTI2020

Wind Farm Simulation and Layout Optimization in Complex Terrain: Preprint

This work reports on incorporating complex terrain into wind farm simulations for the purpose of layout optimization. Adding complex terrain boundary conditions to NREL's medium fidelity computational fluid dynamics model, WindSE, produces significant separation, flow curvature, and speedup effects that would otherwise be difficult to capture with lower-fidelity models or a flat-terrain assumption. These flow features, in turn, can significantly impact the optimal turbine array layout. We demonstrate the impact of complex terrain on flow in both an idealized and real-world setting, and discuss modifications to the code that enable gradient-based optimization using terrain-aware adjoint gradients. Through several optimization case studies, we show that the layout optimization process takes advantage of speedup effects on terrain high points, and leverages flow curvature effects that modify wake trajectories. This yields substantial power improvements over gridded layouts, and hints at future research directions in simulation and optimization for wake trajectories in complex terrain.

17 WIND ENERGY↗