SEARCH · Engineering Papers
Results for “Dynamic optimization”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Optimizing Error-Bounded Lossy Compression for Scientific Data by Dynamic Spline Interpolation
Today's scientific simulations are producing vast volumes of data that cannot be stored and transferred efficiently because of limited storage capacity, parallel I/O bandwidth, and network bandwidth. The situation is getting worse over time because of the ever-increasing gap between relatively slow data transfer speed and fast-growing computation power in modern supercomputers. Error-bounded lossy compression is becoming one of the most critical techniques for resolving the big scientific data issue, in that it can significantly reduce the scientific data volume while guaranteeing that the reconstructed data is valid for users because of its compression-error-bounding feature. In this paper, we present a novel error-bounded lossy compressor based on a state-of-the-art prediction-based compression framework. Our solution exhibits substantially better compression quality than all of the existing error-bounded lossy compressors, with comparable compression speed. Specifically, our contribution is threefold. (1) We provide an in-depth analysis of why the best-existing prediction-based lossy compressor can only minimally improve the compression quality. (2) We propose a dynamic spline interpolation approach with a series of optimization strategies that can significantly improve the data prediction accuracy, substantially improving the compression quality in turn. (3) We perform a thorough evaluation using six real-world scientific simulation datasets across different science domains to evaluate our solution vs. all other related works. Experiments show that the compression ratio of our solution is higher than that of the second-best lossy compressor by 20%similar to 460% with the same error bound in most of the cases.
ARPA-E Grid Optimization (GO) Competition Challenge 2
The ARPA-E Grid Optimization (GO) Competition Challenge 2, from 2020 to 2021, expanded upon the problem posed in Challenge 1 by adding adjustable transformer tap ratios, phase shifting transformers, switchable shunts, price-responsive demand, ramp rate constrained generators and loads, and fast-start unit commitment. Furthermore, Challenge 2 was a maximization problem while Challenge 1 was a minimization problem. Specifically, the economic surplus, defined as the benefit of serving load minus the cost of generation, is being maximized. It was expected that the objective value of a given solution should be positive, representing economic gain, but negative objectives from poor solutions were possible. The two code submission feature of Challenge 1 was maintained. Additionally, Divisions 3 and 4 within the competition permitted on/off switching of transmission lines (Divisions 1 and 2 did not). After the initial release of the Problem Formulation on 7/20/2020, ARPA-E Director Lane Genatowski announced Challenge 2 on 9/12/2020. The final May 31, 2021, version of the Problem Formulation was 97 pages long with 299 equations. The Challenge proceeded with 2 non-prize Events and 2 prize Events. Teams receiving Challenge 1 FOA awards and prize money were required to use the prize money to fund their Challenge 2 efforts (Georgia Institute of Technology, Global Optimal Technology, Inc., Lawrence Livermore National Laboratory, Lehigh University, Northwestern University, Artelys, Columbia, Pearl Street Technologies, Pennsylvania State University, and University of Colorado Boulder). For more information on the competition and challenge 2 see the "GO Competition Challenge 2 Information" resource below. Challenge 1 and Challenge 3 information can be found in the resources linked below.
The Leading Modes of Asian Summer Monsoon Variability as Pulses of Atmospheric Energy Flow
Monsoon rainfall anomalies are often organized into dynamical modes that are more predictable than rainfall at specific locations. Here a linear response function (LRF) is constructed to extract the neutral modes (NM) of the dynamical atmospheric system and their optimal forcing that govern precipitation variability, providing a dynamical underpinning for the empirically derived, recurrent rainfall patterns. The leading mode (NM1) features a shift in the Atlantic ITCZ, a drying over the Indian Ocean and Indian subcontinent, and a “South-Flood-North Drought (SFND)” pattern over eastern China, a pattern inferable from changes in the atmospheric energy flow forced by the corresponding optimal forcing and further enhanced by the water vapor and cloud feedbacks. Moreover, the slow evolving component of the NM1 in response to CO2 forcing can be skillfully predicted by running the ocean heat uptake through the LRF, implicating a deterministic ocean dynamic source for the NM1-like trend under climate warming.
Decision-making based on Markov decision process in integrated artificial reasoning framework—Part I: Theory
This paper presents a decision-making framework based on an integrated artificial reasoning framework and Markov decision process (MDP). The integrated artificial reasoning framework provides a physics-based approach that converts system information into state transition models, and the analysis result will be represented by the transition probabilities that can be used with an MDP to find a traceable and explainable optimal pathway. A dynamic Bayesian network (DBN) is well suited for representing the structure of an MDP. The causality information among process variables (or among subsystems) is mathematically represented in a DBN by the conditional probabilities of the node’s states provided different probabilities of the parent node’s states. To define node states in a physically understandable manner, we used multilevel flow modeling (MFM). An MFM follows the fundamental energy and mass conservation laws and supports the selection of process variables that represent the system of interest so that causal relations among process variables are properly captured. An MFM-based DBN supports developing state transition models in an MDP to capture the effect of process variables of system having physical relations. The operators of the target system can capture stochastic system dynamics as multiple subsystem state transitions based on their physical relations and uncertainties coming from component degradation or random failures. We analyzed a simplified exemplary system to illustrate an optimal operational policy using the suggested approach.
Capturing in-field root system dynamics with RootTracker
Abstract Optimizing root system architecture offers a promising approach to developing stress tolerant cultivars in the face of climate change, as root systems are critical for water and nutrient uptake as well as mechanical stability. However, breeding for optimal root system architecture has been hindered by the difficulty in measuring root growth in the field. Here, we describe the RootTracker, a technology that employs impedance touch sensors to monitor in-field root growth over time. Configured in a cylindrical, window shutter-like fashion around a planted seed, 264 electrodes are individually charged multiple times over the course of an experiment. Signature changes in the measured capacitance and resistance readings indicate when a root has touched or grown close to an electrode. Using the RootTracker, we have measured root system dynamics of commercial maize (Zea mays) hybrids growing in both typical Midwest field conditions and under different irrigation regimes. We observed rapid responses of root growth to water deficits and found evidence for a “priming response” in which an early water deficit causes more and deeper roots to grow at later time periods. Genotypic variation among hybrid maize lines in their root growth in response to drought indicated a potential to breed for root systems adapted for different environments. Thus, the RootTracker is able to capture changes in root growth over time in response to environmental perturbations.
How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system
Both model predictive control (MPC) and deep reinforcement learning control (DRL) have been presented as a way to approximate the true optimality of a dynamic programming problem, and these two have shown significant operational cost saving potentials for building energy systems. Furthermore, there is still a lack of in-depth quantitative studies on their approximation levels to the true optimality, especially in the building energy domain. To fill in the gap, this paper provides a numerical framework that enables the evaluation of the optimality levels of different controllers for building energy systems. This framework is then used to comprehensively compare the optimal control performance of both MPC and DRL controllers with given computation budgets for a single zone fan coil unit system. Note the optimality is estimated based on a user-specific selection of trade-off weights among energy costs, thermal comfort and control slew rates. Compared with the best optimality we can find through expensive optimization simulations, the best DRL agent can maximally approximate the optimality by 96.54%, which outperforms the best MPC whose optimality level is 90.11%. However, due to the stochasticity, the DRL agent is only expected to approximate the optimality by 90.42%, which is almost equivalent to the best MPC. Except for Proximal Policy Optimization (PPO), all DRL agents can have a better approximation to the optimality than the best MPC, and are expected to have better approximation than the MPC with a prediction horizon of 32 steps (15 min per step). In terms of reducing energy cost and thermal discomfort, MPC can outperform the rule-based control (RBC) by 18.47%–25.44%. DRL can be expected to outperform RBC by 18.95%–25.65% ,and the best DRL control policy can outperform RBC by 20.29%–29.72%. Although the comparison of the optimality level is performed in a perfect setting, e.g., MPC assumes perfect models, and DRL assumes a perfect offline training process and online deployment process, this can shed insight on their capabilities of approximating to the original dynamic programming problem.
Bayesian sparse learning with preconditioned stochastic gradient MCMC and its applications
Deep neural networks have been successfully employed in an extensive variety of research areas, including solving partial differential equations. Despite its significant success, there are some challenges in effectively training DNN, such as avoiding overfitting in over-parameterized DNNs and accelerating the optimization in DNNs with pathological curvature. Here, we propose a Bayesian type sparse deep learning algorithm. The algorithm utilizes a set of spike-and-slab priors for the parameters in the deep neural network. The hierarchical Bayesian mixture will be trained using an adaptive empirical method. That is, one will alternatively sample from the posterior using preconditioned stochastic gradient Langevin Dynamics (PSGLD), and optimize the latent variables via stochastic approximation. The sparsity of the network is achieved while optimizing the hyperparameters with adaptive searching and penalizing. A popular SG-MCMC approach is Stochastic gradient Langevin dynamics (SGLD). However, considering the complex geometry in the model parameter space in nonconvex learning, updating parameters using a universal step size in each component as in SGLD may cause slow mixing. To address this issue, we apply a computationally manageable preconditioner in the updating rule, which provides a step-size parameter to adapt to local geometric properties. Moreover, by smoothly optimizing the hyperparameter in the preconditioning matrix, our proposed algorithm ensures a decreasing bias, which is introduced by ignoring the correction term in the preconditioned SGLD. According to the existing theoretical framework, we show that the proposed algorithm can asymptotically converge to the correct distribution with a controllable bias under mild conditions. Numerical tests are performed on both synthetic regression problems and learning solutions of elliptic PDE, which demonstrate the accuracy and efficiency of the present work.
QMMM 2023: A program for combined quantum mechanical and molecular mechanical modeling and simulations
Combined quantum mechanical and molecular mechanical (QM/MM) methods play an important role in multiscale modeling and simulations. QMMM 2023 is a general-purpose program for single-point calculations, geometry optimizations, transition-state optimizations, and molecular dynamics (MD) at the QM/MM level. It calls a QM package and an MM package to perform the required single-level calculations and combines them into a QM/MM energy by a variety of schemes. QMMM 2023 supports GAMESS-US, Gaussian, and ORCA as QM packages and Tinker as the MM package. Four types of treatments are available for embedding the QM subsystem in the MM environment: mechanical embedding with gas-phase calculations of the QM region, electronic embedding that allows polarization of the QM region by the MM environment, polarizable embedding for mutual polarization of the QM and MM regions, and flexible embedding for both mutual polarization and partial charge transfer between the QM and MM regions. Boundaries between QM and MM regions that pass through covalent bonds can be treated by several methods, including the redistributed charge (RC) scheme, redistributed charge and dipole (RCD) scheme, balanced-RC scheme, balanced-RCD scheme, screened charge scheme that takes account of charge penetration effects, and smeared charge scheme that delocalizes the MM charges near the QM–MM boundary. Geometry optimization can be done using the optimizer implemented in QMMM 2023 or the Berny optimizer in Gaussian through external calls to Gaussian. Molecular dynamics simulations can be performed at the pure-MM level, pure-QM level, fixed-partitioning QM/MM level, and adaptive-partitioning QM/MM level. As a result, the adaptive-partitioning treatments permit on-the-fly relocation of the QM–MM boundary by dynamically reclassifying atoms or groups into the QM or MM subsystems.
Reverse and Forward Engineering of Local Voltage Control in Distribution Networks
The increasing penetration of renewable and distributed energy resources in distribution networks calls for real-time and distributed voltage control. As such, in this paper we investigate local Volt/VAR control with a general class of control functions, and show that the power system dynamics with non-incremental local voltage control can be seen as a distributed algorithm for solving a well-defined optimization problem (reverse engineering). The reverse engineering further reveals a fundamental limitation of the non-incremental voltage control: the convergence condition is restrictive and prevents better voltage regulation at equilibrium. This motivates us to design two incremental local voltage control schemes based on the subgradient and pseudo-gradient algorithms respectively for solving the same optimization problem (forward engineering). The new control schemes decouple the dynamical property from the equilibrium property, and have much less restrictive convergence conditions. This work presents another step towards developing a new foundation—network dynamics as optimization algorithms—for distributed real-time control and optimization of future power networks.
Modeling Water Vapor Transport at Liquid/Membrane Interfaces for Applications in Liquid Desiccant Air Conditioners (CRADA CRD-17-679 Final Report)
Conventional compressor-based cooling has undergone incremental changes over the past 100 years. Further improvements in efficiency require evermore complex systems, especially under humid conditions. Meso-porous membranes offer unique opportunities for efficient humidity control in buildings using an absorbent desiccant solution, but membranes are not designed or optimized for this purpose. This project will use molecular dynamic simulations to determine optimal membrane properties for these air conditioning applications, focusing on the membrane properties at the membrane/liquid/air interface. Optimal membrane designs will enable smaller, more durable, and less expensive designs of these membrane air conditioning systems.
Diagnostics for Linac Optimization With Machine Learning
The Fermilab Linac delivers 400 MeV H- beam to the rest of the accelerator chain. Providing stable intensity, energy, and emittance is key since it directly affects downstream machines. To counter fluctuations of Linac output due to various effects to be described below we are working on implementing dynamic longitudinal parameter optimization based on Machine Learning (ML). As inputs for the ML model, signals from beam diagnostics have to be well understood and reliable. In this paper we discuss the status and plans for ML-based optimization as well as preliminary results of diagnostics studies.
Development of scalable design optimization parameters for bi-component protective systems
Bi-component protection-systems need to withstand a variety of extreme loading conditions such as high-velocity projectile impact to shock and blast mitigation. The large number of parameters at each stage of bi-component protection system design process results in a near-infinite number of possible variables for optimization. The aim of this project is to identify the scaling laws linking material and geometric scales of the problem to the final impact performance, further including the effects of wave propagation/interaction and inter-component bonding. Specifically, the impact dynamics for different optimal projectile/target density ratios and relative component mass fractions are quantified for bonded ceramic/titanium alloy systems. The impact behavior such as wave mechanics and damage propagation within the target system is characterized and quantified via digital image correlation or via x-ray phase-contrast imaging.
Preliminary study of auto-differentiation algorithm in beam dynamics with stochastic process
Modern particle accelerator optimization requires sophisticated computational methods to address the inherently stochastic nature of beam dynamics. This research develops a framework applying AD to SDEs that specifically addresses beam dynamics challenges in particle accelerators, focusing on accurately modeling and optimizing beam behavior in regimes dominated by stochastic processes. By incorporating key physical phenomena such as synchrotron radiation, wakefield effects, and quantum excitation, the framework aims to provide auto differentiation on the figure of merit of the phase space evolution and beam dynamics. The methodology will enable effective optimization method in a dynamic system with stochastic process.
Origin of core-to-core x-ray emission spectroscopy sensitivity to structural dynamics
Recently, coherent structural dynamics in the excited state of an iron photosensitizer was observed through oscillations in the intensity of Kα x-ray emission spectroscopy (XES). Understanding the origin of the unexpected sensitivity of core-to-core transitions to structural dynamics is important for further development of femtosecond time-resolved XES methods and, we believe, generally necessary for interpretation of XES signals from highly non-equilibrium structures that are ubiquitous in photophysics and photochemistry. Here, we use multiconfigurational wavefunction calculations combined with atomic theory to analyze the emission process in detail. The sensitivity of core-to-core transitions to structural dynamics is due to a shift of the minimum energy metal–ligand bond distance between 1s and 2p core-hole states. A key effect is the additional contraction of the non-bonding 3s and 3p orbitals in 1s core-hole states, which decreases electron– electron repulsion and increases overlap in the metal–ligand bonds. The effect is believed to be general and especially pronounced for systems with strong bonds. The important role of 3s and 3p orbitals is consistent with the analysis of radial charge and spin densities and can be connected to the negative chemical shift observed for many transition metal complexes. The XES sensitivity to structural dynamics can be optimized by tuning the emission energy spectrometer, with oscillations up to ±4% of the maximum intensity for the current system. The theoretical predictions can be used to design experiments that separate electronic and nuclear degrees of freedom in ultrafast excited state dynamics.
Selective Dynamical Imaging of Interferometric Data
Recent developments in very long baseline interferometry (VLBI) have made it possible for the Event Horizon Telescope (EHT) to resolve the innermost accretion flows of the largest supermassive black holes on the sky. The sparse nature of the EHT’s (u, v)-coverage presents a challenge when attempting to resolve highly time-variable sources. We demonstrate that the changing (u, v)-coverage of the EHT can contain regions of time over the course of a single observation that facilitate dynamical imaging. These optimal time regions typically have projected baseline distributions that are approximately angularly isotropic and radially homogeneous. We derive a metric of coverage quality based on baseline isotropy and density that is capable of ranking array configurations by their ability to produce accurate dynamical reconstructions. We compare this metric to existing metrics in the literature and investigate their utility by performing dynamical reconstructions on synthetic data from simulated EHT observations of sources with simple orbital variability. We then use these results to make recommendations for imaging the 2017 EHT Sgr A* data set.
Ground and excited state gradients with end-to-end differentiable semiempirical quantum chemistry
Accurate and efficient gradients of molecular energy with respect to nuclear degrees of freedom are essential for geometry optimization and molecular dynamics, including simulations that go beyond the Born–Oppenheimer regime. A common approach involves deriving analytical formulas for new electronic structure methods, which is often conceptually difficult and requires tedious coding. Here, we implement analytical, semi-numerical, and automatic differentiation (AD)-based gradient pathways for semiempirical Hamiltonian models in the PYSEQM software package, leveraging both graphics processing unit (GPU) and central processing unit (CPU) architectures. We further extend these capabilities to excited states calculated using the configuration interaction singles and time-dependent Hartree–Fock ansätze. We benchmark wall time, peak memory usage, and accuracy across three molecular families of varying chemical complexity, including systems of up to a thousand atoms. For ground-state simulations, analytical and AD gradients achieve near-identical GPU runtimes, while semi-numerical gradients are slower on GPU but remain competitive on CPU. For excited states, both analytical and custom AD approaches using implicit differentiation show similar performance and low memory requirements, whereas gradients with full AD are memory-limited. AD gradients match analytical ones in accuracy across all tested systems, aided by a quaternion-based diatomic frame rotation for two-center quantities that ensures smooth energy surfaces. Overall, automatic differentiation emerges as a practical alternative to analytical gradients in semiempirical quantum chemistry, offering high accuracy while allowing seamless integration in AI-driven workflows and popular packages, such as PyTorch and JAX. Our results provide actionable guidance for selecting optimal gradient strategies in large-scale ground- and excited-state molecular dynamics simulations.
Coordinated Inverter Control to Increase Dynamic PV Hosting Capacity: A Real-Time Optimal Power Flow Approach
High penetrations of distributed photovoltaics (PV) could cause adverse grid impacts, such as voltage violations. The recent development in inverter technologies provides the opportunity to develop control systems to realize effective PV governance and thus to improve dynamic PV hosting capacity for distribution grids. In this paper, a novel distributed energy resource management system (DERMS) solution is proposed by adopting the real-time optimal power flow (OPF) approach for coordinated control of the distributed PV inverters. The proposed approach eliminates the dependence on load knowledge via measurement feedback correction, and it can be implemented in real time. One challenge is that the technique is sensitive to the data availability and integrity of voltage measurements. Therefore, a decentralized DERMS approach is developed by leveraging the concepts of state estimation. The framework and the effectiveness of the solution approach are numerically demonstrated on a real distribution feeder in Southern California.