Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Convergent”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

High-order finite element method for atomic structure calculations

We introduce featom, an open source code that implements a high-order finite element solver for the radial Schrödinger, Dirac, and Kohn-Sham equations. The formulation accommodates various mesh types, such as uniform or exponential, and the convergence can be systematically controlled by increasing the number and/or polynomial order of the finite element basis functions. The Dirac equation is solved using a squared Hamiltonian approach to eliminate spurious states. Here, to address the slow convergence of the $κ=±1$ states due to divergent derivatives at the origin, we incorporate known asymptotic forms into the solutions. We achieve a high level of accuracy (10 -8 Hartree) for total energies and eigenvalues of heavy atoms such as uranium in both Schrödinger and Dirac Kohn-Sham solutions. We provide detailed convergence studies and computational parameters required to attain commonly required accuracies. Finally, we compare our results with known analytic results as well as the results of other methods. In particular, we calculate benchmark results for atomic numbers (Z) from 1 to 92, verifying current benchmarks. We demonstrate significant speedup compared to the state-of-the-art shooting solver dftatom. An efficient, modular Fortran 2008 implementation, is provided under an open source, permissive license, including examples and tests, wherein particular emphasis is placed on the independence (no global variables), reusability, and generality of the individual routines.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Reinforcement Learning Approach to Parameter Selection for Distributed Optimal Power Flow

With the increasing penetration of distributed energy resources, distributed optimization algorithms have attracted significant attention for power systems applications due to their potential for superior scalability, privacy, and robustness to a single point-of-failure. The Alternating Direction Method of Multipliers (ADMM) is a popular distributed optimization algorithm; however, its convergence performance is highly dependent on the selection of penalty parameters, which are usually chosen heuristically. In this work, we use reinforcement learning (RL) to develop an adaptive penalty parameter selection policy for alternating current optimal power flow (ACOPF) problem solved via ADMM with the goal of minimizing the number of iterations until convergence. We train our RL policy using deep Q-learning and show that this policy can result in significantly accelerated convergence (up to a 59% reduction in the number of iterations compared to existing, curvatureinformed penalty parameter selection methods). Furthermore, we show that our RL policy demonstrates promise for generalizability, performing well under unseen loading schemes as well as under unseen losses of lines and generators (up to a 50% reduction in iterations). This work thus provides a proof-of-concept for using RL for parameter selection in ADMM for power systems applications.

alternating current optimal power flow↗

A quadratic programming flux correction method for high-order DG discretizations of S transport

In this work, we present a new flux-fixup approach for arbitrarily high-order discontinuous Galerkin (DG) discretizations of the S N transport equation, and we demonstrate the compatibility of this approach with the Variable Eddington Factor (VEF) method. The new fixup approach is sweep-compatible: during a transport sweep (block Gauss-Seidel iteration in which the scattering source is lagged), a local quadratic programming (QP) problem is solved in each spatial element to ensure that the solution satisfies certain physical constraints, including local particle balance. In this paper, we describe two choices of physical constraints, resulting in two variants of the method: QP Zero (QPZ) and QP Maximum Principle (QPMP). In QPZ, the finite element coefficients of the solution are constrained to be nonnegative. In QPMP, they are constrained to adhere to an approximate discrete maximum principle. There are two primary takeaways in this paper. First, when the positive Bernstein basis is used for DG discretization, the QPMP method eliminates negativities, preserves high-order accuracy for smooth problems, and significantly dampens unphysical oscillations in the solution. The latter feature – the dampening of unphysical oscillations – is an improvement upon standard, simpler fixup approaches such as the approach described in (denoted as the “zero and rescale” (ZR) method in this paper). This improvement comes at a moderate computational cost, but it is not prohibitive. Our results show that, even in an unrealistic worst-case scenario where 83% of the spatial elements require a fixup, the computational cost of performing a transport sweep with fixup is only ~31% greater than performing one without fixup. The second takeaway is that the VEF method can be used to accelerate the convergence of transport sweeps even when a fixup is applied. When optically thick regions are present, transport sweeps converge slowly, regardless of whether a fixup is applied, and acceleration is needed. However, attempting to apply standard diffusion synthetic acceleration (DSA) to fixed-up transport sweeps results in divergence for optically thick problems. Our results show that the same is not true for VEF. When VEF is combined with fixed-up transport sweeps, the result is a scheme that produces a nonnegative solution, converges independently of the mean free path, and, in the case of the QPMP fixup, adheres to an approximate discrete maximum principle.

97 MATHEMATICS AND COMPUTING↗

An arbitrarily high-order three-dimensional Cartesian-grid method for reconstructing interfaces from volume fraction fields

Here Tthis work describes a newly developed, arbitrarily high-order Cartesian-grid method for reconstructing material interfaces from a volume fraction field. The method begins by identifying all of the grid cells in the volume fraction field that are intersected by the interface and need to be approximated by the reconstruction scheme. Finite-differences are used to calculate the gradient of the volume fraction field and provide an estimate of the surface normal in all of the interfacial grid cells. Groups of connected grid cells are then identified which all have the same dominant component of the normal vector. This grouping by orientation determines the proper dependent variable to use in the surface reconstruction (e.g. for a 2D curve, this step determines if the surface will be approximated by a function of x or y). A cumulative integral over the surface is constructed and fit using b-splines for two-dimensional problems or tensor-product b-splines for three-dimensional problems. This construction allows for the interface to be recovered through application of the second fundamental theorem of calculus. Fitting the cumulative integral with $\mathscr{N}$ th-order b-splines (or tensor-product b-splines) yields an ($\mathscr{N}$-1) th-order convergence rate of the interface shape. Differentiation of the b-spline interface function(s) allows for the high-order approximation of the normal vector and curvature to be obtained directly anywhere along b-spline. Together, the proposed reconstruction technique can achieve arbitrarily high mesh convergence rates. Validation tests are presented with mesh convergence rates ranging from fourth- to tenth-order.

97 MATHEMATICS AND COMPUTING↗

When and why PINNs fail to train: A neural tangent kernel perspective

Physics-informed neural networks (PINNs) have lately received great attention thanks to their flexibility in tackling a wide range of forward and inverse problems involving partial differential equations. However, despite their noticeable empirical success, little is known about how such constrained neural networks behave during their training via gradient descent. More importantly, even less is known about why such models sometimes fail to train at all. Here in this work, we aim to investigate these questions through the lens of the Neural Tangent Kernel (NTK); a kernel that captures the behavior of fully-connected neural networks in the infinite width limit during training via gradient descent. Specifically, we derive the NTK of PINNs and prove that, under appropriate conditions, it converges to a deterministic kernel that stays constant during training in the infinite-width limit. This allows us to analyze the training dynamics of PINNs through the lens of their limiting NTK and find a remarkable discrepancy in the convergence rate of the different loss components contributing to the total training error. To address this fundamental pathology, we propose a novel gradient descent algorithm that utilizes the eigenvalues of the NTK to adaptively calibrate the convergence rate of the total training error. Finally, we perform a series of numerical experiments to verify the correctness of our theory and the practical effectiveness of the proposed algorithms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Towards sharp error analysis of extended Lagrangian molecular dynamics

The extended Lagrangian molecular dynamics (XLMD) method provides a useful framework for reducing the computational cost of a class of molecular dynamics simulations with constrained latent variables. The XLMD method relaxes the constraints by introducing a fictitious mass ε for the latent variables and solving a set of singularly perturbed ordinary differential equations. While favorable numerical performance of XLMD has been demonstrated in several different contexts in the past decade, mathematical analysis of the method remains scarce. Here, we propose the first error analysis of the XLMD method in the context of a classical polarizable force field model. While the dynamics with respect to the atomic degrees of freedom are general and nonlinear, the key mathematical simplification of the polarizable force field model is that the constraints on the latent variables are given by a linear system of equations. We prove that when the initial value of the latent variables is compatible in a sense that we define, XLMD converges as the fictitious mass ε is made small with $\mathscr{O}$(ε) error for the atomic degrees of freedom and with $\mathscr{O}$($\sqrt{ε}$) error for the latent variables, when the dimension of the latent variable d' is 1. Furthermore, when the initial value of the latent variables is improved to be optimally compatible in a certain sense, we prove that the convergence rate can be improved to $\mathscr{O}$(ε) for the latent variables as well. Numerical results verify that both estimates are sharp not only for d'=1, but also for arbitrary d'. In the setting of general d', we do obtain convergence, but with the non-sharp rate of $\mathscr{O}$($\sqrt{ε}$) for both the atomic and latent variables.

74 ATOMIC AND MOLECULAR PHYSICS↗

Advanced two-phase subchannel method via non-linear iteration

A fast-running, robust two-phase flow, sub-channel model is presented based on non-linear solution of the steady-state subchannel fluid flow equations. The drift-flux model solves for conservation of liquid and vapor mass, mixture energy, and axial and transverse mixture momentum as part of an efficient planar marching scheme and nonlinear, nested outer and inner iteration. Here, models based on mechanistic subcooled boiling, two-phase turbulent void mixing, and drift are included. Solution verification and mesh convergence studies were performed for modern GE 10 × 10 fuel geometry and are shown to have excellent convergence behavior. Run time performance for a 50 axial mesh model showed 2.2 seconds on a single CPU core to tightly converge all 3D distributions (flow, void, pressure) for the GE 10 × 10 fuel geometry, supporting its efficient use within the Virtual Environment for Reactor Applications boiling water reactor framework.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A simulation study of the ability to detect power distribution perturbations in the texas A&M TRIGA reactor with self-powered neutron detectors

Given the variety of ways that nuclear reactor core power may be perturbed, reactor operators and developers are keen on understanding the accuracy and convergence time during which perturbations in reactor power distribution may be synthesized (i.e., inferred) from an array of in-core radiation detectors. A simulation study was conducted as described herein using a highly detailed model of the Texas A&M Training, Research, Isotopes, General Atomics Reactor, in which an array of self-powered neutron detectors (SPNDs) was considered for input to the power synthesis methodology. The core power synthesis is conducted using a point-based iterative method with an iterative loop built in to ensure working equation consistency. The forward problem of SPND response to simulated perturbations in reactor power was solved for Gaussian peak-type perturbations in the reactor power distribution. These perturbations varied in variance, amplitude, and core location to assess their impact on synthesis error and to determine the number of iterations required for convergence. A relation between the unique resolvability limit and perturbation width was identified such that the maximum synthesis error increased rapidly when the peak width went beneath this limit (a width approximating half the reactor’s fuel pin-to-pin pitch); this resolvability limit is specific to the SPND configuration and fuel segmentation considered herein. The synthesis error increased linearly with perturbation peak amplitude, whereas the convergence time increased nonlinearly. Perturbations located closer to the center of the core were synthesized more accurately, albeit with a higher number of required iterations. These findings provide a qualitative and quantitative understanding of the accuracy and speed at which different types of spatial power perturbations can be resolved in light-water reactors.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Distributed and communication-efficient solutions to linear equations with special sparse structure

In this paper we report two distributed and communication-efficient algorithms based on the multi-agent system are proposed to solve a system of linear equations with the Laplacian sparse system matrix. One algorithm is based on the gradient descent method in optimization. In this algorithm, the agents only share partial information instead of all of their collective state vectors to save significant communication. The other algorithm is obtained by approximating Newton’s method for a faster convergence rate. Although it requires twice as much communication as the first one, it is still communication-efficient given the low dimension of the information shared among agents. The convergence at a linear rate is proved for both algorithms, and a comprehensive comparison of their convergence rate, communication burden, and computation costs is also performed. The proposed algorithms can be applied to various systems to solve those problems that can be modeled as a system of linear equations with a Laplacian sparse system matrix. Simulation results with the electric power system illustrate their effectiveness.

42 ENGINEERING↗

A deterministic gradient-based approach to avoid saddle points

Abstract Loss functions with a large number of saddle points are one of the major obstacles for training modern machine learning (ML) models efficiently. First-order methods such as gradient descent (GD) are usually the methods of choice for training ML models. However, these methods converge to saddle points for certain choices of initial guesses. In this paper, we propose a modification of the recently proposed Laplacian smoothing gradient descent (LSGD) [Osher et al., arXiv:1806.06317 ], called modified LSGD (mLSGD), and demonstrate its potential to avoid saddle points without sacrificing the convergence rate. Our analysis is based on the attraction region, formed by all starting points for which the considered numerical scheme converges to a saddle point. We investigate the attraction region’s dimension both analytically and numerically. For a canonical class of quadratic functions, we show that the dimension of the attraction region for mLSGD is $\lfloor (n-1)/2\rfloor$ , and hence it is significantly smaller than that of GD whose dimension is $n-1$ .

Mathematics↗

First-Principles Simulation of Beam-Induced Processes Underlying Atomic Manipulation in Electron Microscopes

The development of experimental methods and apparatuses capable of promoting atomically precise material manipulations holds great promise for realizing the ultimate limit of feature miniaturization in materials and devices. The ability to modify materials atom by atom is anticipated to usher in new technologies in areas as diverse as separation science, medicine, and quantum information science. Historically, scanning probe-based techniques have been the most prominent approaches in this space. However, these methods are best suited for the manipulation of surface-exposed regions of materials, as the strong perturbations required for bond scission are delivered most effectively to atoms in the near-proximity to the scanning probe. In contrast, convergent electron beams with energies tuned slightly below the threshold for inducing irreversible knock-on damage have recently been employed (within scanning transmission electron microscopy) to promote atomic-scale bond rearrangements in various beam-stable solids. Currently, however, the efficiency and selectivity of beam-induced atomic manipulation processes with focused electron beams are such that long irradiation times are required to induce a desired atomic rearrangement. With a better understanding of the underlying physics dictating the outcome of a given irradiation event, methods can be devised to improve the efficiency of these techniques so that their promise can be fully realized through widespread adoption.To this end, this Account details our recent efforts to develop and apply tractable first-principles simulation approaches for studying the response of materials to electric beam-like external electric potentials applied in real space. We briefly review the concepts and capabilities in the area of atomically precise materials manipulation and review the early demonstrations of accomplishments in this area, focusing on studies using scanned convergent electron beam probes in particular. We expound upon the depth of the challenge and identify critical shortcomings of theoretical methods that have previously been employed in the simulation of beam-induced processes. We then describe the computational methods that we have generalized from the concepts and tools most commonly applied to the study of molecular photochemistry and how our adaptations of these methods can be employed to capture the relevant dynamical phenomena for beam-induced processes ranging from the initial electron scattering to the ensuing multistate reactions. Here, we contextualize these methods within the current state of the art in this area, which has historically focused primarily on the simulation of inelastic image formation in the electron microscope for the purpose of interpreting the results of quantitative electron microscopy experiments. We demonstrate that the spatial distribution of state-specific excitation rates due to the presence of an external (probe) electric charge is inhomogeneous, such that irradiation at particular locations in materials can favor specific electronic transitions (and disallow others). In addition to the potential for excited-state reaction pathways to be accessed through the initial inelastic scattering of the tightly focused electron beam from the targeted atoms, we also identify favorable conditions for the electronically nonadiabatic evolution of the highly vibrationally excited system to open complex multistate reaction pathways. Implications of the early results for understanding the mechanisms and potential routes to improved efficiency and selectivity in beam-induced reactions are discussed. We conclude with a summary of the current state of theory and modeling capabilities in this area and provide our perspective on future directions for theoretical and experimental developments that we view as crucial to advancing the use of convergent electron beams in mode-specific, atomically precise platforms for direct-write materials modifications.

36 MATERIALS SCIENCE↗

Native Chemical Ligation of Peptoid Oligomers

Bioorganic chemists are inspired by natural biopolymers to design peptidomimetic oligomers that can exhibit sequence-structure-function relationships. Biomimetic polymers can be synthesized to incorporate a specific sequence of nonbiological monomer units using a variety of iterative solution-phase or solid-phase reaction schemes. These protocols generally provide access to a vast diversity of oligomeric compounds but are limited with respect to their ability to attain protein-like chain lengths. This constraint can preclude access to sequence-defined synthetic macromolecules with sufficient sizes required to exhibit tertiary structure and other protein-mimetic attributes. In contrast, peptide chemists have overcome this limitation by developing convergent synthetic methods, such as native chemical ligation, to join individual, smaller peptide chains together to make larger peptides or full proteins. A similar convergent approach is needed to establish efficient synthetic routes to non-natural sequence-defined macromolecules. Herein, we adapt the peptide native chemical ligation method to peptoid oligomers, demonstrating how short chains can be conjoined to create sequence-defined peptoid macromolecules. Nanosheet-forming peptoid polymers with distinct surface loop display domains were generated by sequential ligation of several discrete fragments. This method provides a reliable convergent ligation route for sequence-defined polypeptoids that results in a native amide bond joining the fragments. We envision that this strategy will be useful in synthesizing peptoid-based proteomimetics that incorporate diverse chemical features.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Comprehensive Basis-Set Testing of Extended Symmetry-Adapted Perturbation Theory and Assessment of Mixed-Basis Combinations to Reduce Cost

Hybrid or “extended” symmetry-adapted perturbation theory (XSAPT) replaces traditional SAPT’s treatment of dispersion with better performing alternatives while at the same time extending two-body (dimer) SAPT to a many-body treatment of polarization using a self-consistent charge embedding procedure. The present work presents a systematic study of how XSAPT interaction energies and energy components converge with respect to the choice of Gaussian basis set. Errors can be reduced in a systematic way using correlation-consistent basis sets, with aug-cc-pVTZ results converged within <0.1 kcal/mol. Similar (if slightly less systematic) behavior is obtained using Karlsruhe basis sets at much lower cost, and we introduce new versions with limited augmentation that are even more efficient. Pople-style basis sets, which are more efficient still, often afford good results if a large number of polarization functions are included. The dispersion models used in XSAPT afford much faster basis-set convergence as compared to the perturbative description of dispersion in conventional SAPT, meaning that “compromise” basis sets (such as jun-cc-pVDZ) are no longer required and benchmark-quality results can be obtained using triple-ζ basis sets. The use of diffuse functions proves to be essential, especially for the description of hydrogen bonds. As a result, the “δ(Hartree–Fock)” correction for high-order induction can be performed in double-ζ basis sets without significant loss of accuracy, leading to a mixed-basis approach that offers 4× speedup over the existing (cubic scaling) XSAPT approach.

74 ATOMIC AND MOLECULAR PHYSICS↗

Enhanced Twist-Averaging Technique for Magnetic Metals: Applications Using Quantum Monte Carlo

In this study, we propose an improved twist-averaging (TA) scheme for quantum Monte Carlo methods that use converged Kohn–Sham or Hartree–Fock orbitals as the reference. This TA technique is tailored to sample the Brillouin zone of magnetic metals, although it naturally extends to nonmagnetic (NM) conducting systems. The proposed scheme aims to reproduce the reference magnetization and achieves charge neutrality by construction, thus avoiding the large energy fluctuations and the postprocessing needed to correct the energies. It shows the most robust convergence of total energy and magnetism to the thermodynamic limit (TDL) when compared to four other TA schemes. Diffusion Monte Carlo applications are shown on NM Al and ferromagnetic α-Fe. The cohesive energy of Al in the TDL shows an excellent agreement with the experimental result. Furthermore, the magnetic moments in α-Fe exhibit rapid convergence with an increasing number of twists.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multiresolution Quantum Chemistry: Nonlinear Response Properties at the Basis Set Limit

We benchmark the accuracy of Dunning correlation-consistent Gaussian basis sets for computing frequencydependent second-order hyperpolarizabilities relevant to second-harmonic generation (SHG), using multiresolution analysis (MRA) as a reference. Basis set errors are analyzed using a unit-sphere representation of the effective hyperpolarizability vector, enabling direct assessment of directional error structure. We introduce a relative RMS total error metric that integrates directional deviations over the unit sphere and complement it with signed projection errors that distinguish over- and underestimation. Unsupervised clustering based on these signed directional metrics reveals four distinct convergence behaviors across a set of 68 molecules. Unitsphere visualizations of representative systems show that basis set errors are often highly anisotropic and localized along specific bond directions, even when global error measures appear small. Doubly augmented basis sets consistently outperform singly augmented ones, and core-polarization functions are required for uniform convergence in second-row systems. Overall, this work demonstrates that directional analysis combined with clustering provides a robust framework for understanding basis set convergence in nonlinear optical response properties.

Basis sets↗

Excited State Orbital Optimization via Minimizing the Square of the Gradient: General Approach and Application to Singly and Doubly Excited States via Density Functional Theory

We present a general approach to converge excited state solutions to any quantum chemistry orbital optimization process, without the risk of variational collapse. The resulting square gradient minimization (SGM) approach only requires analytic energy/Lagrangian orbital gradients and merely costs 3 times as much as ground state orbital optimization (per iteration), when implemented via a finite difference approach. SGM is applied to both single determinant ΔSCF and spin-purified restricted open-shell Kohn-Sham (ROKS) approaches to study the accuracy of orbital optimized DFT excited states. It is found that SGM can converge challenging states where the maximum overlap method (MOM) or analogues either collapse to the ground state or fail to converge. We also report that ΔSCF/ROKS predict highly accurate excitation energies for doubly excited states (which are inaccessible via TDDFT). Singly excited states obtained via ROKS are also found to be quite accurate, especially for Rydberg states that frustrate (semi)local TDDFT. Our results suggest that orbital optimized excited state DFT methods can be used to push past the limitations of TDDFT to doubly excited, charge-transfer, or Rydberg states, making them a useful tool for the practical quantum chemist's toolbox for studying excited states in large systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Simultaneous Optimization of Nuclear–Electronic Orbitals

Accurate modeling of important nuclear quantum effects, such as nuclear delocalization, zero-point energy, and tunneling, as well as non-Born-Oppenheimer effects, requires treatment of both nuclei and electrons quantum mechanically. The nuclear–electronic orbital (NEO) method provides an elegant framework to treat specified nuclei, typically protons, on the same level as the electrons. In conventional electronic structure theory, finding a converged ground state can be a computationally demanding task; converging NEO wavefunctions, due to their coupled electronic and nuclear nature, is even more demanding. Herein, we present an efficient simultaneous optimization method that uses the direct inversion in the iterative subspace method to simultaneously converge wavefunctions for both the electrons and quantum nuclei. In conclusion, benchmark studies show that the simultaneous optimization method can significantly reduce the computational cost compared to the conventional stepwise method for optimizing NEO wavefunctions for multicomponent systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The Mechanism of Increasing Summer Water Vapor Over the Tibetan Plateau

Rapid warming over the Tibetan Plateau (TP) has been associated with a wetting trend in atmospheric water vapor content, which is critical for recharging the Asian water tower. However, the mechanism associated with the wetting phenomenon remains unclear. Long-term changes in moisture balance and precipitation recycling processes are investigated using the ERA5 reanalysis from 1979 to 2019. The wetting trend over TP is mainly due to the summer water vapor trend with signi?cantly increases over the western TP. Based on the moisture balance analysis, it is found that precipitation, evaporation, and the convergence of moisture are all increasing over the western TP but decreasing over the eastern TP. Based on the dynamical precipitation recycling model, the results suggest that both internal and external cycles contributes to the wetting over TP, with 63.87% and 36.13% contributions respectively. Further analysis found that the atmospheric heating source is also increasing over the western TP, which could shift the moisture transportation from east to west at the southern boundary of TP. The increasing moisture convergence could enhance precipitation, and the enhanced latent heating in the mid-atmosphere can further induced moisture convergence, which forms a positive feedback. However, an opposite situation occurred over the eastern TP. The internal and external cycle of the recycling process can stimulate (suppress) each other through precipitation over the western (eastern) TP. This mechanism linked the changes in the precipitation recycling and atmospheric circulation, and induced the wetting trend over TP in summer.

54 ENVIRONMENTAL SCIENCES↗