Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Function approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Automation of Active Space Selection for Multireference Methods via Machine Learning on Chemical Bond Dissociation

Predicting and understanding the chemical bond is one of the major challenges of computational quantum chemistry. Kohn–Sham density functional theory (KS-DFT) is the most common method, but approximate density functionals may not be able to describe systems where multiple electronic configurations are equally important. Multiconfigurational wave functions, on the other hand, can provide a detailed understanding of the electronic structures and chemical bonds of such systems. In the complete active space self-consistent field (CASSCF) method, one performs a full configuration interaction calculation in an active space consisting of active electrons and active orbitals. However, CASSCF and its variants require the selection of these active spaces. This choice is not black box; it requires significant experience and testing by the user, and thus active space methods are not considered particularly user-friendly and are employed only by a minority of quantum chemists. Our goal is to popularize these methods by making it easier to make good active space choices. Here, we present a machine learning protocol that performs an automated selection of active spaces for chemical bond dissociation calculations of main group diatomic molecules. The protocol shows high prediction performance for a given target system as long as a properly correlated system is chosen for training. Good active spaces are correctly predicted with a considerably better success rate than random guess (larger than 80% precision for most systems studied). Our automated machine learning protocol shows that a “black-box” mode is possible for facilitating and accelerating the large-scale calculations on multireference systems where single-reference methods such as KS-DFT cannot be applied.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Structure and dynamics of aqueous solutions from PBE-based first-principles molecular dynamics simulations

Establishing an accurate and predictive computational framework for the description of complex aqueous solutions is an ongoing challenge for density functional theory based first-principles molecular dynamics (FPMD) simulations. In this context, important advances have been made in recent years, including the development of sophisticated exchange-correlation functionals. On the other hand, simulations based on simple generalized gradient approximation (GGA) functionals remain an active field, particularly in the study of complex aqueous solutions due to a good balance between the accuracy, computational expense, and the applicability to a wide range of systems. In such simulations we often perform them at elevated temperatures to artificially “correct” for GGA inaccuracies in the description of liquid water; however, a detailed understanding of how the choice of temperature affects the structure and dynamics of other components, such as solvated ions, is largely unknown. In order to address this question, we carried out a series of FPMD simulations at temperatures ranging from 300 to 460 K for liquid water and three representative aqueous solutions containing solvated Na + , K + , and Cl - ions. We show that simulations at 390–400 K with the Perdew-Burke-Ernzerhof (PBE) exchange-correlation functional yield water structure and dynamics in good agreement with experiments at ambient conditions. Simultaneously, this computational setup provides ion solvation structures and ion effects on water dynamics consistent with experiments. These results suggest that an elevated temperature around 390–400 K with the PBE functional can be used for the description of structural and dynamical properties of liquid water and complex solutions with solvated ions at ambient conditions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Collapse of the electron gas from three to two dimensions in Kohn-Sham density functional theory

Here under pressure, a quasi-2D electron gas can collapse toward the true 2D limit. In this limit, the exact exchange-correlation energy per electron has a known finite limit, but general-purpose semilocal approximate density functionals, like the local density approximation (LDA) and Perdew-Burke-Ernzerhof generalized gradient approximation (PBE GGA), are known to diverge to minus infinity. Here we consider a model density for a non-interacting electron gas confined to a thickness $L$ by infinite-barrier walls, with a fixed 2D density $1/(\pi (r_s^{\text{2D}})^2)$, and $r_s^{\text{2D}}=4$ Bohr. We estimate that LDA, PBE, and the strongly constrained and appropriately normed (SCAN) meta-GGA are accurate for the exchange-correlation energy over a wide quasi-2D range, $1.5< L/r_s^{\text{2D}} < 3.85$, but not for smaller $L$. Of these functionals, only SCAN tends to a finite limit when $L$ tends to 0. Since the non-interacting kinetic energy, treated exactly in Kohn-Sham theory, dominates in this limit within a deformable jellium model, all of the general-purpose functionals can estimate the pressure required to achieve any thickness (with SCAN and LDA better than PBE). This pressure vanishes around $L/r_s^{\text{2D}} = 3.85$, where the 3D electron density is roughly that of the valence electrons in metallic potassium, and reaches about 20 GPa at $L/r_s^{\text{2D}} = 1.5$ and 400 GPa at $L/r_s^{\text{2D}} = 0.6$.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Exploiting Kronecker structure in exponential integrators: Fast approximation of the action of φ $-$functions of matrices via quadrature

Here, in this article, we propose an algorithm for approximating the action of φ $-$ functions of matrices against vectors, which is a key operation in exponential time integrators. In particular, we consider matrices with Kronecker sum structure, which arise from problems admitting a tensor product representation. The method is based on quadrature approximations of the integral form of the φ $-$ functions combined with a scaling and modified squaring method. Owing to the Kronecker sum representation, only actions of 1D matrix exponentials are needed at each quadrature node and assembly of the full matrix can be avoided. Additionally, we derive a priori bounds for the quadrature error, which show that, as expected by classical theory, the rate of convergence of our method is supergeometric. Guided by our analysis, we construct a fast and robust method for estimating the optimal scaling factor and number of quadrature nodes that minimizes the total cost for a prescribed error tolerance. We investigate the performance of our algorithm by solving several linear and semilinear time-dependent problems in 2D and 3D. The results show that our method is accurate and orders of magnitude faster than the current state-of-the-art.

97 MATHEMATICS AND COMPUTING↗

A Semi-Lagrangian Spectral Method for the Vlasov–Poisson System Based on Fourier, Legendre and Hermite Polynomials

In this study, we apply a semi-Lagrangian spectral method for the Vlasov–Poisson system, previously designed for periodic Fourier discretizations, by implementing Legendre polynomials and Hermite functions in the approximation of the distribution function with respect to the velocity variable. We discuss second-order accurate-in-time schemes, obtained by coupling spectral techniques in the space–velocity domain with a BDF time-stepping scheme. The resulting method possesses good conservation properties, which have been assessed by a series of numerical tests conducted on some standard benchmark problems including the two-stream instability and the Landau damping test cases. In the Hermite case, we also investigate the numerical behavior in dependence of a scaling parameter in the Gaussian weight. Confirming previous results from the literature, our experiments for different representative values of this parameter, indicate that a proper choice may significantly impact on accuracy, thus suggesting that suitable strategies should be developed to automatically update the parameter during the time-advancing procedure.

97 MATHEMATICS AND COMPUTING↗

Phosphorus allotropes: Stability of black versus red phosphorus re-examined by means of the van der Waals inclusive density functional method

We evaluate the energetic stabilities of white, red, and black allotropes of phosphorus using density functional theory (DFT) and hybrid functional methods, van der Waals (vdW) corrections (DFT+vdW and hybrid+vdW), vdW density functionals, and random phase approximation (RPA). In this work, we find that stability of black phosphorus over red-V (i.e., the violet form) is not ubiquitous among these methods, and the calculated enthalpies for the reaction phosphorus (red-V)→ phosphorus (black) are scattered between –20 and 40 meV/atom. With local density and generalized gradient approximations, and hybrid functionals, mean absolute errors (MAEs) in densities of P allotropes relative to experiments are found to be around 10%–25%, whereas with vdW-inclusive methods, MAEs in densities drop below ~5%. While the inconsistency among the density functional methods could not shed light on the stability puzzle of black versus red phosphorus, comparison of their accuracy in predicting densities and the supplementary RPA results on relative stabilities indicate that opposite to the common belief, black and red phosphorus are almost degenerate, or the red-V (violet) form of phosphorus might even be the ground state.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Quasiparticle and hybrid density functional methods in defect studies: An application to the nitrogen vacancy in GaN

Defects in semiconductors can play a vital role in the performance of electronic devices, with native defects often dominating the electronic properties of the semiconductor. Understanding the relationship between structural defects and electronic function will be central to the design of new high-performance materials. In particular, it is necessary to quantitatively understand the energy and lifetime of electronic states associated with the defect. In this work, we apply first-principles density functional theory (DFT) and many-body perturbation theory within the GW approximation to understand the nature and energy of the defect states associated with a charged nitrogen vacancy on the electronic properties of gallium nitride (GaN), as a model of a well-studied and important wide gap semiconductor grown with defects. We systematically investigate the sources of error associated with the GW approximation and the role of the underlying atomic structure on the predicted defect state energies. Additionally, analysis of the computed electronic density of states (DOS) reveals that there is one occupied defect state 0.2 eV below the valence band maximum and three unoccupied defect states at energy of 0.2–0.4 eV above the conduction band minimum, suggesting that this defect in the +1 charge state will not behave as a carrier trap. Furthermore, we compare the character and energy of the defect state obtained from GW and DFT using the HSE approximate density functional and find excellent agreement. This systematic study provides a more complete understanding of how to obtain quantitative defect energy states in bulk semiconductors.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification

Here, we analyze the convergence of probability density functions utilizing approximate models for both forward and inverse problems. We consider the standard forward uncertainty quantification problem where an assumed probability density on parameters is propagated through the approximate model to produce a probability density, often called a push-forward probability density, on a set of quantities of interest (QoI). The inverse problem considered in this paper seeks to update an initial probability density assumed on model input parameters such that the subsequent push-forward of this updated density through the parameter-to-QoI map matches a given probability density on the QoI. We prove that the densities obtained from solving the forward and inverse problems, using approximate models, converge to the true densities as the approximate models converge to the true models. Numerical results are presented to demonstrate convergence rates of densities for sparse grid approximations of parameter-to-QoI maps and standard spatial and temporal discretizations of PDEs and ODEs.

97 MATHEMATICS AND COMPUTING↗

Electronic structure of intrinsic defects in c -gallium nitride: Density functional theory study without the jellium approximation

Here, we report the first nonjellium, systematic, density functional theory (DFT) study of intrinsic and extrinsic defects and defect levels in zinc-blende (cubic) gallium nitride. We use the local moment counter charge (LMCC) method, the standard Perdew-Becke-Ernzerhoff (PBE) exchange-correlation potential, and two pseudopotentials, where the Ga 3$\textit{d}$ orbitals are either in the core ($d^0$) or explicitly in the valence set ($d^{10}$). We studied 64, 216, 512, and 1000 atom supercells, and demonstrated convergence to the infinite limit, crucial for delineating deep from shallow states near band edges, and for demonstrating the elimination of finite cell-size errors. Contrary to common claims, we find that exact exchange is not required to obtain defect levels across the experimental band gap. As was true in silicon, silicon carbide, and gallium arsenide, the extremal LMCC defect levels of the aggregate of defects yield an effective LMCC defect band gap that is within 10% of the experimental gap (3.3 eV) for both pseudopotentials. We demonstrate that the gallium vacancy is more complicated than previously reported. There is dramatic metastability–a nearest-neighbor nitrogen atom shifts into the gallium site, forming an antisite, nitrogen vacancy pair, which is more stable than the simple vacancy for positive charge states. Our assessment of the $d^0$ and $d^{10}$ pseudopotentials yields minimal differences in defect structures and defect levels. The better agreement of the $d^0$ lattice constant with experiment suggests that the more computationally economical $d^0$ pseudopotentials are sufficient to achieve the fidelity possible within the physical accuracy of DFT, and thereby enable calculations in larger supercells necessary to demonstrate convergence with respect to finite size supercell errors.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Discrete Approximations of Determinantal Point Processes on Continuous Spaces: Tree Representations and Tail Triviality

We prove tail triviality of determinantal point processes μ on continuous spaces. Tail triviality has been proved for such processes only on discrete spaces, and hence we have generalized the result to continuous spaces. To do this, we construct tree representations, that is, discrete approximations of determinantal point processes enjoying a determinantal structure. There are many interesting examples of determinantal point processes on continuous spaces such as zero points of the hyperbolic Gaussian analytic function with Bergman kernel, and the thermodynamic limit of eigenvalues of Gaussian random matrices for Sine{sub 2},Airy{sub 2},Bessel{sub 2}, and Ginibre point processes. Our main theorem proves all these point processes are tail trivial.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The Good, the Bad, and the Ugly: Pseudopotential Inconsistency Errors in Molecular Applications of Density Functional Theory

The pseudopotential (PP) approximation is one of the most common techniques in computational chemistry. Despite its long history, the development of custom PPs has not tracked with the explosion of different density functional approximations (DFAs). As a result, the use of PPs with exchange/correlation models for which they were not developed is widespread, although this practice is known to be theoretically unsound. The extent of PP inconsistency errors (PPIEs) associated with this practice has not been systematically explored across the types of energy differences commonly evaluated in chemical applications. Here, we evaluate PPIEs for a number of PPs and DFAs across 196 chemically relevant systems of both transition-metal and main-group elements, as represented by the W4-11, TMC34, and S22 data sets. Near the complete basis set limit, these PPs are found to cleanly approach all-electron (AE) results for noncovalent interactions but introduce root-mean-squared errors (RMSEs) upwards of 15 kcal mol –1 into predictions of covalent bond energies for a number of popular DFAs. We achieve significant improvements through the use of empirical atom- and DFA-specific PP corrections, indicating considerable systematicity of the PPIEs. The results of this work have implications for chemical modeling in both molecular contexts and for DFA design, which we discuss.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning for impurity charge-state transition levels in semiconductors from elemental properties using multi-fidelity datasets

Quantifying charge-state transition energy levels of impurities in semiconductors is critical to understanding and engineering their optoelectronic properties for applications ranging from solar photovoltaics to infrared lasers. While these transition levels can be measured and calculated accurately, such efforts are time-consuming and more rapid prediction methods would be beneficial. Here, we significantly reduce the time typically required to predict impurity transition levels using multi-fidelity datasets and a machine learning approach employing features based on elemental properties and impurity positions. We use transition levels obtained from low-fidelity (i.e., local-density approximation or generalized gradient approximation) density functional theory (DFT) calculations, corrected using a recently proposed modified band alignment scheme, which well-approximates transition levels from high-fidelity DFT (i.e., hybrid HSE06). Further, the model fit to the large multi-fidelity database shows improved accuracy compared to the models trained on the more limited high-fidelity values. Crucially, in our approach, when using the multi-fidelity data, high-fidelity values are not required for model training, significantly reducing the computational cost required for training the model. Our machine learning model of transition levels has a root mean squared (mean absolute) error of 0.36 (0.27) eV vs high-fidelity hybrid functional values when averaged over 14 semiconductor systems from the II–VI and III–V families. As a guide for use on other systems, we assessed the model on simulated data to show the expected accuracy level as a function of bandgap for new materials of interest. Finally, we use the model to predict a complete space of impurity charge-state transition levels in all zinc blende III–V and II–VI systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Hyperspherical Sparse Approximation Techniques for High-Dimensional Discontinuity Detection

This work proposes a hyperspherical sparse approximation framework for detecting jump discontinuities in functions in high-dimensional spaces. The need for a novel approach results from the theoretical and computational inefficiencies of well-known approaches, such as adaptive sparse grids, for discontinuity detection. Our approach constructs the hyperspherical coordinate representation of the discontinuity surface of a function. Then sparse approximations of the transformed function are built in the hyperspherical coordinate system, with values at each point estimated by solving a one-dimensional discontinuity detection problem. Due to the smoothness of the hypersurface, the new technique can identify jump discontinuities with significantly reduced computational cost, compared to existing methods. Several approaches are used to approximate the transformed discontinuity surface in the hyperspherical system, including adaptive sparse grid and radial basis function interpolation, discrete least squares projection, and compressed sensing approximation. Moreover, hierarchical acceleration techniques are also incorporated to further reduce the overall complexity. In conclusion, rigorous complexity analyses of the new methods are provided, as are several numerical examples that illustrate the effectiveness of our approach.

97 MATHEMATICS AND COMPUTING↗

Deep Neural Networks are Adaptive to Function Regularity and Data Distribution in Approximation and Estimation

Deep learning has exhibited remarkable results across diverse areas. To understand its success, substantial research has been directed towards its theoretical foundations. Nev- ertheless, the majority of these studies examine how well deep neural networks can model functions with uniform regularities. In this paper, we explore a different angle: how deep neural networks can adapt to varying degrees of smoothness in functions and nonuni- form data distributions across different locations and scales. More precisely, we focus on a broad class of functions defined by nonlinear tree-based approximation methods. This class encompasses a range of function types, such as functions with uniform regularities and discontinuous functions. We develop nonparametric approximation and estimation theories for this class using deep ReLU networks. Our results show that deep neural networks are adaptive to the nonuniform smoothness of functions and nonuniform data distributions at different locations and scales. We apply our results to several function classes, and derive the corresponding approximation and generalization errors. The validity of our results is demonstrated through numerical experiments.

97 MATHEMATICS AND COMPUTING↗

On estimating the curvature attributes and strain invariants of deformed surface through radial basis functions

Numerical methods in approximation of derivatives on regular or irregular gridded and scattered data points are of significance in the study of numerous problems in engineering and geoscience. A mathematically accurate and stable method is assessed to compute the differential quantities, while being flexible and easy to implement. Strain-invariant parameters in deformation analysis and curvature attributes in geometrical analysis of approximated surfaces are independent quantities which could be derived numerically through radial basis functions (RBFs) for scattered data points. Approximation of a function or its derivatives through RBFs is highly correlated to its shape parameter which depends on the number and distribution of the particles on the support domain. A procedure to find the optimal shape parameter for RBFs in the influence domain of each nodal point together with the presentation of a manner of calculating the curvature attributes and strain parameters through Gaussian RBFs is proposed here. Results indicate a significant improvement in the approximation accuracy of strain parameters and curvature attributes, while this approximation is more stable when RBFs with optimal shape parameter are implemented rather than the traditional moving least squares.

97 MATHEMATICS AND COMPUTING↗

Chapter 7: Learning Stable Local Volt/Var Controllers in Distribution Grids

This chapter describes a framework to synthesize provably stable local Volt/Var controllers for distributed energy resources (DERs) in power distribution grids (DGs). The goal is to control the reactive power injections of DERs to improve the system performance as quantified by a generic optimal reactive power flow (ORPF) problem. To achieve this, we jointly design for each DER the control function, which prescribes the reactive power update rule, and the equilibrium function, which approximates the ORPF solutions from local measurements of voltages and powers. We provide conditions on the equilibrium functions and the control parameters ensuring the stability of the closed-loop system. In particular, we discuss the trade-offs between each set of conditions accounting for practical considerations, like fully exploiting the DERs' generation capabilities and reducing the optimality gap. These conditions are then translated into learning constraints on the neural networks' parameters that are enforced in the training phase. We validate our framework with numerical simulations on the IEEE 37-bus network and through a comparison with an optimized version of standard piece wise linear control rules.

closed-loop asymptotic stability↗

First-principles study of the infrared spectrum in liquid water from a systematically improved description of H-bond network

An accurate ab initio theory of the H-bond structure of liquid water requires a high-level exchange correlation approximation from density functional theory. Based on the liquid structures modeled by ab initio molecular dynamics by using maximally localized Wannier functions as a basis, we study the infrared spectrum of water within the canonical ensemble. In particular, we employ both the Perdew-Burke-Ernzerhof (PBE) functional within the generalized gradient approximation (GGA) and the state-of-the-art meta-GGA level approximation provided by the strongly constrained and appropriately normed (SCAN) functional. In this work, we demonstrate that the SCAN functional improves not only the water structure but also the theoretical infrared spectrum of water. Our analyses show that the improvement in the stretching and bending bands can be mainly attributed to better descriptions of directional H bonding and the covalency at the inter- and intramolecular levels, respectively. On the other hand, better agreements in libration and hindered translation bands are due to the improved dynamics of the H-bond network enabled by a less structured liquid in the experimental direction. The spectrum predicted by SCAN shows much better agreement with experimental data than the conventionally widely adopted PBE functional at the GGA level.

74 ATOMIC AND MOLECULAR PHYSICS↗

Incorporating Electronic Information into Machine Learning Potential Energy Surfaces via Approaching the Ground-State Electronic Energy as a Function of Atom-Based Electronic Populations

Machine learning (ML) approximations to density functional theory (DFT) potential energy surfaces (PESs) are showing great promise for reducing the computational cost of accurate molecular simulations, but at present, they are not applicable to varying electronic states, and in particular, they are not well suited for molecular systems in which the local electronic structure is sensitive to the medium to long-range electronic environment. With this issue as the focal point, we present a new machine learning approach called "BpopNN" for obtaining efficient approximations to DFT PESs. Conceptually, the methodology is based on approaching the true DFT energy as a function of electron populations on atoms; in practice, this is realized with available density functionals and constrained DFT (CDFT). Additionally, the new approach creates approximations to this function with neural networks. These approximations thereby incorporate electronic information naturally into a ML approach, and optimizing the model energy with respect to populations allows the electronic terms to self-consistently adapt to the environment, as in DFT. We confirm the effectiveness of this approach with a variety of calculations on LinHn clusters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗