Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “function approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Data-driven learning of nonlocal models: from high-fidelity simulations to constitutive laws

We show that machine learning can improve the accuracy of simulations of stress waves in one-dimensional composite materials. We propose a data-driven technique to learn nonlocal constitutive laws for stress wave propagation models. The method is an optimization-based technique in which the nonlocal kernel function is approximated via Bernstein polynomials. The kernel, including both its functional form and parameters, is derived so that when used in a nonlocal solver, it generates solutions that closely match high-fidelity data. The optimal kernel therefore acts as a homogenized nonlocal continuum model that accurately reproduces wave motion in a smaller-scale, more detailed model that can include multiple materials. We apply this technique to wave propagation within a heterogeneous bar with a periodic microstructure. Several one-dimensional numerical tests illustrate the accuracy of our algorithm. The optimal kernel is demonstrated to reproduce high-fidelity data for a composite material in applications that are substantially different from the problems used as training data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Quantum simulation of molecules without fermionic encoding of the wave function

Abstract Molecular simulations generally require fermionic encoding in which fermion statistics are encoded into the qubit representation of the wave function. Recent calculations suggest that fermionic encoding of the wave function can be bypassed, leading to more efficient quantum computations. Here we show that the two-electron reduced density matrix (2-RDM) can be expressed as a unique functional of the unencoded N -qubit-particle wave function without approximation, and hence, the energy can be expressed as a functional of the 2-RDM without fermionic encoding of the wave function. In contrast to current hardware-efficient methods, the derived functional has a unique, one-to-one (and onto) mapping between the qubit-particle wave functions and 2-RDMs, which avoids the over-parametrization that can lead to optimization difficulties such as barren plateaus. An application to computing the ground-state energy and 2-RDM of H 4 is presented.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2023

A Unification Framework for Euclidean and Hyperbolic Graph Neural Networks

Hyperbolic neural networks have recently gained significant attention due to their promising results on several graph problems including node classification and link prediction. The primary reason for this success is the effectiveness of hyperbolic space in capturing the inherent hierarchy of graph datasets. However, they are limited in terms of generalization, scalability, and have inferior performance when applied to non-hierarchical datasets. In this paper, we take a completely different perspective for modeling hyperbolic networks and answer the following question: is an Euclidean model able to approximate a function or behavior in the hyperbolic space? Extending the universal approximation theory developed for Euclidean models, We draw an analogy from the hyperbolic components to the Euclidean counterparts and conclude that, in order to capture hierarchical features, it is possible to generalize hyperbolic models to be a special case of Euclidean models with the proposed Pseudo-Poincaré technique. We applied our non-linear hyperbolic normalization to the current state-of-the-art homogeneous and multi-relational graph networks and demonstrate significant improvements in performance compared to both Euclidean and hyperbolic counterparts. The primary impact of this work lies in its ability to capture hierarchical features in the Euclidean space, and thus, can replace hyperbolic networks without any loss in performance metrics while simultaneously leveraging the power of Euclidean networks such as interpretability and efficient execution of various model components.

Khatir, Mehrdad↗
DOE OSTI2021

Time-dependent orbital-free density functional theory: Background and Pauli kernel approximations

Time-dependent orbital-free density functional theory (DFT) is an efficient method for calculating the dynamic properties of large-scale quantum systems due to the low computational cost compared to standard time-dependent DFT. In this work, we formalize this method by mapping the real system of interacting fermions onto a fictitious system of noninteracting bosons. The dynamic Pauli potential and associated kernel emerge as key ingredients of time-dependent orbital-free DFT. Using the uniform electron gas as a model system, we derive an approximate frequency-dependent Pauli kernel. Pilot calculations suggest that space nonlocality is a key feature for this kernel. Nonlocal terms arise already in the second-order expansion with respect to unitless frequency and reciprocal space variable ($\frac{ω}{qk_F}$ and $\frac{q}{2k_F}$, respectively). Given the encouraging performance of the proposed kernel, we expect it will lead to more accurate orbital-free DFT simulations of nanoscale systems out of equilibrium. Additionally, the proposed path to formulate nonadiabatic Pauli kernels presents several avenues for further improvements which can be exploited in future work to improve the results.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

Automation of Active Space Selection for Multireference Methods via Machine Learning on Chemical Bond Dissociation

Predicting and understanding the chemical bond is one of the major challenges of computational quantum chemistry. Kohn–Sham density functional theory (KS-DFT) is the most common method, but approximate density functionals may not be able to describe systems where multiple electronic configurations are equally important. Multiconfigurational wave functions, on the other hand, can provide a detailed understanding of the electronic structures and chemical bonds of such systems. In the complete active space self-consistent field (CASSCF) method, one performs a full configuration interaction calculation in an active space consisting of active electrons and active orbitals. However, CASSCF and its variants require the selection of these active spaces. This choice is not black box; it requires significant experience and testing by the user, and thus active space methods are not considered particularly user-friendly and are employed only by a minority of quantum chemists. Our goal is to popularize these methods by making it easier to make good active space choices. Here, we present a machine learning protocol that performs an automated selection of active spaces for chemical bond dissociation calculations of main group diatomic molecules. The protocol shows high prediction performance for a given target system as long as a properly correlated system is chosen for training. Good active spaces are correctly predicted with a considerably better success rate than random guess (larger than 80% precision for most systems studied). Our automated machine learning protocol shows that a “black-box” mode is possible for facilitating and accelerating the large-scale calculations on multireference systems where single-reference methods such as KS-DFT cannot be applied.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Collapse of the electron gas from three to two dimensions in Kohn-Sham density functional theory

Here under pressure, a quasi-2D electron gas can collapse toward the true 2D limit. In this limit, the exact exchange-correlation energy per electron has a known finite limit, but general-purpose semilocal approximate density functionals, like the local density approximation (LDA) and Perdew-Burke-Ernzerhof generalized gradient approximation (PBE GGA), are known to diverge to minus infinity. Here we consider a model density for a non-interacting electron gas confined to a thickness $L$ by infinite-barrier walls, with a fixed 2D density $1/(\pi (r_s^{\text{2D}})^2)$, and $r_s^{\text{2D}}=4$ Bohr. We estimate that LDA, PBE, and the strongly constrained and appropriately normed (SCAN) meta-GGA are accurate for the exchange-correlation energy over a wide quasi-2D range, $1.5< L/r_s^{\text{2D}} < 3.85$, but not for smaller $L$. Of these functionals, only SCAN tends to a finite limit when $L$ tends to 0. Since the non-interacting kinetic energy, treated exactly in Kohn-Sham theory, dominates in this limit within a deformable jellium model, all of the general-purpose functionals can estimate the pressure required to achieve any thickness (with SCAN and LDA better than PBE). This pressure vanishes around $L/r_s^{\text{2D}} = 3.85$, where the 3D electron density is roughly that of the valence electrons in metallic potassium, and reaches about 20 GPa at $L/r_s^{\text{2D}} = 1.5$ and 400 GPa at $L/r_s^{\text{2D}} = 0.6$.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Exploiting Kronecker structure in exponential integrators: Fast approximation of the action of φ $-$functions of matrices via quadrature

Here, in this article, we propose an algorithm for approximating the action of φ $-$ functions of matrices against vectors, which is a key operation in exponential time integrators. In particular, we consider matrices with Kronecker sum structure, which arise from problems admitting a tensor product representation. The method is based on quadrature approximations of the integral form of the φ $-$ functions combined with a scaling and modified squaring method. Owing to the Kronecker sum representation, only actions of 1D matrix exponentials are needed at each quadrature node and assembly of the full matrix can be avoided. Additionally, we derive a priori bounds for the quadrature error, which show that, as expected by classical theory, the rate of convergence of our method is supergeometric. Guided by our analysis, we construct a fast and robust method for estimating the optimal scaling factor and number of quadrature nodes that minimizes the total cost for a prescribed error tolerance. We investigate the performance of our algorithm by solving several linear and semilinear time-dependent problems in 2D and 3D. The results show that our method is accurate and orders of magnitude faster than the current state-of-the-art.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

A Semi-Lagrangian Spectral Method for the Vlasov–Poisson System Based on Fourier, Legendre and Hermite Polynomials

In this study, we apply a semi-Lagrangian spectral method for the Vlasov–Poisson system, previously designed for periodic Fourier discretizations, by implementing Legendre polynomials and Hermite functions in the approximation of the distribution function with respect to the velocity variable. We discuss second-order accurate-in-time schemes, obtained by coupling spectral techniques in the space–velocity domain with a BDF time-stepping scheme. The resulting method possesses good conservation properties, which have been assessed by a series of numerical tests conducted on some standard benchmark problems including the two-stream instability and the Landau damping test cases. In the Hermite case, we also investigate the numerical behavior in dependence of a scaling parameter in the Gaussian weight. Confirming previous results from the literature, our experiments for different representative values of this parameter, indicate that a proper choice may significantly impact on accuracy, thus suggesting that suitable strategies should be developed to automatically update the parameter during the time-advancing procedure.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Phosphorus allotropes: Stability of black versus red phosphorus re-examined by means of the van der Waals inclusive density functional method

We evaluate the energetic stabilities of white, red, and black allotropes of phosphorus using density functional theory (DFT) and hybrid functional methods, van der Waals (vdW) corrections (DFT+vdW and hybrid+vdW), vdW density functionals, and random phase approximation (RPA). In this work, we find that stability of black phosphorus over red-V (i.e., the violet form) is not ubiquitous among these methods, and the calculated enthalpies for the reaction phosphorus (red-V)→ phosphorus (black) are scattered between –20 and 40 meV/atom. With local density and generalized gradient approximations, and hybrid functionals, mean absolute errors (MAEs) in densities of P allotropes relative to experiments are found to be around 10%–25%, whereas with vdW-inclusive methods, MAEs in densities drop below ~5%. While the inconsistency among the density functional methods could not shed light on the stability puzzle of black versus red phosphorus, comparison of their accuracy in predicting densities and the supplementary RPA results on relative stabilities indicate that opposite to the common belief, black and red phosphorus are almost degenerate, or the red-V (violet) form of phosphorus might even be the ground state.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2017

Quasiparticle and hybrid density functional methods in defect studies: An application to the nitrogen vacancy in GaN

Defects in semiconductors can play a vital role in the performance of electronic devices, with native defects often dominating the electronic properties of the semiconductor. Understanding the relationship between structural defects and electronic function will be central to the design of new high-performance materials. In particular, it is necessary to quantitatively understand the energy and lifetime of electronic states associated with the defect. In this work, we apply first-principles density functional theory (DFT) and many-body perturbation theory within the GW approximation to understand the nature and energy of the defect states associated with a charged nitrogen vacancy on the electronic properties of gallium nitride (GaN), as a model of a well-studied and important wide gap semiconductor grown with defects. We systematically investigate the sources of error associated with the GW approximation and the role of the underlying atomic structure on the predicted defect state energies. Additionally, analysis of the computed electronic density of states (DOS) reveals that there is one occupied defect state 0.2 eV below the valence band maximum and three unoccupied defect states at energy of 0.2–0.4 eV above the conduction band minimum, suggesting that this defect in the +1 charge state will not behave as a carrier trap. Furthermore, we compare the character and energy of the defect state obtained from GW and DFT using the HSE approximate density functional and find excellent agreement. This systematic study provides a more complete understanding of how to obtain quantitative defect energy states in bulk semiconductors.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2018

Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification

Here, we analyze the convergence of probability density functions utilizing approximate models for both forward and inverse problems. We consider the standard forward uncertainty quantification problem where an assumed probability density on parameters is propagated through the approximate model to produce a probability density, often called a push-forward probability density, on a set of quantities of interest (QoI). The inverse problem considered in this paper seeks to update an initial probability density assumed on model input parameters such that the subsequent push-forward of this updated density through the parameter-to-QoI map matches a given probability density on the QoI. We prove that the densities obtained from solving the forward and inverse problems, using approximate models, converge to the true densities as the approximate models converge to the true models. Numerical results are presented to demonstrate convergence rates of densities for sparse grid approximations of parameter-to-QoI maps and standard spatial and temporal discretizations of PDEs and ODEs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Electronic structure of intrinsic defects in c -gallium nitride: Density functional theory study without the jellium approximation

Here, we report the first nonjellium, systematic, density functional theory (DFT) study of intrinsic and extrinsic defects and defect levels in zinc-blende (cubic) gallium nitride. We use the local moment counter charge (LMCC) method, the standard Perdew-Becke-Ernzerhoff (PBE) exchange-correlation potential, and two pseudopotentials, where the Ga 3$\textit{d}$ orbitals are either in the core ($d^0$) or explicitly in the valence set ($d^{10}$). We studied 64, 216, 512, and 1000 atom supercells, and demonstrated convergence to the infinite limit, crucial for delineating deep from shallow states near band edges, and for demonstrating the elimination of finite cell-size errors. Contrary to common claims, we find that exact exchange is not required to obtain defect levels across the experimental band gap. As was true in silicon, silicon carbide, and gallium arsenide, the extremal LMCC defect levels of the aggregate of defects yield an effective LMCC defect band gap that is within 10% of the experimental gap (3.3 eV) for both pseudopotentials. We demonstrate that the gallium vacancy is more complicated than previously reported. There is dramatic metastability–a nearest-neighbor nitrogen atom shifts into the gallium site, forming an antisite, nitrogen vacancy pair, which is more stable than the simple vacancy for positive charge states. Our assessment of the $d^0$ and $d^{10}$ pseudopotentials yields minimal differences in defect structures and defect levels. The better agreement of the $d^0$ lattice constant with experiment suggests that the more computationally economical $d^0$ pseudopotentials are sufficient to achieve the fidelity possible within the physical accuracy of DFT, and thereby enable calculations in larger supercells necessary to demonstrate convergence with respect to finite size supercell errors.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2018

Discrete Approximations of Determinantal Point Processes on Continuous Spaces: Tree Representations and Tail Triviality

We prove tail triviality of determinantal point processes μ on continuous spaces. Tail triviality has been proved for such processes only on discrete spaces, and hence we have generalized the result to continuous spaces. To do this, we construct tree representations, that is, discrete approximations of determinantal point processes enjoying a determinantal structure. There are many interesting examples of determinantal point processes on continuous spaces such as zero points of the hyperbolic Gaussian analytic function with Bergman kernel, and the thermodynamic limit of eigenvalues of Gaussian random matrices for Sine{sub 2},Airy{sub 2},Bessel{sub 2}, and Ginibre point processes. Our main theorem proves all these point processes are tail trivial.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

The Good, the Bad, and the Ugly: Pseudopotential Inconsistency Errors in Molecular Applications of Density Functional Theory

The pseudopotential (PP) approximation is one of the most common techniques in computational chemistry. Despite its long history, the development of custom PPs has not tracked with the explosion of different density functional approximations (DFAs). As a result, the use of PPs with exchange/correlation models for which they were not developed is widespread, although this practice is known to be theoretically unsound. The extent of PP inconsistency errors (PPIEs) associated with this practice has not been systematically explored across the types of energy differences commonly evaluated in chemical applications. Here, we evaluate PPIEs for a number of PPs and DFAs across 196 chemically relevant systems of both transition-metal and main-group elements, as represented by the W4-11, TMC34, and S22 data sets. Near the complete basis set limit, these PPs are found to cleanly approach all-electron (AE) results for noncovalent interactions but introduce root-mean-squared errors (RMSEs) upwards of 15 kcal mol –1 into predictions of covalent bond energies for a number of popular DFAs. We achieve significant improvements through the use of empirical atom- and DFA-specific PP corrections, indicating considerable systematicity of the PPIEs. The results of this work have implications for chemical modeling in both molecular contexts and for DFA design, which we discuss.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Machine learning for impurity charge-state transition levels in semiconductors from elemental properties using multi-fidelity datasets

Quantifying charge-state transition energy levels of impurities in semiconductors is critical to understanding and engineering their optoelectronic properties for applications ranging from solar photovoltaics to infrared lasers. While these transition levels can be measured and calculated accurately, such efforts are time-consuming and more rapid prediction methods would be beneficial. Here, we significantly reduce the time typically required to predict impurity transition levels using multi-fidelity datasets and a machine learning approach employing features based on elemental properties and impurity positions. We use transition levels obtained from low-fidelity (i.e., local-density approximation or generalized gradient approximation) density functional theory (DFT) calculations, corrected using a recently proposed modified band alignment scheme, which well-approximates transition levels from high-fidelity DFT (i.e., hybrid HSE06). Further, the model fit to the large multi-fidelity database shows improved accuracy compared to the models trained on the more limited high-fidelity values. Crucially, in our approach, when using the multi-fidelity data, high-fidelity values are not required for model training, significantly reducing the computational cost required for training the model. Our machine learning model of transition levels has a root mean squared (mean absolute) error of 0.36 (0.27) eV vs high-fidelity hybrid functional values when averaged over 14 semiconductor systems from the II–VI and III–V families. As a guide for use on other systems, we assessed the model on simulated data to show the expected accuracy level as a function of bandgap for new materials of interest. Finally, we use the model to predict a complete space of impurity charge-state transition levels in all zinc blende III–V and II–VI systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Deep Neural Networks are Adaptive to Function Regularity and Data Distribution in Approximation and Estimation

Deep learning has exhibited remarkable results across diverse areas. To understand its success, substantial research has been directed towards its theoretical foundations. Nev- ertheless, the majority of these studies examine how well deep neural networks can model functions with uniform regularities. In this paper, we explore a different angle: how deep neural networks can adapt to varying degrees of smoothness in functions and nonuni- form data distributions across different locations and scales. More precisely, we focus on a broad class of functions defined by nonlinear tree-based approximation methods. This class encompasses a range of function types, such as functions with uniform regularities and discontinuous functions. We develop nonparametric approximation and estimation theories for this class using deep ReLU networks. Our results show that deep neural networks are adaptive to the nonuniform smoothness of functions and nonuniform data distributions at different locations and scales. We apply our results to several function classes, and derive the corresponding approximation and generalization errors. The validity of our results is demonstrated through numerical experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

On estimating the curvature attributes and strain invariants of deformed surface through radial basis functions

Numerical methods in approximation of derivatives on regular or irregular gridded and scattered data points are of significance in the study of numerous problems in engineering and geoscience. A mathematically accurate and stable method is assessed to compute the differential quantities, while being flexible and easy to implement. Strain-invariant parameters in deformation analysis and curvature attributes in geometrical analysis of approximated surfaces are independent quantities which could be derived numerically through radial basis functions (RBFs) for scattered data points. Approximation of a function or its derivatives through RBFs is highly correlated to its shape parameter which depends on the number and distribution of the particles on the support domain. A procedure to find the optimal shape parameter for RBFs in the influence domain of each nodal point together with the presentation of a manner of calculating the curvature attributes and strain parameters through Gaussian RBFs is proposed here. Results indicate a significant improvement in the approximation accuracy of strain parameters and curvature attributes, while this approximation is more stable when RBFs with optimal shape parameter are implemented rather than the traditional moving least squares.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Chapter 7: Learning Stable Local Volt/Var Controllers in Distribution Grids

This chapter describes a framework to synthesize provably stable local Volt/Var controllers for distributed energy resources (DERs) in power distribution grids (DGs). The goal is to control the reactive power injections of DERs to improve the system performance as quantified by a generic optimal reactive power flow (ORPF) problem. To achieve this, we jointly design for each DER the control function, which prescribes the reactive power update rule, and the equilibrium function, which approximates the ORPF solutions from local measurements of voltages and powers. We provide conditions on the equilibrium functions and the control parameters ensuring the stability of the closed-loop system. In particular, we discuss the trade-offs between each set of conditions accounting for practical considerations, like fully exploiting the DERs' generation capabilities and reducing the optimality gap. These conditions are then translated into learning constraints on the neural networks' parameters that are enforced in the training phase. We validate our framework with numerical simulations on the IEEE 37-bus network and through a comparison with an optimized version of standard piece wise linear control rules.

closed-loop asymptotic stability↗