Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “function approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Diffusion-Model-Assisted Supervised Learning of Generative Models for Density Estimation

Here, we present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks (GANs), normalizing flows, and variational auto-encoders (VAEs), are usually considered as unsupervised learning models, because labeled data are usually unavailable for training. Despite the success of the generative models, there are several issues with the unsupervised training, e.g., requirement of reversible architectures, vanishing gradients, and training instability. To enable supervised learning in generative models, we utilize the score-based diffusion model to generate labeled data. Unlike existing diffusion models that train neural networks to learn the score function, we develop a training-free score estimation method. This approach uses mini-batch-based Monte Carlo estimators to directly approximate the score function at any spatial-temporal location in solving an ordinary differential equation (ODE), corresponding to the reverse-time stochastic differential equation (SDE). This approach can offer both high accuracy and substantial time savings in neural network training. Once the labeled data are generated, we can train a simple, fully connected neural network to learn the generative model in the supervised manner. Compared with existing normalizing flow models, our method does not require the use of reversible neural networks and avoids the computation of the Jacobian matrix. Compared with existing diffusion models, our method does not need to solve the reverse-time SDE to generate new samples. As a result, the sampling efficiency is significantly improved. We demonstrate the performance of our method by applying it to a set of 2D datasets as well as real data from the University of California Irvine (UCI) repository.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Generative Vulnerability Assessment for Cyber-Physical Systems

Cyber-physical systems (CPS) are highly susceptible to malicious attacks due to their complex dynamics and interconnectivity. A comprehensive understanding of their vulnerabilities is essential for designing effective resilience measures. This paper presents a data-driven attack generative system for evaluating the vulnerability of CPS. The proposed approach formulates the vulnerability assessment problem as determining the feasibility of a specific attack set based on two boundary functions that represent the effectiveness and stealthiness of attacks. The attack generative model is trained using a custom loss function, with two universal approximators designed to learn the effectiveness and stealthiness functions simultaneously. Theoretical results for successful generation and asymptotic convergence of the resulting training algorithm are given. As a result, the proposed approach is evaluated via numerical simulation of an IEEE 14-bus system and gas pipeline systems, demonstrating its viability in learning how to attack nonlinear CPS and identify potential vulnerabilities.

Computer systems organization↗
DOE OSTI2023

Robust scalable initialization for Bayesian variational inference with multi-modal Laplace approximations

Predictive modeling typically relies on Bayesian model calibration to provide uncertainty quantification. Variational inference utilizing fully independent (“mean-field”) Gaussian distributions are often used as approximate probability density functions. This simplification is attractive since the number of variational parameters grows only linearly with the number of unknown model parameters. However, the resulting diagonal covariance structure and unimodal behavior can be too restrictive to provide useful approximations of intractable Bayesian posteriors that exhibit highly non-Gaussian behavior, including multimodality. High-fidelity surrogate posteriors for these problems can be obtained by considering the family of Gaussian mixtures. Gaussian mixtures are capable of capturing multiple modes and approximating any distribution to an arbitrary degree of accuracy, while maintaining some analytical tractability. Unfortunately, variational inference using Gaussian mixtures with full-covariance structures suffers from a quadratic growth in variational parameters with the number of model parameters. The existence of multiple local minima due to strong nonconvex trends in the loss functions often associated with variational inference present additional complications, These challenges motivate the need for robust initialization procedures to improve the performance and computational scalability of variational inference with mixture models. In this work, we propose a method for constructing an initial Gaussian mixture model approximation that can be used to warm-start the iterative solvers for variational inference. The procedure begins with a global optimization stage in model parameter space. In this step, local gradient-based optimization, globalized through multistart, is used to determine a set of local maxima, which we take to approximate the mixture component centers. Around each mode, a local Gaussian approximation is constructed via the Laplace approximation. Finally, the mixture weights are determined through constrained least squares regression. The robustness and scalability of the proposed methodology is demonstrated through application to an ensemble of synthetic tests using high-dimensional, multimodal probability density functions. Here, the practical aspects of the approach are demonstrated with inversion problems in structural dynamics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Interpolating between small- and large-$\mathscr{g}$ expansions using Bayesian model mixing

Bayesian model mixing (BMM) is a statistical technique that can be used to combine models that are predictive in different input domains into a composite distribution that has improved predictive power over the entire input space. We explore the application of BMM to the mixing of two expansions of a function of a coupling constant $\mathscr{g}$ that are valid at small and large values of $\mathscr{g}$ respectively. This type of problem is quite common in nuclear physics, where physical properties are straightforwardly calculable in strong and weak interaction limits or at low and high densities or momentum transfers, but difficult to calculate in between. Interpolation between these limits is often accomplished by a suitable interpolating function, e.g., Padé approximants, but it is then unclear how to quantify the uncertainty of the interpolant. We address this problem in the simple context of the partition function of zero-dimensional Φ 4 theory, for which the (asymptotic) expansion at small $\mathscr{g}$ and the (convergent) expansion at large $\mathscr{g}$ are both known. We consider three mixing methods: linear mixture BMM, localized bivariate BMM, and localized multivariate BMM with Gaussian processes. Here, we find that employing a Gaussian process in the intermediate region between the two predictive models leads to the best results of the three methods. The methods and validation strategies we present here should be generalizable to other nuclear physics settings.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2017

Quantum Monte Carlo calculations of light nuclei with local chiral two- and three-nucleon interactions

Local chiral effective field theory interactions have recently been developed and used in the context of quantum Monte Carlo few- and many-body methods for nuclear physics. In this paper, we go over detailed features of local chiral nucleon-nucleon interactions and examine their effect on properties of the deuteron, paying special attention to the perturbativeness of the expansion. We then turn to three-nucleon interactions, focusing on operator ambiguities and their interplay with regulator effects. We then discuss the nuclear Green's function Monte Carlo method, going over both wave-function correlations and approximations for the two- and three-body propagators. Finally, following this, we present a range of results on light nuclei: Binding energies and distribution functions are contrasted and compared, starting from several different microscopic interactions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Surrogate Model Guided Optimization of Expensive Black-Box Multi-Objective Problems: A Posteriori Methods

Many engineering applications require the simultaneous optimization of multiple conflicting objective functions. Often, these objective functions are evaluated using highly accurate computer simulations that are computationally too expensive to be evaluated hundreds or thousands of times during optimization. Thus, the goal is to find good approximations of the Pareto front using as few of these expensive simulations as possible. Here, we describe an optimization approach based on surrogate models and diverse sampling strategies to accelerate the search for the Pareto solutions. We use a separate surrogate model for approximating each objective function and then we use the surrogate models to inform where additional expensive simulations should be run. The surrogate models are updated in an active learning framework whenever new information from the expensive simulations becomes available. The sampling strategies aim at balancing local improvements of the approximate Pareto front and global exploration to identify the extrema and fill in large gaps of the approximate Pareto front. We demonstrate on a large set of benchmark problems the effectiveness of the method for finding good approximations of the Pareto front.

MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Criteria for the Best Approximation by Simple Partial Fractions on Semi-Axis and Axis

We study uniform approximation of real-valued functions f, f(∞) = 0, on ℝ{sup +} and ℝ by real-valued simple partial fractions (the logarithmic derivatives of polynomials). We obtain a criterion for the best approximation on ℝ{sup +} and ℝ in terms of the Chebyshev alternance. This criterion is similar to the known criterion on finite segments. For the problem of approximating odd functions on ℝ we construct an alternance criterion with a weakened condition on the poles of fractions. We present a criterion for the best approximation by simple partial fractions on ℝ{sup +} and ℝ in terms of Kolmogorov. We prove analogs of the de la Vallee-Poussin alternation theorem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Ab-Initio Investigation of Finite Size Effects in Rutile Titania Nanoparticles with Semilocal and Nonlocal Density Functionals

In this work, we employ hybrid and generalized gradient approximation (GGA) level density functional theory (DFT) calculations to investigate the convergence of surface properties and electronic gap of rutile titania nanoparticles with particle size. The surface energies and electronic gaps are calculated for cuboidal particles with minimum dimension ranging from 3.7 Angstrom (24 atoms) to 10.3 Angstrom (384 atoms) using a highly-parallel real-space DFT code to enable hybrid level DFT calculations of larger nanoparticles than are typically practical. We deconvolute the geometric and electronic finite size effects in surface energy, and evaluate the influence of defects on electronic gap and density of states (DOS). The electronic finite size effects in surface energy vanish when the minimum length scale of the nanoparticles becomes greater than 10 Angstrom. We show that this length scale is consistent with a computationally efficient numerical analysis of the characteristic length scale of electronic interactions. The surface energy of nanoparticles having minimum dimension beyond this characteristic length can be approximated using slab calculations that account for the geometric defects. In contrast, the finite size effects on the electronic gap and DOS is highly dependent on the shape and size of these particles. Furthermore, the DOS for cuboidal particles and more realistic particles constructed using the Wulff algorithm reveal that defect states within the electronic gap play a key role in determining the eigen value distribution of nanoparticles and the electronic gap does not converge to the bulk limit for the particle sizes investigated.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Regularized machine learning on molecular graph model explains systematic error in DFT enthalpies

Abstract A major goal of materials research is the discovery of novel and efficient heterogeneous catalysts for various chemical processes. In such studies, the candidate catalyst material is modeled using tens to thousands of chemical species and elementary reactions. Density Functional Theory (DFT) is widely used to calculate the thermochemistry of these species which might be surface species or gas-phase molecules. The use of an approximate exchange correlation functional in the DFT framework introduces an important source of error in such models. This is especially true in the calculation of gas phase molecules whose thermochemistry is calculated using the same planewave basis set as the rest of the surface mechanism. Unfortunately, the nature and magnitude of these errors is unknown for most practical molecules. Here, we investigate the error in the enthalpy of formation for 1676 gaseous species using two different DFT levels of theory and the ‘ground truth values’ obtained from the NIST database. We featurize molecules using graph theory. We use a regularized algorithm to discover a sparse model of the error and identify important molecular fragments that drive this error. The model is robust to rigorous statistical tests and is used to correct DFT thermochemistry, achieving more than an order of magnitude improvement.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Overdestabilization vs Overstabilization in the Theoretical Analysis of f-Orbital Covalency

The complex nature of the f-orbital electronic structures and their interaction with the chemical environment pose significant computational challenges. Advanced computational techniques that variationally include scalar relativities and spin–orbit coupling directly at the molecular orbital level have been developed to address this complexity. Among these, variational relativistic multiconfigurational multireference methods stand out for their high accuracy and systematic improvement in studies of f-block complexes. Additionally, these advanced methods offer the potential for calibrating low-scaling electronic structure methods such as density functional theory. However, studies on the Cl K-edge X-ray absorption spectra of the [Ce(III)Cl 6 ] 3– and [Ce(IV)Cl 6 ] 2– complexes show that time-dependent density functional theory with approximate exchange–correlation kernels can lead to inaccuracies, resulting in an overstabilization of 4f orbitals and incorrect assessments of covalency. In contrast, approaches utilizing small active space wave function methods may understate the stability of these orbitals. The results herein demonstrate the need for large active space, multireference, and variational relativistic methods in studying f-block complexes.

chemical calculations↗
DOE OSTI2024

Toward first principles-based simulations of dense hydrogen

Accurate knowledge of the properties of hydrogen at high compression is crucial for astrophysics (e.g., planetary and stellar interiors, brown dwarfs, atmosphere of compact stars) and laboratory experiments, including inertial confinement fusion. There exists experimental data for the equation of state, conductivity, and Thomson scattering spectra. However, the analysis of the measurements at extreme pressures and temperatures typically involves additional model assumptions, which makes it difficult to assess the accuracy of the experimental data rigorously. On the other hand, theory and modeling have produced extensive collections of data. They originate from a very large variety of models and simulations including path integral Monte Carlo (PIMC) simulations, density functional theory (DFT), chemical models, machine-learned models, and combinations thereof. At the same time, each of these methods has fundamental limitations (fermion sign problem in PIMC, approximate exchange–correlation functionals of DFT, inconsistent interaction energy contributions in chemical models, etc.), so for some parameter ranges accurate predictions are difficult. Recently, a number of breakthroughs in first principles PIMC as well as in DFT simulations were achieved which are discussed in this review. Here we use these results to benchmark different simulation methods. We present an update of the hydrogen phase diagram at high pressures, the expected phase transitions, and thermodynamic properties including the equation of state and momentum distribution. Furthermore, we discuss available dynamic results for warm dense hydrogen, including the conductivity, dynamic structure factor, plasmon dispersion, imaginary-time structure, and density response functions. We conclude by outlining strategies to combine different simulations to achieve accurate theoretical predictions that are based on first principles.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2019

Analysis of over-magnetization of elemental transition metal solids from the SCAN density functional

Current investigations have revealed that the strongly constrained and appropriately normed (SCAN) meta-generalized gradient approximation exchange-correlation functional significantly over-magnetizes elemental Fe, Co, and Ni solids. For the paradigmatic case, bcc Fe, the error relative to experiment is ≳ 20 % . A comparative analysis of magnetization results from SCAN and its deorbitalized counterpart, SCAN-L, leads to identification of the source of the discrepancy. It is not from the difference between Kohn-Sham (SCAN-L) and generalized Kohn-Sham (SCAN) procedures. The key is the iso-orbital indicator α (the ratio of the local Pauli and Thomas-Fermi kinetic energy densities). Its deorbitalized counterpart α L has more dispersion in both spin channels with respect to magnetization in an approximate region between 0.6 and 1.2 bohrs around an Fe nucleus. The overall effect is that the SCAN switching function evaluated with α L reduces the energetic disadvantage of the down channel with respect to up compared to the original α , which in turn reduces the magnetization. This identifies the origin of the SCAN magnetization error as insensitivity of the SCAN switching function to α values in the approximate range 0.5 ≲ α ≲ 0.8 and oversensitivity for α ≳ 0.8 .

36 MATERIALS SCIENCE↗
DOE OSTI2023

Shock-induced metallization of polystyrene along the principal Hugoniot investigated by advanced thermal density functionals

To date, none of the ab-initio molecular dynamics simulations of polystyrene, often used as an ablator material in inertial confinement fusion targets, with the standard ground-state exchange-correlation (XC) functional in density-functional theory can satisfactorily agree with experiments in terms of reflectivity measurements. Here, we use recently developed thermal strongly constrained and appropriately normed Laplacian dependent meta-generalized gradient approximation XC density functional (T-SCAN-L) and thermal hybrid XC density functional (KDT0) to show that the inclusion of thermal and inhomogeneity effects is crucial for accurate prediction of structural evolution and corresponding insulator-metal transition (IMT) during shock compression. Optical reflectivity calculated as an indicator of IMT is in perfect accord with experimental data.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2019

Time-dependent current-density-functional theory of charge, energy and spin transport and dynamics in nanoscale systems (Final Report)

The focus of this research program is on developing density functional methods for the calculation of non-equilibrium phenomena of the transport type (finite wavelength, low frequency) and of the dynamical type (long wavelength, high frequency). One such method is the time-dependent current density functional theory, in which the evolution of the physical system is mimicked in a fictitious non-interacting system subjected to an effective one-particle potential, which we approximate as a function of the equilibrium density and non-equilibrium current density.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2017

Optimal Power Flow of Radial Networks and Its Variations: A Sequential Convex Optimization Approach

This paper proposes a sequential convex optimization method to solve broader classes of optimal power flow (OPF) problems over radial networks. The non-convex branch power flow equation is decomposed as a second-order cone inequality and a non-convex constraint involving the difference of two convex functions. Provided with an initial solution offered by an inexact second-order cone programming relaxation model, this approach solves a sequence of convexified penalization problems, where concave terms are approximated by linear functions and updated in each iteration. It could recover a feasible power flow solution, which usually appears to be very close, if not equal, to the global optimal one. Two variations of the OPF problem, in which non-cost related objectives are optimized subject to power flow constraints and the convex relaxation is generally inexact, are elaborated in detail. One is the maximum loadability problem, which is formulated as a special OPF problem that seeks the maximal distance to the boundary of power flow insolvability. The proposed method is shown to outperform commercial nonlinear solvers in terms of robustness and efficiency. The other is the bi-objective OPF problem. A non-parametric scalarization model is suggested, and is further reformulated as an extended OPF problem by convexifying the objective function. It provides a single trade-off solution without any subjective preference. The proposed computation framework also helps retrieve the Pareto front of the bi-objective OPF via the e-constraint method or the normal boundary intersection method. This paper also discusses extensions for OPF problems over meshed networks based on the semidefinite programming relaxation method.

bi-objective optimization↗
DOE OSTI2018

Vibrational and Thermal Properties of Oxyanionic Crystals

The vibrational and thermal properties of dolomite and alkali chlorates and perchlorates were studied in the gradient approximation of density functional theory using the method of a linear combination of atomic orbitals (LCAO). Long-wave vibration frequencies, IR and Raman spectra, and mode Gruneisen parameters were calculated. Equation-of-state parameters, thermodynamic potentials, entropy, heat capacity, and thermal expansion coefficient were also determined. The thermal expansion coefficient of dolomite was established to be much lower than for chlorates and perchlorates. The temperature dependence of the heat capacity at T > 200 K was shown to be generally governed by intramolecular vibrations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Conditional probability density functional theory

Here we present conditional probability (CP) density functional theory (DFT) as a formally exact theory. In essence, CP-DFT determines the ground-state energy of a system by finding the CP density from a series of independent Kohn-Sham (KS) DFT calculations. By directly calculating CP densities, we bypass the need for an approximate XC energy functional. In this paper we discuss and derive several key properties of the CP density and corresponding CP-KS potential. Illustrative examples are used throughout to help guide the reader through the various concepts and theory presented. We explore a suitable CP-DFT approximation and discuss exact conditions, limitations, and results for selected examples.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Discrete Hahn polynomials for numerical solution of two-dimensional variable-order fractional Rayleigh–Stokes problem

The main aim of this paper is to find the numerical solutions of 2D Rayleigh–Stokes problem with the variable-order fractional derivatives in the Riemann–Liouville sense. The presented method is based on collocation procedure in combination with the new operational matrix of the variable-order fractional derivatives, in the Caputo sense, for the discrete Hahn polynomials. The main advantage of the proposed method is obtaining a global approximation for spatial and temporal discretizations, and it reduced the problem to an algebraic system, which is easier to solve. Also, the profit of approximating a continuous function by Hahn polynomials is that for computing the coefficients of the expansion, we only have to compute a summation and the calculation of coefficients is exact. The error bound for the approximate solution is estimated. Finally, we evaluate results of the presented method with other numerical methods.

97 MATHEMATICS AND COMPUTING↗