Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “functional approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Mathematical nuances of Gaussian process-driven autonomous experimentation

Abstract The fields of machine learning (ML) and artificial intelligence (AI) have transformed almost every aspect of science and engineering. The excitement for AI/ML methods is in large part due to their perceived novelty, as compared to traditional methods of statistics, computation, and applied mathematics. But clearly, all methods in ML have their foundations in mathematical theories, such as function approximation, uncertainty quantification, and function optimization. Autonomous experimentation is no exception; it is often formulated as a chain of off-the-shelf tools, organized in a closed loop, without emphasis on the intricacies of each algorithm involved. The uncomfortable truth is that the success of any ML endeavor, and this includes autonomous experimentation, strongly depends on the sophistication of the underlying mathematical methods and software that have to allow for enough flexibility to consider functions that are in agreement with particular physical theories. We have observed that standard off-the-shelf tools, used by many in the applied ML community, often hide the underlying complexities and therefore perform poorly. In this paper, we want to give a perspective on the intricate connections between mathematics and ML, with a focus on Gaussian process-driven autonomous experimentation. Although the Gaussian process is a powerful mathematical concept, it has to be implemented and customized correctly for optimal performance. We present several simple toy problems to explore these nuances and highlight the importance of mathematical and statistical rigor in autonomous experimentation and ML. One key takeaway is that ML is not, as many had hoped, a set of agnostic plug-and-play solvers for everyday scientific problems, but instead needs expertise and mastery to be applied successfully. Graphical abstract

97 MATHEMATICS AND COMPUTING↗

Hybrid Analytical Technique for Nonlinear Vibration Analysis of Thin-Walled Beams

A two-step hybrid analytical technique is presented for the nonlinear vibration analysis of thin-walled beams. The first step involves the generation of various-order perturbation functions using the Linstedt-Poincare perturbation technique. The second step consists of using the perturbation functions as coordinate (or approximation) functions and then computing both the amplitudes of these functions and the nonlinear frequency of vibration via a direct variational procedure. The analytical formulation is based on a form of the geometrically nonlinear beam theory with the effects of in-plane inertia, rotatory inertia, and transverse shear deformation included. The effectiveness of the proposed technique is demonstrated by means of a numerical example of thin-walled beam with a doubly symmetric I-section. The solutions obtained using a single-spatial mode were compared with those obtained using multiple-spatial modes. The standard of comparison was taken to be the frequencies obtained by the direct integration/fast Fourier transform (FFT) technique. The nonlinear frequencies obtained by the hybrid technique were shown to converge to the corresponding ones obtained by the direct integration/fast Fourier transform (FFT) technique well beyond the range of applicability of the perturbation technique. The frequencies and total strain energy of the beam were overestimated by using a single-spatial mode.

Noor, Ahmed K.↗

An Interactive MATLAB Program for Fitting Transfer Functions to Frequency Responses

A computer program called FRFit (Frequency Response Fitting) for matching single-input single-output (SISO) transfer function models to empirical frequency response data is described. The program was written in MATLAB and has a graphical user interface (GUI). It is interactive in that the user manually builds the transfer function model using ``elementary factors'' (gain, delay, differentiators and integrators, and first- and second-order poles and zeros) and adjusts their values with sliders or entry fields. A nonlinear optimization can also be used to determine maximum-likelihood estimates of the transfer function parameters and their associated uncertainties. The program has some usefulness as a teaching aid, and can be applied to model structure determination, reduced-order modeling, preliminary analysis, and other system identification problems. FRFit is demonstrated using example problems, including the identification of aircraft transfer functions and rational function approximations of Theodorsen's function.

Frequency response↗

New methods of fragmentary approximation of a function

Certain special methods of fragmentary approximation of a function are examined and the properties of the most widespread elementary functions for such approximation methods are investigated, for the purpose of developing useful characteristics and properties for practical realization, in particular, for their reproduction by analog functional converters, with a significantly smaller number of controlable or adjustable parameters than in known ones.

Kolesnichenko, S. G.↗

Thermal weights for semiclassical vibrational response functions

Semiclassical approximations to response functions can allow the calculation of linear and nonlinear spectroscopic observables from classical dynamics. Evaluating a canonical response function requires the related tasks of determining thermal weights for initial states and computing the dynamics of these states. A class of approximations for vibrational response functions employs classical trajectories at quantized values of action variables and represents the effects of the radiation-matter interaction by discontinuous transitions. Here, we evaluate choices for a thermal weight function which are consistent with this dynamical approximation. Weight functions associated with different semiclassical approximations are compared, and two forms are constructed which yield the correct linear response function for a harmonic potential at any temperature and are also correct for anharmonic potentials in the classical mechanical limit of high temperature. Approximations to the vibrational linear response function with quantized classical trajectories and proposed thermal weight functions are assessed for ensembles of one-dimensional anharmonic oscillators. This approach is shown to perform well for an anharmonic potential that is not locally harmonic over a temperature range encompassing the quantum limit of a two-level system and the limit of classical dynamics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Coherency-Constrained Spectral Clustering for Power Network Reduction

This paper presents a methodology for reducing the complexity of large-scale power network models using spectral clustering, aggregation of electrical components, and cost function approximation. Two approaches are explored using unconstrained and constrained spectral clustering to determine areas for effective system reduction. Once the system areas are determined, both loads and generators by type are aggregated, and their new cost function is approximated through polynomial curve-fitting or statistical methods. The performance of reduced networks is evaluated in terms of their ability to follow the true daily cost of the original system over a 24-hour period considering a set of several days. Two test systems are taken as test beds. Application of the methodology to a modified version of the IEEE 39-bus system reduces it from 17 generators to a 4-bus system and 9 generators with about 93% of accuracy. Similarly, the IEEE 118-bus system is reduced from 19 generators to a 3-bus system with three aggregated units achieving over 99% of accuracy. These findings address scalability challenges and enhance accuracy for high and mid-loading level conditions, and by aggregating thermal units with similar cost functions.

42 ENGINEERING↗

DeepONet-grid-UQ: A trustworthy deep operator framework for predicting the power grid’s post-fault trajectories

This paper proposes a novel data-driven method for the reliable prediction of the power grid’s post-fault trajectories, i.e., the power grid’s dynamic response after a disturbance or fault. Here, the proposed method is based on the recently proposed concept of Deep Operator Networks (DeepONets). Unlike traditional neural networks that learn to approximate functions, DeepONets are designed to approximate nonlinear operators, i.e., mappings between infinite-dimensional spaces. Under this operator framework, we design a novel and efficient DeepONet that (i) takes as inputs the trajectories collected before and during the fault and (ii) outputs the predicted post-fault trajectories. In addition, we endow our method with the much-needed ability to balance efficiency with reliable/trustworthy predictions via uncertainty quantification. To this end, we propose and compare two novel methods that enable quantifying the predictive uncertainty. First, we propose a Bayesian DeepONet (B-DeepONet) that uses stochastic gradient Hamiltonian Monte-Carlo to sample from the posterior distribution of the DeepONet trainable parameters. Then, we design a Probabilistic DeepONet (Prob-DeepONet) that uses a probabilistic training strategy to enable quantifying uncertainty at virtually no extra computational cost. Finally, we validate the proposed methods’ predictive power and uncertainty quantification capability using the New York-New England power grid model.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Global properties of pseudospectral methods

The present application of polynomial interpolation methods to function-approximation and numerical solutions for hyperbolic and elliptic PDEs allows the explicit construction of the derivative matrix for a general sequence of collocation points. An evaluation of the effect of several factors on the performance of these methods indicates an inability to interpret global methods in terms of local ones; the accuracy of the approximation will differ when the function's large gradients occur near the center of the region or near the boundary, irrespective of the boundary vicinity's collocation-point density.

Solomonoff, A.↗

Confronting Domain Shift in Trained Neural Networks

Neural networks (NNs) are known as universal function approximators and can interpolate nonlinear functions between observed data points. However, when the target domain for deployment shifts from the training domain and NNs must extrapolate, the results are notoriously poor. Prior work Martinez et al. (2019) has shown that NN uncertainty estimates can be used to correct binary predictions in shifted domains without retraining the model. We hypothesize that this approach can be extended to correct real-valued time series predictions. As an exemplar, we consider two mechanical systems with nonlinear dynamics. The first system consists of a spring-mass system where the stiffness changes abruptly, and the second is a real experimental system with a frictional joint that is an open challenge for structural dynamicists to model efficiently. Our experiments will test whether 1) NN uncertainty estimates can identify when the input domain has shifted from the training domain and 2) whether the information used to calculate uncertainty estimates can be used to correct the NN’s time series predictions. While the method as proposed did not significantly improve predictions, our results did show potential for modifications that could improve models’ predictions and play a role in structural health monitoring systems that directly impact public safety.

97 MATHEMATICS AND COMPUTING↗

Estimation of correlation functions by stochastic approximation.

Consideration of the autocorrelation function of a zero-mean stationary random process. The techniques are applicable to processes with nonzero mean provided the mean is estimated first and subtracted. Two recursive techniques are proposed, both of which are based on the method of stochastic approximation and assume a functional form for the correlation function that depends on a number of parameters that are recursively estimated from successive records. One technique uses a standard point estimator of the correlation function to provide estimates of the parameters that minimize the mean-square error between the point estimates and the parametric function. The other technique provides estimates of the parameters that maximize a likelihood function relating the parameters of the function to the random process. Examples are presented.

Habibi, A.↗

Ab initio quasi-particle approximation bandgaps of silicon nanowires calculated at density functional theory/local density approximation computational effort

Ab initio calculations of hydrogen-passivated Si nanowires were performed using density functional theory within LDA-1/2, to account for the excited states properties. A range of diameters was calculated to draw conclusions about the ability of the method to correctly describe the main trends of bandgap, quantum confinement, and self-energy corrections versus the diameter of the nanowire. Bandgaps are predicted with excellent accuracy if compared with other theoretical results like GW, and with the experiment as well, but with a low computational cost.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Performance evaluation of fault tolerant systems represented by Markov models

A method to evaluate the performance of fault tolerant systems whose configuration can be represented by time-invariant, discrete-time, discrete-state Markov models is introduced. Each state is assumed to be associated with a constant qualitative measure of the system's performance. The method first computes the moments of the performance probability mass function (PMF) and then finds an approximating function that has the same moments. The form of this function is a maximum entropy solution of the moment matching problem. A simple algorithm for calculating the necessary moments is derived and a method for finding the approximate performance PMF is suggested. After some modification, the method is applied to an example, the Inertial Upper Stage navigation system.

Missana, Jean-Olivier A. A.↗

Self-consistent implementation of locally scaled self-interaction-correction method

Recently proposed local self-interaction correction (LSIC) method is a one-electron self-interaction-correction (SIC) method that uses an iso-orbital indicator to apply the SIC at each point in space by scaling the exchange–correlation and Coulomb energy densities. The LSIC method is exact for the one-electron densities, also recovers the uniform electron gas limit of the uncorrected density functional approximation, and reduces to the well-known Perdew–Zunger SIC (PZSIC) method as a special case. This article presents the self-consistent implementation of the LSIC method using the ratio of Weizsäcker and Kohn–Sham kinetic energy densities as an iso-orbital indicator. The atomic forces as well as the forces on the Fermi-Löwdin orbitals are also implemented for the LSIC energy functional. Results show that LSIC with the simplest local spin density functional predicts atomization energies of the AE6 dataset better than some of the most widely used generalized-gradient-approximation (GGA) functional and barrier heights of the BH6 database better than some of the most widely used hybrid functionals. The LSIC method [a mean absolute error (MAE) of 0.008 Å] predicts bond lengths of a small set of molecules better than the PZSIC-LSDA (MAE 0.042 Å) and LSDA (0.011 Å). Furthermore, this work shows that accurate results can be obtained from the simplest density functional by removing the self-interaction-errors using an appropriately designed SIC method.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

How important is self-consistency for the dDsC density dependent dispersion correction?

The treatment of dispersion interactions is ubiquitous but computationally demanding for seamless ab initio approaches. A highly popular and simple remedy consists in correcting for the missing interactions a posteriori by adding an attractive energy term summed over all atom pairs to standard density functional approximations. These corrections were originally based on atom pairwise parameters and, hence, had a strong touch of empiricism. To overcome such limitations, we recently proposed a robust system-dependent dispersion correction, dDsC, that is computed from the electron density and that provides a balanced description of both weak inter- and intramolecular interactions. From the theoretical point of view and for the sake of increasing reliability, we here verify if the self-consistent implementation of dDsC impacts ground-state properties such as interaction energies, electron density, dipole moments, geometries, and harmonic frequencies. In addition, we investigate the suitability of the a posteriori scheme for molecular dynamics simulations, for which the analysis of the energy conservation constitutes a challenging tests. Our study demonstrates that the post-SCF approach in an excellent approximation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Energy Frontier Research Centers: Center for the Computational Design of Functional Layered Materials (CCDM) August 1, 2014 - July 31, 2018; Center for Complex Materials from First Principles (CCM) August 1, 2018 - July 31, 2021 (Final Report)

The mission of the DOE Energy Frontier Research Centers CCDM (2014-2018) and CCM (2018-2021) was to theoretically develop, computationally apply, and experimentally validate electronic structure methods for all materials, with a focus on the complex materials, especially layered and two-dimensional materials, strongly-correlated materials, and liquid water. This was achieved by over 200 published journal articles authored by about 17 senior investigators from physics and chemistry and from theory, computation, and experiment, plus their collaborators. In particular, the Centers confirmed the predictive power of the SCAN (strongly constrained and appropriately normed) density functional, which was constructed to satisfy 17 known exact constraints and several appropriate norms. Without being fitted to real bonded systems, and at a modest computational cost, SCAN correctly predicted covalent, ionic, metallic, hydrogen, and van der Waals bonds in many challenging materials. SCAN gave an improved description of defects in semiconductors, surface properties of metals, seven phases of ice, liquid water, liquid and supercooled silicon, subtle structural distortions in ferroelectrics, formation energies and structural predictions for solids, and critical pressures for structural phase transitions. Perhaps most remarkably, SCAN correctly described some strongly-correlated materials that were previously believed to be beyond the reach of density-functional approximations. SCAN is the only density functional that correctly predicts the band gap closing under chemical doping of the cuprate high-temperature superconducting materials. SCAN also predicts a landscape of competing stripe and magnetic phases in the cuprates. For some materials with some codes, SCAN has convergence problems that are greatly reduced by the CCM-developed r 2 SCAN, without loss of accuracy or rigor. SCAN and r 2 SCAN still make some self-interaction error, which is greatly reduced by the CCDM/ CCM-developed local orbital scaling correction (LOSC). These Centers further proved that the fundamental energy gaps of a solid from an orbital energy difference and from total energy differences are the same for a large class of generalized Kohn-Sham (GKS) functionals, including SCAN and standard hybrid functionals, and that symmetry breaking arises when a dynamic density fluctuation drops to zero frequency. The Centers identified new mechanisms for catalysis in layered materials with ions intercalated between the layers, investigated charge density waves both in model systems and in real layered materials, studied changes of band gap with the number of layers, and explored topological ultrathin films, bent nanoribbons, and defects.

08 HYDROGEN↗

Molecular processes in a high temperature shock layer

The development of techniques for the calculation of electron capture widths, electronic wave functions, cross sections and rates needed for the description of the dissociative recombination (DR) of molecular ions with electrons were described. The cross sections and rates were calculated by using harmonic oscillator wave functions for the ion and a delta function approximation for the continuum vibrational wave function in the repulsive dissociative channel. In order to obtain DR cross sections of quantitative accuracy, a computer program which solves the one dimensional nuclear motion wave equation was revised to calculate the cross sections and rates. The program and the new results are described. Included is a discussion of large windows found in the dissociative recombination cross sections from excited ion vibrational levels. These windows have not been previously reported in the literature. The magnitude of the DR cross sections for several dissociative routes are sensitive to the location of the crossing of the neutral and ion potential curves. Studies of the effects of basis set and CI wave function size on vertical excitation energies are described. Preliminary studies on N2 and O2 using large scale wave functions are also reported.

Guberman, S. L.↗