Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Functional approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Adaptive Activation Functions Accelerate Convergence in Deep and Physics-informed Neural Networks

We employ adaptive activation functions for regression in deep and physics-informed neural networks (PINNs) to approximate smooth and discontinuous functions as well as solutions of linear and nonlinear partial differential equations. In particular, we solve the nonlinear Klein-Gordon equation, which has smooth solutions, the nonlinear Burgers equation, which can admit high gradient solutions, and the Helmholtz equation. We introduce a scalable hyper-parameter in the activation function, which can be optimized to achieve best performance of the network as it changes dynamically the topology of the loss function involved in the optimization process. The adaptive activation function has better learning capabilities than the traditional one (fixed activation) as it improves greatly the convergence rate, especially at early training, as well as the solution accuracy. To better understand the learning process, we plot the neural network solution in the frequency domain to examine how the network captures successively different frequency bands present in the solution. We consider both forward problems, where the approximate solutions are obtained, as well as inverse problems, where parameters involved in the governing equation are identified. Our simulation results show that the proposed method is a very simple and effective approach to increase the efficiency, robustness and accuracy of the neural network approximation of nonlinear functions as well as solutions of partial differential equations, especially for forward problems. We theoretically prove that in the proposed method, gradient descent algorithms are not attracted to suboptimal critical points or local minima.

machine leaning, Bad minima, Inverse problems, Phy↗

e/a classification of Hume–Rothery Rhombic Triacontahedron-type approximants based on all-electron density functional theory calculations

There are three key electronic parameters in elucidating the physics behind the Hume–Rothery electron concentration rule: the square of the Fermi diameter (2kF)2, the square of the critical reciprocal lattice vector and the electron concentration parameter or the number of itinerant electrons per atom e/a. We have reliably determined these three parameters for 10 Rhombic Triacontahedron-type 2/1–2/1–2/1 (N = 680) and 1/1–1/1–1/1 (N = 160–162) approximants by making full use of the full-potential linearized augmented plane wave-Fourier band calculations based on all-electron density-functional theory. We revealed that the 2/1–2/1–2/1 approximants Al13Mg27Zn45 and Na27Au27Ga31 belong to two different sub-groups classified in terms of equal to 126 and 109 and could explain why they take different e/a values of 2.13 and 1.76, respectively. Among eight 1/1–1/1–1/1 approximants Al3Mg4Zn3, Al9Mg8Ag3, Al21Li13Cu6, Ga21Li13Cu6, Na26Au24Ga30, Na26Au37Ge18, Na26Au37Sn18 and Na26Cd40Pb6, the first two, the second two and the last four compounds were classified into three sub-groups with = 50, 46 and 42; and were claimed to obey the e/a = 2.30, 2.10–2.15 and 1.70–1.80 rules, respectively.

36 MATERIALS SCIENCE↗

Measurement of forward-backward multiplicity correlations in lead-lead, proton-lead, and proton-proton collisions with the ATLAS detector

Two-particle pseudorapidity correlations are measured in √ s NN = 2.76TeV Pb + Pb, √ s NN = 5.02TeV p + Pb, and √s = 13 TeV pp collisions at the Large Hadron Collider (LHC), with total integrated luminosities of approximately 7μb –1 , 28 nb –1 , and 65 nb –1 , respectively. The correlation function C N (η 1 ,η 2 ) is measured as a function of event multiplicity using charged particles in the pseudorapidity range |η| < 2.4. The correlation function contains a significant short-range component, which is estimated and subtracted. After removal of the short-range component, the shape of the correlation function is described approximately by 1 + < a2 1 > 1/2 η 1 η 2 in all collision systems over the full multiplicity range. The values of < a 2 1 > 1/2 are consistent for the opposite-charge pairs and same-charge pairs, and for the three collision systems at similar multiplicity. The values of < a 2 1 > 1/2 and the magnitude of the short-range component both follow a power-law dependence on the event multiplicity. Here, the short-range component in p + Pb collisions, after symmetrizing the proton and lead directions, is found to be smaller at a given η than in pp collisions with comparable multiplicity.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Composition and work function relationship in Os–Ru–W ternary alloys

Os–Ru thin films with varying concentrations of W were sputter deposited in order to investigate their structure–property relationships. The films were analyzed with x-ray diffraction to investigate their crystal structures, and a Kelvin probe to investigate their work functions. An Os–Ru–W film with ∼30 at. % W yielded a work function maximum of approximately 5.38 eV. These results align well with other studies that found work function minima from thermionic emission data on M-type cathodes with varying amounts of W in the coatings. Furthermore, the results are consistent with other work explaining energy-level alignment and charge transfer of molecules on metal oxides. This may shed light on the mechanism behind the “anomalous effect” first reported by Zalm et al., whereby a high work function coating results in a low work function for emitting cathode surfaces. An important implication of this work is the potential for the Kelvin probe to evaluate the effectiveness of dispenser cathode coatings.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A Measure Approximation for Distributionally Robust PDE-Constrained Optimization Problems

In numerous applications, scientists and engineers acquire varied forms of data that partially characterize the inputs to an underlying physical system. This data is then used to inform decisions such as controls and designs. Consequently, it is critical that the resulting control or design is robust to the inherent uncertainties associated with the unknown probabilistic characterization of the model inputs. Here in this work, we consider optimal control and design problems constrained by partial differential equations with uncertain inputs. We do not assume a known probabilistic model for the inputs, but rather we formulate the problem as a distributionally robust optimization problem where the outer minimization problem determines the control or design, while the inner maximization problem determines the worst-case probability measure that matches desired characteristics of the data. We analyze the inner maximization problem in the space of measures and introduce a novel measure approximation technique, based on the approximation of continuous functions, to discretize the unknown probability measure. Finally, we prove consistency of our approximated min-max problem and conclude with numerical results.

54 ENVIRONMENTAL SCIENCES↗

Smoothness of Functions in Spaces of the Finite Element Method

We find necessary and sufficient conditions for the generalized smoothness of the coordinate functions obtained from the approximate relations. We show that for the coordinate functions the smoothness on their supports is equivalent to that on the boundaries of supports. We obtain conditions for the continuity of Courant type finite element approximations and conditions for the uniqueness of a linear space of such approximations.

97 MATHEMATICS AND COMPUTING↗

Full-F gyrofluid model

A global electromagnetic gyrofluid model based on the full-F gyrokinetic model is derived. The gyrofluid moment variables are not split into fluctuating and equilibrium parts. Profiles are evolved freely, and gyro-averaging operators are not parametrized, but are functions of the gyrofluid moment variables. The fluid moment hierarchy is closed by approximating the gyrokinetic distribution function as a finite order Hermite-Laguerre polynomial and by determining closure approximations for terms involving the gyrokinetic gyro-averaging operator. The model exactly conserves the gyrokinetic full-F energy invariant evaluated using the Hermite-Laguerre decomposition. The model is suited for qualitative studies of the interplay between turbulence, flows, and dynamically evolving profiles in magnetically confined plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Homogenizing atomic dynamics by fractional differential equations

In this paper, we propose two ways to construct fractional differential equations (FDE) for approximating atomic chain dynamics. Taking harmonic chain as an example, we add a power function of fractional order to Taylor expansion of the dispersion relation, and determine the parameters by matching two selected wave numbers. This approximate function leads to an FDE after considering both directions for wave propagation. As an alternative, we consider the symbol of the force term, and approximate it by a similar function. It also induces an FDE. Both approaches produce excellent agreement with the harmonic chain dynamics. The accuracy may be improved by optimizing the selected wave numbers, or starting with higher order Taylor expansions. When resolved in the lattice constant, the resulting FDE's faithfully reproduce the lattice dynamics. When resolved in a coarse grid instead, they systematically generate homogenized algorithms. Numerical tests are performed to verify the proposed approaches. Moreover, FDE's are also constructed for diatomic chain and anharmonic lattice, to illustrate the generality of the proposed approaches. - Highlights: • Match the dispersion relation of linear chain by power function of fractional order, added on low order Taylor expansion. • Design FDE by approximating dispersion relation, or the symbol for the force term. • Solve the FDE by algorithm of spectral accuracy. • Obtain faithful and systematical homogenization when resolved at coarser grid. • Applies to general lattices: complex, nonlinear and multidimensional.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Cycloidal Shaping of Polyhedra in Two-Rotor Systems

A method of solution is proposed for the model of the cycloid shaping of polyhedra. The method is based on reducing the equations to algebraic form by polynomial approximation of transcendental functions.

42 ENGINEERING↗

Embedded random phase approximation for magnetic systems: H 2 dissociative adsorption on Fe(110)

The random phase approximation (RPA), a method for treating electron correlation, has been shown to be superior to standard density functional theory (DFT) approximations in numerous cases. However, the RPA’s computational cost is substantially higher than that of DFT, particularly restricting its application to extended surfaces. The recently introduced embedded RPA (emb-RPA) approach [Wei et al., J. Chem. Phys. 159(19), 194108 (2023)] reduces this computational cost by approximately two orders of magnitude. While previous applications of emb-RPA focused on non-spin-polarized systems, here we extend the approach to ferromagnetic ones. Unlike other embedded correlated wavefunction methods, such as embedded complete active space self-consistent field theory, emb-RPA is advantageous for spin-polarized systems because the RPA is compatible with unrestricted DFT solutions, which are eigenfunctions of the spin angular momentum operator S z but not the total spin-squared operator S 2 . By applying emb-RPA with specific magnetization constraints, we achieved a speedup of two to three orders of magnitude (one order when accounting for the one-time embedding potential optimization cost) with only small errors (∼50 meV) compared to full periodic RPA. Moreover, emb-RPA significantly reduces the over-binding errors of DFT approximations. In conclusion, we anticipate that the acceleration enabled by the spin-polarized emb-RPA approach will broaden the applicability of RPA to magnetic materials.

Density functional theory↗

Aqueous solvation of the chloride ion revisited with density functional theory: impact of correlation and exchange approximations

The specificity of aqueous halide solvation is fundamental to a wide range of bulk and interfacial phenomena spanning from biology to materials science. Halide polarizability is thought to drive the ion specificity, and if so, it is essential to have an accurate description of the electronic properties of halide ions in water. To this end, the solvation of the chloride anion, Cl - has been reinvestigated with state-of-the-art density functional theory. Specifically, the PBE-D3, PBE0-D3, and SCAN functionals have been employed to probe the impact of correlation and exchange approximations. Anticipating the findings, adding exact exchange improves the electronic structure, but simultaneously significantly reduces the Cl - polarizability, resulting in an over-structured Cl–O radial distribution function (RDF) and longer water H-bond lifetimes to Cl - . SCAN does not yield as much improvement in the energetics of Cl - relative to bulk water, but does result in a smaller reduction of the polarizability and thus a less structured Cl–O RDF, which agrees better with experiment. Special consideration is therefore warranted in assessing the impact of exchange on the energy, charge density, and the charge density response when designing and testing hybrid functionals for aqueous halide solvation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Neural Scaling Laws of Deep ReLU and Deep Operator Network: A Theoretical Study

Neural scaling laws play a pivotal role in the performance of deep neural networks and have been observed in a wide range of tasks. However, a complete theoretical framework for understanding these scaling laws remains underdeveloped. In this paper, we explore the neural scaling laws for deep operator networks, which involve learning mappings between function spaces, with a focus on the Chen and Chen style architecture. These approaches, which include the popular Deep Operator Network (DeepONet), approximate the output functions using a linear combination of learnable basis functions and coefficients that depend on the input functions. We establish a theoretical framework to quantify the neural scaling laws by analyzing its approximation and generalization errors. We articulate the relationship between the approximation and generalization errors of deep operator networks and key factors such as network model size and training data size. Moreover, we address cases where input functions exhibit low-dimensional structures, allowing us to derive tighter error bounds. These results also hold for deep ReLU networks and other similar structures. Our results offer a partial explanation of the neural scaling laws in operator learning and provide a theoretical foundation for their applications.

97 MATHEMATICS AND COMPUTING↗

Exchange-correlation energy from pairing matrix fluctuation and the particle-particle random phase approximation

Despite their unmatched success for many applications, commonly used local, semi-local, and hybrid density functionals still face challenges when it comes to describing long-range interactions, static correlation, and electron delocalization. Density functionals of both the occupied and virtual orbitals are able to address these problems. The particle-hole (ph-) Random Phase Approximation (RPA), a functional of occupied and virtual orbitals, has recently known a revival within the density functional theory community. Following up on an idea introduced in our recent communication [H. van Aggelen, Y. Yang, and W. Yang, Phys. Rev. A 88, 030501 (2013)], we formulate more general adiabatic connections for the correlation energy in terms of pairing matrix fluctuations described by the particle-particle (pp-) propagator. With numerical examples of the pp-RPA, the lowest-order approximation to the pp-propagator, we illustrate the potential of density functional approximations based on pairing matrix fluctuations. The pp-RPA is size-extensive, self-interaction free, fully anti-symmetric, describes the strong static correlation limit in H{sub 2}, and eliminates delocalization errors in H{sub 2}{sup +} and other single-bond systems. It gives surprisingly good non-bonded interaction energies – competitive with the ph-RPA – with the correct R{sup −6} asymptotic decay as a function of the separation R, which we argue is mainly attributable to its correct second-order energy term. While the pp-RPA tends to underestimate absolute correlation energies, it gives good relative energies: much better atomization energies than the ph-RPA, as it has no tendency to underbind, and reaction energies of similar quality. The adiabatic connection in terms of pairing matrix fluctuation paves the way for promising new density functional approximations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An efficient method to estimate the probability density of seismic Green's functions

We present a computationally efficient method to approximate the probability distribution of seismic Green's functions given the uncertainty of an Earth model. The method is based on the Karhunen-Loève (KL) theorem and an approximation of the Green's function (or seismogram) covariance. Using Monte Carlo (MC) simulations as a control case, we demonstrate that our KL-based method can accurately reproduce a probability distribution of seismograms that results from an uncertain Earth model for a MC-derived seismogram covariance. We then describe a method to estimate the covariance of the seismograms resulting from those Earth models that is not based on MC simulations. We use the estimated Green's function covariance in conjunction with our KL-based method to produce a Green's function probability distribution, and compare that distribution to a Green's function probability distribution produced using a MC finite difference method. We find that the Green's function probability distribution approximated using our KL-based method generally mimics that produced using the MC simulations, especially for direct-arriving body waves. However the accuracy of the KL-based method generally decreases for later times in the simulated Green's function distribution.

58 GEOSCIENCES↗

Paramagnetic Cu{sup II} complexes with 1-(hetarylmethyl)silatranes

The structures of paramagnetic complexes CuCl{sub 2}•L with L = HetCH{sub 2}Si(OCH{sub 2}CH{sub 2}){sub 3}N [Het = pyrrol-1-yl (1), indol-1-yl (2), carbazol-9-yl (3), imidazole-1-yl (4), 3,5-dimethylpyrazol-1-yl (5), 1,2,4-triazol-1-yl (6), benzimidazol-1-yl (7), and 1,2,3-benzotriazol-1-yl (8)] were studied by the ESR and quantum chemical methods in terms of the density functional theory (DFT) approximation. The difference in structures of complexes CuCl{sub 2}•1—CuCl{sub 2}•8 is mainly determined by the nature of the five-membered heterocycle. The ESR spectra at room temperature are typical of the mononuclear complexes of Cu{sup II} of axial symmetry with various types of distortions. In complexes CuCl{sub 2}•1—CuCl{sub 2}•3, narrow symmetric signals of zero-valent copper are recorded. These signals remain in the spectra for at least six months, which can characterize them as efficient stabilizing matrices of nanoparticles.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Triangular Alignment (TAME). A Tensor-based Approach for Higher-order Network Alignment

Network alignment is an important tool with extensive applications in comparative interactomics. Traditional approaches aim to simultaneously maximize the number of conserved edges and the underlying similarity of aligned entities. We propose a novel formulation of the network alignment problem that extends topological similarity to higher-order structures and provide a new objective function that maximizes the number of aligned substructures. This objective function corresponds to an integer programming problem, which is NP-hard. Consequently, we approximate this objective function as a surrogate function whose maximization results in a tensor eigenvalue problem. Based on this formulation, we present an algorithm called Triangular AlignMEnt (TAME), which attempts to maximize the number of aligned triangles across networks. We focus on alignment of triangles because of their enrichment in complex networks; however, our formulation and resulting algorithms can be applied to general motifs. Using a case study on the NAPABench dataset, we show that TAME is capable of producing alignments with up to 99% accuracy in terms of aligned nodes. We further evaluate our method by aligning yeast and human interactomes. Our results indicate that TAME outperforms the state-of-art alignment methods both in terms of biological and topological quality of the alignments.

42 ENGINEERING↗

Model-Free Primal-Dual Methods for Network Optimization with Application to Real-Time Optimal Power Flow: Preprint

This paper examines the problem of real-time optimization of networked systems and develops online algorithms that steer the system towards the optimal trajectory without explicit knowledge of the system model. The problem is modeled as a dynamic optimization problem with time-varying performance objectives and engineering constraints. The design of the algorithms leverages the online zero-order primal-dual projected-gradient method. In particular, the primal step that involves the gradient of the objective function (and hence requires networked systems model) is replaced by its zero-order approximation with two function evaluations using a deterministic perturbation signal. The evaluations are performed using the measurements of the system output, hence giving rise to a feedback interconnection, with the optimization algorithm serving as a feedback controller. The paper provides some insights on the stability and tracking properties of this interconnection. Finally, the paper applies this methodology to a real-time optimal power flow problem in power systems, and shows its efficacy on the IEEE 37-node distribution test feeder for reference power tracking and voltage regulation.

61 RADIATION PROTECTION AND DOSIMETRY↗

An Assessment of Density Functional Methods for Potential Energy Curves of Nonbonded Interactions: The XYG3 and B97-D Approximations

A recently proposed double-hybrid functional called XYG3 and a semilocal GGA functional (B97-D) with a semiempirical correction for van der Waals interactions have been applied to study the potential energy curves along the dissociation coordinates of weakly bound pairs of molecules governed by London dispersion and induced dipole forces. Molecules treated in this work were the parallel sandwich, T-shaped, and parallel-displaced benzene dimer, (C6H6)2; hydrogen sulfide and benzene, H2S C6H6; methane and benzene, CH4 C6H6; the methane dimer, (CH4)2; and the pyridine dimer, (C5H5N)2. We compared the potential energy curves of these functionals with previously published benchmarks at the coupled cluster singles, doubles, and perturbative triplets [CCSD(T)] complete-basis-set limit. Both functionals, XYG3 and B97-D, exhibited very good performance, reproducing accurate energies for equilibrium distances and a smooth behavior along the dissociation coordinate. Overall, we found an agreement within a few tenths of one kcal mol-1 with the CCSD(T) results across the potential energy curves.

03 NATURAL GAS↗