Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Functional approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

Light-Front Holographic QCD

The relation between the hadronic short-distance constituent quark and gluon particle limit and the long-range confining domain is yet one of the most challenging aspects of particle physics due to the strong coupling nature of Quantum Chromodynamics, the fundamental theory of the strong interactions. The central question is how one can compute hadronic properties from first principles; i.e., directly from the QCD Lagrangian. The most successful theoretical approach thus far has been to quantize QCD on discrete lattices in Euclidean space-time. Lattice numerical results follow from computation of frame-dependent moments of distributions in Euclidean space and dynamical observables in Minkowski spacetime, such as the time-like hadronic form factors, are not amenable to Euclidean lattice computations. The Dyson-Schwinger methods have led to many important insights, such as the infrared fixed point behavior of the strong coupling constant, but in practice, the analyses are limited to ladder approximation in Landau gauge. Baryon spectroscopy and the excitation dynamics of nucleon resonances encoded in the nucleon transition form factors can provide fundamental insight into the strong-coupling dynamics of QCD. New theoretical tools are thus of primary interest for the interpretation of the results expected at the new mass scale and kinematic regions accessible to the JLab 12 GeV Upgrade Project. The AdS/CFT correspondence between gravity or string theory on a higher-dimensional anti-de Sitter (AdS) space and conformal field theories in physical space-time has led to a semiclassical approximation for strongly-coupled QCD, which provides physical insights into its nonperturbative dynamics. The correspondence is holographic in the sense that it determines a duality between theories in different number of space-time dimensions. This geometric approach leads in fact to a simple analytical and phenomenologically compelling nonperturbative approximation to the full light-front QCD Hamiltonian 'Light-Front Holography'. Light-Front Holography is in fact one of the most remarkable features of the AdS/CFT correspondence. The Hamiltonian equation of motion in the light-front (LF) is frame independent and has a structure similar to eigenmode equations in AdS space. This makes a direct connection of QCD with AdS/CFT methods possible. Remarkably, the AdS equations correspond to the kinetic energy terms of the partons inside a hadron, whereas the interaction terms build confinement and correspond to the truncation of AdS space in an effective dual gravity approximation. One can also study the gauge/gravity duality starting from the bound-state structure of hadrons in QCD quantized in the light-front. The LF Lorentz-invariant Hamiltonian equation for the relativistic bound-state system is P{sub {mu}}P{sup {mu}}|{psi}(P)> = (P{sup +}P{sup -} - P{sub {perpendicular}}{sup 2})|{psi}(P)> = M{sup 2}|{psi}(P)>, P{sup {+-}} = P{sup 0} {+-} P{sup 3}, where the LF time evolution operator P{sup -} is determined canonically from the QCD Lagrangian. To a first semiclassical approximation, where quantum loops and quark masses are not included, this leads to a LF Hamiltonian equation which describes the bound-state dynamics of light hadrons in terms of an invariant impact variable {zeta} which measures the separation of the partons within the hadron at equal light-front time {tau} = x{sup 0} + x{sup 3}. This allows us to identify the holographic variable z in AdS space with an impact variable {zeta}. The resulting Lorentz-invariant Schroedinger equation for general spin incorporates color confinement and is systematically improvable. Light-front holographic methods were originally introduced by matching the electromagnetic current matrix elements in AdS space with the corresponding expression using LF theory in physical space time. It was also shown that one obtains identical holographic mapping using the matrix elements of the energy-momentum tensor by perturbing the AdS metric around its static solution. A gravity dual to QCD is not known, but the mechanisms of confinement can be incorporated in the gauge/gravity correspondence by modifying the AdS geometry in the large infrared (IR) domain z {approx} 1 = {Lambda}{sub QCD}, which also sets the scale of the strong interactions. In this simplified approach we consider the propagation of hadronic modes in a fixed effective gravitational background asymptotic to AdS space, which encodes salient properties of the QCD dual theory, such as the ultraviolet (UV) conformal limit at the AdS boundary, as well as modifications of the background geometry in the large z IR region to describe confinement. The modified theory generates the point-like hard behavior expected from QCD, instead of the soft behavior characteristic of extended objects.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Polarization transfer measurements for {sup 12}C(p-vector,n-vector){sup 12}N(g.s.,1{sup +}) at 296 MeV and nuclear correlation effects

Differential cross sections and complete sets of polarization observables are presented for the Gamow-Teller {sup 12}C(p-vector,n-vector){sup 12}N(g.s.,1{sup +}) reaction at a bombarding energy of 296 MeV with momentum transfers q of 0.1 to 2.2 fm{sup -1}. The polarization transfer observables are used to deduce the spin-longitudinal cross section, ID{sub q}, and spin-transverse cross sections, ID{sub p} and ID{sub n}. The data are compared with calculations based on the distorted-wave impulse approximation (DWIA) using shell-model wave functions. Significant differences between the experimental and theoretical results are observed for all three spin-dependent ID{sub i} at momentum transfers of q > or approx. 0.5 fm{sup -1}, suggesting the existence of nuclear correlations beyond the shell model. We also performed DWIA calculations employing random-phase approximation (RPA) response functions and found that the observed discrepancy is partly resolved by the pionic and {rho}-mesonic correlation effects.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Band gaps in InN/GaN superlattices: Nonpolar and polar growth directions

The electronic structures of nonpolar short-period InN/GaN superlattices (SLs) grown in the wurtzite a- and m-directions have been calculated and compared to previous calculations for polar superlattices (grown in the c-direction). The variation of the band gaps with the composition (m, n) of the mInN/nGaN unit cells of the superlattices was examined. The band structures were obtained by self-consistent calculations based on the local density approximation to the density functional theory using the Linear-Muffin-Tin-Orbital method with a semi-empirical correction for the band gaps. The calculated band gaps and their pressure coefficients for nonpolar superlattices are similar to those calculated for bulk InGaN alloys with an equivalent In/Ga concentration ratio. This is very different from what has been found in polar superlattices where the band gaps are much smaller and vanish when the number m of InN layers in the unit cell exceeds three. A strong internal electric field is responsible for this behavior of polar structures. Experimental photoluminescence data for polar SLs agree very well with gaps calculated for the nonpolar structures. It is suggested that this is caused by screening of the electric field in the polar structures by carriers originating from unintentional defects.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Spin and orbital magnetism of coinage metal trimers (Cu{sub 3}, Ag{sub 3}, Au{sub 3}): A relativistic density functional theory study

We have demonstrated electronic structure and magnetic properties of Cu{sub 3}, Ag{sub 3} and Au{sub 3} trimers using a full potential local orbital method in the framework of relativistic density functional theory. We have also shown that the non-relativistic generalized gradient approximation for the exchange-correlation energy functional gives reliable magnetic properties in coinage metal trimers compared to experiment. In addition we have indicated that the spin-orbit coupling changes the structure and magnetic properties of gold trimer while the structure and magnetic properties of copper and silver trimers are marginally affected. A significant orbital moment of 0.21μ{sub B} was found for most stable geometry of the gold trimer whereas orbital magnetism is almost quenched in the copper and silver trimers.

36 MATERIALS SCIENCE↗

Unveiling the Role of Surface Ir-Oxo Species in O 2 Evolution at IrO 2 Electrocatalysts via Embedded Cluster Multireference Calculations

Understanding the mechanisms driving the oxygen evolution reaction (OER) on iridium oxide (IrO 2 )-based catalysts is essential to improving their performance and enabling an actual scale-up of water-splitting photoelectrochemical cells. The mechanistic pathways at IrO 2 interfaces have been extensively investigated computationally using density functional theory (DFT), which predicts a high-energy barrier for the last step of the OER of molecular oxygen detachment and release from the catalyst surface. Nevertheless, surface O 2 over- and under-binding results by standard generalized gradient approximation and hybrid density functionals, respectively, call for further analysis of this crucial step via multireference methods. Aiming at unveiling the nature of such a barrier, we hereby address the formation of O 2 from the most-stable IrO 2 (110) surface with both periodic DFT and an electrostatic embedded cluster approach at the n-electron valence-state perturbation theory. With this multireference approach, we find a value for the aforementioned energy barrier that is much closer to experimental indications than DFT ones. Here, an in-depth analysis of the involved molecular orbitals suggests that the origin of this barrier is related to the breaking of a π interaction between O 2 and Ir surface atom and to a significant additional O 2 interaction with adjacent electrophilic Ir-oxo species, which is present under experimental operating conditions. Besides shedding light on the mechanism of the OER on IrO 2 , these findings point out the importance of multireference methods for dissecting complex reactions at electrocatalytic interfaces and pave the route for further investigations with effective embedding approaches.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dark-matter harmonics beyond annual modulation

The count rate at dark-matter direct-detection experiments should modulate annually due to the motion of the Earth around the Sun. We show that higher-frequency modulations, including daily modulation, are also present and in some cases are nearly as strong as the annual modulation. These higher-order modes are particularly relevant if (i) the dark matter is light, O(10) GeV, (ii) the scattering is inelastic, or (iii) velocity substructure is present; for these cases, the higher-frequency modes are potentially observable at current and ton-scale detectors. We derive simple expressions for the harmonic modes as functions of the astrophysical and geophysical parameters describing the Earth's orbit, using an updated expression for the Earth's velocity that corrects a common error in the literature. For an isotropic halo velocity distribution, certain ratios of the modes are approximately constant as a function of nuclear recoil energy. Anisotropic distributions can also leave observable features in the harmonic spectrum. Consequently, the higher-order harmonic modes are a powerful tool for identifying a potential signal from interactions with the Galactic dark-matter halo.

79 ASTRONOMY AND ASTROPHYSICS↗

Avoidance of a Landau pole by flat contributions in QED

We consider massless Quantum Electrodynamics in the momentum scheme and carry forward an approach based on Dyson–Schwinger equations to approximate both the β-function and the renormalized photon self-energy (Yeats, 2011). Starting from the Callan–Symanzik equation, we derive a renormalization group (RG) recursion identity which implies a non-linear ODE for the anomalous dimension and extract a sufficient but not necessary criterion for the existence of a Landau pole. This criterion implies a necessary condition for QED to have no such pole. Solving the differential equation exactly for a toy model case, we integrate the corresponding RG equation for the running coupling and find that even though the β-function entails a Landau pole it exhibits a flat contribution capable of decreasing its growth, in other cases possibly to the extent that such a pole is avoided altogether. Finally, by applying the recursion identity, we compute the photon propagator and investigate the effect of flat contributions on both spacelike and timelike photons. -- Highlights: •We present an approach to approximate both the β-function and the photon self-energy. •We find a sufficient criterion for the self-energy to entail the existence of a Landau pole. •We study non-perturbative ‘flat’ contributions that emerge within the context of our approach. •We discuss a toy model and how it is affected by flat contributions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Data-driven predictive probability density function control of fiber length stochastic distribution shaping in refining process

Pulp is the most important raw material in paper in paper industries, whose Fiber Length Stochastic Distribution (FLSD) shaping directly determines the energy consumption and paper quality of the subsequent papermaking processes. However, the mean and variance are insufficient to describe the output FLSD shaping, which display non-Gaussian distribution properties. Therefore, the traditional control, method based on the mean and variance of fiber length is difficult to control the FLSD shaping effectively. In this paper, a novel data-driven predictive probability density function (PDF) control method is proposed for output FLSD shaping in refining process. Primarily, in order to improve the approximation accuracy of the PDF employing RBF neural network, the parameters (center value and width) of each RBF basis functions are tuned via utilizing iterative learning control (ILC) law, and the corresponding estimations of weights law can be obtained. Secondly, considering that the conventional linear model of weights vector has drawbacks of low accuracy and weak generalization ability, random vector functional link networks (RVFLNs) based data driven nonlinear modelling method is employed to characterize the prediction model between the input variables and weights vector. Finally, in order to reduce the randomness of the output FLSD, a minimum entropy control method under mean constraint is employed to design the predictive PDF controller for the output FLSD shaping with the help of the established nonlinear stochastic distribution model. Both simulations and experiments are given to illustrate the effectiveness and practicability of the proposed method.

Probability debsity function, Fiber length distrib↗

Investigation of Ethane Dehydrogenation and Hydrogenolysis on Pt(111), Pt(211), and Pt(100): Bayesian Quantification and Correction of DFT-Based Enthalpic and Entropic Uncertainties

Computational investigations of heterogeneously catalyzed reactions using density functional theory (DFT) are often inaccurate, largely due to uncertainties in the choice of DFT functional (enthalpic uncertainty) and approximations for modeling adsorbate movement along the catalyst surface (entropic uncertainty). This work illustrates that both uncertainties are significant in the investigation of ethane dehydrogenation (EDH) and hydrogenolysis on Pt catalysts by considering the complete deconstruction of ethane on Pt(111), Pt(211), and Pt(100) using microkinetic modeling (MKM). Hence, this work uses both noncalibrated and Bayesian-calibrated MKMs to quantify and correct inaccuracies in macroscopic properties due to both uncertainties. A Bayesian approach to the correction of entropic errors was introduced using a “Modified Fermi Function (MFF)” to calibrate between the two bounds of entropy represented by the harmonic oscillator (HO) and free translator (FT) approximations. Regardless of enthalpic and entropic uncertainties, all three surfaces are capable of ethane activation; however, Pt(211) was found to be the most active and is largely responsible for methane production. Next, Pt(111) is largely responsible for acetylene production, and Pt(100) has the highest ethylene selectivity but is most susceptible to coking. By comparison of different calibrated models, the FT entropy approximation was found to better describe EDH under typical experimental conditions. Statistical evidence was found to support Pt(111) as the active site for EDH, assuming that one single site is responsible for the chemistry. On the three surfaces, competing second dehydrogenations to CH 2 CH 2 and CH 3 CH were observed as well as isomerization of CH 3 CH back to CH 2 CH 2 and deeper dehydrogenation of CH 3 CH. In conclusion, C–C cleavage was found to largely proceed via the CH 3 C intermediate on Pt(100) and Pt(111), while on Pt(211), it was via both CHC and CH 3 C.

Bayesian model selection↗

Electron-vibron coupling in halogenated acenaphthenequinone upon O K-edge soft x-ray absorption

We present high resolution oxygen K near-edge x-ray absorption spectra of the acenaphthenequinone (ANQ) derivative 3,8-dibromo-5,6-dichloro-ANQ (Br{sub 2}Cl{sub 2}-ANQ). The spectral features exhibit an almost identical vibronic fine structure compared to that shown by ANQ. The unequal distances of the vibronic levels as derived from the least-squares fit analysis of the vibronic progressions allows us to determine the anharmonicity of the excited state potentials involved. We conclude that a single vibrational progression couples to the resonant excitation of O 1s core electrons preferentially. Comparison of the two ANQ derivatives gives a clear indication that the vibronic mode corresponds to a C=O stretching mode, rather than coupling to a C-H mode as suggested previously. These conclusions are supported by density functional theory calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Link between optical spectra, crystal-field parameters, and local environments of Eu{sup 3+} ions in Eu{sub 2}O{sub 3}-doped sodium disilicate glass

Rare-earth-doped glasses are key materials for optical technology due to the luminescent properties of 4f{sup n} ions. The crystal-field model describes the effect of local environment on transitions between 4f electrons. We present a detailed modeling study of the optical spectra of sodium disilicate glass, 33Na{sub 2}O{center_dot}67SiO{sub 2}, doped with 0.2% and 1.0 mol%Eu{sub 2}O{sub 3}. This study uses very large molecular dynamics models with up to 100 Eu{sup 3+} ions, the superposition model for covalent and overlap effects on crystal-field parameters, and realistic values for homogeneous linewidth broadening. The simulated spectra are in reasonable agreement with experiment. The trends in {sup 7} F{sub J} energy levels across different Eu{sup 3+} ion sites have been examined and a very detailed analysis is presented that looks at how features of the spectra are related to features of the local environment of Eu{sup 3+} ions. Increasing the crystal-field strength S{sub total} causes the {sup 7} F{sub 0} energy level to decrease and causes the splitting of {sup 7} F{sub J} manifolds to increase, and this is due to increasing mixing of 4f wave functions. To a reasonable approximation the crystal-field strength components S{sub k} depend on angular positions of ligands independently of distances to ligands. The former are seen to be more significant in determining S{sub k}, which are closely related to the rotationally invariant bond-orientational order parameters Q{sub k}. The values of S{sub 2} are approximately linear in Q{sub 2}, and the values of Q{sub 2} are higher for fivefold than sixfold coordinated rare-earth ions. These results can be of importance for efforts to enhance the local environment of rare-earth ions in oxide glasses for optical applications.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Parallel Higher-order Finite Element Method for Accurate Field Computations in Wakefield and PIC Simulations

Over the past years, SLAC's Advanced Computations Department (ACD), under SciDAC sponsorship, has developed a suite of 3D (2D) parallel higher-order finite element (FE) codes, T3P (T2P) and Pic3P (Pic2P), aimed at accurate, large-scale simulation of wakefields and particle-field interactions in radio-frequency (RF) cavities of complex shape. The codes are built on the FE infrastructure that supports SLAC's frequency domain codes, Omega3P and S3P, to utilize conformal tetrahedral (triangular)meshes, higher-order basis functions and quadratic geometry approximation. For time integration, they adopt an unconditionally stable implicit scheme. Pic3P (Pic2P) extends T3P (T2P) to treat charged-particle dynamics self-consistently using the PIC (particle-in-cell) approach, the first such implementation on a conformal, unstructured grid using Whitney basis functions. Examples from applications to the International Linear Collider (ILC), Positron Electron Project-II (PEP-II), Linac Coherent Light Source (LCLS) and other accelerators will be presented to compare the accuracy and computational efficiency of these codes versus their counterparts using structured grids.

43 PARTICLE ACCELERATORS↗

Benchmark calculations on the lowest-energy singlet, triplet, and quintet states of the four-electron harmonium atom

For a wide range of confinement strengths ω, explicitly-correlated calculations afford approximate energies E(ω) of the ground and low-lying excited states of the four-electron harmonium atom that are within few μhartree of the exact values, the errors in the respective energy components being only slightly higher. This level of accuracy constitutes an improvement of several orders of magnitude over the previously published data, establishing a set of benchmarks for stringent calibration and testing of approximate electronic structure methods. Its usefulness is further enhanced by the construction of differentiable approximants that allow for accurate computation of E(ω) and its components for arbitrary values of ω. The diversity of the electronic states in question, which involve both single- and multideterminantal first-order wavefunctions, and the availability of the relevant natural spinorbitals and their occupation numbers make the present results particularly useful in research on approximate density-matrix functionals. The four-electron harmonium atom is found to possess the {sup 3}P{sub +} triplet ground state at strong confinements and the {sup 5}S{sub −} quintet ground state at the weak ones, the energy crossing occurring at ω ≈ 0.0240919.

74 ATOMIC AND MOLECULAR PHYSICS↗

Synthesis, magnetism and electronic structure of YbNi{sub 2-x}Fe{sub x}Al{sub 8} (x=0.91) isolated from Al flux

The combination of ytterbium, nickel, iron in liquid aluminum resulted in the formation of the new intermetallic compound YbNi{sub 2-x}Fe{sub x}Al{sub 8} (x=0.91) which adopts the CaCo{sub 2}Al{sub 8} structure type with a=14.458(3) A, b=12.455(3) A, c=3.9818(8) A and space group Pbam. Its resistivity drops with decreasing temperature, saturating to a constant value at lower temperatures. Above 50 K, the inverse magnetic susceptibility data follows Curie-Weiss Law, with a calculated {mu}{sub eff}=2.19 {mu}{sub B}. Although the observed reduced moment in magnetic susceptibility measurement suggests that the Yb ions in this compound are of mixed-valent nature, ab initio electronic structure calculations within density functional theory using LDA+U approximation give an f{sup 13} configuration in the ground state. - Graphical abstract: The reaction of ytterbium, nickel, iron in aluminum flux gives crystals of the intermetallic compound YbNi{sub 2-x}Fe{sub x}Al{sub 8} (x=0.96) which adopts the CaCo{sub 2}Al{sub 8} structure, ab initio electronic structure calculations within density functional theory using LDA+U approximation suggest an f{sup 13} configuration in the ground state.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Time-dependent occupation numbers in reduced-density-matrix-functional theory: Application to an interacting Landau-Zener model

We prove that if the two-body terms in the equation of motion for the one-body reduced density matrix are approximated by ground-state functionals, the eigenvalues of the one-body reduced density matrix (occupation numbers) remain constant in time. This deficiency is related to the inability of such an approximation to account for relative phases in the two-body reduced density matrix. We derive an exact differential equation giving the functional dependence of these phases in an interacting Landau-Zener model and study their behavior in short- and long-time regimes. The phases undergo resonances whenever the occupation numbers approach the boundaries of the interval [0,1]. In the long-time regime, the occupation numbers display correlation-induced oscillations and the memory dependence of the functionals assumes a simple form.

74 ATOMIC AND MOLECULAR PHYSICS↗

Comparing first-principles density functionals plus corrections for the lattice dynamics of YBa 2 Cu 3 O 6

The enigmatic mechanism underlying unconventional high-temperature superconductivity, especially the role of lattice dynamics, has remained a subject of debate. Theoretical insights have long been hindered due to the lack of an accurate first-principles description of the lattice dynamics of cuprates. Recently, using the r2SCAN meta-generalized gradient approximation (meta-GGA) functional, we have been able to achieve accurate phonon spectra of an insulating cuprate YBa 2 Cu 3 O 6 and discover significant magnetoelastic coupling in experimentally interesting Cu–O bond stretching optical modes [Ning et al., Phys. Rev. B 107, 045126 (2023)]. We extend this work by comparing Perdew–Burke–Ernzerhof and r2SCAN performances with corrections from the on-site Hubbard U and the D4 van der Waals (vdW) methods, aiming at further understanding on both the materials science side and the density functional side. We demonstrate the importance of vdW and self-interaction corrections for accurate first-principles YBa 2 Cu 3 O 6 lattice dynamics. Since r2SCAN by itself partially accounts for these effects, the good performance of r2SCAN is now more fully explained. Finally, in addition, the performances of the Tao–Mo series of meta-GGAs, which are constructed in a different way from the strongly constrained and appropriately normed (SCAN) meta-GGA and its revised version r2SCAN, are also compared and discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Spin currents of charged Dirac particles in rotating coordinates

The semiclassical Boltzmann transport equation of charged, massive fermions in a rotating frame of reference, in the presence of external electromagnetic fields is solved in the relaxation time approach to establish the distribution function up to linear order in the electric field in rotating coordinates, centrifugal force and the derivatives. The spin and spin current densities are calculated by means of this distribution function at zero temperature up to the first order. It is shown that the nonequilibrium part of the distribution function yields the spin Hall effect for fermions constrained to move in a plane perpendicular to the angular velocity and magnetic field. Moreover it yields an analogue of Ohm’s law for spin currents whose resistivity depends on the external magnetic field and the angular velocity of the rotating frame. Spin current densities in three-dimensional systems are also established.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection

Deep neural networks (DNNs) have achieved state-of-the-art performance across a variety of traditional machine learning tasks, e.g., speech recognition, image classification, and segmentation. The ability of DNNs to efficiently approximate high-dimensional functions has also motivated their use in scientific applications, e.g., to solve partial differential equations and to generate surrogate models. In this paper, we consider the supervised training of DNNs, which arises in many of the above applications. We focus on the central problem of optimizing the weights of the given DNN such that it accurately approximates the relation between observed input and target data. Devising effective solvers for this optimization problem is notoriously challenging due to the large number of weights, nonconvexity, data sparsity, and nontrivial choice of hyperparameters. To solve the optimization problem more efficiently, we propose the use of variable projection (VarPro), a method originally designed for separable nonlinear least-squares problems. Our main contribution is the Gauss--Newton VarPro method (GNvpro) that extends the reach of the VarPro idea to nonquadratic objective functions, most notably cross-entropy loss functions arising in classification. These extensions make GNvpro applicable to all training problems that involve a DNN whose last layer is an affine mapping, which is common in many state-of-the-art architectures. In our four numerical experiments from surrogate modeling, segmentation, and classification, GNvpro solves the optimization problem more efficiently than commonly used stochastic gradient descent (SGD) schemes. Finally, GNvpro finds solutions that generalize well, and in all but one example better than well-tuned SGD methods, to unseen data points.

97 MATHEMATICS AND COMPUTING↗