Osher, S. J. | Engineering Papers

DOE OSTI2022

A deterministic gradient-based approach to avoid saddle points

Abstract Loss functions with a large number of saddle points are one of the major obstacles for training modern machine learning (ML) models efficiently. First-order methods such as gradient descent (GD) are usually the methods of choice for training ML models. However, these methods converge to saddle points for certain choices of initial guesses. In this paper, we propose a modification of the recently proposed Laplacian smoothing gradient descent (LSGD) [Osher et al., arXiv:1806.06317 ], called modified LSGD (mLSGD), and demonstrate its potential to avoid saddle points without sacrificing the convergence rate. Our analysis is based on the attraction region, formed by all starting points for which the considered numerical scheme converges to a saddle point. We investigate the attraction region’s dimension both analytically and numerically. For a canonical class of quadratic functions, we show that the dimension of the attraction region for mLSGD is $\lfloor (n-1)/2\rfloor$ , and hence it is significantly smaller than that of GD whose dimension is $n-1$ .

Mathematics↗

NASA NTRS1994

Numerical Simulations of High-Speed Chemically Reacting Flow

The Essentially NonOscillatory (ENO) shock-capturing scheme for the solution of hyperbolic equations is extended to solve a system of coupled conservation equations governing two-dimensional, time-dependent, compressible chemically reacting flow with full chemistry. The thermodynamic properties of the mixture are modeled accurately, and stiff kinetic terms are separated from the fluid motion by a fractional step algorithm. The methodology is used to study the concept of shock-induced mixing and combustion, a process by which the interaction of a shock wave with a jet of low-density hydrogen fuel enhances mixing through streamwise vorticity generation. Test cases with and without chemical reaction are explored here. Our results indicate that, in the temperature range examined, vorticity generation as well as the distribution of atomic species do not change significantly with the introduction of a chemical reaction and subsequent heat release. The actual diffusion of hydrogen is also relatively unaffected by the reaction process. This suggests that the fluid mechanics of this problem may be successfully decoupled from the combustion processes, and that computation of the mixing problem (without combustion chemistry) can elucidate much of the important physical features of the flow.

Ton, V. T.↗

NASA NTRS1994

Numerical Simulations of High-Speed Chemically Reacting Flow

The essentially nonoscillatory (ENO) shock-capturing scheme for the solution of hyperbolic equations is extended to solve a system of coupled conservation equations governing two-dimensional, time-dependent, compressible chemically reacting flow with full chemistry. The thermodynamic properties of the mixture are modeled accurately, and stiff kinetic terms are separated from the fluid motion by a fractional step algorithm. The methodology is used to study the concept of shock-induced mixing and combustion, a process by which the interaction of a shock wave with a jet of low-density hydrogen fuel enhances mixing through streamwise vorticity generation. Test cases with and without chemical reaction are explored here. Our results indicate that, in the temperature range examined, vorticity generation as well as the distribution of atomic species do not change significantly with the introduction of a chemical reaction and subsequent heat release. The actual diffusion of hydrogen is also relatively unaffected by the reaction process. This suggests that the fluid mechanics of this problem may be successfully decoupled from the combustion processes, and that computation of the mixing problem (without combustion chemistry) can elucidate much of the important physical features of the flow.

Ton, V. T.↗

NASA NTRS1986

An entropy correction method for unsteady full potential flows with strong shocks

An entropy correction method for the unsteady full potential equation is presented. The unsteady potential equation is modified to account for entropy jumps across shock waves. The conservative form of the modified equation is solved in generalized coordinates using an implicit, approximate factorization method. A flux-biasing differencing method, which generates the proper amounts of artificial viscosity in supersonic regions, is used to discretize the flow equations in space. Comparisons between the present method and solutions of the Euler equations and between the present method and experimental data are presented. The comparisons show that the present method more accurately models solutions of the Euler equations and experiment than does the isentropic potential formulation.

Whitlow, W., Jr.↗

NASA NTRS1986

An entropy correction method for unsteady full potential flows with strong shocks

An entropy correction method for the unsteady full potential equation is presented. The unsteady potential equation is modified to account for entropy jumps across shock waves. The conservative form of the modified equation is solved in generalized coordinates using an implicit, approximate factorization method. A flux-biasing differencing method, which generates the proper amounts of artificial viscosity in supersonic regions, is used to discretize the flow equations in space. Comparisons between the present method and solutions of the Euler equations and between the present method and experimental data are presented. The comparisons show that the present method more accurately models solutions of the Euler equations and experiment than does the isentropic potential formulation.

Whitlow, W., Jr.↗