Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “proximal operator splitting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Metric Learning to Accelerate Convergence of Operator Splitting Methods

Recent developments in machine learning have led to promising advances in accelerating the solution of constrained optimization problems. Increasing demand for real-time decision-making capabilities in applications such as artificial intelligence and optimal control has led to a variety of proposed strategies for learning to produce fast solutions to optimization problems. For example, recent works have shown that it is possible to accelerate the convergence of optimization algorithms by learning to select their parameters, such as gradient descent stepsizes. This work proposes a new approach, in which the underlying metric spaces of proximal operator splitting algorithms are learned to maximize convergence rate. While prior works in optimization theory have derived optimal metrics in simple cases, no such result exists for many practical problem forms including general Quadratic Programming (QP). This paper shows how differentiable optimization can enable the end-to-end learning of proximal metrics, enhancing the convergence of proximal algorithms for QP problems beyond what is possible based on known theory. Additionally, the results illustrate a strong connection between the learned proximal metrics and active constraints at the optima, leading to an interpretation in which the predicted proximal metrics can be viewed as a form of active set prediction.

King, Ethan [BATTELLE (PACIFIC NW LAB)]↗

Stochastic projective splitting

Here, we present a new, stochastic variant of the projective splitting (PS) family of algorithms for inclusion problems involving the sum of any finite number of maximal monotone operators. This new variant uses a stochastic oracle to evaluate one of the operators, which is assumed to be Lipschitz continuous, and (deterministic) resolvents to process the remaining operators. Our proposal is the first version of PS with such stochastic capabilities. We envision the primary application being machine learning (ML) problems, with the method’s stochastic features facilitating “mini-batch” sampling of datasets. Since it uses a monotone operator formulation, the method can handle not only Lipschitz-smooth loss minimization, but also min–max and noncooperative game formulations, with better convergence properties than the gradient descent-ascent methods commonly applied in such settings. The proposed method can handle any number of constraints and nonsmooth regularizers via projection and proximal operators. We prove almost-sure convergence of the iterates to a solution and a convergence rate result for the expected residual, and close with numerical experiments on a distributionally robust sparse logistic regression problem.

97 MATHEMATICS AND COMPUTING↗

Towards chemical equilibrium in thermochemical water splitting. Part 1: Thermal reduction

The efficiency of many processes strongly depends on their thermodynamic reversibility, i.e., proximity to equilibrium throughout the process. In thermochemical cycles for water and/or carbon dioxide splitting, thermochemical air separation, and thermochemical energy storage, operating near equilibrium means that the oxygen chemical potential of the solid and gas phases must not differ significantly. Herein we show that approaching this ideal is possible in thermal reduction only if the reaction step occurs at a specific, reaction coordinate- and material-dependent temperature. The resulting thermal reduction temperature profile also depends on the ratio of gas and solid flows.

08 HYDROGEN↗

A class of customized proximal point algorithms for linearly constrained convex optimization

In this paper, we propose a class of customized proximal point algorithms for linearly constrained convex optimization problems. The algorithms are implementable, provided that the proximal operator of the objective function is easy to evaluate. We show that, with special setting of the algorithmic scalar, our algorithms contain the customized proximal point algorithm (He et al., Optim Appl 56:559–572, 2013), the linearized augmented Lagrangian method (Yang and Yuan, Math Comput 82:301–329, 2013), the Bregman Operator Splitting algorithm (Zhang et al., SIAM J Imaging Sci 3:253–276, 2010) as special cases. The global convergence and worst-case convergence rate measured by the iteration complexity are established for the proposed algorithms. Numerical results demonstrate that the algorithms work well for a wide range of the scalar.

97 MATHEMATICS AND COMPUTING↗

MO-DE-207A-07: Filtered Iterative Reconstruction (FIR) Via Proximal Forward-Backward Splitting: A Synergy of Analytical and Iterative Reconstruction Method for CT

Purpose: This work is to develop a general framework, namely filtered iterative reconstruction (FIR) method, to incorporate analytical reconstruction (AR) method into iterative reconstruction (IR) method, for enhanced CT image quality. Methods: FIR is formulated as a combination of filtered data fidelity and sparsity regularization, and then solved by proximal forward-backward splitting (PFBS) algorithm. As a result, the image reconstruction decouples data fidelity and image regularization with a two-step iterative scheme, during which an AR-projection step updates the filtered data fidelity term, while a denoising solver updates the sparsity regularization term. During the AR-projection step, the image is projected to the data domain to form the data residual, and then reconstructed by certain AR to a residual image which is in turn weighted together with previous image iterate to form next image iterate. Since the eigenvalues of AR-projection operator are close to the unity, PFBS based FIR has a fast convergence. Results: The proposed FIR method is validated in the setting of circular cone-beam CT with AR being FDK and total-variation sparsity regularization, and has improved image quality from both AR and IR. For example, AIR has improved visual assessment and quantitative measurement in terms of both contrast and resolution, and reduced axial and half-fan artifacts. Conclusion: FIR is proposed to incorporate AR into IR, with an efficient image reconstruction algorithm based on PFBS. The CBCT results suggest that FIR synergizes AR and IR with improved image quality and reduced axial and half-fan artifacts. The authors was partially supported by the NSFC (#11405105), the 973 Program (#2015CB856000), and the Shanghai Pujiang Talent Program (#14PJ1404500).

60 APPLIED LIFE SCIENCES↗

Lattice Mie resonances and emissivity enhancement in mid-infrared iron pyrite metasurfaces

High-refractive-index antennas with characteristic dimensions comparable to wavelength have a remarkable ability to support pronounces electric and magnetic dipole resonances. Furthermore, periodic arrangements of such resonant antennas result in narrow and strong lattice resonances facilitated by the lattice. We design iron pyrite antennas operating in the mid-infrared spectral range due to the material’s low-energy bandgap and high refractive index. We utilize Kirchhoff’s law, stating that emissivity and absorptance are equal to each other in equilibrium, and we apply it to improve the thermal properties of the iron pyrite metasurface. Through the excitation of collective resonances and manipulation of the antenna lattice’s period, we demonstrate our capacity to control emissivity peaks. These peaks stem from the resonant excitation of electric and magnetic dipoles within proximity to the Rayleigh anomalies. In the lattice of truncated-cone antennas, we observe Rabi splitting of electric and magnetic dipole lattice resonances originating from the antennas’ broken symmetry. We demonstrate that the truncated-cone antenna lattices support strong out-of-plane magnetic dipole lattice resonances at oblique incidence. We show that the truncated-cone antennas, as opposed to disks or cones, facilitate a particularly strong resonance and bound state in the continuum at the normal incidence. Our work demonstrates the effective manipulation of emissivity peaks in iron pyrite metasurfaces through controlled lattice resonances and antenna design, offering promising avenues for mid-infrared spectral engineering.

Islam, Md Sakibul↗

First-Principles Quantum Transport Modeling of Spin-Transfer and Spin-Orbit Torques in Magnetic Multilayers

A unified approach for computing (i) spin-transfer torque in magnetic trilayers like spin valve and magnetic tunnel junction, where injected charge current flows perpendicularly to interfaces, and (ii) spin-orbit torque in magnetic bilayers of the type ferromagnet/spin-orbit-coupled material, where injected charge current flows parallel to the interface, was reviewed. The experimentally explored and technologically relevant spin-orbit-coupled materials include 5d heavy metals, topological insulators, Weyl semimetals, and transition metal dichalcogenides. This approach requires to construct the torque operator for a given Hamiltonian of the device and the steady-state nonequilibrium density matrix, where the latter is expressed in terms of the nonequilibrium Green’s functions and split into three contributions. Tracing these contributions with the torque operator automatically yields field-like and damping-like components of spin-transfer torque or spin-orbit torque vector, which is particularly advantageous for spin-orbit torque where the direction of these components depends on the unknown-in-advance orientation of the current-driven nonequilibrium spin density in the presence of spin-orbit coupling. Illustrative examples are provided by computing spin-transfer torque in a one-dimensional toy model of a magnetic tunnel junction and realistic Co/Cu/Co spin valve, both of which are described by first-principles Hamiltonians obtained from noncollinear density functional theory calculations, as well as by computing spin-orbit torque in a ferromagnetic layer described by a tight-binding Hamiltonian which includes spin-orbit proximity effect within ferromagnetic monolayers assumed to be generated by the adjacent monolayer transition metal dichalcogenide. In addition, it is shown here how spin-orbit proximity effect, quantified by computing (via first-principles retarded Green’s function) spectral functions and spin textures on monolayers of realistic ferromagnetic material like Co in contact with heavy metal or monolayer transition metal dichalcogenide, can be tailored to enhance the magnitude of spin-orbit torque. Furthermore, errors made in the calculation of spin-transfer torque are quantified when using Hamiltonian from collinear density functional theory, with rigidly rotated magnetic moments to create noncollinear magnetization configurations, instead of proper (but computationally more expensive) self-consistent Hamiltonian obtained from noncollinear density functional theory.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗