Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “iterative linear solution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

A Scalable Interior‐Point Gauss–Newton Method for PDE‐Constrained Optimization With Bound Constraints

Here, we present a scalable approach to solve a class of partial differential equation (PDE)‐constrained optimization problems with bound constraints. This approach utilizes a robust full‐space interior‐point (IP)‐Gauss–Newton optimization method. To cope with the poorly‐conditioned IP‐Gauss–Newton saddle‐point linear systems that need to be solved approximately, once per optimization step, we propose two spectrally related preconditioners. These preconditioners leverage the limited informativeness of data in regularized PDE‐constrained optimization problems. A block Gauss–Seidel preconditioner is proposed for the GMRES‐based solution of the IP‐Gauss–Newton linear systems. It is shown, for a large‐class of PDE‐ and bound‐constrained optimization problems, that the spectrum of the block Gauss–Seidel preconditioned IP‐Gauss–Newton matrix is asymptotically independent of discretization and is not impacted by the ill‐conditioning that notoriously plagues interior‐point methods. We exploit symmetry of the IP‐Gauss–Newton linear systems and propose a regularization and log‐barrier Hessian preconditioner for the preconditioned conjugate gradient (PCG)‐based solution of the equivalent IP‐Gauss–Newton–Schur complement linear systems. The eigenvalues of the block Gauss–Seidel preconditioned IP‐Gauss–Newton matrix, that are not equal to one, are identical to the eigenvalues of the regularization and log‐barrier Hessian preconditioned Schur complement matrix. The scalability of the approach is demonstrated on two example problems. The numerical solution of these optimization problems is shown to require a discretization independent number of IP‐Gauss–Newton linear solves. Furthermore, the linear systems are solved in a discretization and IP ill‐conditioning independent number of preconditioned Krylov subspace iterations. The parallel scalability of the preconditioner, achieved via algebraic multigrid component solvers when applicable, and the aforementioned algorithmic scalability permits a parallel scalable means to compute solutions of a large class of PDE‐ and bound‐constrained problems.

PDE-constrained optimization↗
DOE OSTI2019

Understanding the Effects of Tapering on Gaussian Process Regression

Gaussian process regression is a computationally expensive machine learning algorithm that requires the solution of a system of linear equations with a dense covariance matrix. We propose a modification that uses tapering to introduce sparsity into the covariance matrix followed by matrix reordering schemes to reduce the bandwidth of the sparse matrix. We also apply iterative refinement to our approximate solution in order to recover some of the accuracy lost to tapering. Our numerical tests showed that this modification works best with datasets that have many small values in the covariance matrix. This restricts the usefulness of the modification, so other techniques to reduce computational time may be worth considering in the future.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

A domain decomposition method of stochastic PDEs: An iterative solution techniques using a two-level scalable preconditioner

Recent advances in high performance computing systems and sensing technologies motivate computational simulations with extremely high resolution models with capabilities to quantify uncertainties for credible numerical predictions. A two-level domain decomposition method is reported in this investigation to devise a linear solver for the large-scale system in the Galerkin spectral stochastic finite element method (SSFEM). In particular, a two-level scalable preconditioner is introduced in order to iteratively solve the large-scale linear system in the intrusive SSFEM using an iterative substructuring based domain decomposition solver. The implementation of the algorithm involves solving a local problem on each subdomain that constructs the local part of the preconditioner and a coarse problem that propagates information globally among the subdomains. The numerical and parallel scalabilities of the two-level preconditioner are contrasted with the previously developed one-level preconditioner for two-dimensional flow through porous media and elasticity problems with spatially varying non-Gaussian material properties. A distributed implementation of the parallel algorithm is carried out using MPI and PETSc parallel libraries. The scalabilities of the algorithm are investigated in a Linux cluster.

42 ENGINEERING↗
DOE OSTI2016

Fourier Analysis of the Multilevel QD Method with {alpha}-Approximation For Time-Dependent Radiative Transfer Problems

Thermal radiation transfer (TRT) problems describe interaction of photon radiation with matter. They are defined by the time-dependent radiative transfer (RT) equation for the specific intensity I coupled with the energy balance (EB) equation. This class of problems is characterised by high dimensionality, multiple scales and strong nonlinearity. In this paper we analyze the multilevel quasi-diffusion (QD) method for solving TRT problems. This is a nonlinear method of moments with exact closures. The QD method enables one to reduce dimensionality of the original radiative transfer problem. It is formulated by a nonlinear system of equations consisting of (i) the high-order RT (HORT) equation for the intensity of photon radiation and (ii) low-order equations for the angular and energy moments of the intensity. The nonlinear closures are formulated by means of stable factors. The low-order problem brings the radiative transfer model to the level of multi-physics equations. The multilevel QD (MLQD) method possesses attractive features for efficient multi-physics coupling. To calculate the high-order RT solution we apply the {alpha}-approximation which assumes that the intensity changes exponentially in time over a time step. The {alpha}-approximation leads to the steady-state RT equation with a modified opacity and enables one to avoid storing the high-dimensional solution from the previous time step. The rate of change is evaluated by the solution of the time-dependent low-order QD (LOQD) equations for moments. We note that the HORT equation in the {alpha}-approximation contains an extra nonlinear term. It affects the iterative behaviour of the MLQD method. The obtained computational results indicated that the rate of convergence is slower compared to the rate when the time-dependent HORT is used to calculate the intensity. In this paper we perform an iterative stability analysis of the MLQD method in a discretized form and analyze convergence of outer (transport) iterations on a time step. We consider multigroup TRT problems in 1D slab geometry. The fully implicit scheme is used to discretize equations in time. The HORT equation is approximated with the method of step characteristics. A finite volume method is applied for spatial discretization of multigroup LOQD equations. The grey (one-group) LOQD equations are algebraically consistent with the multigroup LOQD equations. To perform Fourier analysis a model TRT problem in an infinite homogeneous medium is considered. The system of nonlinear equations of the MLQD method is linearized near an equilibrium solution at some given temperature. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2015

Anderson acceleration of the Jacobi iterative method: An efficient alternative to Krylov methods for large, sparse linear systems

We employ Anderson extrapolation to accelerate the classical Jacobi iterative method for large, sparse linear systems. Specifically, we utilize extrapolation at periodic intervals within the Jacobi iteration to develop the Alternating Anderson–Jacobi (AAJ) method. We verify the accuracy and efficacy of AAJ in a range of test cases, including nonsymmetric systems of equations. We demonstrate that AAJ possesses a favorable scaling with system size that is accompanied by a small prefactor, even in the absence of a preconditioner. In particular, we show that AAJ is able to accelerate the classical Jacobi iteration by over four orders of magnitude, with speed-ups that increase as the system gets larger. Moreover, we find that AAJ significantly outperforms the Generalized Minimal Residual (GMRES) method in the range of problems considered here, with the relative performance again improving with size of the system. As a result, the proposed method represents a simple yet efficient technique that is particularly attractive for large-scale parallel solutions of linear systems of equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

High-order solution methods for grey discrete ordinates thermal radiative transfer

This work presents a solution methodology for solving the grey radiative transfer equations that is both spatially and temporally more accurate than the canonical radiative transfer solution technique of linear discontinuous finite element discretization in space with implicit Euler integration in time. We solve the grey radiative transfer equations by fully converging the nonlinear temperature dependence of the material specific heat, material opacities, and Planck function. The grey radiative transfer equations are discretized in space using arbitrary-order self-lumping discontinuous finite elements and integrated in time with arbitrary-order diagonally implicit Runge–Kutta time integration techniques. Iterative convergence of the radiation equation is accelerated using a modified interior penalty diffusion operator to precondition the full discrete ordinates transport operator.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

A least-squares finite element method based on the Helmholtz decomposition for hyperbolic balance laws

In this paper, a least-squares finite element method for scalar nonlinear hyperbolic balance laws is proposed and studied. The approach is based on a formulation that utilizes an appropriate Helmholtz decomposition of the flux vector and is related to the standard notion of a weak solution. This relationship, together with a corresponding connection to negative-norm least-squares, is described in detail. As a consequence, an important numerical conservation theorem is obtained, similar to the famous Lax–Wendroff theorem. The numerical conservation properties of the method in this paper do not fall precisely in the framework introduced by Lax and Wendroff, but they are similar in spirit as they guarantee that when L 2 convergence holds, the resulting approximations approach a weak solution to the hyperbolic problem. The least-squares functional is continuous and coercive in an H -1 -type norm, but not L 2 -coercive. Nevertheless, the L 2 convergence properties of the method are discussed. Convergence can be obtained either by an explicit regularization of the functional, that provides control of the L 2 norm, or by properly choosing the finite element spaces, providing implicit control of the L 2 norm. Numerical results for the inviscid Burgers equation with discontinuous source terms are shown, demonstrating the L 2 convergence of the obtained approximations to the physically admissible solution. The numerical method utilizes a least-squares functional, minimized on finite element spaces, and a Gauss–Newton technique with nested iteration. Finally, we believe that the linear systems encountered with this formulation are amenable to multigrid techniques and combining the method with adaptive mesh refinement would make this approach an efficient tool for solving balance laws (this is the focus of a future study).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Highly scalable distributed-memory sparse triangular solution algorithms.

This paper presents a highly efficient distributed-memory parallel sparse triangular solver. The triangular solution phase is often performed following factorization phase in the sparse linear solvers and has become increasingly computa­tionally expensive for direct solvers with many right hand sides (RHSs) or preconditioned iterative solvers. However, the low arithmetic intensity and sequential nature of the triangular solve algorithm pose performance challenges for its large-scale distributed-memory parallelization. In this work, we propose several strategies to enhance scalability of an algorithm with 2D block cyclic process layout. First, an asynchronous binary-tree-based communication scheme implemented via non-blocking MPI functions is leveraged to broadcast partial solutions and reduce partial updates among a subset of processes for each block column and row of the triangular matrix, respectively. This scheme reduces message latency, improves communication load balance and significantly accelerates asynchronous execution of the triangular solve. In addition, efficient BLAS operations and threading implementations are exploited to accelerate local computations and further reduce process idle time. The proposed strategies are implemented in SuperLU_DIST and numerical experiments show up to 4.4x improvement with one right-hand side and up to 6.1x improvement with 50 right- hand sides on 4096 processes, compared to the current release. This is the first time that sparse triangular solution is demonstrated strong scaling on more than 4000 cores.

Liu, Yang↗
DOE OSTI2018

Three Dimensional Characterization of Defects by Ultrasonic Time-of-Flight Diffraction (ToFD) Technique

Ultrasonic time-of-flight diffraction (ToFD) technique has high accuracy in locating and sizing discontinuities. The primary reason for this accuracy is the use of time instead of amplitude for measurement of the depth and size of discontinuities. Despite the many advantages of ToFD, it suffers from a number of shortcomings, the most notable one being its two-dimensional character. The goal of this paper is to develop an algorithm, as a prerequisite, to extend ToFD measurements to a three-dimensional space. For this purpose, a combination of multiple transmitting and receiving probes is proposed instead of just one pair commonly used in ToFD measurements. The approach for locating and sizing defects in a 3D space follows the methods used in radar and acoustic positioning systems. Non-iterative techniques are used for positioning a single source (defect) based on signals collected by several transducers. The estimation formula, in the form of a closed-form solution, is derived by linear least-squares minimization. In addition to existing conventional passive algorithms, a new active algorithm is also proposed for the general arrangement of transducers. This algorithm is tested on a steel specimen having an artificially implanted discontinuity and the three-dimensional location of the defect is estimated.

42 ENGINEERING↗
DOE OSTI2017

Stability analysis of nonlinear two-grid method for multigroup neutron diffusion problems

We present theoretical analysis of a nonlinear acceleration method for solving multigroup neutron diffusion problems. This method is formulated with two energy grids that are defined by (i) fine-energy groups structure and (ii) coarse grid with just a single energy group. The coarse-grid equations are derived by averaging of the multigroup diffusion equations over energy. The method uses a nonlinear prolongation operator. We perform stability analysis of iteration algorithms for inhomogeneous (fixed-source) and eigenvalue neutron diffusion problems. To apply Fourier analysis the equations of the method are linearized about solutions of infinite-medium problems. The developed analysis enables us to predict convergence properties of this two-grid method in different types of problems. Numerical results of problems in 2D Cartesian geometry are presented to confirm theoretical predictions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Robust Decentralized Learning Using ADMM With Unreliable Agents

Many signal processing and machine learning problems can be formulated as consensus optimization problems which can be solved efficiently via a cooperative multi-agent system. However, the agents in the system can be unreliable due to a variety of reasons: noise, faults and attacks. Providing erroneous updates leads the optimization process in a wrong direction, and degrades the performance of distributed machine learning algorithms. This paper considers the problem of decentralized learning using ADMM in the presence of unreliable agents. First, we rigorously analyze the effect of erroneous updates (in ADMM learning iterations) on the convergence behavior of the multi-agent system. We show that the algorithm linearly converges to a neighborhood of the optimal solution under certain conditions and characterize the neighborhood size analytically. Next, we provide guidelines for network design to achieve a faster convergence to the neighborhood. Here, we also provide conditions on the erroneous updates for exact convergence to the optimal solution. Finally, to mitigate the influence of unreliable agents, we propose ROAD , a robust variant of ADMM, and show its resilience to unreliable agents with an exact convergence to the optimum.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Linearized frequency domain Landau-Lifshitz-Gilbert equation formulation

We present a general finite element linearized Landau-Lifshitz-Gilbert equation (LLGE) solver for magnetic systems under weak time-harmonic excitation field. The linearized LLGE is obtained by assuming a small deviation around the equilibrium state of the magnetic system. Inserting such expansion into LLGE and keeping only first order terms gives the linearized LLGE, which gives a frequency domain solution for the complex magnetization amplitudes under an external time-harmonic applied field of a given frequency. We solve the linear system with an iterative solver using generalized minimal residual method. We construct a preconditioner matrix to effectively solve the linear system. The validity, effectiveness, speed, and scalability of the linear solver are demonstrated via numerical examples.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Hybrid Fixed-Point Fixed-Stress Splitting Method for Linear Poroelasticity

Efficient and accurate poroelasticity models are critical in modeling geophysical problems such as oil exploration, gas-hydrate detection, and hydrogeology. We propose an efficient operator splitting method for Biot’s model of linear poroelasticity based on fixed-point iteration and constrained stress. In this method, we eliminate the constraint on time step via combining our fixed-point approach with a physics-based restraint between iterations. Three different cases are considered to demonstrate the stability and consistency of the method for constant and variable parameters. The results are validated against the results from the fully coupled approach. In case I, a single iteration is used for continuous coefficients. The relative error decreases with an increase in time. In case II, material coefficients are assumed to be linear. In the single iteration approach, the relative error grows significantly to 40% before rapidly decaying to zero. This is an artifact of the approximate solutions approaching the asymptotic solution. The error in the multiple iterations oscillates within 10 − 6 before decaying to the asymptotic solution. Nine iterations per time step are enough to achieve the relative error close to 10 − 7 . In the last case, the hybrid method with multiple iterations requires approximately 16 iterations to make the relative error 5 × 10 − 6 .

Delgado, Paul M.↗
DOE OSTI2021

Data-driven acceleration of thermal radiation transfer calculations with the dynamic mode decomposition and a sequential singular value decomposition

In this work, we present a method for accelerating discrete ordinates radiative transfer calculations for radiative transfer. Our method works with nonlinear positivity fixes, in contrast to most acceleration schemes. The method is based on the dynamic mode decomposition (DMD) and using a sequence of rank-one updates to compute the singular value decomposition needed for DMD. Using a sequential method allows us to automatically determine the number of solution vectors to include in the DMD acceleration. We present results for slab geometry discrete ordinates calculations with the standard temperature linearization. Compared with positive source iteration, our results demonstrate that our acceleration method reduces the number of transport sweeps required to solve the problem by a factor of about 3 on a standard diffusive Marshak wave problem, a factor of several thousand on a cooling problem where the effective scattering ratio approaches unity, and a factor of 20 improvement in a realistic, multimaterial radiating shock problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

The fusion code XGC: Enabling kinetic study of multi-scale edge turbulent transport in ITER [Book Chapter]

The XGC fusion gyrokinetic code combines state-of-the-art, portable computational and algorithmic technologies to enable complicated multiscale simulations of turbulence and transport dynamics in ITER edge plasma on the largest US open-science computer, the CRAY XK7 Titan, at its maximal heterogeneous capability, which have not been possible before due to a factor of over 10 shortage in the time-to-solution for less than 5 days of wall-clock time for one physics case. Frontier techniques such as nested OpenMP parallelism, adaptive parallel I/O, staging I/O and data reduction using dynamic and asynchronous applications interactions, dynamic repartitioning for balancing computational work in pushing particles and in grid related work, scalable and accurate discretization algorithms for non-linear Coulomb collisions, and communication-avoiding subcycling technology for pushing particles on both CPUs and GPUs are also utilized to dramatically improve the scalability and time-to-solution, hence enabling the difficult kinetic ITER edge simulation on a present-day leadership class computer.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2015

Pre-Commercial Demonstration of Direct Non-Iterative State Estimator (DNSE+)

The objective of this DOE co-funded project is to demonstrate functionality and performance of a production-grade Direct Non-iterative State Estimator (DNSE) through its integration with NYPA’s Energy Management System (EMS) and an enhanced Real Time Dynamics Monitoring System (RTDMS) synchrophasor platform from Electric Power Group (EPG). A production-grade DNSE aims to overcome a major obstacle to the operational use of synchrophasor data in Synchro-Phasor Management Systems (SPMS) by providing SPMS applications with a consistent and a complete synchrophasor data foundation in the same way that a traditional EMS State Estimator (SE) provides to EMS applications. Specifically, the DNSE uses synchrophasor measurements and Supervisory Control and Data Acquisition (SCADA) measurements, together with the complete power system model, to simultaneously obtain the complete state of the entire utility’s operating model at rates that are close to the synchrophasor data rates. The full system coverage property is what distinguishes the DNSE from the linear synchrophasor SEs (which cover only parts of the operating model that are visible through synchrophasor measurements), and DNSE differs from traditional EMS SE in that the solution is obtained without iterations, without initial values (hence the “direct” in the name), and at a much higher execution rate. This presentation provides an overview of the project objectives, a brief description of the main tasks including the development work to productize and optimize DNSE from its current MATLAB code base, RTDMS enhancement for interfacing with the DNSE, factory acceptance testing, field installation, testing and demonstration, as well as the current status of the project execution.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Multi-objective sizing and dispatch for building thermal and battery storage towards economic and environmental synergy

The role of building thermal and battery storage is pivotal in advancing smart cities and achieving sustainability goals through effective energy management. Despite their significance, there are several limitations in the sizing approach and value stream analysis with various objectives for their widespread adoption in buildings. This work proposes a flexible and scalable multi-objective optimization framework for optimal sizing and dispatch of building thermal and battery storage, addressing conflicting objectives simultaneously using mixed-integer linear programming. The weighted-sum method is adapted, combining multiple objectives into a single function. The two-stage procedure iterates over different weights, generating optimal solutions and forming the Pareto front. Case studies are performed to assess the energy, economic, and environmental benefits of building energy storage systems for a large office building in three climate locations. The results demonstrate that the proposed framework efficiently determines optimal sizing and dispatch strategies, addressing the balance between economic viability and emission reduction. The dynamic relationship between time-of-use energy charges and emission factors leads to significantly different strategies based on whether economic or environmental concerns are prioritized. This research enhances our understanding of the benefits of TES and BES systems in buildings, providing valuable guidance to stakeholders.

25 ENERGY STORAGE↗
DOE OSTI2015

Experimental tests of linear and nonlinear three-dimensional equilibrium models in DIII-D

DIII-D experiments using new detailed magnetic diagnostics show that linear, ideal magnetohydrodynamics (MHD) theory quantitatively describes the magnetic structure (as measured externally) of three-dimensional (3D) equilibria resulting from applied fields with toroidal mode number n = 1, while a nonlinear solution to ideal MHD force balance, using the VMEC code, requires the inclusion of n ≥ 1 to achieve similar agreement. These tests are carried out near ITER baseline parameters, providing a validated basis on which to exploit 3D fields for plasma control development. Scans of the applied poloidal spectrum and edge safety factor confirm that low-pressure, n = 1 non-axisymmetric tokamak equilibria are determined by a single, dominant, stable eigenmode. However, at higher beta, near the ideal kink mode stability limit in the absence of a conducting wall, the qualitative features of the 3D structure are observed to vary in a way that is not captured by ideal MHD.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗