Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Numerical stability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1974

Study report on guidelines and test procedures for investigating stability of nonlinear cardiovascular control system models

A general study of the stability of nonlinear as compared to linear control systems is presented. The analysis is general and, therefore, applies to other types of nonlinear biological control systems as well as the cardiovascular control system models. Both inherent and numerical stability are discussed for corresponding analytical and graphic methods and numerical methods.

Fitzjerrell, D. G.↗
NASA NTRS1972

Generation of the invariant coefficients of the characteristic polynomial for an nxn matrix

In theories of numerical stability, roots to a characteristic polynomial are sought, which, in the case of the predictor with iterative correction method of numerical integration, are eigenvalues of a matrix whose elements depend on the coefficients used in the integration process. The characteristic polynomial is displayed explicitly in terms of the elements of the characteristic matrix.

Beaudet, P. R.↗
NASA NTRS1981

PAN AIR - A higher order panel method for predicting subsonic or supersonic linear potential flows about arbitrary configurations

PAN AIR is a computer program for predicting subsonic or supersonic linear potential flow about arbitrary configurations. It uses linear source and quadratic doublet strength distributions. These higher-order distributions have been implemented in a manner that greatly reduces the numerical stability problems that have plagued earlier attempts to make surface paneling methods work successfully for supersonic flow. PAN AIR's problem-solving capability, numerical approach, modeling features, and program architecture are described. Numerical results are presented for a variety of geometries at supersonic Mach numbers.

Carmichael, R. L.↗
DOE OSTI2022

A two-fluid single-column model of turbulent shallow convection. Part II: Single-column model formulation and numerics

The two-fluid single-column model of Thuburn et al. (Quart. J. R. Meteorol. Soc., 2019, 145, 1535–1550) is extended to include moisture and horizontal wind shear. Turbulent kinetic energy is introduced as a prognostic variable, dependence on a diagnosed boundary-layer height is removed, and subfilter fluxes are approximated using a two-fluid version of a Mellor–Yamada scheme. Three mechanisms for entrainment and detrainment processes are introduced, which represent entrainment of unstable air at the surface, forced detrainment of air at the top of the boundary/cloud layers, and turbulent mixing that relaxes the convective fluid to a reference profile. A semi-implicit Eulerian discretization replaces the semi-implicit semi-Lagrangian implementation of Thuburn et al. (Quart. J. R. Meteorol. Soc., 2019, 145, 1535–1550) to improve numerical stability and conservation. The equations for the implicit time step are solved using a quasi-Newton method, which is shown to perform well in numerical tests for conservation and convergence. The two-fluid single-column model presented in this article will be applied to simulations of shallow cumulus convection in Part III.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1989

Efficient computer algebra algorithms for polynomial matrices in control design

The theory of polynomial matrices plays a key role in the design and analysis of multi-input multi-output control and communications systems using frequency domain methods. Examples include coprime factorizations of transfer functions, cannonical realizations from matrix fraction descriptions, and the transfer function design of feedback compensators. Typically, such problems abstract in a natural way to the need to solve systems of Diophantine equations or systems of linear equations over polynomials. These and other problems involving polynomial matrices can in turn be reduced to polynomial matrix triangularization procedures, a result which is not surprising given the importance of matrix triangularization techniques in numerical linear algebra. Matrices with entries from a field and Gaussian elimination play a fundamental role in understanding the triangularization process. In the case of polynomial matrices, matrices with entries from a ring for which Gaussian elimination is not defined and triangularization is accomplished by what is quite properly called Euclidean elimination. Unfortunately, the numerical stability and sensitivity issues which accompany floating point approaches to Euclidean elimination are not very well understood. New algorithms are presented which circumvent entirely such numerical issues through the use of exact, symbolic methods in computer algebra. The use of such error-free algorithms guarantees that the results are accurate to within the precision of the model data--the best that can be hoped for. Care must be taken in the design of such algorithms due to the phenomenon of intermediate expressions swell.

Baras, J. S.↗
DOE OSTI2024

A high-order Shifted Interface Method for Lagrangian shock hydrodynamics

Here, we present a new method for two-material Lagrangian hydrodynamics, which combines the Shifted Interface Method (SIM) with a high-order Finite Element Method. Our approach relies on an exact (or sharp) material interface representation, that is, it uses the precise location of the material interface. The interface is represented by the zero level-set of a continuous high-order finite element function that moves with the material velocity. This strategy allows to evolve curved material interfaces inside curved elements. By reformulating the original interface problem over a surrogate (approximate) interface, located in proximity of the true interface, the SIM avoids cut cells and the associated problematic issues regarding implementation, numerical stability, and matrix conditioning. Accuracy is maintained by modifying the original interface conditions using Taylor expansions. We demonstrate the performance of the proposed algorithms on established numerical benchmarks in one, two and three dimensions.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

A New Approach for a Wider Class of Entropy Split Methods for Compressible Gas Dynamics and MHD

The high order entropy split methods of Sjögreen & Yee [1, 2] by entropy splitting of the compressible Euler (inviscid) flux derivatives for a thermally-perfect gas are based on Harten’s entropy function [3, 4, 5]. Their derivation takes advantage of the homogeneity property of Euler flux, symmetrizable Euler flux derivatives and energy-norm stability in conjunction with high order classical spatial central, DRP (dispersion relation-preserving) [6, 7, 8] or Padé (compact) spatial discretizations [9] with summation-by-parts (SBP) operators [10]. Our entropy split methods have been proven entropy conserving and stable [1, 11, 12]. Our proofs do not rely on a two-point numerical flux, but rather only a linear difference operator is required to derive these methods. To extend the entropy split method for the MHD, we used the Godunov symmetrizable non-conservative MHD form [12, 13, 14]. These high order entropy split methods not only preserve certain physical properties of the chosen governing equations but are also known to either improve numerical stability, and/or minimize aliasing errors in long time integration of turbulent flow computations without the aid of added numerical dissipation. In our previous published work, extensive error norm comparison with grid refinement was performed to show the high accuracy performance of these methods. These studies also showed how well the entropy split methods conserve the entropy, momentum and mass, and preserve the kinetic energy for long time integration of the various flows [1, 2, 12, 13, 14]. The objective of the present work is to use a new approach to obtain a wider class of entropy split methods consisting of a two-point numerical flux portion and a non-conservative portion in such a way that the homogeneity property of the compressible Euler flux is not required. For high order classical spatial central, DRP (dispersion relation-preserving) or Padé (compact) spatial discretizations, this new approach can be proven to be entropy conservative with conservative spatial dsicretizations while at the same time allowing a wider class of symmetrizable inviscid flux derivatives. We also use this generalization to derive an entropy split scheme that is entropy conserving for the equations of MHD without the homogeneity property using the Godunov symmetrizable ideal MHD formulation [15].

High Order Physical Preserving Methods↗
DOE OSTI2025

Stability-preserving Lossy Compression for Large-scale Partial Differential Equations

Checkpoint/Restart (C/R) strategies are vital for fault tolerance in PDE-based scientific simulations, yet traditional checkpointing incurs significant I/O overhead. Lossy compression offers a scalable solution by reducing checkpoint data size, but conventional methods often lack control over physical invariants (e.g., energy), leading to instability such as oscillations or divergence in Partial Differential Equations (PDE) systems. This paper introduces a stability-preserving compression approach tailored for PDE simulations by explicitly controlling kinetic and potential energy perturbations to ensure stable restarts. Extensive experiments conducted across diverse PDE configurations demonstrate that our method maintains numerical stability with minimal error magnification—even across multiple checkpoint-restart cycles—outperforming state-of-the-art lossy compressors. Parallel evaluations on the Frontier supercomputer show up to 8.4× improvement in checkpoint write performance and 6.3× in read performance, while maintaining relative L2 errors ∼ 2e-6 throughout continued simulation. These results provide practical guidance for balancing compression accuracy, stability, and computational efficiency in large-scale PDE applications.

Gong, Qian [ORNL] (ORCID:0000000235704142)↗
DOE OSTI2020

Numerical Experiments and Identification of Areas for Further Consideration (B639388 Subcontract Quarter II Report)

The second quarter of the project was spent carrying out numerical experiments on a variety of test matrices, using a combination of precisions, with the intent to study the numerical properties (namely, accuracy and convergence behavior) of the Conjugate Gradient (CG) method. We summarize our findings in the remainder of the document. Other activities include attending biweekly xSDK meetings. We are also currently collaborating with Steven Thomas (NREL) on the numerical stability analysis of “low-synch” Gram-Schmidt routines, for potential application within high-performance GMRES variants. This work is in progress. The subsequent quarter will be spent delving into the numerical analysis in order to provide theoretical explanation for the behavior observed in our experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

High-accuracy method for modeling nucleation and growth of particles

State-of-the-art numerical models describing the kinetics of aerosol particle nucleation and growth from a cooling vapor primarily use a nodal method, in which particles that are smaller than the critical size are omitted from consideration because they are thermodynamically unfavorable. This omission is based on the assumption that most newly formed particles are above the critical size, so that subcritical-size particles are not important to take into account. Due to the nature of the nodal method, it suffers from numerical diffusion, which can cause an artificial broadening of the cluster size distribution leading to a significant overestimation of the number of large-size particles. To address these issues, we propose a more accurate numerical method that explicitly models particles of all sizes, and uses a special numerical scheme that substantially reduces the numerical diffusion and provides high solution accuracy and numerical stability. We extensively compare this novel method to the commonly used nodal solver of the general dynamic equation (GDE) for particle growth and demonstrate that it offers GDE solutions with higher accuracy with low numerical diffusion. Incorporating small subcritical clusters into the solution is crucial for: 1) more precise determination of the entire particle size distribution function and 2) wider applicability of the model to experimental studies with non-monotonic temperature variations leading to particle evaporation. The computational code implementing this numerical method in Python is available upon request.

42 ENGINEERING↗
NASA NTRS1980

UDU/T/ covariance factorization for Kalman filtering

There has been strong motivation to produce numerically stable formulations of the Kalman filter algorithms because it has long been known that the original discrete-time Kalman formulas are numerically unreliable. Numerical instability can be avoided by propagating certain factors of the estimate error covariance matrix rather than the covariance matrix itself. This paper documents filter algorithms that correspond to the covariance factorization P = UDU(T), where U is a unit upper triangular matrix and D is diagonal. Emphasis is on computational efficiency and numerical stability, since these properties are of key importance in real-time filter applications. The history of square-root and U-D covariance filters is reviewed. Simple examples are given to illustrate the numerical inadequacy of the Kalman covariance filter algorithms; these examples show how factorization techniques can give improved computational reliability.

Thornton, C. L.↗
NASA NTRS1972

Analytical treatment of gas flows through multilayer insulation, project 1

A theoretical investigation of gas flow inside a multilayer insulation system was made for the case of the broadside pumping process. A set of simultaneous first-order differential equations for the temperature and pressure of the gas molecules through the perforations on the insulation layers. A modified Runge-Kutta method was used for numerical experiment. The numerical stability problem was also investigated. It was shown that when the relaxation time is less than the time period over which the gas properties change appreciably, the set of differential equations can be replaced by a set of algebraic equations for solution. Numerical examples were given and comparisons with experimental data were made.

Lin, J. T.↗
NASA NTRS1973

Analysis of gas flow through a multilayer insulation system.

A theoretical investigation of gas flow inside a multilayer insulation system has been made for the case of the broadside pumping process. A set of simultaneous first-order differential equations for the temperature and pressure of the gas mixture was obtained by considering the diffusion mechanism of the gas molecules through the perforations on the insulation layers. A modified Runge-Kutta method was used for numerical experiment. The numerical stability problem was investigated. It has been shown that when the relaxation time is small compared with the time period over which the gas properties change appreciably, the set of differential equations can be replaced by a set of algebraic equations for solution. Numerical examples were given and comparison with experimental data was made.

Lin, J. T.↗
NASA NTRS1973

Thermal engineering research

A theoretical investigation of gas flow inside a multilayer insulation system has been made for the case of the broadside pumping process. A set of simultaneous first-order differential equations for the temperature and pressure of the gas mixture was obtained by considering the diffusion mechanism of the gas molecules through the perforations on the insulation layers. A modified Runge-Kutta method was used for numerical experiment. The numerical stability problem was investigated. It has been shown that when the relaxation time is small compared with the time period over which the gas properties change appreciably, the set of differential equations can be replaced by a set of algebraic equations for solution. Numerical examples were given, and comparisons with experimental data were made.

Shih, C. C.↗
DOE OSTI2026

Assessment of the hydromechanical higher-order MPM for the simulation of geotechnical problems

The Material Point Method (MPM) has been increasingly used to simulate large strain deformations. Linear interpolation functions are commonly used to perform the spatial integration. It is well-known that the discontinuities in the interpolation function derivatives induce shock-like artifacts known as ‘cell-crossing’ error. These errors compound with volumetric locking errors when used with hydromechanical formulations for porous media, where different velocity fields are used for each phase. The capabilities of higher-order MPM frameworks have not been explored for real-scale geotechnical problems. As such, this paper aims to assess, validate, and further discuss a higher-order B-spline MPM (BS-MPM) framework. First, the BS-MPM framework is verified against the large-strain oedometer consolidation problem. Second, the framework is validated against a real-scale slope failure experiment triggered by pore water pressure recharge. Landslide features that are captured using the higher-order framework are specifically highlighted, and results (e.g., pore water pressure and deformation) are validated with field measurements. A generally convergent numerical solution is observed when using cubic interpolation functions. Third, a footing penetration problem is simulated using the multi-patch BS-MPM. Trends are examined with respect to penetration velocity and variation in hydraulic conductivity. The BS-MPM framework ultimately presents a stabilized numerical solution that captures plausible hydromechanical interaction trends important in geotechnical engineering applications.

36 MATERIALS SCIENCE↗
NASA NTRS1976

A numerical comparison of discrete Kalman filtering algorithms - An orbit determination case study

An improved Kalman filter algorithm based on a modified Givens matrix triangularization technique is proposed for solving a nonstationary discrete-time linear filtering problem. The proposed U-D covariance factorization filter uses orthogonal transformation technique; measurement and time updating of the U-D factors involve separate application of Gentleman's fast square-root-free Givens rotations. Numerical stability and accuracy of the algorithm are compared with those of the conventional and stabilized Kalman filters and the Potter-Schmidt square-root filter, by applying these techniques to a realistic planetary navigation problem (orbit determination for the Saturn approach phase of the Mariner Jupiter-Saturn Mission, 1977). The new algorithm is shown to combine the numerical precision of square root filtering with the efficiency of the original Kalman algorithm.

Thornton, C. L.↗