SEARCH · Engineering Papers

Results for “numerical differentiation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

All sources NASA NTRS DOE OSTI

NASA NTRS1993

Linear and nonlinear PSE for compressible boundary layers

Compressible stability of growing boundary layers is studied by numerically solving the partial differential equations under a parabolizing approximation. The resulting parabolized stability equations (PSE) account for nonparallel as well as nonlinear effects. Evolution of disturbances in compressible flat-plate boundary layers are studied for freestream Mach numbers ranging from 0 to 4.5. Results indicate that the effect of boundary-layer growth is important for linear disturbances. Nonlinear calculations are performed for various Mach numbers. Two-dimensional nonlinear results using the PSE approach agree well with those from direct numerical simulations using the full Navier-Stokes equations while the required computational time is less by an order of magnitude. Spatial simulation using PSE were carried out for both the fundamental and subharmonic type breakdown for a Mach 1.6 boundary layer. The promising results obtained show that the PSE method is a powerful tool for studying boundary-layer instabilities and for predicting transition over a wide range of Mach numbers.

Chang, Chau-Lyan↗

NASA NTRS2003

Preliminary Planar Formation: Flight Dynamics Near Sun-Earth L2 Point

NASA's Goddard Space Flight Center is planning a series of missions in the vicinity of the Sun-Earth L2 libration point. Some of these projects will involve a distributed space system of telescope spacecraft acting together as a single telescope for high-resolution. The individual telescopes will be configured in a plane, surrounding a hub, where the telescope plane can be aimed toward various astronomical targets of interest. In preparation for these missions, it is necessary to develop an improved understanding of the dynamical behavior of objects in a planar configuration near L2. The classical circular restricted three body problem is taken as the basis for the analysis. At first order, the motion of such a telescope relative to the hub is described by a system of linear second order differential equations. These equations are identical to the circular restricted problem's linear equations describing the hub motion about L2. Therefore, the fundamental frequencies, both parallel to and normal to the ecliptic plane, are the same for the relative telescope motion as for the hub motion. To maintain the telescope plane for the duration necessary for the planned observations, a halo-type orbit of the telescopes about the hub is investigated. By using a halo orbit, the individual telescopes remain in approximately the same plane over the observation duration. For such an orbit, the fundamental periods parallel to and normal to the ecliptic plane are forced to be the same by careful selection of the initial conditions in order to adjust the higher order forces. The relative amplitudes of the resulting oscillations are associated with the orientation of the telescope plane relative to the ecliptic. As in the circular restricted problem, initial conditions for the linearized equations must be selected so as not to excite the convergent or divergent linear modes. In a higher order analysis, the telescope relative motion equations include the effects of the position of the hub relative to L2. In this paper, the differential equations are developed through second order in the distance of the hub from the libration point. A modified Lindstedt-Poincad perturbation method is employed to construct the solution of these differential equations through that same order of magnitude. In the course of the solution process, relationships are determined between the initial conditions of the telescopes, selected in order to avoid resonance excitation. As the differential equations include the hub position, it is necessary to simultaneously develop the solution for the hub. As has been done in past analyses of the circular restricted problem, the hub position is written in a power series formulation in terms of its distance from L2. Then, in order to be included in the telescope equations, the hub solution is cast in terms of the nonlinear frequency of the relative telescope motion. In the course of the analysis, it is determined that the hub should also maintain a halo orbit - about L2. Additionally, relationships are formed between the initial conditions of the telescopes and the hub. These relationships may be used to associate sets of initial conditions with particular orientations of the telescope plane. The accuracy of the analytical solution is verified through various simulations and comparison to numerical integration of the differential equations. The results of the simulations are presented, along with a graphical representation of the relationships between the initial conditions of the telescopes and hub.

Segerman, Alan M.↗

NASA NTRS1985

Numerical weather prediction in low latitudes

Based on the results of a number of numerical prediction experiments, the differential heating between land and ocean is an important and critical factor for investigation of phenomenon such as the onset of monsoons over the Indian subcontinent. The pre-onset period during the month of May shows a rather persistent flow field in the monsoon region. At low levels the circulation exhibits anticyclonic excursions over the Arabian Sea, flowing essentially parallel to the west coast of India from the north. Over the Indian subcontinent the major feature is a shallow heat low over northern India. As the heat sources commence a rapid northwestward movement toward the southern edge of the Tibetan Plateau, an interesting configuration of the large-scale divergent circulation occurs. A favorable configuration for a rapid exchange of energy from the divergent to the rotational kinetic energy develops. Strong low level monsoonal circulations evolve, attendant with that the onset of monsoon rains occurs. In order to test this observational sequence, a series of short-range numerical prediction experiments were initiated to define the initial heat sources.

Krishnamurti, T. N.↗

DOE OSTI2021

Deep Learning Approaches to Surrogates for Solving the Diffusion Equation for Mechanistic Real-World Simulations

In many mechanistic medical, biological, physical, and engineered spatiotemporal dynamic models the numerical solution of partial differential equations (PDEs), especially for diffusion, fluid flow and mechanical relaxation, can make simulations impractically slow. Biological models of tissues and organs often require the simultaneous calculation of the spatial variation of concentration of dozens of diffusing chemical species. One clinical example where rapid calculation of a diffusing field is of use is the estimation of oxygen gradients in the retina, based on imaging of the retinal vasculature, to guide surgical interventions in diabetic retinopathy. Furthermore, the ability to predict blood perfusion and oxygenation may one day guide clinical interventions in diverse settings, i.e., from stent placement in treating heart disease to BOLD fMRI interpretation in evaluating cognitive function (Xie et al., 2019; Lee et al., 2020). Since the quasi-steady-state solutions required for fast-diffusing chemical species like oxygen are particularly computationally costly, we consider the use of a neural network to provide an approximate solution to the steady-state diffusion equation. Machine learning surrogates, neural networks trained to provide approximate solutions to such complicated numerical problems, can often provide speed-ups of several orders of magnitude compared to direct calculation. Surrogates of PDEs could enable use of larger and more detailed models than are possible with direct calculation and can make including such simulations in real-time or near-real time workflows practical. Creating a surrogate requires running the direct calculation tens of thousands of times to generate training data and then training the neural network, both of which are computationally expensive. Often the practical applications of such models require thousands to millions of replica simulations, for example for parameter identification and uncertainty quantification, each of which gains speed from surrogate use and rapidly recovers the up-front costs of surrogate generation. We use a Convolutional Neural Network to approximate the stationary solution to the diffusion equation in the case of two equal-diameter, circular, constant-value sources located at random positions in a two-dimensional square domain with absorbing boundary conditions. Such a configuration caricatures the chemical concentration field of a fast-diffusing species like oxygen in a tissue with two parallel blood vessels in a cross section perpendicular to the two blood vessels. To improve convergence during training, we apply a training approach that uses roll-back to reject stochastic changes to the network that increase the loss function. The trained neural network approximation is about 1000 times faster than the direct calculation for individual replicas. Because different applications will have different criteria for acceptable approximation accuracy, we discuss a variety of loss functions and accuracy estimators that can help select the best network for a particular application. We briefly discuss some of the issues we encountered with overfitting, mismapping of the field values and the geometrical conditions that lead to large absolute and relative errors in the approximate solution.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2020

Measurement accuracy and spatial resolution of a distributed temperature sensor based on a two-pulse differential coherent reflectometer

We present a model and numerical simulation of a distributed temperature sensor based on a two-pulse differential coherent optical time-domain reflectometer (COTDR). The differential phase measured using a phase-sensitive Rayleigh reflectometer is shown to have a regular component, which is a linear function of temperature, and a random component, which is related to a random distribution of scattering centres in the fibre and restricts the accuracy of measurements of variations in temperature. Measurement accuracy can be improved by reducing the relative contribution of the random component via a decrease in pulse duration and/or an increase in the time delay between pulses. The spatial resolution of a differential two-pulse phase-sensitive reflectometer is shown to be determined by the time delay between pulses and to vary little with pulse duration. At a typical pulse duration (200 ns) and delay time (300 ns), the accuracy in measurements of variations in temperature in the 0.1-K range is 2 % and the spatial resolution is about 30 m. (fibre-optic sensors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2024

A Comprehensive Review of Latent Space Dynamics Identification Algorithms for Intrusive and Non-Intrusive Reduced-Order-Modeling

Numerical solvers of partial differential equations (PDEs) have been widely employed for simulating physical systems. However, the computational cost remains a major bottleneck in various scientific and engineering applications, which has motivated the development of reduced-order models (ROMs). Recently, machine-learning-based ROMs have gained significant popularity and are promising for addressing some limitations of traditional ROM methods, especially for advection dominated systems. In this chapter, we focus on a particular framework known as Latent Space Dynamics Identification (LaSDI), which transforms the high-fidelity data, governed by a PDE, to simpler and low-dimensional latent-space data, governed by ordinary differential equations (ODEs). These ODEs can be learned and subsequently interpolated to make ROM predictions. Each building block of LaSDI can be easily modulated depending on the application, which makes the LaSDI framework highly flexible. In particular, we present strategies to enforce the laws of thermodynamics into LaSDI models (tLaSDI), enhance robustness in the presence of noise through the weak form (WLaSDI), select high-fidelity training data efficiently through active learning (gLaSDI, GPLaSDI), and quantify the ROM prediction uncertainty through Gaussian processes (GPLaSDI). We demonstrate the performance of different LaSDI approaches on Burgers equation, a non-linear heat conduction problem, and a plasma physics problem, showing that LaSDI algorithms can achieve relative errors of less than a few percent and up to thousands of times speed-ups.

Computational Engineering, Finance, and Science (c↗

DOE OSTI2022

Entropy–Preserving and Entropy–Stable Relaxation IMEX and Multirate Time–Stepping Methods

In this work, we propose entropy-preserving and entropy-stable partitioned Runge–Kutta (RK) methods. In particular, we extend the explicit relaxation Runge–Kutta methods to IMEX–RK methods and a class of explicit second-order multirate methods for stiff problems arising from scale-separable or grid-induced stiffness in a system. The proposed approaches not only mitigate system stiffness but also fully support entropy-preserving and entropy-stability properties at a discrete level. The key idea of the relaxation approach is to adjust the step completion with a relaxation parameter so that the time-adjusted solution satisfies the entropy condition at a discrete level. The relaxation parameter is computed by solving a scalar nonlinear equation at each timestep in general; however, as for a quadratic entropy function, we theoretically derive the explicit form of the relaxation parameter and numerically confirm that the relaxation parameter works the Burgers equation. Several numerical results for ordinary differential equations and the Burgers equation are presented to demonstrate the entropy-conserving/stable behavior of these methods. We also compare the relaxation approach and the incremental direction technique for the Burgers equation with and without a limiter in the presence of shocks.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Enhancing photoionization rate calculations in low-temperature plasmas using spectral methods

Photoionization plays a central role in the development of streamer discharges and other non-equilibrium plasma phenomena. It creates seed electrons, which are essential for positive streamer propagation, allowing the ionization front to move forward. Because of this, accurate modeling of photoionization is very important for predicting streamer behavior and plasma evolution. The photoionization process in air (N 2 – O 2 mixture) is often described by the Zheleznyak model (1982). This model is usually solved through Helmholtz-type equations that approximate the Zheleznyak photoionization model (Zheleznyak et al. 1982) as Partial Differential Equations (PDEs). Conventional numerical methods, such as the Finite Difference Method (FDM) or Finite Volume Method (FVM), are widely used to solve these equations. Although they are prevalent, the computational cost of these methods due to their need for matrix operations and iterative solver is demanding. To address this challenge, this work develops a spectral solver based on the Fast Fourier Transform (FFT) combined with Discrete Cosine Transform (DCT) and Discrete Sine Transform (DST) to calculate the photoionization rate efficiently in an axisymmetric cylindrical domain. This method naturally satisfies the boundary conditions used in the model and converts the PDE into algebraic ones in spectral space. Thus, avoids the need for iterative matrix solvers. When compared with FDM results, it is demonstrated that the new solver not only maintains accuracy, but also reduces the computational cost, showing a performance increase of approximately 100 compared to FDM over a wide range of problem sizes. The method is parallelized using Message Passing Interface (MPI) and has been integrated into a fluid plasma model for streamer simulation. Here, this FFT-based approach provides a fast and reliable alternative for calculating photoionization in fluid models, helping large-scale plasma simulations run faster and efficiently, and allows higher-resolution simulation without extra computational cost.

Axisymmetric system↗

DOE OSTI2020

Super-time-stepping schemes for parabolic equations with boundary conditions

In this work, we present a super-time-stepping scheme for numerically solving parabolic partial differential equations with Dirichlet boundary conditions (BC). Using the general Forward Euler scheme, one can show that by taking varying step sizes there is the potential of propagating the solution forward in time by a greater amount than with uniform step sizes, while maintaining the same order of accuracy. As shown in previous works, if one further requires that the scheme have the Convex Monotone Property (CMP), then there exists a scheme which results in linear, monotone stability of the solution. This monotone stability is highly desirable in many physical situations, such as thermal diffusion, where the physical system will not oscillate, but will behave monotonically. However, the schemes devised in previous works do not include situations that have a boundary condition, and the inclusion of boundary conditions will henceforth be our focus. It is shown that a particular Runge-Kutta-Gegenbauer class of schemes [5] will maintain the CMP even in the presence of Dirichlet BC.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Single-stage gradient-based stellarator coil design: Optimization for near-axis quasi-symmetry

Here we present a new coil design paradigm for magnetic confinement in stellarators. Our approach directly optimizes coil shapes and coil currents to produce a vacuum quasi-symmetric magnetic field with a target rotational transform on the magnetic axis. This approach differs from the traditional two-stage approach in which first a magnetic configuration with desirable physics properties is found, and then coils to approximately realize this magnetic configuration are designed. The proposed single-stage approach allows us to find a compromise between confinement and engineering requirements, i.e., find easy-to-build coils with good confinement properties. Using forward and adjoint sensitivities, we derive derivatives of the physical quantities in the objective, which is constrained by a nonlinear periodic differential equation. In two numerical examples, we compare different gradient-based descent algorithms and find that incorporating approximate second-order derivative information through a quasi-Newton method is crucial for convergence. We also explore the optimization landscape in the neighborhood of a minimizer and find many directions in which the objective is mostly flat, indicating ample freedom to find simple and thus easy-to-build coils.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Towards sharp error analysis of extended Lagrangian molecular dynamics

The extended Lagrangian molecular dynamics (XLMD) method provides a useful framework for reducing the computational cost of a class of molecular dynamics simulations with constrained latent variables. The XLMD method relaxes the constraints by introducing a fictitious mass ε for the latent variables and solving a set of singularly perturbed ordinary differential equations. While favorable numerical performance of XLMD has been demonstrated in several different contexts in the past decade, mathematical analysis of the method remains scarce. Here, we propose the first error analysis of the XLMD method in the context of a classical polarizable force field model. While the dynamics with respect to the atomic degrees of freedom are general and nonlinear, the key mathematical simplification of the polarizable force field model is that the constraints on the latent variables are given by a linear system of equations. We prove that when the initial value of the latent variables is compatible in a sense that we define, XLMD converges as the fictitious mass ε is made small with $\mathscr{O}$(ε) error for the atomic degrees of freedom and with $\mathscr{O}$($\sqrt{ε}$) error for the latent variables, when the dimension of the latent variable d' is 1. Furthermore, when the initial value of the latent variables is improved to be optimally compatible in a certain sense, we prove that the convergence rate can be improved to $\mathscr{O}$(ε) for the latent variables as well. Numerical results verify that both estimates are sharp not only for d'=1, but also for arbitrary d'. In the setting of general d', we do obtain convergence, but with the non-sharp rate of $\mathscr{O}$($\sqrt{ε}$) for both the atomic and latent variables.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2024

Dyn$\mathrm{AMO}$: Multi-agent reinforcement learning for dynamic anticipatory mesh optimization with applications to hyperbolic conservation laws

Here we introduce DynAMO, a reinforcement learning paradigm for Dynamic Anticipatory Mesh Optimization. Adaptive mesh refinement is an effective tool for optimizing computational cost and solution accuracy in numerical methods for partial differential equations. However, traditional adaptive mesh refinement approaches for time-dependent problems typically rely only on instantaneous error indicators to guide adaptivity. As a result, standard strategies often require frequent remeshing to maintain accuracy. In the DynAMO approach, multi-agent reinforcement learning is used to discover new local refinement policies that can anticipate and respond to future solution states by producing meshes that deliver more accurate solutions for longer time intervals. By applying DynAMO to discontinuous Galerkin methods for the linear advection and compressible Euler equations in two dimensions, we demonstrate that this new mesh refinement paradigm can outperform conventional threshold-based strategies while also generalizing to different mesh sizes, remeshing and simulation times, and initial conditions.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Scaling Field-Theoretic Simulation for Multicomponent Mixtures with Neural Operators

Multicomponent polymer mixtures are ubiquitous in biological self-organization but are notoriously difficult to study computationally. Plagued by both slow single molecule relaxation times and slow equilibration within dense mixtures, molecular dynamics simulations are typically infeasible at the spatial scales required to study the stability of mesophase structure. Polymer field theories offer an attractive alternative, but analytical calculations are only tractable for mean-field theories and nearby perturbations, constraints that become especially problematic for fluctuation-induced effects such as coacervation. Here, we show that a recently developed technique for obtaining numerical solutions to partial differential equations based on operator learning, neural operators, lends itself to a highly scalable training strategy by parallelizing per-species operator maps. We illustrate the efficacy of our approach on six-component mixtures with randomly selected compositions and that it significantly outperforms the state-of-the-art pseudospectral integrators for field-theoretic simulations, especially as polymer lengths become long.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Physics-informed machine learning

Despite great progress in simulating multiphysics problems using the numerical discretization of partial differential equations (PDEs), one still cannot seamlessly incorporate noisy data into existing algorithms, mesh generation remains complex, and high-dimensional problems governed by parameterized PDEs cannot be tackled. Moreover, solving inverse problems with hidden physics is often prohibitively expensive and requires different formulations and elaborate computer codes. Machine learning has emerged as a promising alternative, but training deep neural networks requires big data, not always available for scientific problems. Instead, such networks can be trained from additional information obtained by enforcing the physical laws (for example, at random points in the continuous space-time domain). Such physics-informed learning integrates (noisy) data and mathematical models, and implements them through neural networks or other kernel-based regression networks. Moreover, it may be possible to design specialized network architectures that automatically satisfy some of the physical invariants for better accuracy, faster training and improved generalization. Furthermore, we review some of the prevailing trends in embedding physics into machine learning, present some of the current capabilities and limitations and discuss diverse applications of physics-informed learning both for forward and inverse problems, including discovering hidden physics and tackling high-dimensional problems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Geometry optimization speedup through a geodesic approach to internal coordinates

We present a new geodesic-based method for geometry optimization in a basis set of redundant internal coordinates. Overall, our method updates the molecular geometry by following the geodesic generated by a displacement vector on the internal coordinate manifold, which dramatically reduces the number of steps required to converge to a minimum. Our method can be implemented in any existing optimization code, requiring only implementation of derivatives of the Wilson B-matrix and the ability to numerically solve an ordinary differential equation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Implementation of a practical Markov chain Monte Carlo sampling algorithm in PyBioNetFit

Abstract Summary Bayesian inference in biological modeling commonly relies on Markov chain Monte Carlo (MCMC) sampling of a multidimensional and non-Gaussian posterior distribution that is not analytically tractable. Here, we present the implementation of a practical MCMC method in the open-source software package PyBioNetFit (PyBNF), which is designed to support parameterization of mathematical models for biological systems. The new MCMC method, am, incorporates an adaptive move proposal distribution. For warm starts, sampling can be initiated at a specified location in parameter space and with a multivariate Gaussian proposal distribution defined initially by a specified covariance matrix. Multiple chains can be generated in parallel using a computer cluster. We demonstrate that am can be used to successfully solve real-world Bayesian inference problems, including forecasting of new Coronavirus Disease 2019 case detection with Bayesian quantification of forecast uncertainty. Availability and implementation PyBNF version 1.1.9, the first stable release with am, is available at PyPI and can be installed using the pip package-management system on platforms that have a working installation of Python 3. PyBNF relies on libRoadRunner and BioNetGen for simulations (e.g. numerical integration of ordinary differential equations defined in SBML or BNGL files) and Dask.Distributed for task scheduling on Linux computer clusters. The Python source code can be freely downloaded/cloned from GitHub and used and modified under terms of the BSD-3 license (https://github.com/lanl/pybnf). Online documentation covering installation/usage is available (https://pybnf.readthedocs.io/en/latest/). A tutorial video is available on YouTube (https://www.youtube.com/watch?v=2aRqpqFOiS4&t=63s). Supplementary information Supplementary data are available at Bioinformatics online.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Operator evolution from the similarity renormalization group and the Magnus expansion

The Magnus expansion is an efficient alternative to solving similarity renormalization group (SRG) flow equations with high-order, memory-intensive ordinary differential equation solvers. The numerical simplifications it offers for operator evolution are particularly valuable for in-medium SRG calculations, though challenges remain for difficult problems involving intruder states. Here we test the Magnus approach in an analogous but more accessible situation, which is the free-space SRG treatment of the spurious bound states arising from a leading-order chiral effective field theory (EFT) potential with very high cutoffs. In this work, we show that the Magnus expansion passes these tests and then use the investigations as a springboard to address various aspects of operator evolution that have renewed relevance in the context of the scale and scheme dependence of nuclear processes. These aspects include SRG operator flow with band- versus block-diagonal generators, universality for chiral EFT Hamiltonians and associated operators with different regularization schemes, and the impact of factorization arising from scale separation. Implications for short-range correlations physics and the possibilities for reconciling high- and low-resolution treatments of nuclear structure and reactions are discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

PETSc Users Manual (Rev. 3.13)

This manual describes the use of PETSc for the numerical solution of partial differential equations and related problems on high-performance computers. The Portable, Extensible Toolkit for Scientific Computation (PETSc) is a suite of data structures and routines that provide the building blocks for the implementation of large-scale application codes on parallel (and serial) computers. PETSc uses the MPI standard for all message-passing communication. PETSc includes an expanding suite of parallel linear solvers, nonlinear solvers, and time integrators that may be used in application codes written in Fortran, C, C++, and Python. PETSc provides many of the mechanisms needed within parallel application codes, such as parallel matrix and vector assembly routines. The library is organized hierarchically, enabling users to employ the level of abstraction that is most appropriate for a particular problem. By using techniques of object-oriented programming, PETSc provides enormous flexibility for users. PETSc is a sophisticated set of software tools; as such, for some users it initially has a much steeper learning curve than a simple subroutine library. In particular, for individuals without some computer science background, experience programming in C, C++, python, or Fortran and experience using a debugger such as gdb or dbx, it may require a significant amount of time to take full advantage of the features that enable efficient software use. However, the power of the PETSc design and the algorithms it incorporates may make the efficient implementation of many application codes simpler than \rolling them" yourself.

97 MATHEMATICS AND COMPUTING↗