SEARCH · Engineering Papers

Results for “Numerical differentiation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Solving sparse finite element problems on neuromorphic hardware

The finite element method (FEM) is one of the most important and ubiquitous numerical methods for solving partial differential equations (PDEs) on computers for scientific and engineering discovery. Applying the FEM to larger and more detailed scientific models has driven advances in high-performance computing for decades. Here we demonstrate that scalable spiking neuromorphic hardware can directly implement the FEM by constructing a spiking neural network that solves the large, sparse, linear systems of equations at the core of the FEM. We show that for the Poisson equation, a fundamental PDE in science and engineering, our neural circuit achieves meaningful levels of numerical accuracy and close to ideal scaling on modern, inherently parallel and energy-efficient neuromorphic hardware, specifically Intel’s Loihi 2 neuromorphic platform. We illustrate extensions to irregular mesh geometries in both two and three dimensions as well as other PDEs such as linear elasticity. Our spiking neural network is constructed from a recurrent network model of the brain’s motor cortex and, in contrast to black-box deep artificial neural network-based methods for PDEs, directly translates the well-understood and trusted mathematics of the FEM to a natively spiking neuromorphic algorithm.

Applied mathematics↗

DOE OSTI2024

Two-loop master integrals for leading-color $$ pp\to t\overline{t}H $$ amplitudes with a light-quark loop

Abstract We compute the two-loop master integrals for leading-color QCD scattering amplitudes including a closed light-quark loop in$$ t\overline{t}H $$ t t ¯ H production at hadron colliders. Exploiting numerical evaluations in modular arithmetic, we construct a basis of master integrals satisfying a system of differential equations inϵ-factorized form. We present the analytic form of the differential equations in terms of a minimal set of differential one-forms. We explore properties of the function space of analytic solutions to the differential equations in terms of iterative integrals which can be exploited for studying the analytic form of related scattering amplitudes. Finally, we solve the differential equations using generalized series expansions to numerically evaluate the master integrals in physical phase space. As the first computation of a set of two-loop seven-scale master integrals, our results provide valuable input for analytic studies of scattering amplitudes in processes involving massive particles and a large number of kinematic scales.

Physics↗

DOE OSTI2021

Differentiable programming for online training of a neural artificial viscosity function within a staggered grid Lagrangian hydrodynamics scheme

Lagrangian methods to solve the inviscid Euler equations produce numerical oscillations near shock waves. A common approach to reducing these oscillations is to add artificial viscosity (AV) to the discrete equations. The AV term acts as a dissipative mechanism that attenuates oscillations by smearing the shock across a finite number of computational cells. However, AV introduces several control parameters that are not determined by the underlying physical model, and hence, in practice are tuned to the characteristics of a given problem. We seek to improve the standard quadratic-linear AV form by replacing it with a learned neural function that reduces oscillations relative to exact solutions of the Euler equations, resulting in a hybrid numerical-neural hydrodynamic solver. Because AV is an artificial construct that exists solely to improve the numerical properties of a hydrodynamic code, there is no offline ‘viscosity data’ against which a neural network can be trained before inserting into a numerical simulation, thus requiring online training. We achieve this via differentiable programming, i.e. end-to-end backpropagation or adjoint solution through both the neural and differential equation code, using automatic differentiation of the hybrid code in the Julia programming language to calculate the necessary loss function gradients. A novel offline pre-training step accelerates training by initializing the neural network to the default numerical AV scheme, which can be learned rapidly by space-filling sampling over the AV input space. We find that online training over early time steps of simulation is sufficient to learn a neural AV function that reduces numerical oscillations in long-term hydrodynamic shock simulations. These results offer an early proof-of-principle that online differentiable training of hybrid numerical schemes with novel neural network components can improve certain performance aspects existing in purely numerical schemes.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

On differentiable local bounds preserving stabilization for Euler equations

This work presents the design of nonlinear stabilization techniques for the finite element discretization of Euler equations in both steady and transient form. Implicit time integration is used in the case of the transient form. A differentiable local bounds preserving method has been developed, which combines a Rusanov artificial diffusion operator and a differentiable shock detector. Nonlinear stabilization schemes are usually stiff and highly nonlinear. This issue is mitigated by the differentiability properties of the proposed method. Moreover, in order to further improve the nonlinear convergence, we also propose a continuation method for a subset of the stabilization parameters. The resulting method has been successfully applied to steady and transient problems with complex shock patterns. Numerical experiments show that it is able to provide sharp and well resolved shocks. Furthermore, the importance of the differentiability is assessed by comparing the new scheme with its non-differentiable counterpart. Numerical experiments suggest that, for up to moderate nonlinear tolerances, the method exhibits improved robustness and nonlinear convergence behavior for steady problems. Additionally, in the case of transient problem, we also observe a reduction in the computational cost.

42 ENGINEERING↗

DOE OSTI2025

On-shell recursion and holomorphic HQET for heavy quark hadronic resonances

We develop a new theoretical framework for the treatment of heavy quark (HQ) resonances within heavy quark effective theory (HQET). This framework uses on-shell recursion techniques to express the resonant amplitude as a product of on-shell subamplitudes, which allows one to employ a form-factor representation of the hadronic matrix elements and to obtain an HQ expansion, but at the price of introducing complex momenta. We construct a generalized “holomorphic HQET” onto which such complex-momentum matrix elements can be matched, and we show that PT symmetry ensures the Isgur-Wise functions (and the perturbative corrections) become holomorphic functions of the complex recoil parameter with real coefficients. They are thus an analytic continuation of the standard HQET description. This framework admits a HQ hadron (strong decay) width expansion. At second order, we show it is compatible with data for the B12∗$$ {B}_{1(2)}^{\left(\ast \right)} $$ and D12∗$$ {D}_{1(2)}^{\left(\ast \right)} $$ HQ doublets. Taking the B¯→D1∗1−→Dπlν$$ \overline{B}\to \left({D}_1^{\ast}\left({1}^{-}\right)\to D\pi \right) l u $$ system as an example, we compute the holomorphic HQET expansion to first order, as well as the complex-momentum on-shell subamplitudes. A toy numerical study of the resulting differential rates demonstrates that this framework generates HQ resonance lineshapes with large tails, resembling those seen in data.

Manzari, Claudio Andrea↗

DOE OSTI2022

An energy-dependent electro-thermal response model of CUORE cryogenic calorimeter

The Cryogenic Underground Observatory for Rare Events (CUORE) is the most sensitive experiment searching for neutrinoless double-beta decay (0νββ) in 130 Te. CUORE uses a cryogenic array of 988 TeO 2 calorimeters operated at ~10 mK with a total mass of 741 kg. To further increase the sensitivity, the detector response must be well understood. Here, we present a non-linear thermal model for the CUORE experiment on a detector-by-detector basis. We have examined both equilibrium and dynamic electro-thermal models of detectors by numerically fitting non-linear differential equations to the detector data of a subset of CUORE channels which are well characterized and representative of all channels. Further, we demonstrate that the hot-electron effect and electric-field dependence of resistance in NTD-Ge thermistors alone are inadequate to describe our detectors' energy-dependent pulse shapes. We introduce an empirical second-order correction factor in the exponential temperature dependence of the thermistor, which produces excellent agreement with energy-dependent pulse shape data up to 6 MeV. We also present a noise analysis using the fitted thermal parameters and show that the intrinsic thermal noise is negligible compared to the observed noise for our detectors.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

On large-scale dynamos with stable stratification and the application to stellar radiative zones

Our understanding of large-scale magnetic fields in stellar radiative zones remains fragmented and incomplete. Such magnetic fields, which must be produced by some form of dynamo mechanism, are thought to dominate angular-momentum transport, making them crucial to stellar evolution. A major difficulty is the effect of stable stratification, which generally suppresses dynamo action. We explore the effects of stable stratification on mean-field dynamo theory with a particular focus on a non-helical large-scale dynamo (LSD) mechanism known as the magnetic shear-current effect. We find that the mechanism is robust to increasing stable stratification as long as the original requirements for its operation are met: a source of shear and non-helical magnetic fluctuations (e.g. from a small-scale dynamo). Both are plausibly sourced in the presence of differential rotation. Our idealized direct numerical simulations, supported by mean-field theory, demonstrate the generation of near equipartition large-scale toroidal fields. Additionally, a scan over magnetic Reynolds number shows no change in the growth or saturation of the LSD, providing good numerical evidence of a dynamo mechanism resilient to catastrophic quenching, which has been an issue for helical dynamos. These properties – the absence of catastrophic quenching and robustness to stable stratification – make the mechanism a plausible candidate for generating in situ large-scale magnetic fields in stellar radiative zones.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Application of Markov Chain Monte Carlo Methods for Uncertainty Quantification in Inverse Transport Problems

Determination of the components of a radioactive source/shield system using the system’s radiation signature is of great importance in homeland security, material safeguards, and waste management. Although significant progress has been made toward solving this inverse transport problem in recent years, work remains to be done to quantify the uncertainty in reconstructed results. In this article we apply two Markov chain Monte Carlo (MCMC) approaches, the delayed rejection adaptive metropolis (DRAM) and differential evolution adaptive metropolis (DREAM) methods, to solve inverse problems and quantify uncertainty. The DRAM method uses delayed rejection combined with global adaptation of the proposal covariance matrix. Furthermore, the DREAM method hybridizes MCMC sampling with the differential evolution (DE) algorithm. In numerical test cases, the DRAM and DREAM methods are shown to be superior to a first-order inverse Hessian approach for problems with noisy data and multiple unknown quantities, with DREAM converging to the posterior distribution more quickly than DRAM. The DREAM and DRAM results indicate that a full posterior distribution is required to quantify uncertainty in many inverse transport problems.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

DOE OSTI2022

Enabling Extended-Term Simulation of Power Systems with High PV Penetration. Final Report

This is the final Technical Report for DOE-SETO Project Award # DE-EE0036461. The goal of this project is to advance the understanding of the grid impact of high penetration of photovoltaic (PV) generation by developing novel numerical methods to solve the differential algebraic equations (DAEs) that define power systems. This will overcome the limitations of current software packages – namely that they only consider fast dynamics over brief time periods. The work presented in this final project report covers results over the entire period of the project. This includes results on model development, code development for the PST repository, datasets in the PST repository, algorithm development and results from variable time-step simulations, development and results from multirate simulations, and sensitivity analysis of key parameter in variable time-step methods. In addition, this report discusses project outreach activities to stakeholders, and a summary of project products. Also covered in this final report is the writing of two conference papers (one of which has already been accepted) and a journal paper. In addition, the updating of two inverter models (both grid forming and grid following) to be compatible with the latest version of PST software is discussed.

14 SOLAR ENERGY↗

DOE OSTI2024

Green's function methods for multiphysics simulations (Final Report)

Green's functions are important tools for analyzing mathematical properties of partial differential equations (PDEs), and for numerically solving PDEs, especially when equations for the same operator but with multiple right hand sides need to be solved simultaneously. This proposal aims at developing efficient and accurate numerical methods for computing Green's functions, which can be used to tackle a challenging question in multiphysics simulation of DOE-mission science problems: how to couple quantum physics with classical physics. The key mathematical difficulty is properly formulate a "boundary condition" for the region described by quantum physics, and conventional approaches often model such boundary conditions in an empirical way. The proposed Green's function methods use the Dirichlet-to-Neumann map to formulate a boundary condition that is non-empirical and can couple the quantum and classical regions in an in principle exact way. The key ingredient of the new methods is to construct the Dirichlet-to-Neumann map in an efficient, accurate and versatile manner. The new methods have provably low complexity and are ideally suited for massively parallel and emerging many-core computational systems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Soliton Generation in Negative Thermal Expansion Materials

Strain solitons have been observed statically in several 2D materials and dynamically in substrate materials using ultrafast laser pulses. The latter case relies on lattice relaxation in response to ultrafast heating in a light-absorbing transducer material, a process which is sensitive to the thermal expansion coefficient. Here we consider an unusual case where the sign of the thermal expansion coefficient is negative, a scenario which is experimentally feasible in light of rapid and recent advances in the discovery of negative thermal expansion materials. We present numerical solutions to a nonlinear differential equation which has been repeatedly demonstrated to quantitatively model experimental data and discuss the salient results using realistic parameters for material linear and nonlinear elasticity. The solitons that emerge from the initial value problem with negative and positive thermal expansion are qualitatively different in several ways. The new case of negative thermal expansion gives rise to a nearly-periodic soliton train with chirped profile and free of an isolated shock front. We suggest this unanticipated result may be realized experimentally and assess the potential for certain applications of this generic effect.

36 MATERIALS SCIENCE↗

DOE OSTI2026

ZEUS: An Efficient GPU Optimization Method Integrating PSO, BFGS, and Automatic Differentiation

We introduce a novel, efficient computational method, ZEUS, for numerical optimization, and provide an open-source implementation. It has four key ingredients: (1) particle swarm optimization (PSO), (2) the use of the Broyden-Fletcher-Goldfarb-Shanno (BFGS) method, (3) automatic differentiation (AD), and (4) GPUs. Our approach addresses the computational challenges inherent in high-dimensional, non-convex optimization problems. In the first phase of the algorithm, we get a potentially good set of starting points using PSO. Thereafter, we run BFGS independently in parallel from these starting points. BFGS is one of the best-performing algorithms for numerical optimization. However, it requires the gradient of the function being optimized. ZEUS integrates automatic differentiation into BFGS thus avoiding the need for the user to calculate derivatives explicitly. The use of GPUs allows ZEUS to speed up the calculations substantially. We carry out systematic studies to explore the trade-offs between the number of PSO iterations taken, starting points, and BFGS iteration depth. We show that a handful of iterations of PSO can improve global convergence when combined with BFGS. We also present performance studies using common test functions. The source code can be found at https://github.com/fnal-numerics/global-optimizer-gpu.

Soos, Dominik [Old Dominion U.]↗

DOE OSTI2020

Calculating fluctuations and self-correlations numerically for causal charge diffusion in relativistic heavy-ion collisions

Here, we study the propagation and diffusion of electric charge fluctuations in the Bjorken hydrodynamic model with both white and Catteneo noise using purely numerical methods. We show that a lattice of noise fluctuations is required to fully calculate the two-point correlators of charge. We introduce a numerical procedure to solve the stochastic differential equations that arise from the charge conservation equation on the lattice event by event. We explicitly identify the self-correlation term in the case of Catteneo noise and provide a physical interpretation. We provide a numerical recipe to remove this contribution from the full two-point correlators. Finally, we calculate the balance functions for charged hadrons. By limiting the speed of signal propagation, we observe the expected narrowing of the balance functions after removing the self-correlations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Magnetically Coupled Broadband Dual Magnetic Mass/Spring Vibrational Energy Harvesting Design

Self-powering sensors and networks are a reality. The ability to extract ambient energy from the surroundings to power electronic devices has a profound impact on the realization of smart adaptable sensor networks. In this study, a magnetically coupled dual spring and magnet design has been investigated to improve the efficiency and performance bandwidth of vibration energy harvesting (VEH) sensors. Using numerical models based on traditional systems of coupled ordinary differential equations (ODE), an optimized design was developed and compared to experimental measurements. Numerical and empirical results show good agreement. Results show improvement in the bandwidth over an equivalent linear system and corresponding improvement in output power conversion efficiency. The increased bandwidth allows improved conversion sensitivity and enhanced power harvesting capabilities. This operational bandwidth coincides with the expected input spectrum for in situ applications.

42 ENGINEERING↗

DOE OSTI2020

Numerical methods for nonlocal and fractional models

Partial differential equations (PDEs) are used with huge success to model phenomena across all scientific and engineering disciplines. However, across an equally wide swath, there exist situations in which PDEs fail to adequately model observed phenomena, or are not the best available model for that purpose. On the other hand, in many situations, nonlocal models that account for interaction occurring at a distance have been shown to more faithfully and effectively model observed phenomena that involve possible singularities and other anomalies. Here, we consider a generic nonlocal model, beginning with a short review of its definition, the properties of its solution, its mathematical analysis and of specific concrete examples. We then provide extensive discussions about numerical methods, including finite element, finite difference and spectral methods, for determining approximate solutions of the nonlocal models considered. In that discussion, we pay particular attention to a special class of nonlocal models that are the most widely studied in the literature, namely those involving fractional derivatives. The article ends with brief considerations of several modelling and algorithmic extensions, which serve to show the wide applicability of nonlocal modelling.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Numerical methods for nonlocal and fractional models

Partial differential equations (PDEs) are used, with huge success, to model phenomena arising across all scientific and engineering disciplines. However, across an equally wide swath, there exist situations in which PDE models fail to adequately model observed phenomena or are not the best available model for that purpose. On the other hand, in many situations, nonlocal models that account for interaction occurring at a distance have been shown to more faithfully and effectively model observed phenomena that involve possible singularities and other anomalies. In this article, we consider a generic nonlocal model, beginning with a short review of its definition, the properties of its solution, its mathematical analysis, and specific concrete examples. We then provide extensive discussions about numerical methods, including finite element, finite difference, and spectral methods, for determining approximate solutions of the nonlocal models considered. In that discussion, we pay particular attention to a special class of nonlocal models that are the most widely studied in the literature, namely those involving fractional derivatives. The article ends with brief considerations of several modeling and algorithmic extensions which serve to show the wide applicability of nonlocal modeling.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

A meshless stochastic method for Poisson–Nernst–Planck equations

A plethora of biological, physical, and chemical phenomena involve transport of charged particles (ions). Its continuum-scale description relies on the Poisson–Nernst–Planck (PNP) system, which encapsulates the conservation of mass and charge. The numerical solution of these coupled partial differential equations is challenging and suffers from both the curse of dimensionality and difficulty in efficiently parallelizing. We present a novel particle-based framework to solve the full PNP system by simulating a drift–diffusion process with time- and space-varying drift. We leverage Green’s functions, kernel-independent fast multipole methods, and kernel density estimation to solve the PNP system in a meshless manner, capable of handling discontinuous initial states. The method is embarrassingly parallel, and the computational cost scales linearly with the number of particles and dimension. We use a series of numerical experiments to demonstrate both the method’s convergence with respect to the number of particles and computational cost vis-à-vis a traditional partial differential equation solver.

Chemistry↗

DOE OSTI2024

Computationally efficient and error aware surrogate construction for numerical solutions of subsurface flow through porous media

Limiting the injection rate to restrict the pressure below a threshold at a critical location can be an important goal of simulations that model the subsurface pressure between injection and extraction wells. The pressure is approximated by the solution of Darcy’s partial differential equation for a given permeability field. The subsurface permeability is modeled as a random field since it is known only up to statistical properties. This induces uncertainty in the computed pressure. Solving the partial differential equation for an ensemble of random permeability simulations enables estimating a probability distribution for the pressure at the critical location. These simulations are computationally expensive, and practitioners often need rapid online guidance for real-time pressure management. An ensemble of numerical partial differential equation solutions is used to construct a Gaussian process regression model that can quickly predict the pressure at the critical location as a function of the extraction rate and permeability realization. The Gaussian process surrogate analyzes the ensemble of numerical pressure solutions at the critical location as noisy observations of the true pressure solution, enabling robust inference using the conditional Gaussian process distribution. Our first novel contribution is to identify a sampling methodology for the random environment and matching kernel technology for which fitting the Gaussian process regression model scales as O ( n log n ) instead of the typical O ( n 3 ) rate in the number of samples n used to fit the surrogate. The surrogate model allows almost instantaneous predictions for the pressure at the critical location as a function of the extraction rate and permeability realization. Our second contribution is a novel algorithm to calibrate the uncertainty in the surrogate model to the discrepancy between the true pressure solution of Darcy’s equation and the numerical solution. Finally, although our method is derived for building a surrogate for the solution of Darcy’s equation with a random permeability field, the framework broadly applies to solutions of other partial differential equations with random coefficients.

54 ENVIRONMENTAL SCIENCES↗