Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “partial differential equation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Scientific Discovery with Physics-Informed System Identification (Abbreviated Report)

My fellowship research focused on making physics-based simulations faster and more useful through machine learning. Many problems in science and engineering are governed by partial differential equations, but high-fidelity simulations are often too expensive to run repeatedly. I worked on improving Latent Space Dynamics Identification (LaSDI), a reduced-order modeling framework that compresses large simulation data sets into a smaller representation and then learns how that representation evolves over time. The motivation was to develop reduced models that remain accurate for more challenging systems, especially when predictions must remain reliable over long time intervals or when the underlying dynamics are more complicated than standard methods can easily handle. I also contributed to related work on Quandary, a high-performance software effort for simulation and control of open quantum systems, before focusing primarily on Latent Space Dynamics Identification methods. The main outcomes of the fellowship were two new algorithms (both of which were published), Rollout-LaSDI and Higher-Order LaSDI, together with supporting work on multi-stage Latent Space Dynamics Identification. Rollout-LaSDI improved long-term prediction by training the model to stay accurate over extended time horizons, and Higher-Order LaSDI broadened the method so it could model systems with higher-order time dynamics. My contributions to multistage Latent Space Dynamics Identification also helped show that its later training stages could be simplified without losing effectiveness, and that this behavior held across different model architectures and training strategies. Taken together, these advances improved the accuracy, flexibility, and practical value of reduced-order modeling tools for computational science.

97 MATHEMATICS AND COMPUTING↗

Towards a Verifiable Domain-Specific Language for Hardware-Accelerated Stencils

Defining a domain-specific language (DSL) that supports vector-calculus abstractions eases the porting of partial differential equation (PDE) solvers to specialized architectures. Sufficiently high-level abstractions empower users to express universal laws with sufficient generality that the laws must always hold true within their domain of validity. A broad class of PDE solvers employs stencil-based algorithms, the target domain of Berkeley Lab's stencil accelerator chip co-design project. First released as open-source in January 2026, the Formal software framework lays a foundation for defining an embedded DSL based on composable operators that implement mimetic numerical methods -- stencil algorithms that guarantee satisfaction of discrete versions of important vector calculus theorems. The Formal DSL will be the frontend to a new class of stencil-PDE accelerators developed jointly by LBNL, UHCL, and UC Berkeley through the DOE Competitive Portfolios for Computer Science Project. This offers the potential of an order of magnitude acceleration for this important category of computational methods to serve the DOE mission. Future work on the Formal DSL will facilitate software verification via type-safe templates that enable problem-specific correctness proofs relying upon generic function theory and carefully crafted unit tests.

Rouson, Damian↗

Collaborative Research: Enabling multi-scale studies of magnetic reconnection with interpretable data-driven models

The development of accurate reduced descriptions and improved closures for magnetic reconnection is an important and a long‐standing challenge in plasma physics. The four‐fluid approach, and associated closures, that were investigated have the potential to improve the accuracy of plasma fluid models, capturing physical effects which would otherwise require a kinetic description. If successful, this approach could have an important impact for the modeling of laboratory and space plasmas. The major goals of this project were to develop new machine learning (ML) tools based on sparse and symbolic regression techniques, and to extract interpretable and generalizable reduced models (e.g., in the form of partial differential equations - PDEs) from data generated by first principles plasma simulations. Preserving interpretability of such data‐driven models is key to addressing the long‐standing theoretical and numerical challenges. Prior proof‐of‐principle studies have demonstrated the enormous potential of this approach, by recovering the well‐established hierarchy of plasma equations (from Vlasov to MHD) from data produced by particle‐in‐cell (PIC) simulations. Our goal in this project was to extend and apply these new tools to construct better kinetic closures for magnetic reconnection; to derive better models of particle injection and acceleration by this fundamental plasma process; and to use this understanding to accelerate the development of multi‐scale plasma algorithms. While our immediate focus was on the problem of magnetic reconnection, the tools that were will developed are general and applicable to other areas of plasma physics, and more broadly to many‐body phenomena. We anticipate that the development of these multi‐scale models will have a significant impact across different areas of plasma science, from fusion to space and astrophysical plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Explicit block encodings of boundary value problems for many-body elliptic operators

Simulation of physical systems is one of the most promising use cases of future digital quantum computers. In this work we systematically analyze the quantum circuit complexities of block encoding the discretized elliptic operators that arise extensively in numerical simulations for partial differential equations, including high-dimensional instances for many-body simulations. When restricted to rectangular domains with separable boundary conditions, we provide explicit circuits to block encode the many-body Laplacian with separable periodic, Dirichlet, Neumann, and Robin boundary conditions, using standard discretization techniques from low-order finite difference methods. To obtain high-precision, we introduce a scheme based on periodic extensions to solve Dirichlet and Neumann boundary value problems using a high-order finite difference method, with only a constant increase in total circuit depth and subnormalization factor. We then present a scheme to implement block encodings of differential operators acting on more arbitrary domains, inspired by Cartesian immersed boundary methods. We then block encode the many-body convective operator, which describes interacting particles experiencing a force generated by a pair-wise potential given as an inverse power law of the interparticle distance. This work provides concrete recipes that are readily translated into quantum circuits, with depth logarithmic in the total Hilbert space dimension, that block encode operators arising broadly in applications involving the quantum simulation of quantum and classical many-body mechanics.

Kharazi, Tyler [University of California, Berkeley↗

A Mathematical Model of the Dynamics of Cytokine Expression and Human Immune Cell Activation in Response to the Pathogen Staphylococcus aureus

Cell-based mathematical models have previously been developed to simulate the immune system in response to pathogens. Mathematical modeling papers which study the human immune response to pathogens have predicted concentrations of a variety of cells, including activated and resting macrophages, plasma cells, and antibodies. This study aims to create a comprehensive mathematical model that can predict cytokine levels in response to a gram-positive bacterium, S. aureus by coupling previous models. To accomplish this, the cytokines Tumor Necrosis Factor Alpha (TNF-α), Interleukin 6 (IL-6), Interleukin 8 (IL-8), and Interleukin 10 (IL-10) are included to quantify the relationship between cytokine release from macrophages and the concentration of the pathogen, S. aureus, ex vivo. Partial differential equations (PDEs) are used to model cellular response and ordinary differential equations (ODEs) are used to model cytokine response, and interactions between both components produce a more robust and more complete systems-level understanding of immune activation. In the coupled cellular and cytokine model outlined in this paper, a low concentration of S. aureus is used to stimulate the measured cellular response and cytokine expression. Results show that our cellular activation and cytokine expression model characterizing septic conditions can predict ex vivo mechanisms in response to gram-negative and gram-positive bacteria. Our simulations provide new insights into how the human immune system responds to infections from different pathogens. Novel applications of these insights help in the development of more powerful tools and protocols in infection biology.

60 APPLIED LIFE SCIENCES↗

Bayes goes fast: Uncertainty quantification for a covariant energy density functional emulated by the reduced basis method

A covariant energy density functional is calibrated using a principled Bayesian statistical framework informed by experimental binding energies and charge radii of several magic and semi-magic nuclei. The Bayesian sampling required for the calibration is enabled by the emulation of the high-fidelity model through the implementation of a reduced basis method (RBM)—a set of dimensionality reduction techniques that can speed up demanding calculations involving partial differential equations by several orders of magnitude. The RBM emulator we build—using only 100 evaluations of the high-fidelity model—is able to accurately reproduce the model calculations in tens of milliseconds on a personal computer, an increase in speed of nearly a factor of 3,300 when compared to the original solver. Besides the analysis of the posterior distribution of parameters, we present model calculations for masses and radii with properly estimated uncertainties. We also analyze the model correlation between the slope of the symmetry energy L and the neutron skin of 48 Ca and 208 Pb. The straightforward implementation and outstanding performance of the RBM makes it an ideal tool for assisting the nuclear theory community in providing reliable estimates with properly quantified uncertainties of physical observables. Such uncertainty quantification tools will become essential given the expected abundance of data from the recently inaugurated and future experimental and observational facilities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NSGA-PINN: A Multi-Objective Optimization Method for Physics-Informed Neural Network Training

This paper presents NSGA-PINN, a multi-objective optimization framework for the effective training of physics-informed neural networks (PINNs). The proposed framework uses the non-dominated sorting genetic algorithm (NSGA-II) to enable traditional stochastic gradient optimization algorithms (e.g., ADAM) to escape local minima effectively. Additionally, the NSGA-II algorithm enables satisfying the initial and boundary conditions encoded into the loss function during physics-informed training precisely. We demonstrate the effectiveness of our framework by applying NSGA-PINN to several ordinary and partial differential equation problems. In particular, we show that the proposed framework can handle challenging inverse problems with noisy data.

Lu, Binghang (ORCID:0009000160016632)↗

Integration of Electromagnetic Geophysics Forward Simulation in Coupled Flow and Geomechanics for Monitoring a Gas Hydrate Deposit Located in the Ulleung Basin, East Sea, Korea

We investigate the feasibility of electromagnetic (EM) geophysics methods to detect the dissociation of gas hydrate specifically from a gas hydrate deposit located in the Ulleung Basin, East Sea, Korea via an integrated flow-geomechanics-EM geophysics simulation. To this end, coupled flow and geomechanics simulation is first performed with the multiple porosity model employed, where a mixed formulation with the finite volume (FV) and finite element (FE) methods are taken for the flow and geomechanics, respectively. From the saturation and porosity fields obtained from the coupled flow and geomechanics, the electrical conductivity model is established for the EM simulation. Solving the partial differential equation of electrical diffusion which is linearized using the 3D finite element method (FEM), the EM fields are then computed. For numerical experiments, particularly two approaches in the configuration for the EM methods are compared in this contribution: the surface-to-surface and the surface-to-borehole methods. When the surface-to-surface EM method is employed, the EM is found to be less sensitive, implying low detectability. Especially for the short term of production, the low detectability is attributed to the similarity of electrical resistivity between the dissociated gas (CH4) and hydrate as well as the specific dissociation pattern within the intercalated composites of the field. On the other hand, when the surface-to-borehole EM method is employed, its sensitivity to capture the produced gas flow is improved, confirming its detectability in monitoring gas flow. Hence, the EM geophysics simulation integrated with coupled flow and geomechanics can be a potential tool for monitoring gas hydrate deposits.

depressurization↗

Development of a Single-Phase, Transient, Subchannel Code, within the MOOSE Multi-Physics Computational Framework

Subchannel codes have been widely used for thermal-hydraulics analyses in nuclear reactors. This paper details the development of a novel subchannel code within the Idaho National Laboratory’s (INL) Multi-physics Object Oriented Simulation Environment (MOOSE). MOOSE is a parallel computational framework targeted at the solution of systems of coupled, nonlinear partial differential equations, that often arise in the simulation of nuclear processes. As such, it includes codes/modules able to solve the multiple linear and nonlinear physics that describe a nuclear reactor, under normal operation conditions or accidents. This includes thermal-hydraulics, fuel performance, and neutronics codes, between others. A MOOSE-based subchannel code is a new addition to the fleet of INL-developed codes, based on the MOOSE framework. In this work, we present the derivation of the subchannel equations for a single-phase fluid, we proceed with the description of the algorithm that is used to solve these equations and describe how this algorithm was implemented within MOOSE. We also present how this code can be coupled to the BISON fuel performance code. Next, we verify the friction model and the turbulent mixing model. We calibrate the turbulent modeling parameters for momentum mixing and enthalpy mixing, C T , β. We validate the code using experimental results and last demonstrate the coupling capabilities using a simple example.

42 ENGINEERING↗

Aircraft Icing Severity Evaluation

Aircraft icing refers to the ice buildup on the surface of an aircraft flying in icing conditions. The ice accretion on the aircraft alters the original aerodynamic configuration and degrades the aerodynamic performances and may lead to unsafe flight conditions. Evaluating the flow structure, icing mechanism and consequences is of great importance to the development of an anti/deicing technique. Studies have shown computational fluid dynamics (CFD) and machine learning (ML) to be effective in predicting the ice shape and icing severity under different flight conditions. CFD solves a set of partial differential equations to obtain the air flow fields, water droplets trajectories and ice shape. ML is a branch of artificial intelligence and, based on the data, the self-improved computer algorithms can be effective in finding the nonlinear mapping relationship between the input flight conditions and the output aircraft icing severity features.

Li, Sibo (ORCID:000000021705844X)↗

Vibration Analysis of a Unimorph Nanobeam with a Dielectric Layer of Both Flexoelectricity and Piezoelectricity

In this study, for the first time, free and forced vibrational responses of a unimorph nanobeam consisting of a functionally graded base, along with a dielectric layer of both piezoelectricity and flexoelectricity, is investigated based on paradox-free local/nonlocal elasticity. The formulation and boundary conditions are attained by utilizing the energy method Hamilton’s principle. In order to set a comparison, the formulation of a model in the framework of differential nonlocal is first presented. An effective implementation of the generalized differential quadrature method (GDQM) is then utilized to solve higher-order partial differential equations. This method can be utilized to solve the complex equations whose analytic results are quite difficult to obtain. Lastly, the impact of various parameters is studied to characterize the vibrational behavior of the system. Additionally, the major impact of flexoelectricity compared to piezoelectricity on a small scale is exhibited. The results show that small-scale flexoelectricity, rather than piezoelectricity, is dominant in electromechanical coupling. One of the results that can be mentioned is that the beams with higher nonlocality have the higher voltage and displacement under the same excitation amplitude. The findings can be helpful for further theoretical as well as experimental studies in which dielectric material is used in smart structures.

36 MATERIALS SCIENCE↗

Challenging the Curse of Dimensionality in Multidimensional Numerical Integration by Using a Low-Rank Tensor-Train Format

Numerical integration is a basic step in the implementation of more complex numerical algorithms suitable, for example, to solve ordinary and partial differential equations. The straightforward extension of a one-dimensional integration rule to a multidimensional grid by the tensor product of the spatial directions is deemed to be practically infeasible beyond a relatively small number of dimensions, e.g., three or four. In fact, the computational burden in terms of storage and floating point operations scales exponentially with the number of dimensions. This phenomenon is known as the curse of dimensionality and motivated the development of alternative methods such as the Monte Carlo method. The tensor product approach can be very effective for high-dimensional numerical integration if we can resort to an accurate low-rank tensor-train representation of the integrand function. In this work, we discuss this approach and present numerical evidence showing that it is very competitive with the Monte Carlo method in terms of accuracy and computational costs up to several hundredths of dimensions if the integrand function is regular enough and a sufficiently accurate low-rank approximation is available.

97 MATHEMATICS AND COMPUTING↗

Super-localisation of a point-like emitter in a resonant environment: Correction of the mirage effect

In this paper, we show that it is possible to overcome one of the fundamental limitations of super-resolution microscopy: the necessity to be in an optically homogeneous environment. Using recent modal approximation results from [ 10 , 7 ], we show, as a proof of concept, that it is possible to recover the position of a single point-like emitter in a known resonant environment from far-field measurements, with a precision two orders of magnitude below the classical Rayleigh limit. The procedure does not involve solving any partial differential equation, is computationally light (optimisation in \begin{document}$ \mathbb{R}^d $\end{document} with \begin{document}$ d $\end{document} of the order of \begin{document}$ 10 $\end{document} ) and is therefore suited for the recovery of a very large number of single emitters.

Mathematics↗

On the Convergence of Physics Informed Neural Networks for Linear Second-Order Elliptic and Parabolic Type PDEs

Physics informed neural networks (PINNs) are deep learning based techniques for solving partial differential equations (PDEs) encountered in computational science and engineering. Guided by data and physical laws, PINNs find a neural network that approximates the solution to a system of PDEs. Such a neural network is obtained by minimizing a loss function in which any prior knowledge of PDEs and data are encoded. Despite its remarkable empirical success in one, two or three dimensional problems, there is little theoretical justification for PINNs. As the number of data grows, PINNs generate a sequence of minimizers which correspond to a sequence of neural networks. We want to answer the question: Does the sequence of minimizers converge to the solution to the PDE? We consider two classes of PDEs: linear second-order elliptic and parabolic. By adapting the Schauder approach and the maximum principle, we show that the sequence of minimizers strongly converges to the PDE solution in C 0 . Furthermore, we show that if each minimizer satisfies the initial/boundary conditions, the convergence mode becomes H 1 . Computational examples are provided to illustrate our theoretical findings. To the best of our knowledge, this is the first theoretical work that shows the consistency of PINNs.

97 MATHEMATICS AND COMPUTING↗

A Comprehensive Review of Latent Space Dynamics Identification Algorithms for Intrusive and Non-Intrusive Reduced-Order-Modeling

Numerical solvers of partial differential equations (PDEs) have been widely employed for simulating physical systems. However, the computational cost remains a major bottleneck in various scientific and engineering applications, which has motivated the development of reduced-order models (ROMs). Recently, machine-learning-based ROMs have gained significant popularity and are promising for addressing some limitations of traditional ROM methods, especially for advection dominated systems. In this chapter, we focus on a particular framework known as Latent Space Dynamics Identification (LaSDI), which transforms the high-fidelity data, governed by a PDE, to simpler and low-dimensional latent-space data, governed by ordinary differential equations (ODEs). These ODEs can be learned and subsequently interpolated to make ROM predictions. Each building block of LaSDI can be easily modulated depending on the application, which makes the LaSDI framework highly flexible. In particular, we present strategies to enforce the laws of thermodynamics into LaSDI models (tLaSDI), enhance robustness in the presence of noise through the weak form (WLaSDI), select high-fidelity training data efficiently through active learning (gLaSDI, GPLaSDI), and quantify the ROM prediction uncertainty through Gaussian processes (GPLaSDI). We demonstrate the performance of different LaSDI approaches on Burgers equation, a non-linear heat conduction problem, and a plasma physics problem, showing that LaSDI algorithms can achieve relative errors of less than a few percent and up to thousands of times speed-ups.

Computational Engineering, Finance, and Science (c↗

Tree hydrodynamic modelling of the soil–plant–atmosphere continuum using FETCH3

Modelling the water transport along the soil–plant–atmosphere continuum is fundamental to estimating and predicting transpiration fluxes. A Finite-difference Ecosystem-scale Tree Crown Hydrodynamics model (FETCH3) for the water fluxes across the soil–plant–atmosphere continuum is presented here. The model combines the water transport pathways into one vertical dimension, and assumes that the water flow through the soil, roots, and above-ground xylem can be approximated as flow in porous media. This results in a system of three partial differential equations, resembling the Richardson–Richards equation, describing the transport of water through the plant system and with additional terms representing sinks and sources for the transfer of water from the soil to the roots and from the leaves to the atmosphere. The numerical scheme, developed in Python 3, was tested against exact analytical solutions for steady state and transient conditions using simplified but realistic model parameterizations. The model was also used to simulate a previously published case study, where observed transpiration rates were available, to evaluate model performance. With the same model setup as the published case study, FETCH3 results were in agreement with observations. Through a rigorous coupling of soil, root xylem, and stem xylem, FETCH3 can account for variable water capacitance, while conserving mass and the continuity of the water potential between these three layers. FETCH3 provides a ready-to-use open access numerical model for the simulation of water fluxes across the soil–plant–atmosphere continuum.

54 ENVIRONMENTAL SCIENCES↗

Multifidelity Monte Carlo estimation for efficient uncertainty quantification in climate-related modeling

Abstract. Uncertainties in an output of interest that depends on the solution of a complex system (e.g., of partial differential equations with random inputs) are often, if not nearly ubiquitously, determined in practice using Monte Carlo (MC) estimation. While simple to implement, MC estimation fails to provide reliable information about statistical quantities (such as the expected value of the output of interest) in application settings such as climate modeling, for which obtaining a single realization of the output of interest is a costly endeavor. Specifically, the dilemma encountered is that many samples of the output of interest have to be collected in order to obtain an MC estimator that has sufficient accuracy – so many, in fact, that the available computational budget is not large enough to effect the number of samples needed. To circumvent this dilemma, we consider using multifidelity Monte Carlo (MFMC) estimation which leverages the use of less costly and less accurate surrogate models (such as coarser grids, reduced-order models, simplified physics, and/or interpolants) to achieve, for the same computational budget, higher accuracy compared to that obtained by an MC estimator – or, looking at it another way, an MFMC estimator obtains the same accuracy as the MC estimator at lower computational cost. The key to the efficacy of MFMC estimation is the fact that most of the required computational budget is loaded onto the less costly surrogate models so that very few samples are taken of the more expensive model of interest. We first provide a more detailed discussion about the need to consider an alternative to MC estimation for uncertainty quantification. Subsequently, we present a review, in an abstract setting, of the MFMC approach along with its application to three climate-related benchmark problems as a proof-of-concept exercise.

54 ENVIRONMENTAL SCIENCES↗

The contribution of Humboldt Glacier, northern Greenland, to sea-level rise through 2100 constrained by recent observations of speedup and retreat

Abstract. Humboldt Glacier, northern Greenland, has retreated and accelerated through the 21st century, raising concerns that it could be a significant contributor to future sea-level rise. We use a data-constrained ensemble of three-dimensional higher-order ice sheet model simulations to estimate the likely range of sea-level rise from the continued retreat of Humboldt Glacier. We first solve for basal traction using observed ice thickness, bed topography, and ice surface velocity from the year 2007 in a PDE-constrained (partial differential equation) optimization. Next, we impose calving rates to match mean observed retreat rates from winter 2007–2008 to winter 2017–2018 in a transient calibration of the exponent in the power-law basal friction relationship. We find that power-law exponents in the range of 1/7–1/5 – rather than the commonly used 1/3–1 – are necessary to reproduce the observed speedup over this period. We then tune an iceberg calving parameterization based on the von Mises stress yield criterion in another transient-calibration step to approximate both observed ice velocities and terminus position in 2017–2018. Finally, we use the range of basal friction relationship exponents and calving parameter values to generate the ensemble of model simulations from 2007–2100 under three climate forcing scenarios from CMIP5 (two RCP8.5 forcings, Representative Concentration Pathway) and CMIP6 (one SSP5-8.5 forcing, Shared Socioeconomic Pathway). Our simulations predict 5.2–8.7 mm of sea-level rise from Humboldt Glacier, significantly higher than a previous estimate (∼ 3.5 mm) and equivalent to a substantial fraction of the 40–140 mm predicted by ISMIP6 from the whole Greenland Ice Sheet. Our larger future sea-level rise prediction results from the transient calibration of our basal friction law to match the observed speedup, which requires a semi-plastic bed rheology. In many simulations, our model predicts the growth of a sizable ice shelf in the middle of the 21st century. Thus, atmospheric warming could lead to more retreat than predicted here if increased surface melt promotes hydrofracture of the ice shelf. Our data-constrained simulations of Humboldt Glacier underscore the sensitivity of model predictions of Greenland outlet glacier response to warming to choices of basal shear stress and iceberg calving parameterizations. Further, transient calibration of these parameterizations, which has not typically been performed, is necessary to reproduce observed behavior. Current estimates of future sea-level rise from the Greenland Ice Sheet could, therefore, contain significant biases.

54 ENVIRONMENTAL SCIENCES↗