Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Differential equations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Probability of Initiation in Neutron Transport

We discuss the numerical solution of the nonlinear integro-differential equation for the probability of a divergent neutron chain in a stationary system (i.e., the probability of initiation (POI)). We follow the development described in Bell’s classic paper on the stochastic theory of neutron transport. As noted by Bell, the linearized form of this equation resembles the linear adjoint neutron transport equation. A matrix formalism for the discretized steady state (or forward) neutron equation in slab geometry is first developed and is then used to derive the discrete adjoint equation. A main advantage of this discrete development is that the resulting discrete adjoint equation does not depend upon how the multigroup cross sections for the forward problem are obtained. That is, we derive the discrete adjoint directly from the discrete forward equations rather than discretizing directly the adjoint equation. This also guarantees that the discrete adjoint operator is consistent with the inner product used to define the adjoint operator. We discuss three approaches for the numerical solution of the POI equations, and present numerical results on several test problems. The three solution methods are a simple fixed-point iteration, a second approach that is akin to a nonlinear Power iteration, and a third approach which uses a Newton-Krylov nonlinear solver. We also give sufficient conditions to guarantee the existence and uniqueness of nontrivial solutions to our discrete POI equations when the discrete system is supercritical, and that only the trivial solution exists when the discrete system is subcritical. Our approach is modeled after the analysis presented for the continuous POI equations by Mokhtar-Kharroubi and Jarmouni-Idrissi, and by Pazy and Rabinowitz.

42 ENGINEERING↗

Where did the tumor start? An inverse solver with sparse localization for tumor growth models

In this work, we present a numerical scheme for solving an inverse problem for parameter estimation in tumor growth models for glioblastomas, a form of aggressive primary brain tumor. The growth model is a reaction–diffusion partial differential equation (PDE) for the tumor concentration. We use a PDE-constrained optimization formulation for the inverse problem. The unknown parameters are the reaction coefficient (proliferation), the diffusion coefficient (infiltration), and the initial condition field for the tumor PDE. Segmentation of magnetic resonance imaging (MRI) scans drive the inverse problem where segmented tumor regions serve as partial observations of the tumor concentration. Like most cases in clinical practice, we use data from a single time snapshot. Moreover, the precise time relative to the initiation of the tumor is unknown, which poses an additional difficulty for inversion. We perform a frozen-coefficient spectral analysis and show that the inverse problem is severely ill-posed. We introduce a biophysically motivated regularization on the structure and magnitude of the tumor initial condition. In particular, we assume that the tumor starts at a few locations (enforced with a sparsity constraint on the initial condition of the tumor) and that the initial condition magnitude in the maximum norm is equal to one. We solve the resulting optimization problem using an inexact quasi-Newton method combined with a compressive sampling algorithm for the sparsity constraint. Our implementation uses PETSc and AccFFT libraries. We conduct numerical experiments on synthetic and clinical images to highlight the improved performance of our solver over a previously existing solver that uses standard two-norm regularization for the calibration parameters. The existing solver is unable to localize the initial condition. Our new solver can localize the initial condition and recover infiltration and proliferation. In clinical datasets (for which the ground truth is unknown), our solver results in qualitatively different solutions compared to the two-norm regularized solver.

97 MATHEMATICS AND COMPUTING↗

Hierarchical off-diagonal low-rank approximation of Hessians in inverse problems, with application to ice sheet model initialization

Obtaining lightweight and accurate approximations of discretized objective functional Hessians in inverse problems governed by partial differential equations (PDEs) is essential to make both deterministic and Bayesian statistical large-scale inverse problems computationally tractable. The cubic computational complexity of dense linear algebraic tasks, such as Cholesky factorization, that provide a means to sample Gaussian distributions and determine solutions of Newton linear systems is a computational bottleneck at large-scale. These tasks can be reduced to log-linear complexity by utilizing hierarchical off-diagonal low-rank (HODLR) matrix approximations. In this work, we show that a class of Hessians that arise from inverse problems governed by PDEs are well approximated by the HODLR matrix format. In particular, we study inverse problems governed by PDEs that model the instantaneous viscous flow of ice sheets. In these problems, we seek a spatially distributed basal sliding parameter field such that the flow predicted by the ice sheet model is consistent with ice sheet surface velocity observations. Here, we demonstrate the use of HODLR Hessian approximation to efficiently sample the Laplace approximation of the posterior distribution with covariance further approximated by HODLR matrix compression. Computational studies are performed which illustrate ice sheet problem regimes for which the Gauss–Newton data-misfit Hessian is more efficiently approximated by the HODLR matrix format than the low-rank (LR) format. We then demonstrate that HODLR approximations can be favorable, when compared to global LR approximations, for large-scale problems by studying the data-misfit Hessian associated with inverse problems governed by the first-order Stokes flow model on the Humboldt glacier and Greenland ice sheet.

97 MATHEMATICS AND COMPUTING↗

An autoencoder compression approach for accelerating large-scale inverse problems

Abstract Partial differential equation (PDE)-constrained inverse problems are some of the most challenging and computationally demanding problems in computational science today. Fine meshes required to accurately compute the PDE solution introduce an enormous number of parameters and require large-scale computing resources such as more processors and more memory to solve such systems in a reasonable time. For inverse problems constrained by time-dependent PDEs, the adjoint method often employed to compute gradients and higher order derivatives efficiently requires solving a time-reversed, so-called adjoint PDE that depends on the forward PDE solution at each timestep. This necessitates the storage of a high-dimensional forward solution vector at every timestep. Such a procedure quickly exhausts the available memory resources. Several approaches that trade additional computation for reduced memory footprint have been proposed to mitigate the memory bottleneck, including checkpointing and compression strategies. In this work, we propose a close-to-ideal scalable compression approach using autoencoders to eliminate the need for checkpointing and substantial memory storage, thereby reducing the time-to-solution and memory requirements. We compare our approach with checkpointing and an off-the-shelf compression approach on an earth-scale ill-posed seismic inverse problem. The results verify the expected close-to-ideal speedup for the gradient and Hessian-vector product using the proposed autoencoder compression approach. To highlight the usefulness of the proposed approach, we combine the autoencoder compression with the data-informed active subspace (DIAS) prior showing how the DIAS method can be affordably extended to large-scale problems without the need for checkpointing and large memory.

Mathematics↗

Taylor approximation variance reduction for approximation errors in PDE-constrained Bayesian inverse problems

In numerous applications, surrogate models are used as a replacement for accurate parameter-to-observable mappings when solving large-scale inverse problems governed by partial differential equations (PDEs). The surrogate model may be a computationally cheaper alternative to the accurate parameter-to-observable mappings and/or may ignore additional unknowns or sources of uncertainty. The Bayesian approximation error (BAE) approach provides a means to account for the induced uncertainties and approximation errors, i.e. the errors between the accurate parameter-to-observable mapping and the surrogate. The statistics of these errors are, however, in general unknown a priori, and are thus calculated using Monte Carlo sampling. Although the sampling is typically carried out offline, i.e. before considering the data, the process can still represent a computational bottleneck. In this work, we develop a scalable computational approach for reducing the costs associated with the sampling stage of the BAE approach. Specifically, we consider the Taylor expansion of the accurate and surrogate forward models with respect to the uncertain parameter fields either as a control variate for variance reduction or as a means to directly and efficiently approximate the mean and covariance of the approximation errors. We propose efficient methods for evaluating the expressions for the mean and covariance of the Taylor approximations based on linear(-ized) PDE solves. Furthermore, the proposed approach is independent of the dimension of the uncertain parameter, depending instead on the intrinsic dimension of the data, ensuring scalability to high-dimensional problems. The potential benefits of the proposed approach are demonstrated for two high-dimensional inverse problems governed by PDE examples, namely for the estimation of a distributed Robin boundary coefficient in a linear diffusion problem, and for a coefficient estimation problem governed by a nonlinear diffusion problem.

Bayesian approximation error↗

Instability and turbulent relaxation in a stochastic magnetic field

An analysis of instability dynamics in a stochastic magnetic field is presented for the tractable case of the resistive interchange. Externally prescribed static magnetic perturbations convert the eigenmode problem to a stochastic differential equation, which is solved by the method of averaging. The dynamics are rendered multi-scale, due to the size disparity between the test mode and magnetic perturbations. Maintaining quasi-neutrality at all orders requires that small-scale convective cell turbulence be driven by disparate scale interaction. Here, the cells in turn produce turbulent mixing of vorticity and pressure, which is calculated by fluctuation-dissipation type analyses, and are relevant to pump-out phenomena. The development of correlation between the ambient magnetic perturbations and the cells is demonstrated, showing that turbulence will 'lock on' to ambient stochasticity. Magnetic perturbations are shown to produce a magnetic braking effect on vorticity generation at large scale. Detailed testable predictions are presented. The relations of these findings to the results of available simulations and recent experiments are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A transient site balance model for atomic layer etching

We present a transient site balance model of plasma-assisted atomic layer etching of silicon (Si) with alternating exposure to chlorine gas (Cl 2 ) and argon ions (Ar + ). Molecular dynamics (MD) simulation results are used to provide parameters for the model. The model couples the dynamics of a top monolayer surface region ('top layer') and a perfectly mixed subsurface region ('mixed layer'). The differential equations describing the rates of change of the Cl coverage in the two layers are transient mass balances. Model predictions include Cl coverages and rates of etching of various species from the surface as a function of Cl 2 or Ar + fluence. The simplified phenomenological model reproduces the MD simulation results well over a range of conditions. Comparing model predictions directly to experimental optical emission spectroscopy data, as reported in a previous paper, provides further evidence of the accuracy of the model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Magnetars and axion-like particles: probes with the hard X-ray spectrum

Quiescent hard X-ray and soft gamma-ray emission from neutron stars constitute a promising frontier to explore axion-like-particles (ALPs). ALP production in the core peaks at energies of a few keV to a few hundreds of keV; subsequently, the ALPs escape and convert to photons in the magnetosphere. The emissivity goes as ~T 6 while the conversion probability is enhanced for large magnetic fields, making magnetars, with their high core temperatures and strong magnetic fields, ideal targets for probing ALPs. We compute the energy spectrum of photons resulting from conversion of ALPs in the magnetosphere and then compare it against hard X-ray data from NuSTAR, INTEGRAL, and XMM-Newton, for a set of eight magnetars for which such data exists. Upper limits are placed on the product of the ALP-nucleon and ALP-photon couplings. For the production in the core, we perform a calculation of the ALP emissivity in degenerate nuclear matter modeled by a relativistic mean field theory. The reduction of the emissivity due to improvements to the one-pion exchange approximation is incorporated, as is the suppression of the emissivity due to proton superfluidity in the neutron star core. A range of core temperatures is considered, corresponding to different models of the steady heat transfer from the core to the stellar surface. For the subsequent conversion, we solve the coupled differential equations mixing ALPs and photons in the magnetosphere. The conversion occurs due to a competition between the dipolar magnetic field and the photon refractive index induced by the external magnetic field. Semi-analytic expressions are provided alongside the full numerical results. Furthermore, we also present an analysis of the uncertainty on the axion limits we derive due to the uncertainties in the magnetar masses, nuclear matter equation of state, and the proton superfluid critical temperature.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Construction of quasisymmetric stellarators using a direct coordinate approach

In this work, optimized stellarator configurations and their analytical properties are obtained using a near-axis expansion approach. Such configurations are associated with good confinement as the guiding center particle trajectories and neoclassical transport are isomorphic to those in a tokamak. This makes them appealing as fusion reactor candidates. Using a direct coordinate approach, where the magnetic field and flux surface functions are found explicitly in terms of the position vector at successive orders in the distance to the axis, the set of ordinary differential equations for first and second order quasisymmetry is derived. Examples of quasi-axisymmetric shapes are constructed using a pseudospectral numerical method. Finally, the direct coordinate approach is used to independently verify two hypotheses commonly associated with quasisymmetric magnetic fields, namely that the number of equations exceeds the number of parameters at third order in the expansion and that the near-axis expansion does not prohibit exact quasisymmetry from being achieved on a single flux surface.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Time-dependent SOLPS-ITER simulations of the tokamak plasma boundary for model predictive control using SINDy *

Abstract Time-dependent SOLPS-ITER simulations have been used to identify reduced models with the sparse identification of nonlinear dynamics (SINDy) method and develop model-predictive control of the boundary plasma state using main ion gas puff actuation. A series of gas actuation sequences are input into SOLPS-ITER to produce a dynamic response in upstream and divertor plasma quantities. The SINDy method is applied to identify reduced linear and nonlinear models for the electron density at the outboard midplane n e , s e p O M P and the electron temperature at the outer divertor T e , s e p d i v . Note that T e , s e p d i v is not necessarily the peak value of T e along the divertor. The identified reduced models are interpretable by construction (i.e. not black box), and have the form of coupled ordinary differential equations. Despite significant noise in T e , s e p d i v , the reduced models can be used to predict the response over a range of actuation levels to a maximum deviation of 0.5% in n e , s e p O M P and 5%–10% in T e , s e p d i v for the cases considered. Model retraining using time history data triggered by a preset error threshold is also demonstrated. A model predictive control strategy for nonlinear models is developed and used to perform feedback control of a SOLPS-ITER simulation to produce a setpoint trajectory in n e , s e p O M P using the integrated plasma simulator framework. The developed techniques are general and can be applied to time-dependent data from other boundary simulations or experimental data. Ongoing work is extending the approach to model identification and control for divertor detachment, which will present transient nonlinear behavior from impurity seeding, including realistic latency and synthetic diagnostic signals derived from the full SOLPS-ITER output.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Validation of prediction capability of operating space for plasma initiation in MAST-U

DYON is a plasma initiation modelling code that solves the differential equation system of the full circuit equations (plasma current, active coil currents and eddy currents in full passive structures) and 0D global energy and particle balance equations (Kim 2022 Nucl. Fusion 62 126012). In order to test the capability of the full electromagnetic plasma initiation model to predict individual discharges in experiments and thus the operating space in the device, a dedicated experimental database was built in MAST-U by scanning the prefilled gas pressure p 0 and the induced loop voltage V loop . In the experimental operating space of p 0 and V loop the lower and the upper limits of p 0 are determined by the plasma breakdown failure and the plasma burn-through failure, respectively. The lower limit of V loop is determined by the plasma burn-through failure. By directly reading the control room data used in each discharge (i.e. currents in the solenoid, poloidal field coils, and toroidal field coils, p 0 , and gas puffing rate), the full electromagnetic DYON consistently predicted the failed breakdown, failed burn-through, and successful plasma initiation discharges in the experimental database, demonstrating its capability to predict the operating space for inductive plasma initiation. The Paschen curve calculated with the effective connection length in MAST-U indicates a much higher p 0 required for plasma breakdown than the experimental data, indicating that individual field line evaluation is necessary to calculate the quantitative requirements for Townsend breakdown. The demonstration in this paper shows that the full electromagnetic DYON could be a useful simulation tool to assess the feasibility of inductive plasma initiation and to optimise operating scenarios in future devices.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

An energy-dependent electro-thermal response model of CUORE cryogenic calorimeter

The Cryogenic Underground Observatory for Rare Events (CUORE) is the most sensitive experiment searching for neutrinoless double-beta decay (0νββ) in 130 Te. CUORE uses a cryogenic array of 988 TeO 2 calorimeters operated at ~10 mK with a total mass of 741 kg. To further increase the sensitivity, the detector response must be well understood. Here, we present a non-linear thermal model for the CUORE experiment on a detector-by-detector basis. We have examined both equilibrium and dynamic electro-thermal models of detectors by numerically fitting non-linear differential equations to the detector data of a subset of CUORE channels which are well characterized and representative of all channels. Further, we demonstrate that the hot-electron effect and electric-field dependence of resistance in NTD-Ge thermistors alone are inadequate to describe our detectors' energy-dependent pulse shapes. We introduce an empirical second-order correction factor in the exponential temperature dependence of the thermistor, which produces excellent agreement with energy-dependent pulse shape data up to 6 MeV. We also present a noise analysis using the fitted thermal parameters and show that the intrinsic thermal noise is negligible compared to the observed noise for our detectors.

47 OTHER INSTRUMENTATION↗

Linear-depth quantum circuits for loading Fourier approximations of arbitrary functions

Abstract The ability to efficiently load functions on quantum computers with high fidelity is essential for many quantum algorithms, including those for solving partial differential equations and Monte Carlo estimation. In this work, we introduce the Fourier series loader (FSL) method for preparing quantum states that exactly encode multi-dimensional Fourier series using linear-depth quantum circuits. Specifically, the FSL method prepares a (Dn)-qubit state encoding the 2 Dn -point uniform discretization of aD-dimensional function specified by aD-dimensional Fourier series. A free parameter,m, which must be less thann, determines the number of Fourier coefficients, 2 D ( m + 1 ) , used to represent the function. The FSL method uses a quantum circuit of depth at most 2 ( n − 2 ) + ⌈ log 2 ( n − m ) ⌉ + 2 D ( m + 1 ) + 2 − 2 D ( m + 1 ) , which is linear in the number of Fourier coefficients, and linear in the number of qubits (Dn) despite the fact that the loaded function’s discretization is over exponentially many (2 Dn ) points. The FSL circuit consists of at most D n + 2 D ( m + 1 ) + 1 − 1 single-qubit and D n ( n + 1 ) / 2 + 2 D ( m + 1 ) + 1 − 3 D ( m + 1 ) − 2 two-qubit gates; we present a classical compilation algorithm with runtime O ( 2 3 D ( m + 1 ) ) to determine the FSL circuit for a given Fourier series. The FSL method allows for the highly accurate loading of complex-valued functions that are well-approximated by a Fourier series with finitely many terms. We report results from noiseless quantum circuit simulations, illustrating the capability of the FSL method to load various continuous 1D functions, and a discontinuous 1D function, on 20 qubits with infidelities of less than 10 −6 and 10 −3 , respectively. We also demonstrate the practicality of the FSL method for near-term quantum computers by presenting experiments performed on the Quantinuum H1-1 and H1-2 trapped-ion quantum computers: we loaded a complex-valued function on 3 qubits with a fidelity of over 95 % , as well as various 1D real-valued functions on up to 6 qubits with classical fidelities ≈99%, and a 2D function on 10 qubits with a classical fidelity ≈94%.

Physics↗

In situ compression artifact removal in scientific data using deep transfer learning and experience replay

The massive amount of data produced during simulation on high-performance computers has grown exponentially over the past decade, exacerbating the need for streaming compression and decompression methods for efficient storage and transfer of this data---key to realizing the full potential of large-scale computational science. Lossy compression approaches such as JPEG when applied to scientific simulation data realized as a stream of images can achieve good compression rates but at the cost of introducing compression artifacts and loss of information. This paper develops a unified framework for in situ compression artifact removal in which the fully convolutional neural network architectures are combined with scalable training, transfer learning, and experience replay to achieve superior accuracy and efficiency while significantly decreasing the storage footprint as compared with the traditional optimization-based approaches. We demonstrate the proposed approach and compare it with compressed sensing postprocessing and other baseline deep learning models using climate simulations and nuclear reactor simulations, both of which are driven by hyperbolic partial differential equations. Our approach when applied to remove the compression artifacts on the JPEG-compressed nuclear reactor simulation data (using a transfer-trained model that was pretrained on the climate simulation data and updated incrementally as the nuclear reactor simulation progressed), achieved a significant improvement---mean peak signal-to-noise ratio of 42.438 as compared with 27.725 obtained with the compressed sensing approach.

97 MATHEMATICS AND COMPUTING↗

Recipes for when physics fails: recovering robust learning of physics informed neural networks

Abstract Physics-informed neural networks (PINNs) have been shown to be effective in solving partial differential equations by capturing the physics induced constraints as a part of the training loss function. This paper shows that a PINN can be sensitive to errors in training data and overfit itself in dynamically propagating these errors over the domain of the solution of the PDE. It also shows how physical regularizations based on continuity criteria and conservation laws fail to address this issue and rather introduce problems of their own causing the deep network to converge to a physics-obeying local minimum instead of the global minimum. We introduce Gaussian process (GP) based smoothing that recovers the performance of a PINN and promises a robust architecture against noise/errors in measurements. Additionally, we illustrate an inexpensive method of quantifying the evolution of uncertainty based on the variance estimation of GPs on boundary data. Robust PINN performance is also shown to be achievable by choice of sparse sets of inducing points based on sparsely induced GPs. We demonstrate the performance of our proposed methods and compare the results from existing benchmark models in literature for time-dependent Schrödinger and Burgers’ equations.

97 MATHEMATICS AND COMPUTING↗

Applications of physics informed neural operators

Abstract We present a critical analysis of physics-informed neural operators (PINOs) to solve partial differential equations (PDEs) that are ubiquitous in the study and modeling of physics phenomena using carefully curated datasets. Further, we provide a benchmarking suite which can be used to evaluate PINOs in solving such problems. We first demonstrate that our methods reproduce the accuracy and performance of other neural operators published elsewhere in the literature to learn the 1D wave equation and the 1D Burgers equation. Thereafter, we apply our PINOs to learn new types of equations, including the 2D Burgers equation in the scalar, inviscid and vector types. Finally, we show that our approach is also applicable to learn the physics of the 2D linear and nonlinear shallow water equations, which involve three coupled PDEs. We release our artificial intelligence surrogates and scientific software to produce initial data and boundary conditions to study a broad range of physically motivated scenarios. We provide the source code , an interactive website to visualize the predictions of our PINOs, and a tutorial for their use at the Data and Learning Hub for Science .

97 MATHEMATICS AND COMPUTING↗

Paired autoencoders for likelihood-free estimation in inverse problems

Abstract We consider the solution of nonlinear inverse problems where the forward problem is a discretization of a partial differential equation. Such problems are notoriously difficult to solve in practice and require minimizing a combination of a data-fit term and a regularization term. The main computational bottleneck of typical algorithms is the direct estimation of the data misfit. Therefore, likelihood-free approaches have become appealing alternatives. Nonetheless, difficulties in generalization and limitations in accuracy have hindered their broader utility and applicability. In this work, we use a paired autoencoder framework as a likelihood-free estimator (LFE) for inverse problems. We show that the use of such an architecture allows us to construct a solution efficiently and to overcome some known open problems when using LFEs. In particular, our framework can assess the quality of the solution and improve on it if needed. We demonstrate the viability of our approach using examples from full waveform inversion and inverse electromagnetic imaging.

Chung, Matthias (ORCID:0000000178224539)↗

Forecasting high-dimensional spatio-temporal systems from sparse measurements

This paper introduces a new neural network architecture designed to forecast high-dimensional spatio-temporal data using only sparse measurements. The architecture uses a two-stage end-to-end framework that combines neural ordinary differential equations (NODEs) with vision transformers. Initially, our approach models the underlying dynamics of complex systems within a low-dimensional space; and then it reconstructs the corresponding high-dimensional spatial fields. Many traditional methods involve decoding high-dimensional spatial fields before modeling the dynamics, while some other methods use an encoder to transition from high-dimensional observations to a latent space for dynamic modeling. In contrast, our approach directly uses sparse measurements to model the dynamics, bypassing the need for an encoder. This direct approach simplifies the modeling process, reduces computational complexity, and enhances the efficiency and scalability of the method for large datasets. We demonstrate the effectiveness of our framework through applications to various spatio-temporal systems, including fluid flows and global weather patterns. Although sparse measurements have limitations, our experiments reveal that they are sufficient to forecast system dynamics accurately over long time horizons. Our results also indicate that the performance of our proposed method remains robust across different sensor placement strategies, with further improvements as the number of sensors increases. This robustness underscores the flexibility of our architecture, particularly in real-world scenarios where sensor data is often sparse and unevenly distributed.

97 MATHEMATICS AND COMPUTING↗