SEARCH · Engineering Papers

Results for “linear inverse modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

189 records · Page 11

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks

One of the open problems in scientific computing is the long-time integration of nonlinear stochastic partial differential equations (SPDEs), especially with arbitrary initial data. We address this problem by taking advantage of recent advances in scientific machine learning and the spectral dynamically orthogonal (DO) and borthogonal (BO) methods for representing stochastic processes. The recently introduced DO/BO methods reduce the SPDE to solving a system of deterministic PDEs and a system of stochastic ordinary differential equations. Specifically, we propose two new physics-informed neural networks (PINNs) for solving time-dependent SPDEs, namely the neural network (NN)-DO/BO methods. The proposed methods incorporate the DO/BO constraints into the loss function (along with the modal decomposition of the SPDE) with an implicit form instead of generating explicit expressions for the temporal derivatives of the DO/BO modes. Hence, the NN-DO/BO methods can overcome some of the drawbacks of the original DO/BO methods. For example, we do not need the assumption that the covariance matrix of the random coefficients is invertible as in the original DO method, and we can remove the assumption of no eigenvalue crossing as in the original BO method. Moreover, the NN-DO/BO methods can be used to solve time-dependent stochastic inverse problems with the same formulation and same computational complexity as for forward problems. Furthermore, we demonstrate the capability of the proposed methods via several numerical examples, namely: (1) A linear stochastic advection equation with deterministic initial condition: we obtain good results with the proposed methods, while the original DO/BO methods cannot be applied directly in this case. (2) Long-time integration of the stochastic Burgers' equation: we show the good performance of NN-DO/BO methods, especially the effectiveness of the NN-BO approach for such problems with many eigenvalue crossings during the whole time evolution, while the original BO method fails. (3) Nonlinear reaction diffusion equation: we consider both the forward problem and the inverse problems, including very noisy initial point values, to investigate the flexibility of the NN-DO/BO methods in handling inverse and mixed type problems. Taken together, these simulation results demonstrate that the NN-DO/BO methods can be employed to effectively quantify uncertainty propagation in a wide range of physical problems, but future work should address the efficiency issue of PINNs for forward problems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Spectral density reconstruction with Chebyshev polynomials

Accurate calculations of the spectral density in a strongly correlated quantum many-body system are of fundamental importance to study its dynamics in the linear response regime. Typical examples are the calculation of inclusive and semiexclusive scattering cross sections in atomic nuclei and transport properties of nuclear and neutron star matter. Integral transform techniques play an important role in accessing the spectral density in a variety of nuclear systems. However, their accuracy is in practice limited by the need to perform a numerical inversion which is often ill-conditioned. Here, in the present work we extend a recently proposed quantum algorithm which circumvents this problem. We show how to perform controllable reconstructions of the spectral density over a finite energy resolution with rigorous error estimates. An appropriate expansion in Chebyshev polynomials allows for efficient simulations also on classical computers. We apply our idea to obtain the local density of states for graphene in a magnetic field as a proof of principle. This paves the way for future applications in nuclear and condensed matter physics.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

Dynamics of disordered mechanical systems with large connectivity, free probability theory, and quasi-Hermitian random matrices

Disordered mechanical systems with high connectivity represent a limit opposite to the more familiar case of disordered crystals. Individual ions in a crystal are subjected essentially to nearest-neighbor interactions. In contrast, the systems studied in this paper have all their degrees of freedom coupled to each other. Thus, the problem of linearized small oscillations of such systems involves two full positive-definite and non-commuting matrices, as opposed to the sparse matrices associated with disordered crystals. Consequently, the familiar methods for determining the averaged vibrational spectra of disordered crystals, introduced many years ago by Dyson and Schmidt, are inapplicable for highly connected disordered systems. In this paper we apply random matrix theory (RMT) to calculate the averaged vibrational spectra of such systems, in the limit of infinitely large system size. At the heart of our analysis lies a calculation of the average spectrum of the product of two positive definite random matrices by means of free probability theory techniques. We also show that this problem is intimately related with quasi-hermitian random matrix theory (QHRMT), which means that the ‘hamiltonian’ matrix is hermitian with respect to a non-trivial metric. This extends ordinary hermitian matrices, for which the metric is simply the unit matrix. The analytical results we obtain for the spectrum agree well with our numerical results. The latter also exhibit oscillations at the high-frequency band edge, which fit well the Airy kernel pattern. We also compute inverse participation ratios of the corresponding amplitude eigenvectors and demonstrate that they are all extended, in contrast with conventional disordered crystals. Finally, we compute the thermodynamic properties of the system from its spectrum of vibrations. In addition to matrix model analysis, we also study the vibrational spectra of various multi-segmented disordered pendula, as concrete realizations of highly connected mechanical systems. A universal feature of the density of vibration modes, common to both pendula and the matrix model, is that it tends to a non-zero constant at vanishing frequency.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2024

Differentiable Multiphysics Codes: A Breakthrough Technology for Simulation and Computing

This document summarizes the findings of a strategic planning exercise commissioned by the Weapons Simulation and Computing, Computational Physics (WSC/CP) program at the Lawrence Livermore National Laboratory (LLNL) in FY24. During the year, the committee met with multiple stakeholder communities to gather input, opinions, suggestions and concerns which have been incorporated throughout this document. The key findings from this exercise are summarized: • The development of multiphysics modelling and simulation (mod/sim) codes and software technologies, their deployment on exascale compute platforms, and their broad adoption across the NNSA is a major success of the Advanced Simulation and Computing (ASC) program and the Exascale Computing Project (ECP). Sustained investment in these core technologies is essential. • Today’s state of the art involves running ensembles of O(100K) simulations to perform uncertainty quantification (UQ) and design studies using multiple statistical methods such as Bayesian optimization to understand sensitivities of our models and explore parameterized design spaces. Even with exascale computing, we are practically limited to O(10) parameters in these studies since the number of simulations required to sample the space scales exponentially with the number of design parameters. • The data from these simulation ensembles is increasingly being used to train machine learned (ML) surrogates (or reduced order models, ROMs) which can then be used for optimization or real time design exploration. However, the trained surrogates are still limited in the number of parameters they can represent due to the sampling limitations previously noted. • Augmenting our suite of integrated multiphysics simulation codes, both current and emerging, with the ability to compute gradients (solution derivatives) of arbitrary simulation outputs with respect to (some or all) simulation inputs would be a breakthrough technology, opening the door to a new era of efficient and automated inverse design based on verified and validated mod/sim capabilities. • This capability, which we refer to as differentiable multiphysics codes (DMCs), would revolutionize both UQ and optimization studies by breaking the curse of dimensionality that presently limits our “gradient-free” ensemble based computing approach. A similar breakthrough occurred in the AI/ML community once the ability to compute gradients of arbitrary loss functions using back-propagation became commonplace. Gradient information from the multiphysics codes can also be used to dramatically improve the efficiency and scale of training of ML/ROM surrogates for rapid assessments. • Achieving this in our suite of codes will be a grand challenge, similar to the amount of effort that was required to transition from CPU to GPU computing. It will require buy-in from the entire WSC/CP program and beyond, including all integrated codes, physics and engineering models, third-party library dependencies and performance portability abstractions. It will also require investment in research and development of numerical methods for computing adjoints of coupled physics across multiple adaptively refined moving meshes and of stochastic (Monte Carlo) and mesh free (SPH) methods. • New software and numerical techniques, largely pioneered by the AI/ML community, make this feasible. Chief among these is automatic differentiation (AD), the ability to employ AD at point-wise locations in a physics calculation (instead of traditional black-box approaches) and the ability to perform “back-propagation in time” (or reverse mode AD) for non-linear partial differential equations (PDEs). Fundamentally, the conclusion of this strategic planning exercise is that the time is right to undertake a large scale effort in WSC, centered on the existing integrated codes, to continue the natural evolution of mod/sim in the age of AI/ML. Instead of attempting to replace mod/sim with purely data driven AI/ML models, we believe the key to success is to integrate AI/ML by building on top of the decades of hard-won knowledge and the verified/validated multiphysics modelling capability that is the hallmark of the ASC program.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

An Inverse Heat Conduction Algorithm Used to Calculate the Temperatures on the Inner and Outer Cylindrical Surfaces of an HMX-based PBX Explosive Annulus

In this work, a new Inverse Heat Conduction (IHC) algorithm is applied to estimate the surface temperatures at twelve locations on the inner and outer cylindrical boundaries of an HMX-based Plastic Bonded Explosive (PBX) annulus. This IHC algorithm was developed in references using a set of Direct Heat Conduction (DHC) solutions and a temperature correction method. The DHC solutions were calculated using a Galerkin based finite element (FE) method. This HMX based PBX annulus was used in the Large Scale Annular Cookoff (LSAC) experiment, Shot 5. The reason Shot 5 was chosen as a prototype mathematical model for this study is that the temperature was measured at eighteen locations in the midplane of the HMX-based PBX annulus. In addition, this annulus underwent an experimental thermal ignition and a deflagration that caused a thermal explosion and the disassembly of the experiment. The objective of this study is to describe how the application of the temperature correction algorithm produced the convergence of the DHC solutions to the measured temperatures at twelve internal locations in the midplane of the HMX-based PBX annulus.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Robust scalable initialization for Bayesian variational inference with multi-modal Laplace approximations

Predictive modeling typically relies on Bayesian model calibration to provide uncertainty quantification. Variational inference utilizing fully independent (“mean-field”) Gaussian distributions are often used as approximate probability density functions. This simplification is attractive since the number of variational parameters grows only linearly with the number of unknown model parameters. However, the resulting diagonal covariance structure and unimodal behavior can be too restrictive to provide useful approximations of intractable Bayesian posteriors that exhibit highly non-Gaussian behavior, including multimodality. High-fidelity surrogate posteriors for these problems can be obtained by considering the family of Gaussian mixtures. Gaussian mixtures are capable of capturing multiple modes and approximating any distribution to an arbitrary degree of accuracy, while maintaining some analytical tractability. Unfortunately, variational inference using Gaussian mixtures with full-covariance structures suffers from a quadratic growth in variational parameters with the number of model parameters. The existence of multiple local minima due to strong nonconvex trends in the loss functions often associated with variational inference present additional complications, These challenges motivate the need for robust initialization procedures to improve the performance and computational scalability of variational inference with mixture models. In this work, we propose a method for constructing an initial Gaussian mixture model approximation that can be used to warm-start the iterative solvers for variational inference. The procedure begins with a global optimization stage in model parameter space. In this step, local gradient-based optimization, globalized through multistart, is used to determine a set of local maxima, which we take to approximate the mixture component centers. Around each mode, a local Gaussian approximation is constructed via the Laplace approximation. Finally, the mixture weights are determined through constrained least squares regression. The robustness and scalability of the proposed methodology is demonstrated through application to an ensemble of synthetic tests using high-dimensional, multimodal probability density functions. Here, the practical aspects of the approach are demonstrated with inversion problems in structural dynamics.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Assessment of Thin Plastic Scintillation Detectors for Beta-Particle Measurements at the Advanced Test Reactor Critical Facility

The Fission Wire Measurement System is a custom measurement system designed in the 1960s to measure the beta-particle activity of irradiated uranium-aluminum fission wires. This measurement is conducted to determine the fission rate profile of the Advanced Reactor Test Critical facility. The Advanced Test Reactor Critical facility is an open-pool, low-power test reactor used to qualify experiment configurations and verify core models prior to full-power experiment irradiations in the Advanced Test Reactor. Power distribution measurements in ATR-C use uranium-aluminum wires that are distributed throughout the core to validate simulation and modeling results. These measurements require from 340 to 1500 wires to be irradiated and measured within a 12-hour window. The system consists of 4 measurement channels and one reference channel, each with a 2-pi proportional gas flow detector and the measurement channels each have an automated sample changer. The gas flow detectors are of a custom design for this detector system that use methane gas with a large anode wire compared to modern proportional counters. These detectors, which are nearly 60 years old are irreplaceable. The measurements from these gas detectors are affected by the gas flow rate, atmospheric and line pressure, and are very sensitive to the applied high voltage. Recent improvements have been made to the control and data acquisition system, but the detectors have remained the same. The nature of the measurement of the fission product decay activity is such that the energy spectrum of the signal is changing with time. Thin, 250-um thick, plastic scintillators were commercially obtained as a potential replacement for the gas flow detectors. The original calibration of the uranium-aluminum fission wires was conducted in 1965 using a series of irradiations of gold foils and the wires in a well-characterized thermal neutron field. These measurements provided a time-dependent fission rate conversion factor from the gold foil data to calibrate the fission wires based on the response from the 2-pi proportional gas detectors. Transitioning to the new detectors requires qualification and testing. The sensitivity of the scintillators to changes in the energy spectrum of the fission wires and translation of the calibration factor have been completed. These measurements indicated that the sensitivity of the scintillators over time changes at a different rate than the sensitivity of the gas flow detectors. However, the inverse activity of measurements of both detector types is linear with time. Initial results indicate that the scintillator detectors will be a sufficient replacement for the gas detectors with minor adjustments to the fission rate conversion factor. Replacement of the detectors will improve the fission wire measurements and provide a more stable and reliable measurement system.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

DOE OSTI2024

Capillary-Enhanced Two-Phase Micro-Cooler Using Copper-Inverse-Opal Wick with Silicon Microchannel Manifold for High-Heat-Flux Cooling Application

In this work, we demonstrate a two-phase capillary-fed boiling micro-cooler that consists of a ~ 25-..mu..m-thick copper inverse opal (CIO) porous wicking structure for high-heat-flux boiling and a silicon 3D-manifold for distributed liquid delivery and vapor extraction across a 0.5 cm x 0.5 cm heated area. At low inlet water mass flow rates of 1.5 to 1.9 g(min)-1, the micro-cooler displays nearly two-phase boiling with exit vapor quality ~ 1 and a high critical heat flux (CHF) of 253 to 320 W cm-2 with low superheat of ~ 10 degrees C resulting in a thermal resistance of boiling ~ 0.025 cm2 degrees C W-1 or heat transfer coefficient of 0.4 MW m-2 degrees C-1. For higher flow rates of 5, 10, and 15 g(min)-1, the micro-cooler exhibits a hybrid single-phase and two-phase cooling regime where the contribution of the sensible heat (single-phase) cooling is linearly added to that of the two-phase cooling. For the highest flow rate of 15 g(min)-1, the CHF is increased to ~ 500 W cm-2 resulting in an overall thermal resistance of ~ 0.18 cm2 degrees C W-1. However, the two-phase heat transfer effectiveness, which estimates the utilization level of the inlet mass flow rate for two-phase boiling, is reduced to ~ 0.11. To achieve the best cooling system performances, the micro-cooler must operate entirely within the two-phase boiling regime (exit vapor quality or two-phase heat transfer effectiveness ~ 1). Ideally, the "coolant" should be delivered near its saturation temperature (~ 100 degrees C for water), which provides significant advantages for the energy-efficient operation of data centers and power electronics. We present detailed analysis with Infrared and high speed camera images at various inlet flow rates and heat fluxes to understand complex heat transfer in the micro-cooler. Furthermore, a conjugate thermofluidic simulation model, which incorporates the physics of capillary-fed boiling in a porous copper layer, agrees well with the experimental data.

capillary-enhanced boiling↗

DOE OSTI2021

B-PINNs: Bayesian Physics-informal Neural Networks for Forward and Inverse PDE Problems with Noisy Data

We propose a Bayesian physics-informed neural network (B-PINN) to solve both forward and inverse nonlinear problems described by partial differential equations (PDEs) and noisy data. In this Bayesian framework, the Bayesian neural network (BNN) combined with a PINN for PDEs serves as the prior while the Hamiltonian Monte Carlo (HMC) or the variational inference (VI) could serve as an estimator of the posterior. B-PINNs make use of both physical laws and scattered noisy measurements to provide predictions and quantify the aleatoric uncertainty arising from the noisy data in the Bayesian framework. Compared with PINNs, in addition to uncertainty quantification, B-PINNs obtain more accurate predictions in scenarios with large noise due to their capability of avoiding overfitting. We conduct a systematic comparison between the two different approaches for the B-PINNs posterior estimation (i.e., HMC or VI), along with dropout used for quantifying uncertainty in deep neural networks. Our experiments show that HMC is more suitable than VI with mean field Gaussian approximation for the B-PINNs posterior estimation, while dropout employed in PINNs can hardly provide accurate predictions with reasonable uncertainty. Finally, we replace the BNN in the prior with a truncated Karhunen-Loève (KL) expansion combined with HMC or a deep normalizing flow (DNF) model as posterior estimators. The KL is as accurate as BNN and much faster but this framework cannot be easily extended to high-dimensional problems unlike the BNN based framework.

Non linear PDEs, Noisy data, Bysian physics inform↗