Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Adam”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Fermionic Finite-Group Gauge Theories and Interacting Symmetric/Crystalline Orders via Cobordisms

We formulate a family of spin Topological Quantum Field Theories (spin-TQFTs) as fermionic generalization of bosonic Dijkgraaf–Witten TQFTs. They are obtained by gauging G-equivariant invertible spin-TQFTs, or, in physics language, gauging the interacting fermionic Symmetry Protected Topological states (SPTs) with a finite group G symmetry. We use the fact that the torsion part of the classification is given by Pontryagin duals to spin-bordism groups of the classifying space BG. We also consider unoriented analogues, that is G-equivariant invertible pin ± -TQFTs (fermionic time-reversal-SPTs) and their gauging. We compute these groups for various examples of abelian G using Adams spectral sequence and describe all corresponding TQFTs via certain bordism invariants in 3, 4 and other dimensions. This gives explicit formulas for the partition functions of spin-TQFTs on closed manifolds with possible extended operators inserted. The results also provide explicit classification of ’t Hooft anomalies of fermionic QFTs with finite abelian group symmetries in one dimension lower. We construct new anomalous boundary spin-TQFTs (surface fermionic topological orders). Finally, we explore SPT and symmetry enriched topologically (SET) ordered states, and crystalline SPTs protected by space-group (e.g. translation Z) or point-group (e.g. reflection, inversion or rotation C m ) symmetries, via the layer-stacking construction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A Bayesian View on the Dr. Evil Scenario

Abstract In Defeating Dr. Evil with Self-Locating Belief , Adam Elga proposes and defends a principle of indifference for self-locating beliefs: if an individual is confident that his world contains more than one individual who is in a state subjectively indistinguishable from his own, then he should assign equal credences to the hypotheses that he is any one of these individuals. Through a sequence of thought experiments, Elga in effect claims that he can derive the credence function that should apply in such situations, thus justifying his principle of indifference. Here we argue, using a Bayesian approach, that Elga’s reasoning is circular: in analyzing the third of his thought experiments, he uses an assertion that is justifiable only if one assumes, from the start, the principle of indifference that he is attempting to justify. We agree with Elga that the assumption of equal credences is a very reasonable principle, in the absence of any reason to assign unequal credences, but we do not agree that the equality of credences can be so derived.

Azhar, Feraz↗
DOE OSTI2022

Mode connectivity in the loss landscape of parameterized quantum circuits

Variational training of parameterized quantum circuits (PQCs) underpins many workflows employed on near-term noisy intermediate scale quantum (NISQ) devices. It is a hybrid quantum-classical approach that minimizes an associated cost function in order to train a parameterized ansatz. In this work we adapt the qualitative loss landscape characterization for neural networks introduced in Goodfellow et al. (2014); Li et al. (2017) and tests for connectivity used in Draxler et al. (2018) to study the loss landscape features in PQC training. We present results for PQCs trained on a simple regression task, using the bilayer circuit ansatz, which consists of alternating layers of parameterized rotation gates and entangling gates. Multiple circuits are trained with 3 different batch gradient optimizers: stochastic gradient descent, the quantum natural gradient, and Adam. We identify large features in the landscape that can lead to faster convergence in training workflows.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Convergence of Hyperbolic Neural Networks Under Riemannian Stochastic Gradient Descent

Abstract We prove, under mild conditions, the convergence of a Riemannian gradient descent method for a hyperbolic neural network regression model, both in batch gradient descent and stochastic gradient descent. We also discuss a Riemannian version of the Adam algorithm. We show numerical simulations of these algorithms on various benchmarks.

Whiting, Wes (ORCID:0000000247505060)↗
DOE OSTI2025

Optimizing the optimizer for physics-informed neural networks and Kolmogorov-Arnold networks

Physics-Informed Neural Networks (PINNs) have revolutionized the computation of PDE solutions by integrating partial differential equations (PDEs) into the neural network’s training process as soft constraints, becoming an important component of the scientific machine learning (SciML) ecosystem. More recently, physics-informed Kolmogorv-Arnold networks (PIKANs) have also shown to be effective and comparable in accuracy with PINNs. In their current implementation, both PINNs and PIKANs are mainly optimized using first-order methods like Adam, as well as quasi-Newton methods such as BFGS and its low-memory variant, L-BFGS. However, these optimizers often struggle with highly nonlinear and non-convex loss landscapes, leading to challenges such as slow convergence, local minima entrapment, and (non)degenerate saddle points. In this study, we investigate the performance of Self- Scaled BFGS (SSBFGS), Self-Scaled Broyden (SSBroyden) methods and other advanced quasi-Newton schemes, including BFGS and L-BFGS with different line search strategies. These methods dynamically rescale updates based on historical gradient information, thus enhancing training efficiency and accuracy. We systematically compare these optimizers – using both PINNs and PIKANs – on key challenging PDEs, including the Burgers, Allen-Cahn, Kuramoto-Sivashinsky, Ginzburg-Landau, and Stokes equations. Additionally, we evaluate the performance of SSBFGS and SSBroyden for Deep Operator Network (DeepONet) architectures, demonstrating their effectiveness for data-driven operator learning. Our findings provide state-of-the-art results with orders-of-magnitude accuracy improvements without the use of adaptive weights or any other enhancements typically employed in PINNs. More broadly, our work reveal insights into the effectiveness of quasi-Newton optimization strategies in significantly improving the convergence and accurate generalization of PINNs and PIKANs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation

We report the Boltzmann equation with the Bhatnagar-Gross-Krook collision model (Boltzmann-BGK equation) has been employed to describe multiscale flows, i.e., from the hydrodynamic limit to free molecular flow. In this study we employ physics-informed neural networks (PINNs) to solve forward and inverse problems via the Boltzmann-BGK formulation (PINN-BGK), enabling PINNs to model flows in both the continuum and rarefied regimes. In particular, the PINN-BGK is composed of three sub-networks, i.e., the first for approximating the equilibrium distribution function, the second for approximating the non-equilibrium distribution function, and the third one for encoding the Boltzmann-BGK equation as well as the corresponding boundary/initial conditions. By minimizing the residuals of the governing equations and the mismatch between the predicted and provided boundary/initial conditions, we can approximate the Boltzmann-BGK equation for both continuous and rarefied flows. For forward problems, the PINN-BGK is utilized to solve various benchmark flows given boundary/initial conditions, e.g. Kovasznay flow, Taylor-Green flow, cavity flow, and micro Couette flow for Knudsen number up to 5. For inverse problems, we focus on rarefied flows in which accurate boundary conditions are difficult to obtain. We employ the PINN-BGK to infer the flow field in the entire computational domain given a limited number of interior scattered measurements on the velocity without using the (unknown) boundary conditions. Results for the two-dimensional micro Couette and micro cavity flows with Knudsen numbers ranging from 0.1 to 10 indicate that the PINN-BGK can infer the velocity field in the entire domain with good accuracy. Finally, we also present some results on using transfer learning to accelerate the training process. Specifically, we can obtain a three-fold speedup comparted to the standard training process (e.g., Adam plus L-BFG-B) for the two-dimensional flow problems considered in our work.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

B-DeepONet: An enhanced Bayesian DeepONet for solving noisy parametric PDEs using accelerated replica exchange SGLD

Here, the Deep Operator Network (DeepONet) is a neural network architecture used to approximate operators, including the solution operator of parametric PDEs. DeepONets have shown remarkable approximation ability. However, the performance of DeepONets deteriorates when the training data is polluted with noise, a scenario that occurs in practice. To handle noisy data, we propose a Bayesian DeepONet based on replica exchange Langevin diffusion (reLD). Replica exchange uses two particles. The first particle trains a DeepONet to exploit the loss landscape and make predictions. The other particle trains a different DeepONet to explore the loss landscape and escape local minima via swapping. Compared to DeepONets trained with state-of-the-art gradient-based algorithms (e.g., Adam), the proposed Bayesian DeepONet greatly improves the training convergence for noisy scenarios and accurately estimates the uncertainty. To further reduce the high computational cost of the reLD training of DeepONets, we propose (1) an accelerated training framework that exploits the DeepONet's architecture to reduce its computational cost up to 25% without compromising performance and (2) a transfer learning strategy that accelerates training DeepONets for PDEs with different parameter values. Finally, we illustrate the effectiveness of the proposed Bayesian DeepONet using four parametric PDE problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Arrhenian to non-Arrhenian crossover in glass melt viscosity

The activation energy for glass melt viscosity is a function of temperature, i.e., non-Arrhenian, within a middle range of viscosity values (typically, between 10 2 and 10 10 Pa s) and constant, i.e., Arrhenian, outside this range. At the low-viscosity end, the Arrhenian to non-Arrhenian transition (termed the crossover) falls within the glass processing range: glass melting and fining occur within the Arrhenian range while glass forming occurs within the non-Arrhenian range. By the Adam-Gibbs equation, the configuration entropy is nearly constant at high temperatures (low viscosities), where the glass melt turns into a simple liquid, and decreases with decreasing temperature (increasing viscosity) as the glass is increasingly polymerized. In the present study, the power-law function and hyperbolic tangent function are used to express the configuration entropy as a function of temperature. The viscosity crossover is defined as the point at which onset of structural grouping is causing the configuration entropy to deviate from its high-temperature value. In conclusion, it appears that the limited range of the configuration entropy of the fully depolymerized melt imposes a restriction on the crossover viscosity; for well-defined glass families, such as float glasses or nuclear waste glasses, the crossover point can be defined using a fixed, i.e., composition-independent, viscosity value.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Viscosity of transient glass-forming melt and its relation to foaming during batch-to-glass conversion

Primary foam, which affects the heat transfer into the glass batch and the final glass quality, occurs when a sufficient quantity of transient glass-forming melt evolves with viscosity low enough to close the open porosity of the reacting glass batch. To better understand how the fraction of transient melt and its viscosity affect the primary foam temperature range, we determined, with x-ray diffraction, the fraction and composition of the transient glass-forming melt in a heated waste glass melter feed as a function of temperature. Then we prepared a set of transient melts that occurred within the foaming temperature interval and measured their viscosities with spindle and falling sphere viscometers. Further, the results agree with the Adam-Gibbs and VFT viscosity-composition models, even for transient melt compositions outside of the models compositional validity range. As silica and other refractory particles dissolved in the predominantly borate transient melt while temperature increased, viscosity increased from the initial value of ~500 Pa s at the onset of foaming (~650°C) to a maximum of ~770 Pa s when silica dissolution was almost complete (~700°C). As temperature increased further, transient melt viscosity decreased to ~220 Pa s (~850°C) when the primary foam collapsed.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Fast-RF-Shimming: Accelerate RF shimming in 7T MRI using deep learning

Ultrahigh field (UHF) Magnetic Resonance Imaging (MRI) offers an elevated signal-to-noise ratio (SNR), enabling exceptionally high spatial resolution that benefits both clinical diagnostics and advanced research. However, the jump to higher fields introduces complications, particularly transmit radiofrequency (RF) field ($B^{+}_{1}$) inhomogeneities, manifesting as uneven flip angles and image intensity irregularities. These artifacts can degrade image quality and impede broader clinical adoption. Traditional RF shimming methods, such as Magnitude Least Squares (MLS) optimization, effectively mitigate $B^{+}_{1}$ inhomogeneity, but remain time-consuming. Recent machine learning approaches, including RF Shim Prediction by Iteratively Projected Ridge Regression and other deep learning architectures, suggest alternative pathways. Although these approaches show promise, challenges such as extensive training periods, limited network complexity, and practical data requirements persist. In this paper, we introduce a holistic learning-based framework called Fast-RF-Shimming, which achieves a 5000 ​× ​speed-up compared to the traditional MLS method. In the initial phase, we employ random-initialized Adaptive Moment Estimation (Adam) to derive the desired reference shimming weights from multi-channel $B^{+}_{1}$ fields. Next, we train a Residual Network (ResNet) to map $B^{+}_{1}$ fields directly to the ultimate RF shimming outputs, incorporating the confidence parameter into its loss function. Finally, we design Non-uniformity Field Detector (NFD), an optional post-processing step, to ensure the extreme non-uniform outcomes are identified. Comparative evaluations with standard MLS optimization underscore notable gains in both processing speed and predictive accuracy, which indicates that our technique shows a promising solution for addressing persistent inhomogeneity challenges.

Deep learning↗
DOE OSTI2020

Calibration of parallel bond parameters in bonded particle models via physics-informed adaptive moment optimisation

This study proposes an automated calibration procedure for bond parameters in bonded discrete element modelling. By exploring the underlying physical correlations between microscopic parameters of bonds and macroscopic strength parameters of the continuum to be modelled, the microscopic shear strength and tensile strength are identified as independent variables for calibration purpose. Then a physics-informed iterative scheme is proposed to automatically approximate the bond parameters by viewing the micro-macro relation as an implicitly defined mathematical mapping function. As a result of highly non-convex features of this implicit mapping, the adaptive moment estimation (Adam), which is especially suitable for problems with noisy gradients, is adopted as the basic iterative scheme, in conjunction with other numerical techniques to approximately evaluate the partial derivatives involved. The whole procedure offers a simple and effective framework for bond parameter calibration. Finally, a numerical example of SiC ceramic is provided for validation. By compared with some existing calibration methods, the proposed method shows significant advantages in terms of calibration efficiency and accuracy.

42 ENGINEERING↗
DOE OSTI2020

An error-controlled adaptive time-stepping method for particle advancement in coupled CFD-DEM simulations

Coupled Computational-Fluid-Dynamics (CFD) and Discrete-Element-Method (DEM) models provide an accurate description of multiphase physical systems where a solid granular particle phase exists in an underlying gaseous continuous medium. The time integration of the granular phase in these simulations is typically handled using an explicit scheme with a constant time-step among all particles that is invariant in time to resolve inter-particle collisions. A locally third-order accurate adaptive time integration technique for particles that employs an embedded locally second-order scheme for error determination is presented in this work. The particle time-step size is dynamically adapted based on solution error, thus leading to significant savings in computational time. The efficacy of our scheme is quantified using four test cases of varying complexity (binary collision, homogeneous cooling system, fluidized bed and hopper discharge). The adaptive time-stepping method exhibits improved performance (~ 2–3 times in most of the cases studied) compared to three commonly used non-adaptive time-step methods (first-order Euler-explicit, second-order Adams-Bashforth and third-order Runge-Kutta schemes), while maintaining the same level of accuracy and parallel scalability.

42 ENGINEERING↗
DOE OSTI2022

Dose conversion factors for absorbed dose in a mobile phone to absorbed dose in critical organs in an anthropomorphic phantom for emergency dosimetry applications: OSL and TL experimental results, and Monte Carlo simulations

Here, an anthropomorphic phantom was equipped with three smartphones and irradiated in five separate exposure geometries in air using a 137 Cs source. The phantom was fitted internally with thermoluminescence dosimeters (TLD-700 chips) to measure the absorbed dose to the individual organs, while the absorbed doses in the phones were evaluated using optically stimulated luminescence (OSL) from the phones’ surface mount resistors (SMRs), along with reference dosimeters, namely Luxel OSL films and TLD-700 chips. The results indicate a strong dependence on the phone location with respect to the source due to shielding and scattering from the body. Dose conversion factors were calculated for several plausible exposure scenarios in order to correlate the absorbed doses measured in the phones to the average body dose received by the phantom. The measured conversion factors were compared with calculated factors using MCNP6.2 Monte Carlo simulations and an ADAM voxel phantom. Experiments were conducted to assess how the phone orientation and angle impacts the dose received by the phone components. The overall results indicate that the doses measured can vary significantly depending upon exposure geometry (including phone position and angle). However, in rotational irradiation symmetry, the phone doses lead to an over-estimate of the average whole-body dose by an average of ~10%, independent of the phone locations tested in this study. This result, if confirmed in future studies, may be acceptable for triage.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2022

Global stochastic optimization of stellarator coil configurations

In the construction of a stellarator, the manufacturing and assembling of the coil system is a dominant cost. These coils need to satisfy strict engineering tolerances, and if those are not met the project could be cancelled as in the case of the National Compact Stellarator Experiment (NCSX) project. Therefore, our goal is to find coil configurations that increase construction tolerances without compromising the performance of the magnetic field. In this paper, we develop a gradient-based stochastic optimization model which seeks robust stellarator coil configurations in high dimensions. In particular, we design a two-step method: first, we perform an approximate global search by a sample efficient trust-region Bayesian optimization; second, we refine the minima found in step one with a stochastic local optimizer. To this end, we introduce two stochastic local optimizers: BFGS applied to the sample average approximation; and Adam, equipped with a control variate for variance reduction. Numerical simulations performed on a W7-X-like coil configuration demonstrate that our global optimization approach finds a variety of promising local solutions at less than 0.1% of the cost of previous work, which considered solely local stochastic optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

The relaxation behavior of supercooled and glassy imidacloprid

Employing dielectric spectroscopy, oscillatory shear rheology, and calorimetry, the present work explores the molecular dynamics of the widely used insecticide imidacloprid above and below its glass transition temperature. In its supercooled liquid regime, the applied techniques yield good agreement regarding the characteristic structural (alpha) relaxation times of this material. In addition, the generalized Gemant–DiMarzio–Bishop model provides a good conversion between the frequency-dependent dielectric and shear mechanical responses in its viscous state, allowing for an assessment of imidacloprid’s molecular hydrodynamic radius. In order to characterize the molecular dynamics in its glassy regime, we employ several approaches. These include the application of frequency–temperature superposition (FTS) to its isostructural dielectric and rheological responses as well as use of dielectric and calorimetric physical aging and the Adam–Gibbs–Vogel model. While the latter approach and dielectric FTS provide relaxation times that are close to each other, the other methods predict notably longer times that are closer to those reflecting a complete recovery of ergodicity. In conclusion, this seemingly conflicting dissimilarity demonstrates that the molecular dynamics of glassy imidacloprid strongly depends on its thermal history, with high relevance for the use of this insecticide as an active ingredient in technological applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

The Manhattan Project Nuclear Science and Technology Developments at Los Alamos: A Special Issue of Nuclear Technology

The year 2020 marked the 75th anniversary of the Trinity experiment, the world’s first nuclear explosion, on July 16, 1945, near Alamogordo, New Mexico. Trinity was a vital proof step toward the culmination of the Manhattan Project and the end of World War II. The technical accomplishments made by scientists and engineers from the United States, United Kingdom, and Canada (some originating in Germany, Hungary, Italy, France, and other countries) were recognized by many events in 2020, including a visit to New Mexico’s Los Alamos National Laboratory by U.S. Department of Energy (DOE) National Nuclear Security Administration (NNSA) dignitaries; historical documentaries. The importance of Trinity as a foundational accomplishment for the broad nuclear science and engineering community is clear; indeed, New Mexico’s chapter of the American Nuclear Society (ANS) is referred to as the Trinity Section. The events surrounding Trinity have even entered into high culture with recent performances of John Adams’s opera Doctor Atomic in San Francisco, Amsterdam, Chicago, New York, and Santa Fe.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Quantum solver for single-impurity Anderson models with particle-hole symmetry

Quantum embedding methods, such as dynamical mean-field theory (DMFT), provide a powerful framework for investigating strongly correlated materials. A central computational bottleneck in DMFT is in solving the Anderson impurity model (AIM), whose exact solution is classically intractable for large bath sizes. In this work, we benchmark a quantum-classical hybrid solver tailored for particle-hole symmetric AIMs, using the variational quantum eigensolver to prepare the ground state of the model with shallow quantum circuits. The solver uses shallow quantum ansätze and one set of variational parameters to prepare the ground state and its particle and hole excitations, enabling the construction of the impurity Green’s function through a continued-fraction expansion. We evaluate the performance of this approach across a few bath sizes and interaction strengths under noisy, shot-limited conditions. We compare three optimization routines (COBYLA, Adam, and L-BFGS-B) in terms of convergence and fidelity, assess the benefits of estimating a quantum-computed moment correction to the variational energies, and benchmark the approach by comparing the density of states computed from the impurity Green’s function against that obtained using a classical pipeline. Our results demonstrate the feasibility of Green’s function construction on near-term devices and establish practical benchmarks for quantum impurity solvers embedded within self-consistent DMFT loops.

Karabin, Mariia [ORNL]↗
DOE OSTI2022

Non-Boussinesq subgrid-scale model with dynamic tensorial coefficients

A major drawback of Boussinesq-type subgrid-scale stress models used in large-eddy simulations is the inherent assumption of alignment between large-scale strain rates and filtered subgrid-stresses. A priori analyses using direct numerical simulation (DNS) data have shown that this assumption is invalid locally as subgrid-scale stresses are poorly correlated with the large-scale strain rates [J. Bardina, J. Ferziger, and W. Reynolds, Improved subgrid-scale models for large-eddy simulation, in Proceedings of the 13th Fluid and Plasmadynamics Conference, AIAA (1980); C. Meneveau and K. Katz, Scale-invariance and turbulence models for large-eddy simulation, Ann. Rev. Fluid Mech. 32, 1 (2000)]. In the present work, a new, non-Boussinesq subgrid-scale model is presented where the model coefficients are computed dynamically. Some previous non-Boussinesq models have observed issues in providing adequate dissipation of turbulent kinetic energy [e.g., Bardina et al., Proceedings of the 13th Fluid and Plasmadynamics Conference (1980); R. A. Clark, J. Ferziger, and W.C. Reynolds. Evaluation of subgrid-scale models using an accurately simulated turbulent flow, J. Fluid Mech. 91, 1 (1979); S. Stolz and N. A. Adams, An approximate deconvolution procedure for large-eddy simulation, Phys. Fluids 11, 1699 (1999)]; however, the present model is shown to provide sufficient dissipation using dynamic coefficients. Modeled subgrid-scale Reynolds stresses satisfy the consistency requirements of the governing equations for large-eddy simulation (LES), vanish in laminar flow and at solid boundaries, and have the correct asymptotic behavior in the near-wall region of a turbulent boundary layer. The new model, referred to as the dynamic tensor-coefficient Smagorinsky model (DTCSM), has been tested in simulations of canonical flows: decaying and forced homogeneous isotropic turbulence, and wall-modeled turbulent channel flow at high Reynolds numbers. The results show favorable agreement with DNS data. It has been shown that DTCSM offers similar predictive capabilities as the dynamic Smagorinsky model for canonical flows. In order to assess the performance of DTCSM in more complex flows, wall-modeled simulations of high Reynolds number flow over a Gaussian bump (Boeing speed bump) exhibiting smooth-body flow separation are performed. Predictions of surface pressure and skin friction, compared against DNS and experimental data, show improved accuracy from DTCSM in comparison to existing static coefficient (Vreman) and dynamic Smagorinsky model. The computational cost of performing LES with this model is up to 15% higher than the dynamic Smagorinsky model.

42 ENGINEERING↗