Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Operator approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Generalized moving least squares vs. radial basis function finite difference methods for approximating surface derivatives

Approximating differential operators defined on two-dimensional surfaces is an important problem that arises in many areas of science and engineering. Over the past ten years, localized meshfree methods based on generalized moving least squares (GMLS) and radial basis function finite differences (RBF-FD) have been shown to be effective for this task as they can give high orders of accuracy at low computational cost, and they can be applied to surfaces defined only by point clouds. However, there have yet to be any studies that perform a direct comparison of these methods for approximating surface differential operators (SDOs). The first purpose of this work is to fill that gap. For this comparison, we focus on an RBF-FD method based on polyharmonic spline kernels and polynomials (PHS+Poly) since they are most closely related to the GMLS method. Additionally, we use a relatively new technique for approximating SDOs with RBF-FD called the tangent plane method since it is simpler than previous techniques and natural to use with PHS+Poly RBF-FD. Further, the second purpose of this work is to relate the tangent plane formulation of SDOs to the local coordinate formulation used in GMLS and to show that they are equivalent when the tangent space to the surface is known exactly. The final purpose is to use ideas from the GMLS SDO formulation to derive a new RBF-FD method for approximating the tangent space for a point cloud surface when it is unknown. For the numerical comparisons of the methods, we examine their convergence rates for approximating the surface gradient, divergence, and Laplacian as the point clouds are refined for various parameter choices. We also compare their efficiency in terms of accuracy per computational cost, both when including and excluding setup costs.

97 MATHEMATICS AND COMPUTING↗

Improving Estimation of the Koopman Operator with Kolmogorov–Smirnov Indicator Functions

It has become common to perform kinetic analysis using approximate Koopman operators that transform high-dimensional timeseries of observables into ranked dynamical modes. The key to the practical success of the approach is the identification of a set of observables that form a good basis on which to expand the slow relaxation modes. Good observables are, however, difficult to identify a priori and suboptimal choices can lead to significant underestimations of characteristic time scales. Leveraging the representation of slow dynamics in terms of Hidden Markov Models (HMM), we propose a simple and computationally efficient clustering procedure to infer surrogate observables that form a good basis for slow modes. Here, we apply the approach to an analytically solvable model system as well as on three protein systems of different complexities. We consistently demonstrate that the inferred indicator functions can significantly improve the estimation of the leading eigenvalues of Koopman operators and correctly identify key states and transition time scales of stochastic systems, even when good observables are not known a priori.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Bayesian, Multifidelity Operator Learning for Complex Engineering Systems–A Position Paper

Abstract Deep learning has significantly improved the state-of-the-art in computer vision and natural language processing, and holds great potential to design effective tools for predicting and simulating complex engineering systems. In particular, scientific machine learning seeks to apply the power of deep learning to scientific and engineering tasks, with operator learning (OL) emerging as a particularly effective tool. OL can approximate nonlinear operators arising in complex engineering systems, making it useful for simulating, designing, and controlling those systems. In this position paper, we provide a comprehensive overview of OL, including its potential applications to complex engineering domains. We cover three variations of OL approaches: deterministic OL for modeling nonautonomous systems, OL with uncertainty quantification (UQ) capabilities, and multifidelity OL. For each variation, we discuss drawbacks and potential applications to engineering, in addition to providing a detailed explanation. We also highlight how multifidelity OL approaches with UQ capabilities can be used to design, optimize, and control engineering systems. Finally, we outline some potential challenges for OL within the engineering domain.

Computer Science↗

A Convex Data-Driven Approach for Nonlinear Control Synthesis

We consider a class of nonlinear control synthesis problems where the underlying mathematical models are not explicitly known. We propose a data-driven approach to stabilize the systems when only sample trajectories of the dynamics are accessible. Our method is built on the density-function-based stability certificate that is the dual to the Lyapunov function for dynamic systems. Unlike Lyapunov-based methods, density functions lead to a convex formulation for a joint search of the control strategy and the stability certificate. This type of convex problem can be solved efficiently using the machinery of the sum of squares (SOS). For the data-driven part, we exploit the fact that the duality results in the stability theory can be understood through the lens of Perron–Frobenius and Koopman operators. This allows us to use data-driven methods to approximate these operators and combine them with the SOS techniques to establish a convex formulation of control synthesis. The efficacy of the proposed approach is demonstrated through several examples.

97 MATHEMATICS AND COMPUTING↗

Dimension Reduction and Redundancy Removal through Successive Schmidt Decompositions

Quantum computers are believed to have the ability to process huge data sizes, which can be seen in machine learning applications. In these applications, the data, in general, are classical. Therefore, to process them on a quantum computer, there is a need for efficient methods that can be used to map classical data on quantum states in a concise manner. On the other hand, to verify the results of quantum computers and study quantum algorithms, we need to be able to approximate quantum operations into forms that are easier to simulate on classical computers with some errors. Motivated by these needs, in this paper, we study the approximation of matrices and vectors by using their tensor products obtained through successive Schmidt decompositions. We show that data with distributions such as uniform, Poisson, exponential, or similar to these distributions can be approximated by using only a few terms, which can be easily mapped onto quantum circuits. The examples include random data with different distributions, the Gram matrices of iris flower, handwritten digits, 20newsgroup, and labeled faces in the wild. Similarly, some quantum operations, such as quantum Fourier transform and variational quantum circuits with a small depth, may also be approximated with a few terms that are easier to simulate on classical computers. Furthermore, we show how the method can be used to simplify quantum Hamiltonians: In particular, we show the application to randomly generated transverse field Ising model Hamiltonians. The reduced Hamiltonians can be mapped into quantum circuits easily and, therefore, can be simulated more efficiently.

97 MATHEMATICS AND COMPUTING↗

Energy Efficient Waste Heat Coupled Forward Osmosis for Effluent Water Management at Coal-Fired Power Plants

This project sought to evaluate the technical and economic viability of the Aquapod©, a transformational low energy (<200 kJ/kg water) waste heat coupled forward osmosis (FO) technology, to manage effluents, meet cooling water demands, and achieve water conservation in a coal-fired power plant environment. The Aquapod© process is innovative because it is heat-driven, avoids the evaporation of water, and uses no toxic chemicals such as ammonia or amines. The Aquapod© process accomplishes this using an aqueous two-phase system (ATPS) coupled FO process. The evaluation revealed that the Aquapod© process offers a pathway to exploit waste heat resources within a power plant to achieve flue-gas desulfurization (FGD) wastewater volume reduction and water recovery with minimal pretreatment. Water recovery of 80% from FGD wastewater was achieved with minimal pretreatment, exceeding the project target of 50%. The estimated electrical energy of 2.16 kWh/m 3 of water produced for the Aquapod© process met the project target of < 3.6 kWh/m 3 . The heat required for the process operation was approximately 186 kJ/kg of produced water, which was slightly lower than the project target of 200 kJ/kg. The estimated treatment cost for installing and operating the Aquapod© process in conjunction with a spray dryer evaporator to achieve zero-liquid discharge (ZLD) of the 100 gpm FGD wastewater was $13.24/m 3 over a 30-year lifetime. As a point of reference, this study’s host power plant currently incurs a cost of $3.70/m 3 – $8.87/m3 on a discharged volume basis to discharge its wastewater into the publicly owned treatment works (POTW) after physical-chemical treatment. Therefore, the Illinois power plant would incur an incremental cost increase of $4.37/m 3 – 9.54/m 3 to achieve ZLD using the Aquapod© and spray dryer combination. Ample opportunities exist to further lower the ZLD capital and operating costs in the next design iteration to attain pipe parity at the higher end of the site treatment costs.

01 COAL, LIGNITE, AND PEAT↗

Data-driven linear time advance operators for the acceleration of plasma physics simulation

In this study, we demonstrate the application of data-driven linear operator construction for time advance with a goal of accelerating plasma physics simulation. We apply dynamic mode decomposition (DMD) to data produced by the nonlinear SOLPS-ITER (Scrape-off Layer Plasma Simulator - International Thermonuclear Experimental Reactor) plasma boundary code suite in order to estimate a series of linear operators and monitor their predictive accuracy via online error analysis. We find that this approach defines when these dynamics can be represented by a sequence of approximate linear operators and is essential for providing consistent projections when compared to an unconstrained application. For linear diffusion and advection–diffusion fluid test problems, we construct and apply operators within explicit and implicit time advance schemes, demonstrating that stability can be robustly guaranteed in each case. We further investigate the use of the linear time advance operators within several integration methods including forward Euler, backward Euler, and the matrix exponential. The application of this method to simulation data from SOLPS-ITER, with varying levels of Markov chain Monte Carlo numerical noise, shows that constrained DMD operators yield a capability to identify, extract, and integrate a (slow) subset of the present timescales. Example applications show that for projected speedup factors of [Formula: see text], and [Formula: see text], a mean relative error of 3%, 5%, and 8% and maximum relative error less than 20% are achievable, which appears acceptable for typical SOLPS-ITER steady-state simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Heterogeneous Mixtures of Dictionary Functions to Approximate Subspace Invariance in Koopman Operators: Why Deep Koopman Operators Work

Abstract Koopman operators model nonlinear dynamics as a linear dynamic system acting on a nonlinear function as the state. This nonstandard state is often called a Koopman observable and is usually approximated numerically by a superposition of functions drawn from a dictionary . In a widely used algorithm, extended dynamic mode decomposition (EDMD), the dictionary functions are drawn from a fixed class of functions. Deep learning combined with EDMD has been used to learn novel dictionary functions in an algorithm called deep dynamic mode decomposition (deepDMD). The learned representation both (1) accurately models and (2) scales well with the dimension of the original nonlinear system. In this paper, we analyze the learned dictionaries from deepDMD and explore the theoretical basis for their strong performance. We explore State-Inclusive Logistic Lifting (SILL) dictionary functions to approximate Koopman observables. Error analysis of these dictionary functions show they satisfy a property of subspace approximation, which we define as uniform finite approximate closure. Typically, a Koopman dictionary’s nonlinear functions are homogeneous. In this paper, we discover that structured mixing of heterogeneous dictionary functions drawn from different classes of nonlinear functions achieve the same accuracy and dimensional scaling as the deep-learning-based deepDMD algorithm Yeung et al. ( In: 2019 American Control Conference (ACC), 2019). We specifically show this by building a heterogeneous dictionary comprised of SILL functions and conjunctive radial basis functions (RBFs). This mixed dictionary achieves similar accuracy and dimensional scaling to deepDMD with an order of magnitude reduction in parameters, while maintaining geometric interpretability. These results strengthen the viability of dictionary-based Koopman models to solving high-dimensional nonlinear learning problems.

Johnson, Charles A.↗

Sound propagation in realistic interactive 3D scenes with parameterized sources using deep neural operators

We address the challenge of acoustic simulations in three-dimensional (3D) virtual rooms with parametric source positions, which have applications in virtual/augmented reality, game audio, and spatial computing. The wave equation can fully describe wave phenomena such as diffraction and interference. However, conventional numerical discretization methods are computationally expensive when simulating hundreds of source and receiver positions, making simulations with parametric source positions impractical. To overcome this limitation, we propose using deep operator networks to approximate linear wave-equation operators. This enables the rapid prediction of sound propagation in realistic 3D acoustic scenes with parametric source positions, achieving millisecond-scale computations. By learning a compact surrogate model, we avoid the offline calculation and storage of impulse responses for all relevant source/listener pairs. Our experiments, including various complex scene geometries, show good agreement with reference solutions, with root mean squared errors ranging from 0.02 to 0.10 Pa. Notably, our method signifies a paradigm shift as—to our knowledge—no prior machine learning approach has achieved precise predictions of complete wave fields within realistic domains.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Importance of gyrokinetic exact Fokker-Planck collisions in fusion plasma turbulence

Gyrokinetic simulations of turbulence are fundamental to understanding and predicting particle and energy loss in magnetic fusion devices. Previous works have used model collision operators with approximate field-particle terms of unknown accuracy and/or have neglected collisional finite Larmor radius effects. This research moves beyond models to demonstrate important corrections using a gyrokinetic Fokker-Planck collision operator with the exact field-particle terms, in realistic simulations of turbulence in magnetically confined fusion plasmas. The exact operator shows significant corrections for temperature-gradient-driven trapped electron mode turbulence and zonal flow damping, and for microtearing modes in a Joint European Torus pedestal under ITER-like wall conditions. Analysis of the corrections using parameter scans motivates an accurate model which closely reproduces the exact results while reducing computational demands.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A scalable multidimensional fully implicit solver for Hall magnetohydrodynamics

We propose an optimally performant fully implicit algorithm for the Hall magnetohydrodynamics (HMHD) equations based on multigrid-preconditioned Jacobian-free Newton-Krylov methods. HMHD is a challenging system to solve numerically because it supports stiff fast dispersive waves. The preconditioner is formulated using an operator-split approximate block factorization (Schur complement), informed by physics insight. We use a vector-potential formulation (instead of a magnetic field one) to allow a clean segregation of the problematic $\nabla$ x $\nabla$ x operator in the electron Ohm's law subsystem. This segregation allows the formulation of an effective damped block-Jacobi smoother for multigrid. We demonstrate by analysis that our proposed block-Jacobi iteration is convergent and has the smoothing property. The resulting HMHD solver is verified linearly with wave propagation examples, and nonlinearly with the GEM challenge reconnection problem by comparison against another HMHD code. We demonstrate the excellent algorithmic and parallel performance of the algorithm up to 16384 MPI tasks in two dimensions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Molecular dynamics study of interstitial He clusters in nickel

This study presents a molecular dynamics analysis focusing on the behavior of interstitial helium (He) clusters in nickel (Ni), examining their formation, stability, and migration energetics. Consistent with previous research, we found that the binding energies of interstitial helium within a helium cluster are positive and increase with the cluster size, indicating a preference for helium atoms to cluster together. However, our findings also reveal that while the formation energy increases monotonically with cluster size, the increase in binding energy is non-monotonic. Importantly, small He clusters were observed to be thermally unstable at reactor operational temperatures (approximately 600 K), with the He 2 cluster exhibiting instability even at room temperature. With a binding energy of 0.49 eV for a He 4 cluster, we hypothesize that for helium bubbles to form via homogeneous nucleation (i.e., through trap mutation) at reactor operating temperatures, the helium concentration must be high enough to facilitate the formation of helium clusters of at least size 4 or larger. As expected, interstitial helium and small helium clusters are highly mobile. This mobility was observed not only at room temperature but also at temperatures as low as approximately 200 K. Furthermore, the mean squared displacement method has been utilized to determine the migration barriers and the corresponding prefactors for clusters ranging from He 1 to He 6

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Neural Scaling Laws of Deep ReLU and Deep Operator Network: A Theoretical Study

Neural scaling laws play a pivotal role in the performance of deep neural networks and have been observed in a wide range of tasks. However, a complete theoretical framework for understanding these scaling laws remains underdeveloped. In this paper, we explore the neural scaling laws for deep operator networks, which involve learning mappings between function spaces, with a focus on the Chen and Chen style architecture. These approaches, which include the popular Deep Operator Network (DeepONet), approximate the output functions using a linear combination of learnable basis functions and coefficients that depend on the input functions. We establish a theoretical framework to quantify the neural scaling laws by analyzing its approximation and generalization errors. We articulate the relationship between the approximation and generalization errors of deep operator networks and key factors such as network model size and training data size. Moreover, we address cases where input functions exhibit low-dimensional structures, allowing us to derive tighter error bounds. These results also hold for deep ReLU networks and other similar structures. Our results offer a partial explanation of the neural scaling laws in operator learning and provide a theoretical foundation for their applications.

97 MATHEMATICS AND COMPUTING↗

Online Output-Based Inertia Estimation of Modern Power Systems

The overall inertia of modern power systems is drastically impacted by the penetration level of converter-based resources (CBRs). The intermittent output of CBRs and their dependence on the weather conditions affirm the need for a realtime inertia estimation approach. This can help the transmission system operators(TSOs) to be continuously aware of the changes in the system inertia and to take suitable control actions. This paper is a step forward to a totally data-driven framework for power system inertia estimation using the available measurements from the phasor measurement units (PMUs). This inertia estimation is done based on the spectral analysis of the so-called Koopman linear operator. Koopman operator considers the relationship between the system's inertia and its dynamical response to slight disturbances in the load. Simulation results show that Koopman operator can approximate the system behavior in a reconstructed linear space hence inertia constant is estimated accurately.

data-driven↗

Core Design of the Holos-Quad Microreactor

The Holos-Quad micro-reactor concept, developed by HolosGen LLC, is equipped with a 22 MWt (Mega-Watt thermal) core and an integral power conversion system converting the core thermal energy into approximately 10 MWe (Mega-Watt electric). This design can be configured to support a wide range of applications. It is a very innovative high-temperature gas-cooled reactor concept using TRI-structural ISOtropic particle fuel (TRISO) distributed in graphite hexagonal blocks, cooled with helium in a direct Brayton cycle independently executed by four Subcritical Power Modules (SPMs) fitted into a hardened 40-foot container whose dimensions are in compliance with ISO shipping containers requirements. In FY2019 HolosGen LLC was awarded by the Department of Energy Advanced Research Project Agency-Energy (DOE ARPA-E) under the MEITNER funding program. As part of the MEITNER award, the Argonne National Laboratory (ANL) contributed expertise through two specialized teams: The “Design Team” and the “Resource Team”. The Design Team was dedicated to validate feasibility of the Holos-Quad core and to optimize its core design through neutronics analyses. The Resource Team was dedicated to feasibility verification via high-fidelity codes of Holos-Quad thermal-hydraulic, heat transfer, shielding, and structural aspects. This report summarizes the activities conducted by ANL Design Team. A rigorous design approach based on multi-criteria optimization and code-to-code comparison involving stochastic and high-fidelity deterministic solutions was developed and employed at several evolutionary stages of the Holos-Quad design. Several generations of the Holos-Quad core were designed within this project before converging to the current full-scale Gen 2+ design that is detailed in this report. Figure EA-1 illustrates a cross-sectional view of Gen 2+ Holos-Quad core configuration, and Figure EA-2 provides a simplified perspective view of 1-of-4 SPMs. The Holos-Quad uses four thermal-hydraulically independent SPMs locked into stationary positions during power operation, surrounded by BeO reflector and structural component fully comprised within the dimensional constraints represented by traditional ISO containers. One of the benefits of this approach is to enable transportation of each SPM promptly after irradiation in shielded containers. The core is designed to operate for approximately 8 full-power years while the reactivity controls and power conversion system enable load-following operations. The reactivity controls are represented by independent, diversified, and redundant reactivity control systems based on control drums and redundant sets of shutdown rods. The high-fidelity simulation tools were used to assess detailed power and flux distributions of the three-dimensional full-core or quarter-core of the Gen 2+ configuration. Single-physics and multi-physics simulations of the neutronics code PROTEUS and the thermal-hydraulic code System Analysis Module (SAM) were performed to analyze the Holos design configurations with detailed high-fidelity solutions. The design work performed confirmed feasibility of the Holos-Quad concept, provided realistic design description for detailed design of the operational system, and identified several core design improvements to be further considered for future reactor development activities.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Cold compressor performance and energy consumption improvements at Jefferson Lab’s Central Helium Liquefiers

Abstract Jefferson Lab operates two central helium liquefiers (CHLs) which both utilize full cold compression from the saturation pressure at operating temperature (approximately 2.1 K) to just over atmospheric pressure. The original plant, CHL1, was recently outfitted with a replacement subatmospheric cold box (SC1R) containing state-of-the-art cold compressor technology, while the newer plant, CHL2, uses an older cold compressor system. In both cases, the heat of compression is absorbed at low temperature at the expense of electrical power consumed by the warm compressors. Due to the superior efficiency and turndown capabilities of SC1R, a new operating mode has been identified for CHL1 in which the required number of operating warm compressors is reduced by one. A cost-based method for optimizing cold compressor stability and efficiency has been developed and applied to CHL2, improving its turndown and lowering the warm compressor discharge pressure. As a result of these efforts, power consumption of the combined CHLs during normal operations has been reduced by nearly 10%, or a total of 650 kW. The observed performance of CHL1 with SC1R, as well as the cold compressor optimization method, leading to this improved energy consumption rate will be discussed in detail.

Mastracci, B [Thomas Jefferson National Accelerato↗

Methane Mitigation Thermoelectric Generator (MMTEG) (Final Scientific/ Technical Report)

Gas Technology Institute (GTI) has completed a $1.815M (plus $500K cost share), 54-month Co-operative agreement with the Department of Energy’s National Energy Technology Laboratory to develop a Methane Mitigation Thermoelectric Generator (MMTEG) system for gas field applications. This novel system uses fugitive gas to produce electrical power and consists of Thermoelectric Generators (TEG) driven by a linear burner, an air compressor, an accumulator, valves, batteries, and power electronics. The electrical power generated by the system is used to compress air and, in turn, the air is used to operate the pneumatic valves at the well site instead of using natural gas (NG) which would then be vented. The team completed the project objectives which included (1) Design, fabricate and test an integrated 6We nominal MMTEG prototype system, (2) Design a “retrofit kit” MMTEG system capable of being field tested at a gas well production site, and (3) build and test the field MMTEG system in a laboratory environment. Multiple system options were developed prior to selecting a “Passive” system which meets cost, NG savings, and greenhouse gas (GHG) reduction targets although not as efficient as initially planned. The MMTEG system is built primarily from commercial off-the-shelf parts (in some cases re-purposed) including the heat exchanger, heat rejection, electronic components, and also the TEGs. The team developed and implemented a novel system including the control system developed by Morrison Applied Sciences (MAS). The team completed incremental demonstrations of the hardware prior to the MMTEG system demonstration. A one-year simulation of the air delivery and battery charging subsystems was completed prior to the integration into the MMTEG system. In addition, the team simulated two-years of thermal cycles for integrated Burner/TEG/heat rejection subsystem. Finally, the entire MMTEG system was assembled, and troubleshooting was completed over a two-week period. Next, the MMTEG system was tested to simulate over 15 weeks of entire system operation over approximately four weeks in an accelerated test fashion with minimal intervention (such as changing fuel tanks). The MMTEG system met the key goals of a unit cost of under $1500 while saving 97% of NG expended today (including leakage) on average by pneumatic systems venting to the atmosphere. The MMTEG system reduced GHG emissions by 1000X (using the methane intensification factor of 28 relative to CO2). GTI is currently pursuing a field test of the MMTEG system. Interfacing with producers has provided additional insight into system improvements. Planned improvements include additional weather protection and control system improvements including the implementation of a long- range radio capability to notify operators if there is a fault.

03 NATURAL GAS↗

Incorporation of Thermal Hydraulic Models for Thermal Power Dispatch into a PWR Power Plant Simulator

This report describes the development, modeling, and results of a generic pressurized water reactor power plant simulator that incorporates coupled electrical and thermal power dispatch to an industrial process located approximately one kilometer from the nuclear power plant. The simulator is a commercial PWR simulator that has been modified to include thermal power dispatch as described in past milestone reports [ , ]. The commercial PWR simulator is a generic simulator available from GSE SYSTEMS® (Sykesville, MD, USA) that is built using RELAP5-HDTM Real-Time Solution and in-house software developed by GSE Systems. This generic PWR (GPWR) simulator performs real-time simulation of the complete power plant from the reactor neutronics to the electricity generation and distribution. All primary, secondary, and auxiliary systems are modeled including all control logic in order to provide the most accurate representation of actual nuclear power plant (NPP) operation, and the simulator results have been rigorously verified by an actual NPP operating at approximately 1 GWe. This report is a continuation of worked performed in previous years, and supplemental information from previous reports is included in the appendix for reference.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗