Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “reduced order methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Implementation of higher-order velocity mapping between marker particles and grid in the particle-in-cell code XGC

The global total-f gyrokinetic particle-in-cell code XGC, used to study transport in magnetic fusion plasmas or to couple with a core gyrokinetic code while functioning as an edge gyrokinetic code, implements a 5-dimensional (5D) continuum grid to perform the dissipative operations, such as plasma collisions, or to exchange the particle distribution function information with a core code. To transfer the distribution function between marker particles and a rectangular 2D velocity-space grid, XGC employs a bilinear mapping. The conservation of particle density and momentum is accurate enough in this bilinear operation, but the error in the particle energy conservation can become undesirably large and cause non-negligible numerical heating in a steep edge pedestal. In the present work we update XGC to use a novel mapping technique, based on the calculation of a pseudo-inverse, to exactly preserve moments up to the order of the discretization space. We describe the details of the implementation and we demonstrate the reduced interpolation error for a tokamak test plasma by using 1st- and 2nd-order elements with the pseudo-inverse method and comparing to the bilinear mapping.

Fusion Plasma↗

pvcracks

SAND2024-00922O This software uses electroluminescence images to predict power loss due to cell cracks in photovoltaic modules. The software will incorporate trained variational autoencoder(s) to parameterize cell cracks detected in electroluminescence images of photovoltaic modules and relate cracks to electrical properties; reduced-order models of finite element simulations of electrical behavior of photovoltaic modules under thermomechanical stresses; reduced-order models of stress distributions; inside photovoltaic modules resulting from x-ray topography experiments; and image segmentation and splining methods to analyze x-ray topography measurements of cracked photovoltaic cells. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Hartley, James↗

Multiscale Reduced Order Modeling and Parameter Estimation for Climate Sciences

Several problems in earth system modeling are dependent on highly multiscale phenomena, such as turbulence, where computational modeling is challenging and expensive. This issue is exacerbated in atmospheric and oceanic domains, due to inherent high-dimensionality of the problem. One approach to this problem has been reduced order modeling (ROM); which aims to represent the key physics of the phenomena as a low-dimensional system. AI methods have huge potential in building accurate, stable ROMs and parameter estimation for these ROMs, as it requires extracting nonlinearities and patterns from simulation and/or observational data. Developing physics-based AI approaches specialized for the complexities of multiscale data, along with strategies to account for uncertainties, will revolutionize rapid modeling, analysis and decision making for earth system problems of practical interest.

58 GEOSCIENCES↗

Acquire and Test IDAES Framework Components

The cooperation under the Grid Modernization Initiative and the Applied Energy Tri-Laboratory umbrellas requires mutual understanding of capabilities and a common effort to identify gaps existing in the available computational modeling and analysis tools. In this work, we report acquisition and testing of the National Energy Technology Laboratory’s Institute for the Design of Advanced Energy Systems (IDAES) framework, particularly including both electric power systems production cost model simulator Prescient as well as system optimization IDAES itself. Further, we consider the methods in which developments in Prescient and IDAES for grid-energy simulation and optimization may be included in the Framework for Optimization of ResourCes and Economics (FORCE) ecosystem that has been under collaborative development by Idaho National Laboratory, Argonne National Laboratory, and Oak Ridge National Laboratory. We propose two integration methods to introduce Prescient and IDAES into existing FORCE automated workflows. One integration involves using Prescient as a market reduced-order model and IDAES models similar to how existing Modelica models are used. The other integration involves wrapping the Prescient-IDAES dispatch optimization process with the stochastic capacity optimization workflow in FORCE.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Thermal field reconstruction and compressive sensing using proper orthogonal decomposition

Model order reduction allows critical information about sensor placement and experiment design to be distilled from raw fluid mechanics simulation data. In many cases, sensed information in conjunction with reduced order models can also be used to regenerate full field variables. In this paper, a proper orthogonal decomposition (POD) inferencing method is extended to the modeling and compressive sensing of temperature, a scalar field variable. The method is applied to a simulated, critically stable, incompressible flow over a heated cylinder (Re = 1000) with Prandtl number varying between 0.001 and 50. The model is trained on pressure and temperature data from simulations. Field reconstructions are then generated using data from selected sensors and the POD model. Finally, the reconstruction error is evaluated across all Prandtl numbers for different numbers of retained modes and sensors. The predicted trend of increasing reconstruction accuracy with decreasing Prandtl number is confirmed and a Prandtl number/sensor count error matrix is presented.

Matulis, John↗

Optimal control of coupled quantum systems based on the first-order Magnus expansion: Application to multiple dipole-dipole-coupled molecular rotors

This paper presents a method for performing approximate optimal control simulations for quantum systems with multiple coupled degrees of freedom. In this work, the time evolution is simulated using the first-order Magnus expansion in the interaction picture, where the couplings between different degrees of freedom are treated as the perturbation. A numerical implementation procedure is presented that leverages upon pairwise couplings and the separability of the zeroth-order time evolution operator to achieve a reduced computational cost, which is analyzed with respect to the number of degrees of freedom. The formulation is compatible with gradient-free methods to optimize the control field, and a stochastic hill climbing algorithm is adopted for this purpose. As illustrations, optimal control simulations are performed for systems of two and three dipole-dipole-coupled molecular rotors under the influence of a control field. For the two-rotor system, the field is optimized to achieve either orientation or entanglement objectives. For the three-rotor system, the field is optimized either to orient all three rotors in the same direction or to orient one rotor in a particular direction while the other two rotors point in the opposite direction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Greedy emulators for nuclear two-body scattering

Applications of reduced basis method emulators are increasing in low-energy nuclear physics because they enable fast and accurate sampling of high-fidelity calculations, enabling robust uncertainty quantification. Here, in this paper, we develop, implement, and test two model-driven emulators based on the (Petrov-)Galerkin projection using the prototypical test case of two-body scattering with the Minnesota potential and a more realistic local chiral potential. The high-fidelity scattering equations are solved with the matrix Numerov method, a reformulation of the popular Numerov recurrence relation for solving special second-order differential equations as a linear system of coupled equations. A novel error estimator based on reduced-space residuals is applied to an active learning approach (a greedy algorithm) to choosing training samples (“snapshots”) for the emulator and contrasted with a proper orthogonal decomposition (POD) approach. Both approaches allow for computationally efficient offline-online decompositions, but the greedy approach requires many fewer snapshot calculations. These developments set the groundwork for emulating scattering observables based on chiral nucleon-nucleon and three-nucleon interactions and optical models, where computational speed-ups are necessary for Bayesian uncertainty quantification. Our emulators and error estimators are widely applicable to linear systems.

Bayesian methods↗

Multi-Model and Multi-Scale Global Sensitivity Analysis for Identifying Controlling Processes of Complex Systems

An environmental model consists of multiple process level sub-models, and each sub-model represents a process that is key to the operation of the simulated system. Global sensitivity analysis methods have been widely used to identify important processes for system model development and improvement. The existing methods of global sensitivity analysis only consider parametric uncertainty, and are not capable of handling model uncertainty caused by multiple process models that arise from competing hypotheses about one or more processes. To address this problem, this project develops a new method to probe model output sensitivity to competing process models by integrating model averaging methods with variance-based global sensitivity analysis to address uncertainty in process models and parameters. The new method yields three process sensitivity indices. The first one is called first-order process sensitivity index, and it is derived as a single summary measure of relative process importance. Evaluating the index is computationally expensive, because it relies in a Monte Carlo scheme that requires thousands and even millions of model executions. To reduce computational cost, this project develops a computationally efficient, quasi Monte Carlo method, and this method is presented in Chapter 2 of this report with and a numerical example for demonstration. The numerical example shows that the results of the quasi Monte Carlo method are substantially close to those of the full Monte Carlo method, but the computational cost of the quasi Monte Carlo method is only 0.7% of that of the full Monte Carlo method. The second index is called total-effect process sensitivity index, and it measures interactions between different processes. Therefore, this sensitivity index includes the first-order process sensitivity index, and can be used to identify influential processes. On the other hand, the total-effect process sensitivity index can also be used to screen non-influential processes. This is demonstrated by two numerical examples using the Sobol-G* functions and groundwater flow models that consider recharge process, geological process, and snowmelt process. The numerical examples shows that the total-effect process sensitivity index is more informative than the first-order process sensitivity. The derivation of the process sensitivity index and the numerical examples are discussed in Chapter 3. Chapter 4 presents two computationally efficient methods for screening non-influential processes to exclude them from further investigation. The two methods are the multi-model difference-based sensitivity (MMDS) analysis method, which can be implemented using the Latin Hypercube Sampling. The second one is the implementation of MMDS method using a binning method. The numerical example for the Sobol-G* function indicates the two methods are capable of identifying non-influential models, and the numerical examples for the groundwater flow and reactive transport show that the two methods are effective for groundwater problems. However, it should be noted that the two methods are numerical approximations, and they can only be used for screening non-influential processes, not for ranking importance of system processes. All the sensitivity analysis methods are implemented by developing python codes, and the codes are in a software called SAMMPY: a python package for process sensitivity analysis under multiple models. The SAMMPY design and structure are discussed in Chapter 5, and the package is released to the public for free download.

54 ENVIRONMENTAL SCIENCES↗

Data-Driven Learning for the Mori--Zwanzig Formalism: A Generalization of the Koopman Learning Framework

A theoretical framework which unifies the conventional Mori--Zwanzig formalism and the approximate Koopman learning of deterministic dynamical systems from noiseless observation is presented. In this framework, the Mori--Zwanzig formalism, developed in statistical mechanics to tackle the hard problem of construction of reduced-order dynamics for high-dimensional dynamical systems, can be considered as a natural generalization of the Koopman description of the dynamical system. We next show that, similar to the approximate Koopman learning methods, data-driven methods can be developed for the Mori--Zwanzig formalism with Mori's linear projection operator. We have developed two algorithms to extract the key operators, the Markov and the memory kernel, using time series of a reduced set of observables in a dynamical system. We have adopted the Lorenz `96 system as a test problem and solved for the above operators. These operators exhibit complex behaviors, which are unlikely to be captured by traditional modeling approaches in Mori--Zwanzig analysis. The nontrivial generalized fluctuation-dissipation relationship, which relates the memory kernel with the two-time correlation statistics of the orthogonal dynamics, was numerically verified as a validation of the solved operators. Here we present numerical evidence that the generalized Langevin equation, a key construct in the Mori--Zwanzig formalism, is more advantageous in predicting the evolution of the reduced set of observables than the conventional approximate Koopman operators.

97 MATHEMATICS AND COMPUTING↗

Clock model interpolation and symmetry breaking in O(2) models

The $q$-state clock model is a classical spin model that corresponds to the Ising model when $q=2$ and to the $XY$ model when $q\to\infty$. The integer-$q$ clock model has been studied extensively and has been shown to have a single phase transition when $q=2$,$3$,$4$ and two phase transitions when $q>4$.We define an extended $q$-state clock model that reduces to the ordinary $q$-state clock model when $q$ is an integer and otherwise is a continuous interpolation of the clock model to noninteger $q$. We investigate this class of clock models in 2D using Monte Carlo (MC) and tensor renormalization group (TRG) methods, and we find that the model with noninteger $q$ has a crossover and a second-order phase transition. We also define an extended-$O(2)$ model (with a parameter $\gamma$) that reduces to the $XY$ model when $\gamma=0$ and to the extended $q$-state clock model when $\gamma\to\infty$, and we begin to outline the phase diagram of this model. These models with noninteger $q$ serve as a testbed to study symmetry breaking in situations corresponding to quantum simulators where experimental parameters can be tuned continuously.

Hostetler, Leon↗

Sharp front tracking with geometric interface reconstruction

Here, this paper presents a novel sharp front-tracking method designed to address limitations in classical front-tracking approaches, specifically their reliance on smooth interpolation kernels and extended stencils for coupling the front and fluid mesh. In contrast, the proposed method employs exclusively sharp, localized interpolation and spreading kernels, restricting the coupling to the interfacial fluid cells–those containing the interface/front. This localized coupling is achieved by integrating a divergence-preserving velocity interpolation method with a piecewise parabolic interface calculation (PPIC) and a polyhedron intersection algorithm to compute the indicator function and local interface curvature. Surface tension is computed using the Continuum Surface Force (CSF) method, maintaining consistency with the sharp representation. Additionally, we propose an efficient local roughness smoothing implementation to account for surface mesh undulations, which is easily applicable to any triangulated surface mesh. Building on our previous work, the primary innovation of this study lies in the localization of the coupling for both the indicator function and surface tension calculations. By reducing the interface thickness on the fluid mesh to a single cell, as opposed to the 4–5 cell spans typical in classical methods, the proposed sharp front-tracking method achieves a highly localized and accurate representation of the interface. This sharper representation mitigates parasitic currents and improves force balancing, making it particularly suitable for scenarios where the interface plays a critical role, such as microfluidics, fluid-fluid interactions, and fluid-structure interactions. The proposed method is comprehensively validated and tested on canonical interfacial flow problems, including stationary and translating Laplace equilibria, oscillating droplets, and rising bubbles. The presented results demonstrate that the sharp front-tracking method significantly outperforms the classical approach in terms of accuracy, stability, and computational efficiency. Notably, parasitic currents are reduced by approximately two orders of magnitude and stable results are obtained for parameter ranges where classical front tracking fails to converge.

42 ENGINEERING↗

Fast uncertainty estimates in deep learning interatomic potentials

Deep learning has emerged as a promising paradigm to give access to highly accurate predictions of molecular and material properties. A common short-coming shared by current approaches, however, is that neural networks only give point estimates of their predictions and do not come with predictive uncertainties associated with these estimates. Existing uncertainty quantification efforts have primarily leveraged the standard deviation of predictions across an ensemble of independently trained neural networks. This incurs a large computational overhead in both training and prediction, resulting in order-of-magnitude more expensive predictions. Here, we propose a method to estimate the predictive uncertainty based on a single neural network without the need for an ensemble. This allows us to obtain uncertainty estimates with virtually no additional computational overhead over standard training and inference. We demonstrate that the quality of the uncertainty estimates matches those obtained from deep ensembles. We further examine the uncertainty estimates of our methods and deep ensembles across the configuration space of our test system and compare the uncertainties to the potential energy surface. Finally, we study the efficacy of the method in an active learning setting and find the results to match an ensemble-based strategy at order-of-magnitude reduced computational cost.

Chemistry↗

Reducing negative weights in Monte Carlo event generation with Sherpa

An increase in theoretical precision of Monte Carlo event generators is typically accompanied by an increased need for computational resources. One major obstacle are negative weighted events, which appear in Monte Carlo simulations with higher perturbative accuracy. While they can be handled somewhat easily in fixed-order calculations, they are a major concern for particle level event simulations. In this article, the origin of negative weights in the S-MC@NLO method is reviewed and mechanisms to reduce the negative weight fraction in simulations with the Sherpa event generator are presented, with a focus on V+jets and tt+jets simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Scientific Discovery with Physics-Informed System Identification (Abbreviated Report)

My fellowship research focused on making physics-based simulations faster and more useful through machine learning. Many problems in science and engineering are governed by partial differential equations, but high-fidelity simulations are often too expensive to run repeatedly. I worked on improving Latent Space Dynamics Identification (LaSDI), a reduced-order modeling framework that compresses large simulation data sets into a smaller representation and then learns how that representation evolves over time. The motivation was to develop reduced models that remain accurate for more challenging systems, especially when predictions must remain reliable over long time intervals or when the underlying dynamics are more complicated than standard methods can easily handle. I also contributed to related work on Quandary, a high-performance software effort for simulation and control of open quantum systems, before focusing primarily on Latent Space Dynamics Identification methods. The main outcomes of the fellowship were two new algorithms (both of which were published), Rollout-LaSDI and Higher-Order LaSDI, together with supporting work on multi-stage Latent Space Dynamics Identification. Rollout-LaSDI improved long-term prediction by training the model to stay accurate over extended time horizons, and Higher-Order LaSDI broadened the method so it could model systems with higher-order time dynamics. My contributions to multistage Latent Space Dynamics Identification also helped show that its later training stages could be simplified without losing effectiveness, and that this behavior held across different model architectures and training strategies. Taken together, these advances improved the accuracy, flexibility, and practical value of reduced-order modeling tools for computational science.

97 MATHEMATICS AND COMPUTING↗

Observer-Based Nonlinear Control Scheme to Reduce Oscillations and Zero Crossing in Skid-Steer Vehicles

Motion sickness is a common condition experienced by drivers of skid-steer vehicles, primarily caused by zero crossing and oscillations in undamped systems. This study proposes an observer-based nonlinear control scheme to reduce transient oscillations and zero-crossing phenomena in skid-steer vehicles, thereby potentially alleviating motion sickness. Reducing transient oscillations and zero crossing in the transient response may alleviate motion sickness. A nonlinear damping controller is designed to improve transient response by reducing oscillations and zero-crossing. To design the controller, a reduced-order kinematic model based on coordinate transformation is developed. This transformation not only converts the system modeling into a controllable form but also enhances control performance. Modeling error is addressed by considering the distance between the center of the vehicle and the sensor location. Despite these improvements, model uncertainties and external disturbances remain, which may degrade control performance. To ensure robustness and estimate such disturbances, a high-order sliding mode observer (HOSMO) is incorporated. The effectiveness of the proposed method is validated through MATLAB/Simulink and TruckMaker simulations. From the simulation results, it was shown that the proposed method reduced the mean squared error of the tracking error to within 10 % compared to the state feedback controller with the HOSMO.

Seo, Jiwon [Chung-Ang University, Seoul (Korea, Re↗

Sulfidation of magnetite with incorporated uranium

Uranium (U) is a radionuclide of key environmental interest due its abundance by mass within radioactive waste and presence in contaminated land scenarios. Ubiquitously present iron (oxyhydr)oxide mineral phases, such as (nano)magnetite, have been identified as candidates for immobilisation of U via incorporation into the mineral structure. Studies of how biogeochemicalprocesses, such as sulfidation from the presence of sulfate-reducing bacteria, may affect iron (oxyhydr)oxides and impact radionuclide mobility are important in order to underpin geological disposal of radioactive waste and manage radioactively contaminated land. Here, this study utilised a highly controlled abiotic method for sulfidation of U(V) incorporated into nanomagnetite to determine the fate and speciation of U. Upon sulfidation, transient release of U into solution occurred (~8.6 % total U) for up to 3 days, despite the highly reducing conditions. As the system evolved, lepidocrocite was observed to form over a period of days to weeks. After 10 months, XAS and geochemical data showed all U was partitioned to the solid phase, as both nanoparticulate uraninite (U(IV)O2) and a percentage of retained U(V). Further EXAFS analysis showed incorporation of the residual U(V) fraction into an iron (oxyhydr)oxide mineral phase, likely nanomagnetite or lepidocrocite. Overall, these results provide new insights into the stability of U(V) incorporated iron (oxyhydr)oxides during sulfidation, confirming the longer term retention of U in the solid phase under complex, environmentally relevant conditions.

Townsend, Luke↗

Revisiting matrix-based inversion of scanning mobility particle sizer (SMPS) and humidified tandem differential mobility analyzer (HTDMA) data

Abstract. Tikhonov regularization is a tool for reducing noise amplification during data inversion. This work introduces RegularizationTools.jl, a general-purpose software package for applying Tikhonov regularization to data. The package implements well-established numerical algorithms and is suitable for systems of up to ∼ 1000 equations. Included is an abstraction to systematically categorize specific inversion configurations and their associated hyperparameters. A generic interface translates arbitrary linear forward models defined by a computer function into the corresponding design matrix. This obviates the need to explicitly write out and discretize the Fredholm integral equation, thus facilitating fast prototyping of new regularization schemes associated with measurement techniques. Example applications include the inversion involving data from scanning mobility particle sizers (SMPSs) and humidified tandem differential mobility analyzers (HTDMAs). Inversion of SMPS size distributions reported in this work builds upon the freely available software DifferentialMobilityAnalyzers.jl. The speed of inversion is improved by a factor of ∼ 200, now requiring between 2 and 5 ms per SMPS scan when using 120 size bins. Previously reported occasional failure to converge to a valid solution is reduced by switching from the L-curve method to generalized cross-validation as the metric to search for the optimal regularization parameter. Higher-order inversions resulting in smooth, denoised reconstructions of size distributions are now included in DifferentialMobilityAnalyzers.jl. This work also demonstrates that an SMPS-style matrix-based inversion can be applied to find the growth factor frequency distribution from raw HTDMA data while also accounting for multiply charged particles. The outcome of the aerosol-related inversion methods is showcased by inverting multi-week SMPS and HTDMA datasets from ground-based observations, including SMPS data obtained at Bodega Marine Laboratory during the CalWater 2/ACAPEX campaign and co-located SMPS and HTDMA data collected at the US Department of Energy observatory located at the Southern Great Plains site in Oklahoma, USA. Results show that the proposed approaches are suitable for unsupervised, nonparametric inversion of large-scale datasets as well as inversion in real time during data acquisition on low-cost reduced-instruction-set architectures used in single-board computers. The included software implementation of Tikhonov regularization is freely available, general, and domain-independent and thus can be applied to many other inverse problems arising in atmospheric measurement techniques and beyond.

54 ENVIRONMENTAL SCIENCES↗

Model fusion with physics-guided machine learning: Projection-based reduced-order modeling

The unprecedented amount of data generated from experiments, field observations, and large-scale numerical simulations at a wide range of spatiotemporal scales has enabled the rapid advancement of data-driven and especially deep learning models in the field of fluid mechanics. Although these methods are proven successful for many applications, there is a grand challenge of improving their generalizability. This is particularly essential when data-driven models are employed within outer-loop applications like optimization. In this work, we put forth a physics-guided machine learning (PGML) framework that leverages the interpretable physics-based model with a deep learning model. Leveraging a concatenated neural network design from multi-modal data sources, the PGML framework is capable of enhancing the generalizability of data-driven models and effectively protects against or inform about the inaccurate predictions resulting from extrapolation. We apply the PGML framework as a novel model fusion approach combining the physics-based Galerkin projection model and long- to short-term memory (LSTM) network for parametric model order reduction of fluid flows. We demonstrate the improved generalizability of the PGML framework against a purely data-driven approach through the injection of physics features into intermediate LSTM layers. Our quantitative analysis shows that the overall model uncertainty can be reduced through the PGML approach, especially for test data coming from a distribution different than the training data. Moreover, we demonstrate that our approach can be used as an inverse diagnostic tool providing a confidence score associated with models and observations. The proposed framework also allows for multi-fidelity computing by making use of low-fidelity models in the online deployment of quantified data-driven models.

42 ENGINEERING↗