SEARCH · Engineering Papers

Results for “Mathematical physics methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Limited-view Cone Beam CT reconstruction using 3D Patch-based Supervised and Adversarial Learning [Slides]

We present a novel machine learning CNN architecture that can learn from limited data combined appropriately with physics and statistical priors (e.g., forward models and noise models). To address the limited availability of training data we adopt a 3D patch-based approach for our models. Patch-based learning is central to several image reconstruction methods and demands fewer training data than DL approaches, as a single data volume can be broken into several millions of overlapping 3D sub-volumes or patches. This creates a very large number of training sub-volumes from a limited number of overall image volumes. A 3D Generative Adversarial Networks (GAN) is then trained to remove artifacts at the sub-volume level. The combination of a sub-volume-based approach with DL allows us to exploit the richness of the latter in extracting and representing image features, while avoiding risks associated with overfitting due to limited training data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2021

On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks

Physics-informed neural networks (PINNs) are demonstrating remarkable promise in integrating physical models with gappy and noisy observational data, but they still struggle in cases where the target functions to be approximated exhibit high-frequency or multi-scale features. Here in this work we investigate this limitation through the lens of Neural Tangent Kernel (NTK) theory and elucidate how PINNs are biased towards learning functions along the dominant eigen-directions of their limiting NTK. Using this observation, we construct novel architectures that employ spatio-temporal and multi-scale random Fourier features, and justify how such coordinate embedding layers can lead to robust and accurate PINN models. Numerical examples are presented for several challenging cases where conventional PINN models fail, including wave propagation and reaction–diffusion dynamics, illustrating how the proposed methods can be used to effectively tackle both forward and inverse problems involving partial differential equations with multi-scale behavior.

42 ENGINEERING↗

DOE OSTI2024

Trust-Based Detection and Mitigation of Cyber Attacks in Distributed Cooperative Control of Islanded AC Microgrids

In this study, we address the challenge of detecting and mitigating cyber attacks in the distributed cooperative control of islanded AC microgrids, with a particular focus on detecting False Data Injection Attacks (FDIAs), a significant threat to the Smart Grid (SG). The SG integrates traditional power systems with communication networks, creating a complex system with numerous vulnerable links, making it a prime target for cyber attacks. These attacks can lead to the disclosure of private data, control network failures, and even blackouts. Unlike machine learning-based approaches that require extensive datasets and mathematical models dependent on accurate system modeling, our method is free from such dependencies. To enhance the microgrid’s resilience against these threats, we propose a resilient control algorithm by introducing a novel trustworthiness parameter into the traditional cooperative control algorithm. Our method evaluates the trustworthiness of distributed energy resources (DERs) based on their voltage measurements and exchanged information, using Kullback-Leibler (KL) divergence to dynamically adjust control actions. We validated our approach through simulations on both the IEEE-34 bus feeder system with eight DERs and a larger microgrid with twenty-two DERs. The results demonstrated a detection accuracy of around 100%, with millisecond range mitigation time, ensuring rapid system recovery. Additionally, our method improved system stability by up to almost 100% under attack scenarios, showcasing its effectiveness in promptly detecting attacks and maintaining system resilience. These findings highlight the potential of our approach to enhance the security and stability of microgrid systems in the face of cyber threats.

Computer Science↗

DOE OSTI2021

PPPL Laboratory Directed Research and Development (Project Final Reports, FY2018 - FY2020)

The U.S. Department of Energy’s (DOE) Princeton Plasma Physics Laboratory (PPPL) is a collaborative national center for fusion energy science, basic sciences, and advanced technology. The Laboratory has three major missions: (1) to develop the scientific knowledge and advanced engineering to enable fusion to power the U.S. and the world; (2) to advance the science of nanoscale fabrication for technologies of tomorrow; and (3) to further the development of the scientific understanding of the plasma universe from laboratory to astrophysical scales. PPPL’s Laboratory Directed Research and Development (LDRD) program supports and encourages creativity and innovation and contributes to its long-term viability. New scientific and technical research areas emerge and are nurtured through the program. Furthermore, new capabilities are developed to enable the Laboratory to meet its and DOE’s missions. The program is used to systematically diversify the Laboratory’s programs and mission. In the last few years, the program has started projects in nanomaterial synthesis, microelectronics, advanced x-ray spectroscopy, high-energy-density physics, superconducting magnet technology, machine learning and artificial intelligence, 3D magnetic fields to optimize fusion plasmas, integration of permanent magnets with simple high-field magnets to reduce the cost of producing complex 3D magnetic fields, advanced computational methods for predictive understanding and control of fusion plasma, development of quantum computing algorithms for plasma physics, liquid metal plasma-facing components for fusion reactors, virtual engineering, and plasma-based space propulsion. The program is also the vehicle to recruit and train talented scientists and engineers with the new skills needed to perform the Laboratory’s mission. Many of the new hires through the program go on to become world-class scientists and engineers in their fields. This report provides descriptions and accomplishments of those LDRD projects that were completed during fiscal years 2018 through 2020.

36 MATERIALS SCIENCE↗

DOE OSTI2022

aphBO-2GP-3B: a budgeted asynchronous parallel multi-acquisition functions for constrained Bayesian optimization on high-performing computing architecture

High-fidelity complex engineering simulations are often predictive, but also computationally expensive and often require substantial computational efforts. The mitigation of computational burden is usually enabled through parallelism in high-performance cluster (HPC) architecture. Optimization problems associated with these applications is a challenging problem due to the high computational cost of the high-fidelity simulations. In this paper, an asynchronous parallel constrained Bayesian optimization method is proposed to efficiently solve the computationally expensive simulation-based optimization problems on the HPC platform, with a budgeted computational resource, where the maximum number of simulations is a constant. The advantage of this method are three-fold. Firstly, the efficiency of the Bayesian optimization is improved, where multiple input locations are evaluated parallel in an asynchronous manner to accelerate the optimization convergence with respect to physical runtime. This efficiency feature is further improved so that when each of the inputs is finished, another input is queried without waiting for the whole batch to complete. Second, the proposed method can handle both known and unknown constraints. Third, the proposed method samples several acquisition functions based on their rewards using a modified GP-Hedge scheme. The proposed framework is termed aphBO-2GP-3B, which means asynchronous parallel hedge Bayesian optimization with two Gaussian processes and three batches. The numerical performance of the proposed framework aphBO-2GP-3B is comprehensively benchmarked using 16 numerical examples, compared against other 6 parallel Bayesian optimization variants and 1 parallel Monte Carlo as a baseline, and demonstrated using two real-world high-fidelity expensive industrial applications. The first engineering application is based on finite element analysis (FEA) and the second one is based on computational fluid dynamics (CFD) simulations.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Efficient learning of accurate surrogates for simulations of complex systems

Machine learning methods are increasingly deployed to construct surrogate models for complex physical systems at a reduced computational cost. However, the predictive capability of these surrogates degrades in the presence of noisy, sparse or dynamic data. Here, we introduce an online learning method empowered by optimizer-driven sampling that has two advantages over current approaches: it ensures that all local extrema (including endpoints) of the model response surface are included in the training data, and it employs a continuous validation and update process in which surrogates undergo retraining when their performance falls below a validity threshold. We find, using benchmark functions, that optimizer-directed sampling generally outperforms traditional sampling methods in terms of accuracy around local extrema even when the scoring metric is biased towards assessing overall accuracy. Finally, the application to dense nuclear matter demonstrates that highly accurate surrogates for a nuclear equation-of-state model can be reliably autogenerated from expensive calculations using few model evaluations.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

Improved energies and local energies with weighted variational Monte Carlo

Neural network parametrizations have increasingly been used to represent the ground and excited states in variational Monte Carlo (VMC) with promising results. However, traditional VMC methods only optimize the wave function in regions of peak probability. The wave function is uncontrolled in the tails of the probability distribution, which can limit the accuracy of the trained wave function. To improve the approximation accuracy in the probability tails, this paper interprets VMC as a gradient flow in the space of wave functions, followed by a projection step. From this perspective, arbitrary probability distributions can be used in the projection step, allowing the user to prioritize accuracy in different regions of state space. Motivated by this theoretical perspective, the paper tests a weighted VMC method on the antiferromagnetic Heisenberg model for a periodic spin chain. Compared to traditional VMC, weighted VMC reduces the error in the ground state energy by a factor of 2, and it reduces the errors in the local energies away from the mode by large factors of 10 2 –10 4 .

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2021

Improving Prediction of Peroxide Value of Edible Oils Using Regularized Regression Models

We present four unique prediction techniques, combined with multiple data pre-processing methods, utilizing a wide range of both oil types and oil peroxide values (PV) as well as incorporating natural aging for peroxide creation. Samples were PV assayed using a standard starch titration method, AOCS Method Cd 8-53, and used as a verified reference method for PV determination. Near-infrared (NIR) spectra were collected from each sample in two unique optical pathlengths (OPLs), 2 and 24 mm, then fused into a third distinct set. All three sets were used in partial least squares (PLS) regression, ridge regression, LASSO regression, and elastic net regression model calculation. While no individual regression model was established as the best, global models for each regression type and pre-processing method show good agreement between all regression types when performed in their optimal scenarios. Furthermore, small spectral window size boxcar averaging shows prediction accuracy improvements for edible oil PVs. Best-performing models for each regression type are: PLS regression, 25 point boxcar window fused OPL spectral information RMSEP = 2.50; ridge regression, 5 point boxcar window, 24 mm OPL, RMSEP = 2.20; LASSO raw spectral information, 24 mm OPL, RMSEP = 1.80; and elastic net, 10 point boxcar window, 24 mm OPL, RMSEP = 1.91. The results show promising advancements in the development of a full global model for PV determination of edible oils.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

NRC Multiphysics Analysis Capability Deployment FY21: Part 3

This report details the progress and activities of Idaho National Laboratory (INL) on the Nuclear Regulatory Commission (NRC) project “Development and Modeling Support for Advanced Non-Light Water Reactors.” The deliverables completed for this report are: Deliverable 1c: the capability to model gas mixtures was added to Pronghorn. A test problem mimicking the conditions achieved in a depressurized loss of forced cooling (DLOFC) event was solved with both RELAP-5 and Pronghorn. Pronghorn employed a finite vol ume method with the Kurganov-Tadmor discretization. The comparison between the mass fraction spatial profiles computed with RELAP-5 and Pronghorn clearly shows the presence of numerical artifacts (i.e., overly diffusive behavior at low Mach numbers). We confirmed that the problem disappears at higher Mach numbers. We recommend future work on the implementation of a low Mach finite volume formulation to better treat low Mach number problems. Deliverable 2a: we demonstrated two approaches to model the radiation/conduction/natural convection heat transfer across a stagnant gas for the PBMR-400 design using Pronghorn. The first approach is based on the net radiation method, which relies on the computation of view factors with the Multiphysics Object-Oriented Simulation Environment (MOOSE) ray tracing capability. The second method is a traditional thermal resistance approach. The test problems include both 2D and 3D geometries. In all cases, the results show very good agreement during a DLOFC transient. This confirms that the faster thermal resistance method produces solutions that are equivalent to the net radiation method for this geometry. Deliverable 3d: we demonstrated the use of the advection kernel for the delayed neutron precursor equation in Griffin with a 2D MSFR model. The results appear physical but further verification is recommended. We also recommend the addition of conjugate heat transfer to compute the temperatures and model the thermomechanic behavior of the reflectors and other structures. Significant memory and performance issues were encountered in the 3D axisymmetric model. Future work is recommended in this area. Task 8g: this task allows multidimensional MOOSE applications to be coupled to system codes (RELAP-7 and SAM). We implemented a faster multiphysics iteration coupling algorithm, which provides an overall 6× acceleration of the 3D-1D coupling of the core multidi- mensional fluid flow solver and the 1D primary and secondary loop model.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

Polynomial Chaos Surrogate Construction for Random Fields with Parametric Uncertainty

Engineering and applied science rely on computational experiments to rigorously study physical systems. The mathematical models used to probe these systems are highly complex, and sampling-intensive studies often require prohibitively many simulations for acceptable accuracy. Surrogate models provide a means of circumventing the high computational expense of sampling such complex models. In particular, polynomial chaos expansions (PCEs) have been successfully used for uncertainty quantification studies of deterministic models where the dominant source of uncertainty is parametric. We discuss an extension to conventional PCE surrogate modeling to enable surrogate construction for stochastic computational models that have intrinsic noise in addition to parametric uncertainty. We develop a PCE surrogate on a joint space of intrinsic and parametric uncertainty, enabled by Rosenblatt transformations, which are evaluated via kernel density estimation of the associated conditional cumulative distributions. Furthermore, we extend the construction to random field data via the Karhunen–Loève expansion. We then take advantage of closed-form solutions for computing PCE Sobol indices to perform a global sensitivity analysis of the model which quantifies the intrinsic noise contribution to the overall model output variance. Additionally, the resulting joint PCE is generative in the sense that it allows generating random realizations at any input parameter setting that are statistically approximately equivalent to realizations from the underlying stochastic model. The method is demonstrated on a chemical catalysis example model and a synthetic example controlled by a parameter that enables a switch from unimodal to bimodal response distributions.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Hubbard-corrected oxide formation enthalpies without adjustable parameters

A density functional theory (DFT) approach to computing transition metal oxide heat of formation without adjustable parameters is presented. Different degrees of d-electron localization in oxides are treated within the DFT+U approach with site-dependent, first-principles Hubbard U-parameters obtained from linear response theory, and delocalized states in the metallic phases are treated without Hubbard corrections. Comparison of relative stabilities of these differently treated phases is enabled by a local d-electron density matrix-dependent model, which was found by genetic programming against experimental reference formation enthalpies. This mathematically simple model does not explicitly depend on the Hubbard-corrected ionic species and is shown to reproduce the heats of formation of the Mott insulators Ca 2 RuO 4 and Y 2 Ru 2 O 7 within ~3% of experimental results, where the experimental training data did not contain Ru oxides. This newly developed method thus absolves from the need for element-specific corrections fitted to experiments in existing Hubbard-corrected approaches to the prediction of reaction energies of transition metal oxides and metals. The absence of fitting parameters opens up here the possibility to predict relative thermodynamic stabilities and reaction energies involving d-states of varying degree of localization at transition metal oxide interfaces and defects, where site-dependent U-parameters will be particularly important and devising a fitting scheme against experimental data with predictive power would be exceedingly difficult.

transition metal oxides↗

DOE OSTI2023

Control of multi-agent systems: Results, open problems, and applications

The purpose of this review article is to present some recent results on the modeling and control of large systems of agents. We focus on particular applications where the agents are capable of independent actions instead of simply reacting to external forces. In the literature, such agents were referred to as autonomous, intelligent, self-propelled, greedy, and others. The main applications we have in mind are social systems (as opinion dynamics), pedestrians’ movements (also called crowd dynamics), animal groups, and vehicular traffic. We note that the last three examples include physical constraints; however, the agents are able to inject energy into the system, thus preventing the typical conservation of momentum and energy. In addition, the control problems posed by such systems are new and require innovative methods. We illustrate some ideas developed recently, including the use of sparse controls, limiting the total variation of controls, and defining new control problems for measures. After reviewing various approaches, we discuss some future research directions of potential interest. The latter encompasses both new types of equations and new types of limiting procedures to connect several scales at which a system can be represented. We conclude by illustrating a recent real-life experiment using autonomous vehicles on an open highway to smooth traffic waves. This opens the door to a new era of interventions to control real-time multi-agent systems and to increase the societal impact of such interventions guided by control research.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Quantum Foundations of Classical Reversible Computing

The reversible computation paradigm aims to provide a new foundation for general classical digital computing that is capable of circumventing the thermodynamic limits to the energy efficiency of the conventional, non-reversible digital paradigm. However, to date, the essential rationale for, and analysis of, classical reversible computing (RC) has not yet been expressed in terms that leverage the modern formal methods of non-equilibrium quantum thermodynamics (NEQT). In this paper, we begin developing an NEQT-based foundation for the physics of reversible computing. We use the framework of Gorini-Kossakowski-Sudarshan-Lindblad dynamics (a.k.a. Lindbladians) with multiple asymptotic states, incorporating recent results from resource theory, full counting statistics and stochastic thermodynamics. Important conclusions include that, as expected: (1) Landauer’s Principle indeed sets a strict lower bound on entropy generation in traditional non-reversible architectures for deterministic computing machines when we account for the loss of correlations; and (2) implementations of the alternative reversible computation paradigm can potentially avoid such losses, and thereby circumvent the Landauer limit, potentially allowing the efficiency of future digital computing technologies to continue improving indefinitely. We also outline a research plan for identifying the fundamental minimum energy dissipation of reversible computing machines as a function of speed.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Physics-Informed Machine Learning of Dynamical Systems for Efficient Bayesian Inference

Although the no-u-turn sampler (NUTS) is a widely adopted method for performing Bayesian inference, it requires numerous posterior gradients which can be expensive to compute in practice. Recently, there has been a significant interest in physics-based machine learning of dynamical (or Hamiltonian) systems and Hamiltonian neural networks (HNNs) is a noteworthy architecture. But these types of architectures have not been applied to solve Bayesian inference problems efficiently. We propose the use of HNNs for performing Bayesian inference efficiently without requiring numerous posterior gradients. We introduce latent variable outputs to HNNs (L-HNNs) for improved expressivity and reduced integration errors. We integrate L-HNNs in NUTS and further propose an online error monitoring scheme to prevent sampling degeneracy in regions where L-HNNs may have little training data. We demonstrate L-HNNs in NUTS with online error monitoring consider several complex high-dimensional posterior densities and compare its performance to NUTS.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

A robust framework for frictional fault contact in geological formations using a stabilized augmented Lagrangian approach

Numerical simulations are essential to evaluate the performance and safety of engineered subsurface systems such as geological carbon storage sites, enhanced geothermal fields, and oil and gas reservoirs. A key challenge lies in accurately modeling the frictional contact behavior along fault surfaces. This problem involves inequality constraints that arise from the physics of frictional slip, requiring specialized numerical methods to handle the resulting highly nonlinear and path-dependent behavior. Here, in this work, we address this challenge using an Augmented Lagrangian Method (ALM) implemented via the Uzawa algorithm. The formulation employs mixed finite element spaces, combining low-order piecewise linear displacements within the 3D domain cells with piecewise constant tractions defined on the fault surfaces. Furthermore, to ensure stability and satisfy the inf-sup condition, the discrete displacement space is enriched with face bubble functions on both sides of the contact interfaces. This approach offers several advantages over other stabilization techniques that rely on additional terms, and it integrates naturally in the Uzawa framework.

58 GEOSCIENCES↗

DOE OSTI2023

A Lattice Boltzmann Method for Predicting Porous Transport Layer Performance During Electrolysis

Electrolysis, the splitting of water into oxygen and hydrogen using electricity, is a sustainable way to produce green hydrogen for energy storage. In polymer electrolyte membrane (PEM) water electrolysis, water is brought into contact with charged catalyst layers and electrochemically separated into oxygen and hydrogen. The hydrogen product formed at the cathode is carried through the catalyst layer for eventual collection, while the oxygen by-product formed at the anode is removed from the surface via a multiphase interaction with circulating water and a solid porous transport layer (PTL). The design of this PTL aids in the detachment and advection of the oxygen by-product and thereby plays a role in the overall efficacy of the catalyst. In this presentation, we present our initial results modeling this multiphase system using a single-component, multiphase lattice Boltzmann method. We use the Shan-Chen model describing inter-particle forces to capture both the cohesion of the water (liquid) and oxygen (gas) phases and their interaction with the PTL (solid) (Shan and Chen, 1993). We use a Carnahan-Starling equation of state to model the effective density governing these inter-particle interactions which allows us to model this relatively high density ratio system (Carnahan and Starling, 1969). With these simulations, we show that the geometry and heterogeneity of the PTL geometry plays a large role in its ability to move oxygen away from the catalyst layer and the resulting bubble structures that are formed within the PTL. The current work demonstrates these effects using synthesized PTL geometries and 2D physics, which will be extended to experimentally-imaged PTL sections and 3D algorithms in the near future.

Boltzmann↗

DOE OSTI2023

A high‐order discontinuous Galerkin approach for physics‐based thermospheric modeling

Abstract The accurate prediction of aerodynamic drag on satellites orbiting in the upper atmosphere is critical to the operational success of modern space technologies, such as satellite‐based communication or navigation systems, which have become increasingly popular in the last few years due to the deployment of constellations of satellites in low‐Earth orbit. As a result, physics‐based models of the ionosphere and thermosphere have emerged as a necessary tool for the prediction of atmospheric outputs under highly variable space weather conditions. This paper proposes a high‐fidelity approach for physics‐based space weather modeling based on the solution of the Navier–Stokes equations using a high‐order discontinuous Galerkin method, combined with a matrix‐free strategy suitable for high‐performance computing on GPU architectures. The approach consists of a thermospheric model that describes a chemically frozen neutral atmosphere in nonhydrostatic equilibrium driven by the external excitation of the Sun. A novel set of variables is considered to treat the low densities present in the upper atmosphere and to accommodate the wide range of scales present in the problem. At the same time, and unlike most existing approaches, radial and angular directions are treated in a nonsegregated approach. The study presents a set of numerical examples that demonstrate the accuracy of the approximation and validate the current approach against observational data along a satellite orbit, including estimates of established empirical and physics‐based models of the ionosphere‐thermosphere system. Finally, a one‐dimensional radial derivation of the physics‐based model is presented and utilized for conducting a parametric study of the main thermal quantities under various solar conditions.

Engineering↗

DOE OSTI2026

Accelerating multicanonical sampling with irreversibility

Flat-histogram Monte Carlo simulations are well-established, robust methods to perform random walks in a physical observable or parameter space, making them suitable for finding ground states or studying phase transitions in complex systems in statistical physics. However, their efficiency can be limited by the time to attain the desired flat distribution, which is generally unknown prior to the simulations. In particular, they might suffer from slowing down towards the end of a simulation due to the diffusive nature of random walks. In this work we apply irreversibility to the multicanonical Monte Carlo method via the lifting approach to alleviate this behavior. We achieve a 2–4 times speedup in ground-state search for a two-dimensional (2D) Ising model, and up to an order of magnitude of speedup for finding the ground-state energy in an Edwards–Anderson spin glass, compared to traditional multicanonical sampling. In conclusion, the round-trip times between ground states show a narrower distribution and are significantly shorter compared to the reversible counterpart, suggesting that a lower convergence time with a smaller time variance is feasible.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗