Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Physics Regularization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

The National Solar Radiation Database (NSRDB) Fiscal Years 2019-2021(Final Report)

The National Solar Radiation Database (NSRDB) is the leading public source of high-resolution solar resource data in the United States, with more than 166,000 users annually. This database represents the state of the art in satellite-based estimation of solar resource information and uses a unique physics-based modeling approach that enables improvements in accuracy with the deployment of the next-generation geostationary satellites. Making the highest quality, state-of-the-art, regularly updated data sets available on a timely basis for users reduces costs of solar deployment by providing accurate information for siting studies and system output prediction, and thereby reduces levelized cost of energy. Also, high-resolution information from the NSRDB enables moving beyond levelized cost of energy when valuing the impact of renewables on the grid. Additionally, the NSRDB enables the integration of large amounts of solar on the grid by providing critical information about solar availability and variability that is used to enhance grid reliability and power quality.

14 SOLAR ENERGY↗
DOE OSTI2022

Health Assessment and Performance Monitoring of Large Machine Diagnostics

Presentation to be given at the CCS-6 Statistical Seminar Series. Regularly maintained and operated diagnostic machines are a backbone of data collection and are a vital component of the Stockpile Stewardship Program’s efforts to better understand nuclear physics. The Cygnus X-ray machine, stationed at the Nevada National Security Site’s U1a underground facility, is one such diagnostic that provides a radiographic capability for the subcritical experiment program. Component failures within Cygnus can result in catastrophic downtime for the diagnostic, affecting performance, schedules, and cost. However, over the years various measurements have been collected on the two Cygnus axes, including voltage and current measurements at different locations, which we believe have predictive power to indicate machine health. We will share preliminary insight into this data and the machine learning approaches we are taking to assess Cygnus’ health, observe declining performance, and predict failures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

On the Analysis of the Tin-Inside-H 3 S Mössbauer Experiment

Here, a simple analysis is presented of the particular experiment used to prove the bulk nature of very-high-Tc superconductivity in H 3 S compound under ultra-high pressure. In the experiment, an internal magnetic field was sensed by the synchrotron Mössbauer spectroscopy in tin placed inside the H 3 S sample. The experiment showed peculiar anisotropy with respect to the direction of the applied field at first sight. By considering actual experimental geometries and parameters of the experiment, we show that this particular observation is consistent with the expectations for a regular type-II superconductor with Meissner expulsion and pinning.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Quantitative imaging and automated fuel pin identification for passive gamma emission tomography

Compliance of member States to the Treaty on the Non-Proliferation of Nuclear Weapons is monitored through nuclear safeguards. The Passive Gamma Emission Tomography (PGET) system is a novel instrument developed within the framework of the International Atomic Energy Agency (IAEA) project JNT 1510, which included the European Commission, Finland, Hungary and Sweden. The PGET is used for the verification of spent nuclear fuel stored in water pools. Advanced image reconstruction techniques are crucial for obtaining high-quality cross-sectional images of the spent-fuel bundle to allow inspectors of the IAEA to monitor nuclear material and promptly identify its diversion. In this work, we have developed a software suite to accurately reconstruct the spent-fuel cross sectional image, automatically identify present fuel rods, and estimate their activity. Unique image reconstruction challenges are posed by the measurement of spent fuel, due to its high activity and the self-attenuation. While the former is mitigated by detector physical collimation, we implemented a linear forward model to model the detector responses to the fuel rods inside the PGET, to account for the latter. The image reconstruction is performed by solving a regularized linear inverse problem using the fast-iterative shrinkage-thresholding algorithm. We have also implemented the traditional filtered back projection (FBP) method based on the inverse Radon transform for comparison and applied both methods to reconstruct images of simulated mockup fuel assemblies. Higher image resolution and fewer reconstruction artifacts were obtained with the inverse-problem approach, with the mean-square-error reduced by 50%, and the structural-similarity improved by 200%. We then used a convolutional neural network (CNN) to automatically identify the bundle type and extract the pin locations from the images; the estimated activity levels finally being compared with the ground truth. The proposed computational methods accurately estimated the activity levels of the present pins, with an associated uncertainty of approximately 5%.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Strictly Enforcing Invertibility and Conservation in CNN-Based Super Resolution for Scientific Datasets

Abstract Recently, deep convolutional neural networks (CNNs) have revolutionized image “super resolution” (SR), dramatically outperforming past methods for enhancing image resolution. They could be a boon for the many scientific fields that involve imaging or any regularly gridded datasets: satellite remote sensing, radar meteorology, medical imaging, numerical modeling, and so on. Unfortunately, while SR-CNNs produce visually compelling results, they do not necessarily conserve physical quantities between their low-resolution inputs and high-resolution outputs when applied to scientific datasets. Here, a method for “downsampling enforcement” in SR-CNNs is proposed. A differentiable operator is derived that, when applied as the final transfer function of a CNN, ensures the high-resolution outputs exactly reproduce the low-resolution inputs under 2D-average downsampling while improving performance of the SR schemes. The method is demonstrated across seven modern CNN-based SR schemes on several benchmark image datasets, and applications to weather radar, satellite imager, and climate model data are shown. The approach improves training time and performance while ensuring physical consistency between the super-resolved and low-resolution data. Significance Statement Recent advancements in using deep learning to increase the resolution of images have substantial potential across the many scientific fields that use images and image-like data. Most image super-resolution research has focused on the visual quality of outputs, however, and is not necessarily well suited for use with scientific data where known physics constraints may need to be enforced. Here, we introduce a method to modify existing deep neural network architectures so that they strictly conserve physical quantities in the input field when “super resolving” scientific data and find that the method can improve performance across a wide range of datasets and neural networks. Integration of known physics and adherence to established physical constraints into deep neural networks will be a critical step before their potential can be fully realized in the physical sciences.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

The National Solar Radiation Database Final Report: Fiscal Years 2022-2024

The National Solar Radiation Database (NSRDB) is the leading public source of high-resolution solar resource data in the United States, with more than 400,000 users annually. This database represents the state of the art in the satellite-based estimation of solar resource information and uses a unique physics-based modeling approach that enables improvements in accuracy with the deployment of the next-generation geostationary satellites. Making the highest-quality, state-of-the-art, regularly updated datasets available on a timely basis for users reduces costs of solar deployment by providing accurate information for siting studies and system output prediction and thereby reduces project financing costs and risks.

14 SOLAR ENERGY↗
DOE OSTI2025

Physics-guided dual implicit neural representations for source separation

Significant challenges exist in efficient data analysis of most advanced experimental and observational techniques because the collected signals often include unwanted contributions, such as background and signal distortions, that can obscure the physically relevant information of interest. To address this, we have developed a self-supervised machine-learning approach for source separation using a dual implicit neural representation framework that jointly trains two neural networks: one for approximating distortions of the physical signal of interest and the other for learning the effective background contribution. Our method learns directly from the raw data by minimizing a reconstruction-based loss function without requiring labeled data or pre-defined dictionaries. We demonstrate the effectiveness of our framework by considering a challenging case study involving large-scale simulated, as well as experimental, momentum-energy-dependent inelastic neutron scattering data in a four-dimensional parameter space, characterized by heterogeneous background contributions and unknown distortions to the target signal. The method is found to successfully separate physically meaningful signals from a complex or structured background even when the signal characteristics vary across all four dimensions of the parameter space. An analytical approach that informs the choice of the regularization parameter is presented. Our method offers a versatile framework for addressing source separation problems across diverse domains, ranging from superimposed signals in astronomical measurements to structural features in biomedical image reconstructions.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Accelerating Markov Chain Monte Carlo sampling with diffusion models

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a Metropolis-Hastings algorithm with a diffusion model that can draw global samples with the aim of approximating the posterior. We briefly review diffusion models in the context of image synthesis before providing a streamlined diffusion model tailored towards low-dimensional data arrays. We then present our adapted Metropolis-Hastings algorithm which combines local proposals with global proposals taken from a diffusion model that is regularly trained on the samples produced during the MCMC run. Our approach leads to a significant reduction in the number of likelihood evaluations required to obtain an accurate representation of the Bayesian posterior across several analytic functions, as well as for a physical example based on a global fit of parton distribution functions. Our method is extensible to other MCMC techniques, and we briefly compare our method to similar approaches based on normalising flows. A code implementation can be found at https://github.com/NickHunt-Smith/MCMC-diffusion.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Deep energy-pressure regression for a thermodynamically consistent EOS model

Abstract In this paper, we aim to explore novel machine learning (ML) techniques to facilitate and accelerate the construction of universal equation-Of-State (EOS) models with a high accuracy while ensuring important thermodynamic consistency. When applying ML to fit a universal EOS model, there are two key requirements: (1) a high prediction accuracy to ensure precise estimation of relevant physics properties and (2) physical interpretability to support important physics-related downstream applications. We first identify a set of fundamental challenges from the accuracy perspective, including an extremely wide range of input/output space and highly sparse training data. We demonstrate that while a neural network (NN) model may fit the EOS data well, the black-box nature makes it difficult to provide physically interpretable results, leading to weak accountability of prediction results outside the training range and lack of guarantee to meet important thermodynamic consistency constraints. To this end, we propose a principled deep regression model that can be trained following a meta-learning style to predict the desired quantities with a high accuracy using scarce training data. We further introduce a uniquely designed kernel-based regularizer for accurate uncertainty quantification. An ensemble technique is leveraged to battle model overfitting with improved prediction stability. Auto-differentiation is conducted to verify that necessary thermodynamic consistency conditions are maintained. Our evaluation results show an excellent fit of the EOS table and the predicted values are ready to use for important physics-related tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

A general non-Fourier Stefan problem formulation that accounts for memory effects

The Stefan problem is the classical model of a melting phase change. In heterogeneous systems, such phase changes can exhibit non-Fourier (anomalous) behaviors, where the advance of the melt interface does not follow the expected time scaling. These situations can be modeled by replacing the derivatives, in the governing partial differential equations, with fractional order derivatives. In particular, replacing the time derivatives leads to non-Fourier models that account for memory effects in the system. In this work, by using appropriate time convolution integrals, a general thermodynamic balance statement for melting phase problems, explicitly accounting for memory effects, is developed. From this balance, a general model formulation applicable to problems involving melting over a temperature range (i.e., a mushy region) is derived. A key component in this model is the representation of memory effects through the use of fractional derivative based constitutive models of the enthalpy and heat flux. Further, on shrinking the mushy region to a single isotherm, a general sharp interface melting model is obtained. Here, in contrast to the classic Stefan problem, the fractional derivatives induce a natural regularization, such that the constitutive models for enthalpy and heat flux are continuous at the melt interface; a result confirmed through numerical simulation. To further support the theoretical findings, a physical example of a non-Fourier Stefan problem is presented. Overall the development and results in this paper underscore the importance of explicitly relating the development of fractional calculus models to the appropriate thermodynamic balance statements.

42 ENGINEERING↗
DOE OSTI2021

Bayesian automated weighting of aggregated DFT, MD, and experimental data for candidate thermodynamic models of aluminum with uncertainty quantification

Atomic-scale modeling methods such as density functional theory (DFT) and molecular dynamics (MD) can predict the thermodynamic properties of materials at a lower cost than experimental measurements. However, their regular usage in thermodynamic model construction is hampered by the lack of quantitative agreement with experimental measurements and the lack of uncertainty estimates on the data. To make regular usage of this atomistic simulation data, it is important to assess whether the atomistic simulation datasets, by themselves or in combination with experimental measurements, result in the same physics-informed models best supported by experimental measurements alone. Here, models of aluminum thermodynamic properties are discussed using three data sources: atomistic calculations (DFT and MD), experiments, and a combination of atomistic calculations and experiments. The study shows that, after ensuring self-consistency in predicting key invariant points, both experimental measurements and atomistic calculations can significantly contribute to an optimal model.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Tempering stochastic density functional theory

Here, we introduce a tempering approach with stochastic density functional theory (sDFT), labeled t-sDFT, which reduces the statistical errors in the estimates of observable expectation values. This is achieved by rewriting the electronic density as a sum of a "warm" component complemented by "colder" correction(s). Since the warm component is larger in magnitude but faster to evaluate, we use many more stochastic orbitals for its evaluation than for the smaller-sized colder correction(s). This results in a significant reduction in the statistical fluctuations and systematic deviation compared to sDFT for the same computational effort. We demonstrate the method's performance on large hydrogen-passivated silicon nanocrystals, finding a reduction in the systematic deviation in the energy by more than an order of magnitude, while the systematic deviation in the forces is also quenched. Similarly, the statistical fluctuations are reduced by factors of ≈4-5 for the total energy and ≈1.5-2 for the forces on the atoms. Since the embedding in t-sDFT is fully stochastic, it is possible to combine t-sDFT with other variants of sDFT such as energy-window sDFT and embedded-fragmented sDFT.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

High-Fidelity Numerical Wave Tank Verification & Validation Study: Wave Generation Through Paddle Motion: Preprint

This paper presents a numerical benchmark study of wave propagation due to a paddle motion using different high-fidelity numerical models, which are capable of replicating the nearly actual physical wave tank testing. A full time series of the measured wave generation paddle motion which was used to generate wave propagation in the physical wave tank will be utilized in each of the models contributed by IEA OES Task 10's participants, which includes both computational fluid dynamics (CFD) and smooth hydrodynamic particle (SPH). The high-fidelity simulations of the physical wave testcase will allow for the evaluation of the initial transient effects from wave ramp-up and its evolution in the wave tank over time for two representative regular waves with varying levels of nonlinearity. A couple of interesting metrics like the predicted wave surface elevation at select wave probes, wave period, and phase-shift in time will be assessed to evaluate the relative accuracy of numerical models versus experimental data within specified time intervals. These models will serve as a guide for modelers in the wave energy community and provide a base case to allow further and more detailed numerical modeling of the fixed Kramer Sphere Cases under wave excitation force wave tank testing.

HYDRO ENERGY,TIDAL AND WAVE POWER↗
DOE OSTI2022

A fourth-order phase-field fracture model: Formulation and numerical solution using a continuous/discontinuous Galerkin method

Modeling crack initiation and propagation in brittle materials is of great importance to be able to predict sudden loss of load-carrying capacity and prevent catastrophic failure under severe dynamic loading conditions. Second-order phase-field fracture models have gained wide adoption given their ability to capture the formation of complex fracture patterns, e.g. via crack merging and branching, and their suitability for implementation within the context of the conventional finite element method. Higher-order phase-field models have also been proposed to increase the regularity of the exact solution and thus increase the spatial convergence rate of its numerical approximation. However, they require special numerical techniques to enforce the necessary continuity of the phase field solution. In this paper, we derive a fourth-order phase-field model of fracture in two independent ways; namely, from Hamilton’s principle and from a higher-order micromechanics-based approach. The latter approach is novel, and provides a physical interpretation of the higher-order terms in the model. In addition, we propose a continuous/discontinuous Galerkin (C/DG) method for use in computing the approximate phase-field solution. This method employs Lagrange polynomial shape functions to guarantee -continuity of the solution at inter-element boundaries, and enforces the required regularity with the aid of additional variational and interior penalty terms in the weak form. Finally, the phase-field equation is coupled with the momentum balance equation to model dynamic fracture problems in hyper-elastic materials. Two benchmark problems are presented to compare the numerical behavior of the C/DG method with mixed finite element methods.

42 ENGINEERING↗
DOE OSTI2022

Physics-informed Karhunen-Loeve and Neural Network Approximations for Solving Inverse Differential Equation Problems

Here we present the PI-CKL-NN method for parameter estimation in differential equation (DE) models given sparse measurements of the parameters and states. In the proposed approach, the space- or time-dependent parameters are approximated by Karhunen-Loeve (KL) expansions that are conditioned on the parameters’ measurements, and the states are approximated by deep neural networks (DNNs). The unknown weights in the KL expansions and DNNs are found my minimizing the cost function that enforces the measurements of the states the DE constraint. Regularization is achieved by adding the l2 norm of the conditional KL coefficients into the loss function. Our approach assumes that the parameter fields are correlated in space or time and enforces the statistical knowledge (the mean and the covariance function) in addition to the DE constraints and measurements as opposed to the physics-informed neural network (PINN) and other similar physics-informed machine learning methods where only DE constraints and data are used for parameter estimation. We use the PI-CKL-NN method for parameter estimation in an ordinary differential equation with an unknown time-dependent parameter and the one- and two-dimensional partial differential diffusion equations with unknown space-dependent diffusion coefficients. We also demonstrate that PI-CKL-NN is more accurate than the PINN method, especially when the observations of the parameters are very sparse

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

From Latent Dynamics to Meaningful Representations

While representation learning has been central to the rise of machine learning and artificial intelligence, a key problem remains in making the learnt representations meaningful. For this the typical approach is to regularize the learned representation through prior probability distributions. However such priors are usually unavailable or are ad hoc. To deal with this, recent efforts have shifted towards leveraging the insights from physical principles to guide the learning process. In this spirit, we propose a purely dynamics-constrained representation learning framework. Instead of relying on predefined probabilities, we restrict the latent representation to follow overdamped Langevin dynamics with a learnable transition density — a prior driven by statistical mechanics. We show this is a more natural constraint for representation learning in stochastic dynamical systems, with the crucial ability to uniquely identify the ground truth representation. We validate our framework for different systems including a real-world fluorescent DNA movie dataset. Here, we show that our algorithm can uniquely identify orthogonal, isometric and meaningful latent representations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Construction of two-dimensional topological field theories with non-invertible symmetries

We construct the defining data of two-dimensional topological field theories (TFTs) enriched by non-invertible symmetries/topological defect lines. Simple formulae for the three-point functions and the lasso two-point functions are derived, and crossing symmetry is proven. The key ingredients are open-to-closed maps and a boundary crossing relation, by which we show that a diagonal basis exists in the defect Hilbert spaces. We then introduce regular TFTs, provide their explicit constructions for the Fibonacci, Ising and Haagerup $\mathscr{H}$ 3 fusion categories, and match our formulae with previous bootstrap results. We end by explaining how non-regular TFTs are obtained from regular TFTs via generalized gauging.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Energy and momentum conservation in the Euler–Poincaré formulation of local Vlasov–Maxwell-type systems

The action principle by Low for the classic Vlasov–Maxwell system contains a mix of Eulerian and Lagrangian variables. This renders the Noether analysis of reparametrization symmetries inconvenient, especially since the well-known energy- and momentum-conservation laws for the system are expressed in terms of Eulerian variables only. While an Euler–Poincaré formulation of Vlasov–Maxwell-type systems, effectively starting with Low's action and using constrained variations for the Eulerian description of particle motion, has been known for a while Cendra et al, it is hard to come by a documented derivation of the related energy- and momentum-conservation laws in the spirit of the Euler–Poincaré machinery. To our knowledge only one such derivation exists in the literature so far, dealing with the so-called guiding-center Vlasov–Darwin system Sugama et al. The present exposition discusses a generic class of local Vlasov–Maxwell-type systems, with a conscious choice of adopting the language of differential geometry to exploit the Euler–Poincaré framework to its full extent. After reviewing the transition from a Lagrangian picture to an Eulerian one, we demonstrate how symmetries generated by isometries in space lead to conservation laws for linear- and angular-momentum density and how symmetry by time translation produces a conservation law for energy density. Here, we also discuss what happens if no symmetries exist. Finally, two explicit examples will be given—the classic Vlasov–Maxwell and the drift-kinetic Vlasov–Maxwell—and the results expressed in the language of regular vector calculus for familiarity.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗