Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “maximum entropy method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

36 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Maximum Entropy Theory of Multiscale Coarse-Graining via Matching Thermodynamic Forces: Application to a Molecular Crystal (TATB)

The MSCG/FM (multiscale coarse-graining via force-matching) approach is an efficient supervised machine learning method to develop microscopically informed coarse-grained (CG) models. Here we present a theory based on the principle of maximum entropy (PME) enveloping the existing MSCG/FM approaches. This theory views the MSCG/FM method as a special case of matching the thermodynamic forces from the extended ensemble described by the set of thermodynamic (relevant) system coordinates. This set may include CG coordinates, the stress tensor, applied external fields, and so forth, and may be characterized by nonequilibrium conditions. Following the presentation of the theory, we discuss the consistent matching of both bonded and nonbonded interactions. The proposed PME formulation is used as a starting point to extend the MSCG/FM method to the constant strain ensemble, which together with the explicit matching of the bonded forces is better suited for coarse-graining anisotropic media at a submolecular resolution. The theory is demonstrated by performing the fine coarse-graining of crystalline 1,3,5-triamino-2,4,6-trinitrobenzene (TATB), a well-known insensitive molecular energetic material, which exhibits highly anisotropic mechanical properties.

1,3,5-triamino-2,4,6-trinitrobenzene↗
DOE OSTI2022

Bayesian optimized collection strategies for fatigue strength testing

Abstract A statistical framework is presented enabling optimal sampling and analysis of constant life fatigue data. Protocols using Bayesian maximum entropy sampling are built based on conventional staircase and stress step methods, reducing the requirement of prior knowledge for data collection. The Bayesian Staircase method shows improved parameter estimation efficiency, and the Bayesian Stress Step method shows equal accuracy to the standard method at larger step size allowing experimentalists to lessen concerns of loading history. Statistical methods for determining model suitability are shown, highlighting the influence of protocol. Experimental validation is performed, showing the applicability of the methods in laboratory testing.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Proximal Galerkin: A Structure-Preserving Finite Element Method for Pointwise Bound Constraints

The proximal Galerkin finite element method is a high-order, low iteration complexity, nonlinear numerical method that preserves the geometric and algebraic structure of pointwise bound constraints in infinite-dimensional function spaces. This paper introduces the proximal Galerkin method and applies it to solve free boundary problems, enforce discrete maximum principles, and develop a scalable, mesh-independent algorithm for optimal design with pointwise bound constraints. This paper also introduces the latent variable proximal point (LVPP) algorithm, from which the proximal Galerkin method derives. When analyzing the classical obstacle problem, we discover that the underlying variational inequality can be replaced by a sequence of second-order partial differential equations (PDEs) that are readily discretized and solved with, e.g., the proximal Galerkin method. Throughout this work, we arrive at several contributions that may be of independent interest. These include (1) a semilinear PDE we refer to as the entropic Poisson equation; (2) an algebraic/geometric connection between high-order positivity-preserving discretizations and certain infinite-dimensional Lie groups; and (3) a gradient-based, bound-preserving algorithm for two-field, density-based topology optimization. The complete proximal Galerkin methodology combines ideas from nonlinear programming, functional analysis, tropical algebra, and differential geometry and can potentially lead to new synergies among these areas as well as within variational and numerical analysis. Open-source implementations of our methods accompany this work to facilitate reproduction and broader adoption.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Realizability-preserving discontinuous Galerkin method for spectral two-moment radiation transport in special relativity

Here we present a realizability-preserving numerical method for solving a spectral two-moment model to simulate the transport of massless, neutral particles interacting with a steady background material moving with relativistic velocities. The model is obtained as the special relativistic limit of a four-momentum-conservative general relativistic two-moment model. Using a maximum-entropy closure, we solve for the Eulerian-frame energy and momentum. The proposed numerical method is designed to preserve moment realizability, which corresponds to moments defined by a nonnegative phase-space density. The realizability-preserving method is achieved with the following key components: (i) a discontinuous Galerkin phase-space discretization with specially constructed numerical fluxes in the spatial and energy dimensions; (ii) a strong stability-preserving implicit-explicit time-integration method; (iii) a realizability-preserving conserved to primitive moment solver; (iv) a realizability-preserving implicit collision solver; and (v) a realizability-enforcing limiter. Component (iii) is necessitated by the closure procedure, which closes higher order moments nonlinearly in terms of primitive moments. The nonlinear conserved to primitive and the implicit collision solves are formulated as fixed-point problems, which are solved with custom iterative solvers designed to preserve the realizability of each iterate. With a series of numerical tests, we demonstrate the accuracy and robustness of this discontinuous-Galerkin-implicit-explicit method.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Stochastic fluctuations in relativistic fluids: Causality, stability, and the information current

We develop a general formalism for introducing stochastic fluctuations around thermodynamic equilibrium which takes into account, for the first time, recent developments in the causality and stability properties of relativistic hydrodynamic theories. The method is valid for any covariantly stable theory of relativistic viscous fluid dynamics derived from a covariant maximum entropy principle. We illustrate the formalism with some applications, showing how it could be used to consistently introduce fluctuations in a model of relativistic heat diffusion and in conformally invariant Israel-Stewart theory in a general hydrodynamic frame. Furthermore, the latter example is used to study the hydrodynamic frame dependence of the symmetric two-point function of fluctuations of the energy-momentum tensor.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Maximum entropy distributions of dark matter in ΛCDM cosmology

Context. Small-scale challenges to ΛCDM cosmology require a deeper understanding of dark matter physics. Aims. This paper aims to develop the maximum entropy distributions for dark matter particle velocity (denoted by X ), speed (denoted by Z ), and energy (denoted by E ) that are especially relevant on small scales where system approaches full virialization. Methods. For systems involving long-range interactions, a spectrum of halos of different sizes is required to form to maximize system entropy. While the velocity in halos can be Gaussian, the velocity distribution throughout the entire system, involving all halos of different sizes, is non-Gaussian. With the virial theorem for mechanical equilibrium, we applied the maximum entropy principle to the statistical equilibrium of entire system, such that the maximum entropy distribution of velocity (the X distribution) could be analytically derived. The halo mass function was not required in this formulation, but it did indeed result from the maximum entropy. Results. The predicted X distribution involves a shape parameter α and a velocity scale, v 0 . The shape parameter α reflects the nature of force ( α → 0 for long-range force or α → ∞ for short-range force). Therefore, the distribution approaches Laplacian with α → 0 and Gaussian with α → ∞. For an intermediate value of α , the distribution naturally exhibits a Gaussian core for v ≪ v 0 and exponential wings for v ≫ v 0 , as confirmed by N -body simulations. From this distribution, the mean particle energy of all dark matter particles with a given speed, v , follows a parabolic scaling for low speeds (∝ v 2 for v ≪ v 0 in halo core region, i.e., “Newtonian”) and a linear scaling for high speeds (∝ v for v ≫ v 0 in halo outskirt, i.e., exhibiting “non-Newtonian” behavior due to long-range gravity). We compared our results against N -body simulations and found a good agreement.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

High-dimensional maximum-entropy phase space tomography

Reconstructing 4D or 6D phase space distributions from 1D or 2D measurements is a challenging inverse problem encountered in particle accelerators. Entropy maximization is an established method to incorporate prior information in the reconstruction, but it is typically infeasible in high-dimensional spaces. In this paper, I review two recent approaches to high-dimensional entropy maximization. The first approach utilizes differentiable simulations and a class of generative models known as normalizing flows, whereas the second approach employs the method of Lagrange multipliers and Markov Chain Monte Carlo (MCMC) sampling. My aim is to provide a short explanation of each method using a common notation. I conclude by mentioning several unsolved problems in phase space tomography.

Hoover, Austin [ORNL] (ORCID:0000000153136962)↗
DOE OSTI2023

Model-Free Approach for Profiling of Polydisperse Soft Matter Using Small Angle Scattering

A strategy for determining the size polydispersity of systems from their small angle coherent scattering is outlined. Here, using the method of moment expansion, we show that the various central moments representing the average particle size, variance of particle size, and skewness of size distribution function (SDF) for polydisperse systems can be extracted from spectral analysis without bias. When the degree of polydispersity is moderate, SDF can be further reconstructed based on the maximum entropy principle. Numerical benchmarking of a model study over a wide range of size nonuniformity demonstrates the validity of this analytical approach for quantifying the size distribution of general soft matter systems in a model-free manner. Furthermore, the efficacy of this method was validated by successfully applying it to the fitting of small-angle neutron scattering data obtained from L64 Pluronic micelles using various form factor models. The numerical and experimental verification underscores the reliability and versatility of this method in accurately characterizing the size distribution of complex soft matter systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Fluid dynamic and thermal performance of a slotted cylinder at low Reynolds number

The fluid dynamic and thermal performance of a circular cylinder with a slot parallel to the flow is numerically investigated. The study utilized the semi-implicit finite volume multi-material algorithm MPM-ICE, a component of the Uintah framework. The normalized slot width s/D ranges from 0.1 - 0.3, introducing an additional heat transfer surface area between ~ 10 and ~ 50%, and a mass reduction between ~ 13 and ~ 38% in the cylinder. We assumed two-dimensional incompressible flow and simulated a Reynolds number Re D between 100 and 1000. The slotted cylinders are found to have a total drag force reduction up to ~ 45%, compared to a solid cylinder despite the additional viscous drag force in the slot. Convection heat transfer is enhanced up to ~ 70%. Further, the slotted cylinder performance index, defined as the ratio of the heat rate to the drag force, increases up to maximum of ~ 3, indicating better overall thermal fluid performance. An entropy analysis showed the best performance index occurs at the highest Re D . Correlations for drag coefficient and Nusselt number are proposed along with an entropy optimization method.

42 ENGINEERING↗
DOE OSTI2025

Biased degenerate ground-state sampling of small Ising models with converged quantum approximate optimization algorithm

The quantum alternating operator ansatz, a generalization of the quantum approximate optimization algorithm (QAOA), is a quantum algorithm used for approximately solving combinatorial optimization problems. QAOA typically uses the transverse field mixer as the driving Hamiltonian. One of the interesting properties of the transverse field driving Hamiltonian is that it results in nonuniform sampling of degenerate ground states of optimization problems. In this study, we numerically examine the fair sampling properties of the transverse field mixer QAOA, and Grover mixer QAOA (GM-QAOA), which provides theoretical guarantees of fair sampling of degenerate optimal solutions, up to a large enough p such that the mean expectation value converges to an optimal approximation ratio of 1. This comparison is performed with high-quality heuristically computed, but not necessarily optimal, QAOA angles, which give strictly monotonically improving solution quality as p increases. These angles are computed using the Julia based numerical simulation software JuliQAOA. Fair sampling of degenerate ground states is quantified using the Shannon entropy of the ground-state amplitudes distribution. The fair sampling properties are reported on several quantum signature Hamiltonians from previous quantum annealing fair sampling studies. Small random fully connected spin glasses are shown, which exhibit exponential suppression of some degenerate ground states with transverse field mixer QAOA. The transverse field mixer QAOA simulations show that some problem instances clearly saturate the Shannon entropy of 0 with a maximally biased distribution that occurs when the learning converges to an approximation ratio of 1 while other problem instances never deviate from a maximum Shannon entropy (uniform distribution) at any p step. Published by the American Physical Society 2025

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Bayesian Entropy Neural Networks for physics-aware prediction

This article addresses the need for deep learning models to integrate well-defined constraints into their outputs, driven by their application in surrogate models, learning with limited data and partial information, and scenarios requiring flexible model behavior to incorporate non-data sample information. We introduce Bayesian Entropy Neural Networks (BENN), a framework grounded in Maximum Entropy (MaxEnt) principles, designed to impose constraints on Bayesian Neural Network (BNN) predictions. BENN is capable of constraining not only the predicted values but also their derivatives and variances, ensuring a more robust and reliable model output. To achieve simultaneous uncertainty quantification and constraint satisfaction, we employ the method of multipliers approach. This allows for the concurrent estimation of neural network parameters and the Lagrangian multipliers associated with the constraints. Our experiments, spanning diverse applications such as beam deflection modeling and microstructure generation, demonstrate the effectiveness of BENN. The results highlight significant improvements over traditional BNNs and showcase competitive performance relative to contemporary constrained deep learning methods.

14 SOLAR ENERGY↗
DOE OSTI2024

Lattice engineering of high-entropy olivine-type lithium metal phosphate as high-voltage cathodes

Engineering of high-entropy cathode materials for lithium-ion batteries has been actively pursued owing to the outstanding conductivity of high-entropy materials benefited from the maximum entropy and unique antisite disordering structure. Olivine lithium metal phosphates such as LiMnPO 4 and LiNiPO 4 feature high working voltages but low capacities due to their insulation nature. Here in this work, the synthesis of the high-entropy lithium metal phosphate materials (HELMPs) is realized by combining mechanochemistry with a calcination method. By regulating lattice of HELMPs, the high-entropy Li(Mn 0.35 Fe 0.35 Co0.1Mg 0.1 Ca 0.1 )PO 4 reveals three typical high-voltage plateaus in charge–discharge curves corresponding to the redox of Fe, Mn, and Co in the voltage range of 2.0–4.9 V vs Li + /Li, and a much higher initial capacity than LiMnPO 4 (104 vs 15 mAh g -1 ).

25 ENERGY STORAGE↗
DOE OSTI2024

Semi-Lagrangian nodal discontinuous Galerkin method for the BGK model

In this work, we propose a semi-Lagrangian (SL) nodal discontinuous Galerkin (DG) solver for the BGK equation. The BGK model was introduced by Bhatnagar, Gross, and Krook [1] as a relaxation model for the fundamental Boltzmann equation [5], which describes the kinetic dynamic of rarefied gases with a probability distribution function. The challenges of designing efficient numerical schemes for the Boltzmann equation mainly come from its high dimensionality and complicated nonlinear collision operator. The BGK model gains interests since it has much lower computational cost, due to the relatively simple structure of the relaxation operator in replacement of the collision operator, while simultaneously preserving several important physical properties, such as macroscopic quantities and dissipation of entropy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Boundary-induced classical generalized Gibbs ensemble with angular momentum

We investigate how confinement geometry leads to the emergence of a Generalized Gibbs Ensemble (GGE) in classical systems. Unlike the standard Gibbs ensemble, the GGE includes additional conserved quantities, such as angular momentum, that arise from boundary-induced symmetries. Using analytical arguments based on the maximum entropy principle, we show that circular boundaries preserve angular momentum and drive the system toward a chiral, non-ergodic GGE that violates time-reversal symmetry. This ensemble differs fundamentally from the Gibbs case, producing near-boundary condensation and revealing how geometry alone can alter thermal equilibration. To quantify these effects, we introduce an order parameter measuring deviations from Gibbs behavior and demonstrate that conventional Monte Carlo methods must incorporate angular momentum conservation under such conditions. Our study highlights how geometric constraints shape non-equilibrium statistical ensembles and lead to subtle departures from the Bohr-van Leeuwen theorem. These predictions are validated through detailed simulations of confined classical hard-disk gases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Physics-based stabilized finite element approximations of the Poisson–Nernst–Planck equations

We present and analyze two stabilized finite element methods for solving numerically the Poisson–Nernst–Planck equations. The stabilization we consider is carried out by using a shock detector and a discrete graph Laplacian operator for the ion equations, whereas the discrete equation for the electric potential need not be stabilized. Discrete solutions stemmed from the first algorithm preserve both maximum and minimum discrete principles. For the second algorithm, its discrete solutions are conceived so that they hold discrete principles and obey an entropy law provided that an acuteness condition is imposed for meshes. Remarkably the latter is found to be unconditionally stable. We validate our methodology through transient numerical experiments that show convergence toward steady-state solutions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Integrating Maximum Entropy Production Theory and Machine Learning to Improve Global Evapotranspiration Modeling

Accurate estimation of terrestrial evapotranspiration (ET) is vital for understanding global water and energy cycles. However, current global ET estimations are not well constrained. This study introduces an integrated framework combining the Maximum Entropy Production (MEP) theory with Random Forest (RF) model to improve global ET estimation. Specifically, in contrast to direct ET estimation by the RF model, the integrated framework (MEP‐RF) trains to predict error of MEP‐simulated ET. MEP‐RF outperforms RF in spatiotemporal extrapolation. Attribution analysis with in situ observations reveals that the inputs of MEP are the most critical variables for the ET process, including net radiation, vegetated area, soil moisture, and surface temperature. We further drive MEP‐RF with global reanalysis and satellite data sets of these four inputs, yielding a global mean terrestrial ET of 548 mm/year, with 77% attributed to transpiration. The global ET increased at a rate of 0.85 mm/year per year during 2003–2021, primarily due to vegetation greening rather than rising temperature, while decreasing soil moisture led to decreasing regional ET. The integrated framework provides a novel approach for the estimation of global ET without the need for hard‐to‐obtain and thus uncertain inputs, such as wind speed, surface roughness, aerodynamic and canopy stomatal resistance. Therefore, MEP‐RF offers an independent method on existing global ET products. It represents a promising physically based approach that can be incorporated into Earth System Models to enhance water and energy cycle simulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Nonequilibrium statistical mechanics and optimal prediction of partially-observed complex systems

Abstract Only a subset of degrees of freedom are typically accessible or measurable in real-world systems. As a consequence, the proper setting for empirical modeling is that of partially-observed systems. Notably, data-driven models consistently outperform physics-based models for systems with few observable degrees of freedom; e.g. hydrological systems. Here, we provide an operator-theoretic explanation for this empirical success. To predict a partially-observed system’s future behavior with physics-based models, the missing degrees of freedom must be explicitly accounted for using data assimilation and model parametrization. Data-driven models, in contrast, employ delay-coordinate embeddings and their evolution under the Koopman operator to implicitly model the effects of the missing degrees of freedom. We describe in detail the statistical physics of partial observations underlying data-driven models using novel maximum entropy and maximum caliber measures. The resulting nonequilibrium Wiener projections applied to the Mori–Zwanzig formalism reveal how data-driven models may converge to the true dynamics of the observable degrees of freedom. Additionally, this framework shows how data-driven models infer the effects of unobserved degrees of freedom implicitly, in much the same way that physics models infer the effects explicitly. This provides a unified implicit-explicit modeling framework for predicting partially-observed systems, with hybrid physics-informed machine learning methods combining both implicit and explicit aspects.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Sm 2 Ru 3 Sn 5 : A Noncentrosymmetric Cubic Member of the Ln 2 M 3 X 5 Family

An optimized synthetic method is presented for Sm 2 Ru 3 Sn 5 and investigate its physical properties and electronic structure. Sm 2 Ru 3 Sn 5 is prepared by arc-melting stoichiometric ratios of the elements and is confirmed by single crystal and powder X-ray diffraction. An antiferromagnetic transition is observed at T N = 3.8 K. A modified Curie-Weiss fit to the data in the range 50–150 K yields a Curie-Weiss temperature: θ CW = −36.6 K and an effective magnetic moment: μ eff = 0.83 μ B , in agreement with a Sm 3+ oxidation state. Field-dependent magnetization up to H = 7 T at 2 K shows a maximum response of 0.06 μ B , which is significantly lower than the expected Sm 3+ saturation moment (0.71 μ B ). Resistivity measurements indicate metallic behavior, and analysis of the magnetic entropy from the heat capacity reveals a doublet ground state due to crystal electric field splitting. The electronic structure and density of states are calculated with density function theory and further supported by the local density approximation with dynamical mean-field theory. Finally, the experimental and computational results highlight localized Sm 3+ moments and suggest a possible interplay between Ruddelman–Kitel–Kasuya–Yosida and Kondo interactions, positioning Sm 2 Ru 3 Sn 5 as a promising material for studying topology and complex physical phenomena.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗