Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “entropy functional”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

The Generalization of Mutual Information as the Information between a Set of Variables: The Information Correlation Function Hierarchy and the Information Structure of Multi-Agent Systems

The topic of this paper is a hierarchy of information-like functions, here named the information correlation functions, where each function of the hierarchy may be thought of as the information between the variables it depends upon. The information correlation functions are particularly suited to the description of the emergence of complex behaviors due to many- body or many-agent processes. They are particularly well suited to the quantification of the decomposition of the information carried among a set of variables or agents, and its subsets. In more graphical language, they provide the information theoretic basis for understanding the synergistic and non-synergistic components of a system, and as such should serve as a forceful toolkit for the analysis of the complexity structure of complex many agent systems. The information correlation functions are the natural generalization to an arbitrary number of sets of variables of the sequence starting with the entropy function (one set of variables) and the mutual information function (two sets). We start by describing the traditional measures of information (entropy) and mutual information.

Wolf, David R.↗

Statistical and linguistic features of DNA sequences

We present evidence supporting the idea that the DNA sequence in genes containing noncoding regions is correlated, and that the correlation is remarkably long range--indeed, base pairs thousands of base pairs distant are correlated. We do not find such a long-range correlation in the coding regions of the gene. We resolve the problem of the "non-stationary" feature of the sequence of base pairs by applying a new algorithm called Detrended Fluctuation Analysis (DFA). We address the claim of Voss that there is no difference in the statistical properties of coding and noncoding regions of DNA by systematically applying the DFA algorithm, as well as standard FFT analysis, to all eukaryotic DNA sequences (33 301 coding and 29 453 noncoding) in the entire GenBank database. We describe a simple model to account for the presence of long-range power-law correlations which is based upon a generalization of the classic Levy walk. Finally, we describe briefly some recent work showing that the noncoding sequences have certain statistical features in common with natural languages. Specifically, we adapt to DNA the Zipf approach to analyzing linguistic texts, and the Shannon approach to quantifying the "redundancy" of a linguistic text in terms of a measurable entropy function. We suggest that noncoding regions in plants and invertebrates may display a smaller entropy and larger redundancy than coding regions, further supporting the possibility that noncoding regions of DNA may carry biological information.

Non-NASA Center↗

Source function from two-particle correlation function through entropy-regularized Richardson-Lucy deblurring

Source functions are obtained from p – p and d – α correlation functions by applying the Richardson-Lucy (RL) deblurring to the Koonin-Pratt (KP) equation. To prevent fitting of noise in the correlation function, total-variation (TV) regularization is employed that has been effective in ordinary image restoration. TV alone cannot ensure normalization of the source functions. To ensure the latter, we propose a maximum-entropy regularized RL algorithm (MEM-RL). We outline the MEM-RL formalism and optimization strategy for the KP equation, demonstrating its effectiveness on both simulated and experimental data, including the p – p and d – α correlation functions.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Entropy Generation Across Earth's Bow Shock

Earth's bow shock is a transition layer that causes an irreversible change in the state of plasma that is stationary in time. Theories predict entropy increases across the bow shock but entropy has never been directly measured. Cluster and Double Star plasma experiments measure 3D plasma distributions upstream and downstream of the bow shock that allow calculation of Boltzmann's entropy function H and his famous H-theorem, dH/dt ~ O. We present the first direct measurements of entropy density changes across Earth's bow shock. We will show that this entropy generation may be part of the processes that produce the non-thermal plasma distributions is consistent with a kinetic entropy flux model derived from the collisionless Boltzmann equation, giving strong support that solar wind's total entropy across the bow shock remains unchanged. As far as we know, our results are not explained by any existing shock models and should be of interests to theorists.

Parks, George K.↗

Theory and Implementation of the Spectacular Nonlinear Viscoelastic Constitutive Model

This report is a comprehensive guide to the nonlinear viscoelastic Spectacular model, which is an isotropic, thermo-rheologically simple constitutive model for glass-forming materials, such as amorphous polymers. Spectacular is intermediate in complexity to the previous PEC and SPEC models (Potential Energy Clock and Simplified Potential Energy Clock models, respectively). The model form consists of two parts: a Helmholtz free energy functional and a nonlinear material clock that controls the rate of viscoelastic relaxation. The Helmholtz free energy is derived from a series expansion about a reference state. Expressions for the stress and entropy functionals are derived from the Helmholtz free energy following the Rational Mechanics approach. The material clock depends on a simplified expression for the potential energy, which itself is a functional of the temperature and strain histories. This report describes the thermo-mechanical theory of Spectacular, the numerical methods for time-integrating the model, model verification for its implementation in LAMÉ, a user guide for its implementation in LAMÉ, and ideas for future work. A number of appendices provide supplementary mathematical details and a description of the procedure used to derive the simplified potential energy from the full expression for the potential energy. The goal of this report is create a convenient point-of-entry for engineers who wish to learn more about Spectacular, but also to serve as a reference manual for advanced users of the model.

36 MATERIALS SCIENCE↗

Multi-variance replica exchange SGMCMC for inverse and forward problems via Bayesian PINN

Physics-informed neural network (PINN) has been successfully applied in solving a variety of nonlinear non-convex forward and inverse problems. However, the training is challenging because of the non-convex loss functions and the multiple optima in the Bayesian inverse problem. In this work, we propose a multi-variance replica exchange stochastic gradient Langevin dynamics method to tackle the challenge of the multiple local optima in the optimization and the challenge of the multiple modal posterior distribution in the inverse problem. Replica exchange methods are capable of escaping from the local traps and accelerating the convergence; two chains with different temperatures are designed where the low temperature chain aims for the local convergence, and the target of the high temperature chain is to travel globally and explore the whole loss function entropy landscape. However, it may not be efficient to solve mathematical inversion problems by using the vanilla replica method directly since the method doubles the computational cost in evaluating the forward solvers (likelihood functions) in the two chains. To address this issue, we propose to make different assumptions on the energy function estimation and this facilities one to use solvers of different fidelities in the likelihood function evaluation. More precisely, one can use a solver with low fidelity in the high temperature chain while using a solver with high fidelity in the low temperature chain. Our proposed method significantly lowers the computational cost in the high temperature chain, meanwhile preserving the accuracy and converging very fast. Here we give an unbiased estimate of the swapping rate and give an estimation of the discretization error of the scheme. To verify our idea, we design and solve four inverse problems which have multiple modes. The proposed method is also employed to train the Bayesian PINN to solve the forward and inverse problems; faster and more accurate convergence has been observed when compared to the stochastic gradient Langevin dynamics (SGLD) method and vanilla replica exchange methods.

97 MATHEMATICS AND COMPUTING↗

Entropy–Preserving and Entropy–Stable Relaxation IMEX and Multirate Time–Stepping Methods

In this work, we propose entropy-preserving and entropy-stable partitioned Runge–Kutta (RK) methods. In particular, we extend the explicit relaxation Runge–Kutta methods to IMEX–RK methods and a class of explicit second-order multirate methods for stiff problems arising from scale-separable or grid-induced stiffness in a system. The proposed approaches not only mitigate system stiffness but also fully support entropy-preserving and entropy-stability properties at a discrete level. The key idea of the relaxation approach is to adjust the step completion with a relaxation parameter so that the time-adjusted solution satisfies the entropy condition at a discrete level. The relaxation parameter is computed by solving a scalar nonlinear equation at each timestep in general; however, as for a quadratic entropy function, we theoretically derive the explicit form of the relaxation parameter and numerically confirm that the relaxation parameter works the Burgers equation. Several numerical results for ordinary differential equations and the Burgers equation are presented to demonstrate the entropy-conserving/stable behavior of these methods. We also compare the relaxation approach and the incremental direction technique for the Burgers equation with and without a limiter in the presence of shocks.

97 MATHEMATICS AND COMPUTING↗

Entropy Splitting and Numerical Dissipation

A rigorous stability estimate for arbitrary order of accuracy of spatial central difference schemes for initial-boundary value problems of nonlinear symmetrizable systems of hyperbolic conservation laws was established recently by Olsson and Oliger (1994) and Olsson (1995) and was applied to the two-dimensional compressible Euler equations for a perfect gas by Gerritsen and Olsson (1996) and Gerritsen (1996). The basic building block in developing the stability estimate is a generalized energy approach based on a special splitting of the flux derivative via a convex entropy function and certain homogeneous properties. Due to some of the unique properties of the compressible Euler equations for a perfect gas, the splitting resulted in the sum of a conservative portion and a non-conservative portion of the flux derivative. hereafter referred to as the "Entropy Splitting." There are several potential desirable attributes and side benefits of the entropy splitting for the compressible Euler equations that were not fully explored in Gerritsen and Olsson. The paper has several objectives. The first is to investigate the choice of the arbitrary parameter that determines the amount of splitting and its dependence on the type of physics of current interest to computational fluid dynamics. The second is to investigate in what manner the splitting affects the nonlinear stability of the central schemes for long time integrations of unsteady flows such as in nonlinear aeroacoustics and turbulence dynamics. If numerical dissipation indeed is needed to stabilize the central scheme, can the splitting help minimize the numerical dissipation compared to its un-split cousin? Extensive numerical study on the vortex preservation capability of the splitting in conjunction with central schemes for long time integrations will be presented. The third is to study the effect of the non-conservative proportion of splitting in obtaining the correct shock location for high speed complex shock-turbulence interactions. The fourth is to determine if this method can be extended to other physical equations of state and other evolutionary equation sets. If numerical dissipation is needed, the Yee, Sandham, and Djomehri (1999) numerical dissipation is employed. The Yee et al. schemes fit in the Olsson and Oliger framework.

Yee, H. C.↗

A New Approach for a Wider Class of Entropy Split Methods for Compressible Gas Dynamics and MHD

The high order entropy split methods of Sjögreen & Yee [1, 2] by entropy splitting of the compressible Euler (inviscid) flux derivatives for a thermally-perfect gas are based on Harten’s entropy function [3, 4, 5]. Their derivation takes advantage of the homogeneity property of Euler flux, symmetrizable Euler flux derivatives and energy-norm stability in conjunction with high order classical spatial central, DRP (dispersion relation-preserving) [6, 7, 8] or Padé (compact) spatial discretizations [9] with summation-by-parts (SBP) operators [10]. Our entropy split methods have been proven entropy conserving and stable [1, 11, 12]. Our proofs do not rely on a two-point numerical flux, but rather only a linear difference operator is required to derive these methods. To extend the entropy split method for the MHD, we used the Godunov symmetrizable non-conservative MHD form [12, 13, 14]. These high order entropy split methods not only preserve certain physical properties of the chosen governing equations but are also known to either improve numerical stability, and/or minimize aliasing errors in long time integration of turbulent flow computations without the aid of added numerical dissipation. In our previous published work, extensive error norm comparison with grid refinement was performed to show the high accuracy performance of these methods. These studies also showed how well the entropy split methods conserve the entropy, momentum and mass, and preserve the kinetic energy for long time integration of the various flows [1, 2, 12, 13, 14]. The objective of the present work is to use a new approach to obtain a wider class of entropy split methods consisting of a two-point numerical flux portion and a non-conservative portion in such a way that the homogeneity property of the compressible Euler flux is not required. For high order classical spatial central, DRP (dispersion relation-preserving) or Padé (compact) spatial discretizations, this new approach can be proven to be entropy conservative with conservative spatial dsicretizations while at the same time allowing a wider class of symmetrizable inviscid flux derivatives. We also use this generalization to derive an entropy split scheme that is entropy conserving for the equations of MHD without the homogeneity property using the Godunov symmetrizable ideal MHD formulation [15].

High Order Physical Preserving Methods↗

Entropy Stable h/p-Nonconforming Discretization with the Summation-by-Parts Property for the Compressible Euler and Navier–Stokes Equations

In this paper, we extend the entropy conservative/stable algorithms presented by Del Rey Fernandez and coauthors for the compressible Euler and Navier-Stokes equations on nonconforming p-refined/coarsened curvilinear grids to h/p refinement/coarsening. The main difficulty in developing nonconforming algorithms is the construction of appropriate coupling procedures across nonconforming interfaces. Here, we utilize a computationally simple and efficient approach based upon using decoupled interpolation operators. The resulting scheme is entropy conservative/stable and elementwise conservative. Numerical simulations of the isentropic vortex and viscous shock propagation con firm the entropy conservation/stability and accuracy properties of the method (achieving ~ p + 1 convergence), which are comparable to those of the original conforming scheme. Simulations of the Taylor{Green vortex at R(e) = 1,600 and turbulent flow past a sphere at R(e(infinity)) = 2,000 show the robustness and stability properties of the overall spatial discretization for unstructured grids. Finally, to demonstrate the entropy conservation property of a fully-discrete explicit entropy stable algorithm with h=p refinement/coarsening, we present the time evolution of the entropy function obtained by simulating the propagation of the isentropic vortex using a relaxation Runge-Kutta scheme.

Nonconforming interfaces↗

Kullback-Leibler information function and the sequential selection of experiments to discriminate among several linear models

A sequential adaptive experimental design procedure for a related problem is studied. It is assumed that a finite set of potential linear models relating certain controlled variables to an observed variable is postulated, and that exactly one of these models is correct. The problem is to sequentially design most informative experiments so that the correct model equation can be determined with as little experimentation as possible. Discussion includes: structure of the linear models; prerequisite distribution theory; entropy functions and the Kullback-Leibler information function; the sequential decision procedure; and computer simulation results. An example of application is given.

Sidik, S. M.↗

Thermodynamics

The fundamental structure of thermodynamics is purely algebraic, in the sense of atopological, and it is also independent of partitions, composite systems, the zeroth law, and entropy. The algebraic structure requires the notion of heat, but not the first law. It contains a precise definition of entropy and identifies it as a purely mathematical concept. It also permits the construction of an entropy function from heat measurements alone when appropriate conditions are satisfied. Topology is required only for a discussion of the continuity of thermodynamic properties, and then the weak topology is the relevant topology. The integrability of the differential form of the first law can be examined independently of Caratheodory's theorem and his inaccessibility axiom. Criteria are established by which one can determine when an integrating factor can be made intensive and the pseudopotential extensive and also an entropy. Finally, a realization of the first law is constructed which is suitable for all systems whether they are solids or fluids, whether they do or do not exhibit chemical reactions, and whether electromagnetic fields are or are not present.

Zeleznik, F. J.↗

Formation of a very thin current sheet in the near-earth magnetotail and the explosive growth phase of substorms

A magnetofricional method is used to construct two-dimensional MHD equilibria of the Earth's magnetosphere for a given distribution of entropy functions(S = pV(exp gamma), where p is the plasma pressure and V is the tube volume per unit magnetic flux. It is found that a very thin current sheet with B (sub zeta) is less than 0.5 nu T and thickness less than 1000 km can be formed in the near-earth magnetotail (x is approximately -8 to -20R(sub e) during the growth phase of substorm. The tail current sheets are found to become thinner as the entropy or the entropy gradient increases. It is suggested that the new entropy anti-diffusion instability associated with plasma transport across field lines leads to magnetic field dipolarization and accelerates the formation of thin current sheet, which may explain the observed explosive growth phase of substorms.

Lee, L. C.↗

The attractor flow for AdS 5 black holes in $\mathcal{N}$ = 2 gauged supergravity

We study the flow equations for BPS black holes in $\mathcal{N}$ = 2 five-dimensional gauged supergravity coupled to any number of vector multiplets via FI couplings. We develop the Noether-Wald procedure in this context and exhibit the conserved charges as explicit integrals of motion, in the sense that they can be computed at any radius on the rotating spacetime. The boundary conditions needed to solve the first order differential equations are discussed in great detail. We extremize the entropy function that controls the near horizon geometry and give explicit formulae for all geometric variables at their supersymmetric extrema. We have also considered a complexification of the near-horizon variables that elucidates some features of the theory from the near-horizon perspective.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Conservative discontinuous Galerkin scheme of a gyro-averaged Dougherty collision operator

Here, a conservative discontinuous Galerkin scheme for a non-linear Dougherty collision operator in full-f long-wavelength gyrokinetics is presented. Analytically this model operator has the advective-diffusive form of Fokker-Planck operators, it has a non-decreasing entropy functional, and conserves particles, momentum and energy. Discretely these conservative properties are maintained exactly as well, independent of numerical resolution. In this work the phase space discretization is performed using a novel version of the discontinuous Galerkin scheme, carefully constructed using concepts of weak equality and recovery. Discrete time advancement is carried out with an explicit time-stepping algorithm, whose stability limits we explore. The formulation and implementation within the long-wavelength gyrokinetic solver of Gkeyll are validated with relaxation tests, collisional Landau-damping benchmarks and the study of 5D gyrokinetic turbulence on helical, open field lines.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Working Fluid Characterization and Performance Assessment of Subcritical Organic Rankine Cycles Based on the Lee–Kesler Approach for Energy Recovery

Here, a generalized model using the Lee–Kesler approach based on the corresponding states principle is developed to assess the performance of subcritical Organic Rankine Cycles operating with different working fluids. Each fluid is characterized by five parameters: the acentric factor, critical temperature, critical pressure, molar mass, and the ideal-gas ratio of specific heats at the critical temperature. The model was developed using the compressibility factor modified version of the Benedict–Webb–Rubin equation proposed by Lee and Kesler and the enthalpy and entropy functions to calculate thermodynamic state properties. The model was validated by comparing the results calculated with the model and working fluid thermodynamic properties obtained with the CoolProp database. This comparison was conducted for 91 working fluids, obtaining a relative error below 5% for 88 out of the 91 fluids (∼97%). A generalized parametric study was conducted to determine the influence of the pinch point and each fluid parameter on the performance of Organic Rankine Cycle (ORC) systems. It was found that efficiency increases with critical temperature, ideal-gas ratio of specific heats at the critical temperature, and acentric factor, reaching up to 13%. The developed model enables the evaluation of ORC system performance for existing working fluids. It also allows the formulation and evaluation of new fluids to enhance the performance of the ORC while retrieving energy from any kind of source; and likewise, the methodology can be applied to other power generation cycles.

24 POWER TRANSMISSION AND DISTRIBUTION↗