SEARCH · Engineering Papers

Results for “information entropy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

NASA NTRS1991

Compression of digital images over local area networks. Appendix 1: Item 3

Differential Pulse Code Modulation (DPCM) has been used with speech for many years. It has not been as successful for images because of poor edge performance. The only corruption in DPC is quantizer error but this corruption becomes quite large in the region of an edge because of the abrupt changes in the statistics of the signal. We introduce two improved DPCM schemes; Edge correcting DPCM and Edge Preservation Differential Coding. These two coding schemes will detect the edges and take action to correct them. In an Edge Correcting scheme, the quantizer error for an edge is encoded using a recursive quantizer with entropy coding and sent to the receiver as side information. In an Edge Preserving scheme, when the quantizer input falls in the overload region, the quantizer error is encoded and sent to the receiver repeatedly until the quantizer input falls in the inner levels. Therefore these coding schemes increase the bit rate in the region of an edge and require variable rate channels. We implement these two variable rate coding schemes on a token wing network. Timed token protocol supports two classes of messages; asynchronous and synchronous. The synchronous class provides a pre-allocated bandwidth and guaranteed response time. The remaining bandwidth is dynamically allocated to the asynchronous class. The Edge Correcting DPCM is simulated by considering the edge information under the asynchronous class. For the simulation of the Edge Preserving scheme, the amount of information sent each time is fixed, but the length of the packet or the bit rate for that packet is chosen depending on the availability capacity. The performance of the network, and the performance of the image coding algorithms, is studied.

Gorjala, Bhargavi↗

NASA NTRS1991

A safety-based decision making architecture for autonomous systems

Engineering systems designed specifically for space applications often exhibit a high level of autonomy in the control and decision-making architecture. As the level of autonomy increases, more emphasis must be placed on assimilating the safety functions normally executed at the hardware level or by human supervisors into the control architecture of the system. The development of a decision-making structure which utilizes information on system safety is detailed. A quantitative measure of system safety, called the safety self-information, is defined. This measure is analogous to the reliability self-information defined by McInroy and Saridis, but includes weighting of task constraints to provide a measure of both reliability and cost. An example is presented in which the safety self-information is used as a decision criterion in a mobile robot controller. The safety self-information is shown to be consistent with the entropy-based Theory of Intelligent Machines defined by Saridis.

Musto, Joseph C.↗

NASA NTRS1993

Visual communication - Information and fidelity

This assessment of visual communication deals with image gathering, coding, and restoration as a whole rather than as separate and independent tasks. The approach focuses on two mathematical criteria, information and fidelity, and on their relationships to the entropy of the encoded data and to the visual quality of the restored image. Past applications of these criteria to the assessment of image coding and restoration have been limited to the link that connects the output of the image-gathering device to the input of the image-display device. By contrast, the approach presented in this paper explicitly includes the critical limiting factors that constrain image gathering and display. This extension leads to an end-to-end assessment theory of visual communication that combines optical design with digital processing.

Huck, Freidrich O.↗

NASA NTRS1993

Adaptive analog video signal conditioner

This paper presents an adaptive analog video signal conditioner. This system supplements conventional irises and automatic gain controls to condition video signals for digitizing with a uniform analog-to-digital converter. Employing two degree of freedom, this circuit adjusts an analog gain and analog offset to increase the average information content of digitized images as defined by an entropy measure. The globally near-optimized implementation tracks smoothly to adapt to changing scene conditions.

Jeong, Cheol-Ho↗

NASA NTRS2004

Measuring Questions: Relevance and its Relation to Entropy

The Boolean lattice of logical statements induces the free distributive lattice of questions. Inclusion on this lattice is based on whether one question answers another. Generalizing the zeta function of the question lattice leads to a valuation called relevance or bearing, which is a measure of the degree to which one question answers another. Richard Cox conjectured that this degree can be expressed as a generalized entropy. With the assistance of yet another important result from Janos Acz6l, I show that this is indeed the case; and that the resulting inquiry calculus is a natural generalization of information theory. This approach provides a new perspective of the Principle of Maximum Entropy.

Knuth, Kevin H.↗

NASA NTRS2022

Molecular information theory meets protein folding

We propose an application of molecular information theory to analyze the folding of single domain proteins. We analyze results from various areas of protein science, such as sequence-based potentials, reduced amino acid alphabets, backbone configurational entropy, secondary structure content, residue burial layers, and mutational studies of protein stability changes. We found that the average information contained in the sequences of evolved proteins is very close to the average information needed to specify a fold ~2.2 ± 0.3 bits/(site operation). The effective alphabet size in evolved proteins equals the effective number of conformations of a residue in the compact unfolded state at around 5. We calculated an energy-to-information conversion efficiency upon folding of around 50%, lower than the theoretical limit of 70%, but much higher than human built macroscopic machines. We propose a simple mapping between molecular information theory and energy landscape theory and explore the connections between sequence evolution, configurational entropy and the energetics of protein folding.

Ignacio E. Sánchez↗

NASA NTRS1994

Beyond maximum entropy: Fractal Pixon-based image reconstruction

We have developed a new Bayesian image reconstruction method that has been shown to be superior to the best implementations of other competing methods, including Goodness-of-Fit methods such as Least-Squares fitting and Lucy-Richardson reconstruction, as well as Maximum Entropy (ME) methods such as those embodied in the MEMSYS algorithms. Our new method is based on the concept of the pixon, the fundamental, indivisible unit of picture information. Use of the pixon concept provides an improved image model, resulting in an image prior which is superior to that of standard ME. Our past work has shown how uniform information content pixons can be used to develop a 'Super-ME' method in which entropy is maximized exactly. Recently, however, we have developed a superior pixon basis for the image, the Fractal Pixon Basis (FPB). Unlike the Uniform Pixon Basis (UPB) of our 'Super-ME' method, the FPB basis is selected by employing fractal dimensional concepts to assess the inherent structure in the image. The Fractal Pixon Basis results in the best image reconstructions to date, superior to both UPB and the best ME reconstructions. In this paper, we review the theory of the UPB and FPB pixon and apply our methodology to the reconstruction of far-infrared imaging of the galaxy M51. The results of our reconstruction are compared to published reconstructions of the same data using the Lucy-Richardson algorithm, the Maximum Correlation Method developed at IPAC, and the MEMSYS ME algorithms. The results show that our reconstructed image has a spatial resolution a factor of two better than best previous methods (and a factor of 20 finer than the width of the point response function), and detects sources two orders of magnitude fainter than other methods.

Puetter, Richard C.↗

NASA NTRS1984

Study on spectral/radiometric characteristics of the Thematic Mapper for land use applications

An information theoretic measure of multispectral information content is developed and applied to a simultaneous LANDSAT TM and MSS data set. The entropy based function measures the dispersion and concentration of signal values in various data spaces, irrespective of specific class memberships. It is used to compare the information content of TM and MSS and of various subsets of TM and MSS bans, as well as tasseled cap transformations of the band values. Differences exist between the information measure results and results using variance based measures. System design information capacities and data space volumes are also compared. The results and observations presented are considered preliminary in nature since only one real and one simulated data set are analyzed.

Malila, W. A.↗

NASA NTRS1972

Computer program for calculating supersonic flow about circular, elliptic, and bielliptic cones by the method of lines

A user's manual for a computer program which calculates the supersonic flow about circular, elliptic, and bielliptic cones at incidence and elliptic cones at yaw by the method of lines is presented. The program is automated to compute a case from known or easily calculated solution by changing the parameters through a sequence of steps. It provides information including the shock shape, flow field, isentropic surface properties, entropy layer, and force coefficients. A description of the program operation, sample computations, and a FORTRAN 4 listing are presented.

Klunker, E. B.↗

NASA NTRS2017

Information Theoretic Evaluation of Satellite Soil Moisture Retrievals

Microwave radiometry has a long legacy of providing estimates of remotely sensed near surfacesoil moisture measurements over continental and global scales. A consistent assessment of theerrors and uncertainties associated with these retrievals is important for their effective utilization in modeling, data assimilation and end-use application environments. This article presents an evaluationof soil moisture retrieval products from AMSR-E, ASCAT, SMOS, AMSR2 and SMAPinstruments using information theory-based metrics. These metrics rely on time series analysis ofsoil moisture retrievals for estimating the measurement error, level of randomness (entropy) andregularity (complexity) of the data. The results of the study indicate that the measurement errors inthe remote sensing retrievals are significantly larger than that of the ground soil moisture measurements.The SMAP retrievals, on the other hand, were found to have reduced errors (comparable to Preprint submitted to Remote Sensing of Environment October 1, 2017those of in-situ datasets), particularly over areas with moderate vegetation. The SMAP retrievals also demonstrate high information content relative to other retrieval products, with higher levelsof complexity and reduced entropy. Finally, a joint evaluation of the entropy and complexity ofremotely sensed soil moisture products indicates that the information content of the AMSR-E, ASCAT,SMOS and AMSR2 retrievals is low, whereas SMAP retrievals show better performance. The use of information theoretic assessments is effective in quantifying the required levels of improvements needed in the remote sensing soil moisture retrievals to enhance their utility and information content.

Information theory↗

NASA NTRS2007

Understanding Local Structure Globally in Earth Science Remote Sensing Data Sets

Empirical probability distributions derived from the data are the signatures of physical processes generating the data. Distributions defined on different space-time windows can be compared and differences or changes can be attributed to physical processes. This presentation discusses on ways to reduce remote sensing data in a way that preserves information, focusing on the rate-distortion theory and using the entropy-constrained vector quantization algorithm.

massive data sets↗

NASA NTRS1992

Decision analysis with approximate probabilities

This paper concerns decisions under uncertainty in which the probabilities of the states of nature are only approximately known. Decision problems involving three states of nature are studied. This is due to the fact that some key issues do not arise in two-state problems, while probability spaces with more than three states of nature are essentially impossible to graph. The primary focus is on two levels of probabilistic information. In one level, the three probabilities are separately rounded to the nearest tenth. This can lead to sets of rounded probabilities which add up to 0.9, 1.0, or 1.1. In the other level, probabilities are rounded to the nearest tenth in such a way that the rounded probabilities are forced to sum to 1.0. For comparison, six additional levels of probabilistic information, previously analyzed, were also included in the present analysis. A simulation experiment compared four criteria for decisionmaking using linearly constrained probabilities (Maximin, Midpoint, Standard Laplace, and Extended Laplace) under the eight different levels of information about probability. The Extended Laplace criterion, which uses a second order maximum entropy principle, performed best overall.

Whalen, Thomas↗

NASA NTRS2022

Linear Disturbance Amplification Over Blunted Flat Plates in High-Speed Flows

Modal and nonmodal instability characteristics of cylindrically blunted flat plates with varying leading edge radii are described for Mach 4 and Mach 6 freestream conditions. The selection of leading edge radii and freestream parameters is informed by experimental conditions. The investigation of this 2D problem provides a slow entropy layer swallowing which allows for an isolated development of perturbations seeded upstream within different wall-normal regions of the flow. At both Mach numbers, a decrease in modal instability amplification was seen as the leading edge radius was increased. Nonmodal analysis reveals amplifying perturbations in the boundary layer as well as in the entropy layer. The medium bluntness regime exhibits the strongest amplification of nonmodal disturbances that is nonmonotonic in character. Small amplitude boundary forcing at the plate surface or volumetric forcing at various wall-normal heights was used to account for receptivity effects. While wall forcing effectively induced modal instabilities, only an actuation above the boundary layer captured disturbances that amplify within the entropy layer. The optimal nonmodal theory’s entropy-layer disturbance evolution exhibited outstanding agreement with controlled forcing, including receptivity effects. The evolution of entropy-layer disturbances from the optimal nonmodal theory showed excellent agreement with the results of receptivity to controlled forcing. Therefore, the nonmodal optimal growth analysis may provide a useful as well as efficient technique to identify the complete disturbance spectrum in blunt hypersonic configurations, where both modal and nonmodal disturbances can amplify in the boundary-layer and entropy-layer regions.

Boundary layer transition↗

NASA NTRS2022

Linear Disturbance Amplification Over Blunted Flat Plates in High-Speed Flows

Boundary layer transition↗

NASA NTRS2020

Toward Transition Modeling in a Hypersonic Boundary Layer at Flight Conditions

An accurate physics-based transition prediction method integrated with computational fluid dynamics (CFD) solvers is pursued for hypersonic boundary layer flows over slender hypersonic vehicles at flight conditions. The geometry and flow conditions are selected to match relevant trajectory locations from the ascent phase of the HIFiRE-1 flight experiment, namely, a 7-degree half-angle cone with 2.5 mm nose radius, freestream Mach numbers in the range of 3.8 – 5.5 and freestream unit Reynolds numbers in the range of 3.3 × 10(exp 6) – 21.4 × 10(exp 6) m(exp -1). Earlier research had shown that the onset of transition during the HIFiRE-1 flight experiment correlated with an amplification factor of N ≈ 13.5 for the planar Mack modes. However, to incorporate the N-factor correlations into a CFD code, we investigate surrogate models for disturbance amplification that avoid the direct computation of stability characteristics. A commonly used approach for low-speed flows is based on an a priori database of stability characteristics for locally similar profiles. However, the results presented in this paper demonstrate that the application of this approach to hypersonic boundary layers over blunt spherical nose-tip cones leads to large, unacceptable errors in the predictions of amplification factors, mainly due to its failure in accounting for the effects of the entropy layer on the boundary-layer profiles along the length of the model. We propose and demonstrate an alternate approach that employs the stability computations for a canonical set of blunt cone configurations to train a physics-informed convolutional neural network model that is shown to provide substantially improved transition predictions for hypersonic flow configurations with entropy-layer effects. Furthermore, the excellent performance of the neural network model is also confirmed for cone configurations with nose radius and half-angle values that do not correspond to those used to build the database. Finally, the convolutional neural network model is shown to outperform the linear stability calculations for underresolved basic states.

Pedro Paredes↗

NASA NTRS1992

Discrete-time entropy formulation of optimal and adaptive control problems

The discrete-time version of the entropy formulation of optimal control of problems developed by G. N. Saridis (1988) is discussed. Given a dynamical system, the uncertainty in the selection of the control is characterized by the probability distribution (density) function which maximizes the total entropy. The equivalence between the optimal control problem and the optimal entropy problem is established, and the total entropy is decomposed into a term associated with the certainty equivalent control law, the entropy of estimation, and the so-called equivocation of the active transmission of information from the controller to the estimator. This provides a useful framework for studying the certainty equivalent and adaptive control laws.

Tsai, Yweting A.↗

NASA NTRS2001

Determining Biosignatures by Complexity Analysis in Antarctic Cryptoendolithic Communities

One of the most difficult problems of life detection is that of identifying biosignatures across a wide range of scales using multiple co-registered probes. The technique should be of equal utility across a wide range of search spaces from remote sensors probing volumes of space or planetary surfaces, visual eye or camera searches across the surface of a rock in Antarctica, low resolution microscopic scanning of a rock or a space craft in situ, or high resolution electron microscope and computerized tomography scanning of geobiological samples. We describe here an approach to this problem which derives in large part from past work done in the area of astrophysics - namely the analysis of complexity in galactic signals by data compression methods. This approach is a radically new one for geobiology and astrobiology, and allows us to assess the complexity (and thus potential biogenicity) of an object being examined. This is done by considering the information within pixels of an image (regardless the sensor used to gather the information) as an energetic system capable of description in terms of classical thermodynamics. The image data space is searched by an algorithm that judges complexity via data compression (e.g., the more compressible it is, the less complex, and vice versa) and maximum entropy as originally outlined by Shannon. At present we are implementing methods to utilize images from multiple sensors gathering different kinds of information (e.g., visible gray-scale data, color analyses, UV fluorescence, chemical information, etc). We present here preliminary data from deep UV fluorescence and ESEM (Environmental Scanning Electron Microscope) images from a layered cryptoendolithic community of an Antarctic rock.

Storrie-Lombardi, M. C.↗

NASA NTRS1984

A geometric approach to high resolution TVD schemes

A geometric approach, similar to Van Leer's MUSCL schemes, is used to construct a second-order accurate generalization of Godunov's method for solving scalar conservation laws. By making suitable approximations, a scheme is obtained which is easy to implement and total variation diminishing. The entropy condition is also investigated from the standpoint of the spreading of rarefaction waves. Quantitative information is obtained for Godunov's method on the rate of spreading which explain the kinks in rarefaction waves often observed at the sonic point.

Goodman, J. B.↗