Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “mutual information”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Quantifying the Importance of Selected Drought Indicators for the United States Drought Monitor

Using information theory, our study quantifies the importance of selected indicators for the U.S. Drought Monitor (USDM) maps. We use the technique of mutual information (MI) to measure the importance of any indicator to the USDM, and because MI is derived solely from the data, our findings are independent of any model structure (conceptual, physically-based, or empirical). We also compare these MIs against the drought representation effectiveness ratings in the North America Drought Indices and Indicators Assessment (NADIIA) survey for Koeppen climate zones. This reveals: [1] agreement between some ratings and our MI values (high for example indicators like Standardized Precipitation-Evapotranspiration Index or SPEI); [2] some divergences (for example, soil moisture has high ratings but near-zero MIs for ESA-CCI soil moisture in the Western U.S., indicating the need of another remotely sensed soil moisture source); and [3] new insights into the importance of variables such as Snow Water Equivalent (SWE) that are not included in sources like NADIIA. Further analysis of the MI results yields findings related to: [1] hydrological mechanisms (summertime SWE domination during individual drought events through snowmelt into the water-scarce soil); [2] hydroclimatic types (the top pair of inputs in the Western and non-Western regions are SPEIs and soil moistures respectively); and [3] predictability (high for the California 2012-2017 event, with longer-timescale indicators dominating). Finally, the high MIs between multiple indicators jointly and the USDM indicate potentially high drought forecasting accuracies achievable using only model-based inputs, and the potential for global drought monitoring using only remotely sensed inputs, especially for locations having insufficient in situ observations.

Drought↗

Automated Registration of Multi-Mode Nondestructive Evaluation Data

Registration techniques play a central role in applications of image processing to computer vision, medical imaging, and automatic target tracking. Feature-based techniques such as scale-invariant feature transform (SIFT) and speeded up robust features (SURF) are commonly used to register images derived from a single modality. However, SIFT and SURF struggle to register images from different modalities because the features tend to manifest rather differently and at sometimes very different length-scales. The most successful methods that have been developed to register multi-modal data use information-theoretic approaches. These methods play a key part in nondestructive evaluation scenarios where data that is collected by sensors of different modalities must be registered to be fused. In this paper, automated registration based on normalized mutual information is applied to align data derived from ultrasonic and radiographic inspections of (i) additively manufactured titanium alloy test coupons, and (ii) thin, lithium metal pouch-cell batteries. The quality of the registration is quantified in terms of computational resources and spatial accuracy. In the first case the X-ray computed tomography (XCT) data is captured on a region corresponding to a small subset of the ultrasonic data, while in the case of the lithium batteries the digital radiography (DR) captures a larger region of interest than the ultrasonic data. In both cases the radiographic data resolution is much higher than for ultrasound, but interestingly, in both cases the accuracy of the registration is approximately equal to two-to-three-pixel lengths in the ultrasonic images.

Nondestructive Evaluation↗

The Dolinar Receiver in an Information Theoretic Framework

Optical communication at the quantum limit requires that measurements on the optical field be maximally informative, but devising physical measurements that accomplish this objective has proven challenging. The Dolinar receiver exemplifies a rare instance of success in distinguishing between two coherent states: an adaptive local oscillator is mixed with the signal prior to photodetection, which yields an error probability that meets the Helstrom lower bound with equality. Here we apply the same local-oscillator-based architecture with aninformation-theoretic optimization criterion. We begin with analysis of this receiver in a general framework for an arbitrary coherent-state modulation alphabet, and then we concentrate on two relevant examples. First, we study a binary antipodal alphabet and show that the Dolinar receiver's feedback function not only minimizes the probability of error, but also maximizes the mutual information. Next, we study ternary modulation consistingof antipodal coherent states and the vacuum state. We derive an analytic expression for a near-optimal local oscillator feedback function, and, via simulation, we determine its photon information efficiency (PIE). We provide the PIE versus dimensional information efficiency (DIE) trade-off curve and show that this modulation and the our receiver combination performs universally better than (generalized) on-off keying plus photoncounting, although, the advantage asymptotically vanishes as the bits-per-photon diverges towards infinity.

optical communications↗

STRATCOM-8 scientific objectives and mission orginization

Stratospheric photochemistry was studied, with emphasis on the Ozone-NOx-ultraviolet flux interactions, but also including members of the chlorine, water vapor, and carbon-containing families. Secondary objectives include: (1) study of the balloon environment, (2) comparison of independent measurements of ozone and of NO, (3) development of new sensor systems; and (4) some measurements for exploratory purposes. Most, but not all, systems and instruments performed as planned, and it is believed that data are available to achieve most of the planned scientific and engineering objectives. The emphasis on photochemistry in the 35 to 40 km region is greater than anticipated, and observations are more complete for sunset than for sunrise. The planned instruments and a summary of the flight operations is discussed partly for the mutual information of those participating and partly for the wider scientific community.

Reed, E. I.↗

Maximum likelihood clustering with dependent feature trees

The decomposition of mixture density of the data into its normal component densities is considered. The densities are approximated with first order dependent feature trees using criteria of mutual information and distance measures. Expressions are presented for the criteria when the densities are Gaussian. By defining different typs of nodes in a general dependent feature tree, maximum likelihood equations are developed for the estimation of parameters using fixed point iterations. The field structure of the data is also taken into account in developing maximum likelihood equations. Experimental results from the processing of remotely sensed multispectral scanner imagery data are included.

Chittineni, C. B.↗

Reveal, A General Reverse Engineering Algorithm for Inference of Genetic Network Architectures

Given the immanent gene expression mapping covering whole genomes during development, health and disease, we seek computational methods to maximize functional inference from such large data sets. Is it possible, in principle, to completely infer a complex regulatory network architecture from input/output patterns of its variables? We investigated this possibility using binary models of genetic networks. Trajectories, or state transition tables of Boolean nets, resemble time series of gene expression. By systematically analyzing the mutual information between input states and output states, one is able to infer the sets of input elements controlling each element or gene in the network. This process is unequivocal and exact for complete state transition tables. We implemented this REVerse Engineering ALgorithm (REVEAL) in a C program, and found the problem to be tractable within the conditions tested so far. For n = 50 (elements) and k = 3 (inputs per element), the analysis of incomplete state transition tables (100 state transition pairs out of a possible 10(exp 15)) reliably produced the original rule and wiring sets. While this study is limited to synchronous Boolean networks, the algorithm is generalizable to include multi-state models, essentially allowing direct application to realistic biological data sets. The ability to adequately solve the inverse problem may enable in-depth analysis of complex dynamic systems in biology and other fields.

Liang, Shoudan↗

Multi-Sensor Registration of Earth Remotely Sensed Imagery

Assuming that approximate registration is given within a few pixels by a systematic correction system, we develop automatic image registration methods for multi-sensor data with the goal of achieving sub-pixel accuracy. Automatic image registration is usually defined by three steps; feature extraction, feature matching, and data resampling or fusion. Our previous work focused on image correlation methods based on the use of different features. In this paper, we study different feature matching techniques and present five algorithms where the features are either original gray levels or wavelet-like features, and the feature matching is based on gradient descent optimization, statistical robust matching, and mutual information. These algorithms are tested and compared on several multi-sensor datasets covering one of the EOS Core Sites, the Konza Prairie in Kansas, from four different sensors: IKONOS (4m), Landsat-7/ETM+ (30m), MODIS (500m), and SeaWIFS (1000m).

LeMoigne, Jacqueline↗

Registration and Fusion of Multiple Source Remotely Sensed Image Data

Earth and Space Science often involve the comparison, fusion, and integration of multiple types of remotely sensed data at various temporal, radiometric, and spatial resolutions. Results of this integration may be utilized for global change analysis, global coverage of an area at multiple resolutions, map updating or validation of new instruments, as well as integration of data provided by multiple instruments carried on multiple platforms, e.g. in spacecraft constellations or fleets of planetary rovers. Our focus is on developing methods to perform fast, accurate and automatic image registration and fusion. General methods for automatic image registration are being reviewed and evaluated. Various choices for feature extraction, feature matching and similarity measurements are being compared, including wavelet-based algorithms, mutual information and statistically robust techniques. Our work also involves studies related to image fusion and investigates dimension reduction and co-kriging for application-dependent fusion. All methods are being tested using several multi-sensor datasets, acquired at EOS Core Sites, and including multiple sensors such as IKONOS, Landsat-7/ETM+, EO1/ALI and Hyperion, MODIS, and SeaWIFS instruments. Issues related to the coregistration of data from the same platform (i.e., AIRS and MODIS from Aqua) or from several platforms of the A-train (i.e., MLS, HIRDLS, OMI from Aura with AIRS and MODIS from Terra and Aqua) will also be considered.

LeMoigne, Jacqueline↗

Memory-efficient decoding of LDPC codes

We present a low-complexity quantization scheme for the implementation of regular (3,6) LDPC codes. The quantization parameters are optimized to maximize the mutual information between the source and the quantized messages. Using this non-uniform quantized belief propagation algorithm, we have simulated that an optimized 3-bit quantizer operates with 0.2dB implementation loss relative to a floating point decoder, and an optimized 4-bit quantizer operates less than 0.1dB quantization loss.

Low-Density-Parity-Check (LDPC)↗

Multi-Modal Image Registration and Matching for Localization of a Balloon on Titan

A solution was developed that matches visible/IR imagery aboard a balloon in Saturn's moon Titan's atmosphere to SAR (synthetic aperture radar) and visible/IR data acquired from orbit. A balloon in Titan's atmosphere must be able to localize itself autonomously both globally and with respect to local terrain. The orbital data is used to provide the balloon imagery with global context. The work is novel in applying mutual information (MI) to orbital vs. aerial data. There are unique challenges in this setting. Image offsets are much higher than in medical imaging, there is local distortion due to 3D terrain relief, and the fields of regard from orbit and from the air are quite different.

Ansar, Adnan I.↗

Revised (Mixed-Effects) Estimation for Forest Burning Emissions of Gases and Smoke, Fire/Emission Factor Typology, and Potential Remote Sensing Classification of Types for Ozone and Black-Carbon Simulation

We summarize recent progress (a) in correcting biomass burning emissions factors deduced from airborne sampling of forest fire plumes, (b) in understanding the variability in reactivity of the fresh plumes sampled in ARCTAS (2008), DC3 (2012), and SEAC4RS (2013) airborne missions, and (c) in a consequent search for remotely sensed quantities that help classify forest-fire plumes. Particle properties, chemical speciation, and smoke radiative properties are related and mutually informative, as pictures below suggest (slopes of lines of same color are similar). (a) Mixed-effects (random-effects) statistical modeling provides estimates of both emission factors and a reasonable description of carbon-burned simultaneously. Different fire plumes will have very different contributions to volatile organic carbon reactivity; this may help explain differences of free NOx(both gas- and particle-phase), and also of ozone production, that have been noted for forest-fire plumes in California. Our evaluations check or correct emission factors based on sequential measurements (e.g., the Normalized Ratio Enhancement and similar methods). We stress the dangers of methods relying on emission-ratios to CO. (b) This work confirms and extends many reports of great situational variability in emissions factors. VOCs vary in OH reactivity and NOx-binding. Reasons for variability are not only fuel composition, fuel condition, etc., but are confused somewhat by rapid transformation and mixing of emissions. We use "unmixing" (distinct from mixed-effects) statistics and compare briefly to approaches like neural nets. We focus on one particularly intense fire the notorious Yosemite Rim Fire of 2013. In some samples, NOx activity was not so suppressed by binding into nitrates as in other fires. While our fire-typing is evolving and subject to debate, the carbon-burned delta(CO2+CO) estimates that arise from mixed effects models, free of confusion by background-CO2 variation, should provide a solid base for discussion. (c) We report progress using promising links we find between emissions-related "fire types" and promising features deducible from remote observations of plumes, e.g., single scatter albedo, Angstrom exponent of scattering, Angstrom exponent of absorption, (CO column density)/(aerosol optical depth).

Remote sensing↗

Planetary Crater Detection and Registration Using Marked Point Processes, Graph Cut Algorithms, and Wavelet Transforms

This paper addresses the problem of semi-automatic image registration on planetary images. A joint feature-based and area-based approach is proposed. Firstly, the most relevant craters are extracted from the two images to register, and then, registration is performed in two steps. The first step matches the craters extracted from the images based on a generalized Hausdorff distance. In the second step, the mutual information between the two images is maximized to achieve high registration accuracy. Craters are detected by a stochastic-geometry approach based on a marked point process model and of a multiple-birth-and-cut energy minimization algorithm. The experimental validation is carried out with 13 images for the crater extraction stage, and with 20 semi-synthetic pairs of images with ground truth and several images extracted from actual multi-temporal lunar scenes for the registration phase.

Image Processing; Pattern Recognition↗

A cold air outbreak over the Norwegian Sea observed with the Tiros-N Operational Vertical Sounder (TOVS) and the Special Sensor Microwave/Imager (SSM/I)

Until recently, the scarcity of meteorological observations over polar areas has limited studies of high latitude weather systems, but now data from polar orbiting satellites offer a new opportunity to observe and describe these systems. TOVS data were used successfully for delineating synoptic and subsynoptic systems since they provide the vertical temperature structure of the atmosphere: SSM/I observations have proved valuable for analyzing storms through water vapor and rain determinations. These positive results prompted us to analyze simultaneous TOVS and SSM/I observations obtained during a cold air outbreak over the Norwegian Sea. After a description of the instruments and the retrieval schemes, the mutually supporting information from these two independent instruments is discussed. Implications for the monitoring of polar lows are presented.

Claud, Chantal↗

A cold air outbreak over the Norwegian Sea observed with the Tiros-N Operational Vertical Sounder (TOVS) and the Special Sensor Microwave/Imager (SSM/I)

Until recently, the scarcity of meteorological observations over polar areas has limited studies of high-latitude weather systems, but now data from polar orbiting satellites offer a new opportunity to observe and describe these systems. TOVS data have been used successfully for delineating synoptic and subsynoptic systems, since they provide the vertical temperature structure of the atmosphere; SSM/I observations have proved valuable for analyzing storms through water vapor and rain determinations. These positive results prompted simultaneous analysis of TOVS and SSM/I observations obtained during a cold air outbreak over the Norwegian Sea. After a description of the instruments and the retrieval schemes, the mutually supporting information from these two independent instruments is discussed. Implications for the monitoring of polar lows are presented.

Claud, Chantal↗

Zero-Fidelity Simulation: Engaging Team Coordination without Physical, Functional, or Psychological Re-Creation

Team coordination is essential across domains, enabling efficiency and safety. As technology improves, our temptation is to simulate with ever-higher fidelity, by making simulators re-create reality through their physical interfaces, functionality, and by making participants believe they are undertaking the simulated task. However, high-fidelity simulations often miss salient human-human work practices. We introduce the concept of zero-fidelity simulation (ZFS), a move away from literal high-fidelity mimesis of the concrete environment. ZFS alternatively models cooperation and communication as the basis of simulation. The ZFS Team Coordination Game (TeC) is developed from observation of fire emergency response work practice. We identify ways in which team members are mutually dependent on one another for information, and use these as the basis for the ZFS game design. The design creates a need for cooperation by restricting individual activity and requiring communication. The present research analyzes the design of interdependence in the validated ZFS TeC game. We successfully simulate interdependence between roles in emergency response without simulating the concrete environment.

Toups, Zachary O.↗

Multivariate Analysis of Solar Spectral Irradiance Measurements

Principal component analysis is used to characterize approximately 7000 downwelling solar irradiance spectra retrieved at the Southern Great Plains site during an Atmospheric Radiation Measurement (ARM) shortwave intensive operating period. This analysis technique has proven to be very effective in reducing a large set of variables into a much smaller set of independent variables while retaining the information content. It is used to determine the minimum number of parameters necessary to characterize atmospheric spectral irradiance or the dimensionality of atmospheric variability. It was found that well over 99% of the spectral information was contained in the first six mutually orthogonal linear combinations of the observed variables (flux at various wavelengths). Rotation of the principal components was effective in separating various components by their independent physical influences. The majority of the variability in the downwelling solar irradiance (380-1000 nm) was explained by the following fundamental atmospheric parameters (in order of their importance): cloud scattering, water vapor absorption, molecular scattering, and ozone absorption. In contrast to what has been proposed as a resolution to a clear-sky absorption anomaly, no unexpected gaseous absorption signature was found in any of the significant components.

Pilewskie, P.↗

Infrared observations of outer planet satellites

This task supports IR observations of the outer planet satellites. These data provide vital information about the thermophysical properties of satellite surfaces, including internal heat sources for Io. Observations include both broad and narrow band measurementsin the 2 to 20 micrometer spectral range. The program in the last year has aimed at obtaining lonitude coverage on Io to establish stability of hot spot patterns previously reported. Several runs produced the most complete data set for an apparition since the start of the program. Unfortunately, bad weather limited coverage of key longitude ranges containing the largest known hot spot Loki. Among the preliminary results is the observation of an outburst in Io's thermal flux that was measured at 4.8, 8.7 and 20 micrometer. Analysis of the data has given the best evidence to date of silicate volcanism on Io; this is one of the most significant pieces of the puzzle as to the relative roles of silicate and sulfur volcanism on Io. Researchers are collaborating with J. Goguen (NRC RRA to finish reduction of mutual event data, which have already improved ephermeris information for the satellites. The data appear to place significant limits on the characteristics of any leading side hot spots.

Johnson, T. V.↗