Engineering PapersSearch

SEARCH · Engineering Papers

Results for “lossy data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

57 records · Page 4

Compression of color-mapped images

In a standard image coding scenario, pixel-to-pixel correlation nearly always exists in the data, especially if the image is a natural scene. This correlation is what allows predictive coding schemes (e.g., DPCM) to perform efficient compression. In a color-mapped image, the values stored in the pixel array are no longer directly related to the pixel intensity. Two color indices which are numerically adjacent (close) may point to two very different colors. The correlation still exists, but only via the colormap. This fact can be exploited by sorting the color map to reintroduce the structure. The sorting of colormaps is studied and it is shown how the resulting structure can be used in both lossless and lossy compression of images.

Hadenfeldt, A. C.

Assimilation of Reconstructed Radiances from IASI Principal Component Scores into the GEOS-ADAS

Hyperspectral Infrared sounders such as IASI, AIRS, and CrIS have long been an integral part of radiance assimilation in numerical weather prediction (NWP), providing vertical profiles of water vapor and temperature information. Principal Component Scores (PCS) are a lossy form of compression that retains most information, such as temperature and moisture, by using a large training set of atmospheric profiles. However, PCS may not well represent profiles which are rare events, such as volcanic eruptions, and drops some sources of random noise. There has been an increased interest in the use of PCS as EUMETSAT plans to distribute future geostationary sounder radiances from MTG-IRS via PCS only. NWP centers use two approaches to deal with PCS: direct assimilation of the PCS by modifying the radiative transfer model to produce PCS and the associated Jacobians, or a simpler approach of decompressing the PCS and reconstructing the radiances back into channel space to allow assimilating radiances without modifications to the data assimilation system. EUMETSAT has developed a PCS product for IASI that has been operational since 2011. We utilize this product opting for the simpler approach, decompressing IASI PCS into channel space, and assimilating those radiances using the GEOS-ADAS. We then compare this with a control using the standard IASI radiance product. Resulting differences in global forecast statistics, differences in Forecast Sensitivity to Observation Impact, along with implications for implementation and quality control are discussed.

Bryan M. Karpowicz

Efficient transfer of images over networks

Effective remote observing requires sending large images over long distances. The usual approach to the transfer problem is to require high bandwidth transmission links, which are expensive to install and operate. An alternative approach is to use existing low-bandwidth connections, such as phone lines or the Internet, in a highly efficient manner by compressing the images. The combined use of existing low-cost infrastructure and standard networking software means that remote observing can be made practical even for small observatories with limited network resources. The authors have implemented such a scheme based on the H-transform compression method developed for astronomical images, which are often resistant to compression because they are noisy. The H-transform can be used for either lossy or lossless compression, and compression factors of at least 10 can be achieved with no noticeable losses in the astrometric or photometric properties of the compressed images. The H-transform allows us to organize the information in an image so that the 'useful' information can be sent first, followed by the noise, which makes up the bulk of the transmission. The receiver can invert a partially received set of H-coefficients, creating an image that improves with time. The H-transform is particularly well-suited to this style of incremental reconstruction, because the spatially localized nature of the basis functions of the H-transorm prevents the appearance of artifacts such as ringing around point sources and edges. The authors' implementation uses the WIYN Telescope Control System's TCP-based communications protocol. An 800x800 16-bit astronomical image was sent over a 2400 baud connection, which would normally take about 71 minutes; after only 60 seconds, the partially received H-transform produced an image that did not differ appreciably from the original. This poster presents a quantification of the efficiencies, as well as examples of images reconstructed from partial data.

Percival, J. W.