Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “lossless”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

The implementation of a lossless data compression module in an advanced orbiting system: Analysis and development

Data compression has been proposed for several flight missions as a means of either reducing on board mass data storage, increasing science data return through a bandwidth constrained channel, reducing TDRSS access time, or easing ground archival mass storage requirement. Several issues arise with the implementation of this technology. These include the requirement of a clean channel, onboard smoothing buffer, onboard processing hardware and on the algorithm itself, the adaptability to scene changes and maybe even versatility to the various mission types. This paper gives an overview of an ongoing effort being performed at Goddard Space Flight Center for implementing a lossless data compression scheme for space flight. We will provide analysis results on several data systems issues, the performance of the selected lossless compression scheme, the status of the hardware processor and current development plan.

Yeh, Pen-Shu↗
NASA NTRS1992

Lossless compression of AVIRIS data: Comparison of methods and instrument constraints

A family of lossless compression methods, allowing exact image reconstruction, are evaluated for compressing Airborne Visible/Infrared Imaging Spectrometers (AVIRIS) image data. The methods are used on Differential Pulse Code Modulation (DPCM). The compressed data have an entropy of order 6 bits/pixel. A theoretical model indicates that significantly better lossless compression is unlikely to be achieved because of limits caused by the noise in the AVIRIS channels. AVIRIS data differ from data produced by other visible/near-infrared sensors, such as LANDSAT-TM or SPOT, in several ways. Firstly, the data are recorded at a greater resolution (12 bits, though packed into 16-bit words). Secondly, the spectral channels are relatively narrow and provide continuous coverage of the spectrum so that the data in adjacent channels are generally highly correlated. Thirdly, the noise characteristics of the AVIRIS are defined by the channels' Noise Equivalent Radiances (NER's), and these NER's show that, at some wavelengths, the least significant 5 or 6 bits of data are essentially noise.

Roger, R. E.↗
NASA NTRS1993

An adaptive, lossless data compression algorithm and VLSI implementations

This paper first provides an overview of an adaptive, lossless, data compression algorithm originally devised by Rice in the early '70s. It then reports the development of a VLSI encoder/decoder chip set developed which implements this algorithm. A recent effort in making a space qualified version of the encoder is described along with several enhancements to the algorithm. The performance of the enhanced algorithm is compared with those from other currently available lossless compression techniques on multiple sets of test data. The results favor our implemented technique in many applications.

Venbrux, Jack↗
NASA NTRS1994

An adaptive technique to maximize lossless image data compression of satellite images

Data compression will pay an increasingly important role in the storage and transmission of image data within NASA science programs as the Earth Observing System comes into operation. It is important that the science data be preserved at the fidelity the instrument and the satellite communication systems were designed to produce. Lossless compression must therefore be applied, at least, to archive the processed instrument data. In this paper, we present an analysis of the performance of lossless compression techniques and develop an adaptive approach which applied image remapping, feature-based image segmentation to determine regions of similar entropy and high-order arithmetic coding to obtain significant improvements over the use of conventional compression techniques alone. Image remapping is used to transform the original image into a lower entropy state. Several techniques were tested on satellite images including differential pulse code modulation, bi-linear interpolation, and block-based linear predictive coding. The results of these experiments are discussed and trade-offs between computation requirements and entropy reductions are used to identify the optimum approach for a variety of satellite images. Further entropy reduction can be achieved by segmenting the image based on local entropy properties then applying a coding technique which maximizes compression for the region. Experimental results are presented showing the effect of different coding techniques for regions of different entropy. A rule-base is developed through which the technique giving the best compression is selected. The paper concludes that maximum compression can be achieved cost effectively and at acceptable performance rates with a combination of techniques which are selected based on image contextual information.

Stewart, Robert J.↗
NASA NTRS1994

Radiometric resolution enhancement by lossy compression as compared to truncation followed by lossless compression

Recent advances in imaging technology make it possible to obtain imagery data of the Earth at high spatial, spectral and radiometric resolutions from Earth orbiting satellites. The rate at which the data is collected from these satellites can far exceed the channel capacity of the data downlink. Reducing the data rate to within the channel capacity can often require painful trade-offs in which certain scientific returns are sacrificed for the sake of others. In this paper we model the radiometric version of this form of lossy compression by dropping a specified number of least significant bits from each data pixel and compressing the remaining bits using an appropriate lossless compression technique. We call this approach 'truncation followed by lossless compression' or TLLC. We compare the TLLC approach with applying a lossy compression technique to the data for reducing the data rate to the channel capacity, and demonstrate that each of three different lossy compression techniques (JPEG/DCT, VQ and Model-Based VQ) give a better effective radiometric resolution than TLLC for a given channel rate.

Tilton, James C.↗
NASA NTRS1995

A spatially adaptive spectral re-ordering technique for lossless coding of hyper-spectral images

In this paper, we propose a new approach, applicable to lossless compression of hyper-spectral images, that alleviates some limitations of linear prediction as applied to this problem. According to this approach, an adaptive re-ordering of the spectral components of each pixel is performed prior to prediction and encoding. This re-ordering adaptively exploits, on a pixel-by pixel basis, the presence of inter-band correlations for prediction. Furthermore, the proposed approach takes advantage of spatial correlations, and does not introduce any coding overhead to transmit the order of the spectral bands. This is accomplished by using the assumption that two spatially adjacent pixels are expected to have similar spectral relationships. We thus have a simple technique to exploit spectral and spatial correlations in hyper-spectral data sets, leading to compression performance improvements as compared to our previously reported techniques for lossless compression. We also look at some simple error modeling techniques for further exploiting any structure that remains in the prediction residuals prior to entropy coding.

Memon, Nasir D.↗
NASA NTRS2009

Lossless Astronomical Image Compression and the Effects of Random Noise

In this paper we compare a variety of modern image compression methods on a large sample of astronomical images. We begin by demonstrating from first principles how the amount of noise in the image pixel values sets a theoretical upper limit on the lossless compression ratio of the image. We derive simple procedures for measuring the amount of noise in an image and for quantitatively predicting how much compression will be possible. We then compare the traditional technique of using the GZIP utility to externally compress the image, with a newer technique of dividing the image into tiles, and then compressing and storing each tile in a FITS binary table structure. This tiled-image compression technique offers a choice of other compression algorithms besides GZIP, some of which are much better suited to compressing astronomical images. Our tests on a large sample of images show that the Rice algorithm provides the best combination of speed and compression efficiency. In particular, Rice typically produces 1.5 times greater compression and provides much faster compression speed than GZIP. Floating point images generally contain too much noise to be effectively compressed with any lossless algorithm. We have developed a compression technique which discards some of the useless noise bits by quantizing the pixel values as scaled integers. The integer images can then be compressed by a factor of 4 or more. Our image compression and uncompression utilities (called fpack and funpack) that were used in this study are publicly available from the HEASARC web site.Users may run these stand-alone programs to compress and uncompress their own images.

Pence, William↗
NASA NTRS2010

Algorithm for Lossless Compression of Calibrated Hyperspectral Imagery

A two-stage predictive method was developed for lossless compression of calibrated hyperspectral imagery. The first prediction stage uses a conventional linear predictor intended to exploit spatial and/or spectral dependencies in the data. The compressor tabulates counts of the past values of the difference between this initial prediction and the actual sample value. To form the ultimate predicted value, in the second stage, these counts are combined with an adaptively updated weight function intended to capture information about data regularities introduced by the calibration process. Finally, prediction residuals are losslessly encoded using adaptive arithmetic coding. Algorithms of this type are commonly tested on a readily available collection of images from the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) hyperspectral imager. On the standard calibrated AVIRIS hyperspectral images that are most widely used for compression benchmarking, the new compressor provides more than 0.5 bits/sample improvement over the previous best compression results. The algorithm has been implemented in Mathematica. The compression algorithm was demonstrated as beneficial on 12-bit calibrated AVIRIS images.

Kiely, Aaron B.↗
NASA NTRS2006

Fast Lossless Compression of Multispectral-Image Data

An algorithm that effects fast lossless compression of multispectral-image data is based on low-complexity, proven adaptive-filtering algorithms. This algorithm is intended for use in compressing multispectral-image data aboard spacecraft for transmission to Earth stations. Variants of this algorithm could be useful for lossless compression of three-dimensional medical imagery and, perhaps, for compressing image data in general.

Klimesh, Matthew↗
NASA NTRS2012

Fast and Adaptive Lossless Onboard Hyperspectral Data Compression System

Modern hyperspectral imaging systems are able to acquire far more data than can be downlinked from a spacecraft. Onboard data compression helps to alleviate this problem, but requires a system capable of power efficiency and high throughput. Software solutions have limited throughput performance and are power-hungry. Dedicated hardware solutions can provide both high throughput and power efficiency, while taking the load off of the main processor. Thus a hardware compression system was developed. The implementation uses a field-programmable gate array (FPGA). The implementation is based on the fast lossless (FL) compression algorithm reported in Fast Lossless Compression of Multispectral-Image Data (NPO-42517), NASA Tech Briefs, Vol. 30, No. 8 (August 2006), page 26, which achieves excellent compression performance and has low complexity. This algorithm performs predictive compression using an adaptive filtering method, and uses adaptive Golomb coding. The implementation also packetizes the coded data. The FL algorithm is well suited for implementation in hardware. In the FPGA implementation, one sample is compressed every clock cycle, which makes for a fast and practical realtime solution for space applications. Benefits of this implementation are: 1) The underlying algorithm achieves a combination of low complexity and compression effectiveness that exceeds that of techniques currently in use. 2) The algorithm requires no training data or other specific information about the nature of the spectral bands for a fixed instrument dynamic range. 3) Hardware acceleration provides a throughput improvement of 10 to 100 times vs. the software implementation. A prototype of the compressor is available in software, but it runs at a speed that does not meet spacecraft requirements. The hardware implementation targets the Xilinx Virtex IV FPGAs, and makes the use of this compressor practical for Earth satellites as well as beyond-Earth missions with hyperspectral instruments.

Aranki, Nazeeh I.↗
DOE OSTI2021

Improving Signal to Noise Ratios in Ion Mobility Spectrometry and Structures for Lossless Ion Manipulations (SLIM) using a High Dynamic Range Analog-to-Digital Converter

Signal digitization is a commonly overlooked part of ion mobility-mass spectrometry (IMS-MS) workflows, yet it is a significant contributor for determining signal-to-noise ratios and MS resolution. Here we report on the integration of a 2 GS/s, 14-bit ADC with a structures for lossless ion manipulations (SLIM)-IMS-MS and compare the performance to a commonly used 8-bit ADC. The 14-bit ADC provided an effective reduction in digitized noise by factor of ~6, owing largely to the use of smaller bit sizes. The low baseline allowed the threshold voltage levels to be set very close to the MCP baseline voltage, allowing for as much signal to be acquired as possible without causing overloading or excessive digitization of MCP baseline noise. Analyses of Agilent tuning mixture ions and a complex mixture of heavy labeled phosphopeptides showed that the 14-bit ADC (compared to the 8-bit ADC) provided a modest signal-to-noise increase (~1.5 to 2-fold) for high intensity ions, such as the Agilent tuning mixture ions and the 2+ and 3+ charge states of many phosphopeptide constituents. However, signal enhancements were as much as 10-fold for low intensity ions, and the 14-bit ADC enabled discernable signal intensities otherwise lost using an 8-bit digitizer. Additionally, the 14-bit ADC required ~14-fold fewer mass spectra to be averaged to produce a mass spectrum with similar S/N as the 8-bit ADC under identical conditions, potentially providing an order of magnitude higher measurement throughput. The high resolution, low baseline, and fast speed of the new 14-bit ADC enables high performance digitization of MS, IMS-MS, and SLIM-IMS-MS spectra, and allows a much fuller picture of analyte profiles in complex mixtures to be acquired.

data acquisition, digitization, ion mobility spect↗
NASA NTRS2005

Low-Complexity Lossless Compression of Hyperspectral Imagery Via Adaptive Filtering

A low-complexity, adaptive predictive technique for lossless compression of hyperspectral data is presented. The technique relies on the sign algorithm from the repertoire of adaptive filtering. The compression effectiveness obtained with the technique is competitive with that of the best of previously described techniques with similar complexity.

lossless data compression↗
NASA NTRS2012

Real-Time Adaptive Lossless Hyperspectral Image Compression using CCSDS on Parallel GPGPU and Multicore Processor Systems

The proposed CCSDS (Consultative Committee for Space Data Systems) Lossless Hyperspectral Image Compression Algorithm was designed to facilitate a fast hardware implementation. This paper analyses that algorithm with regard to available parallelism and describes fast parallel implementations in software for GPGPU and Multicore CPU architectures. We show that careful software implementation, using hardware acceleration in the form of GPGPUs or even just multicore processors, can exceed the performance of existing hardware and software implementations by up to 11x and break the real-time barrier for the first time for a typical test application.

realtime↗
DOE OSTI2024

High-resolution ion mobility based on traveling wave structures for lossless ion manipulation resolves hidden lipid features

Abstract High-resolution ion mobility (resolving power > 200) coupled with mass spectrometry (MS) is a powerful analytical tool for resolving isobars and isomers in complex samples. High-resolution ion mobility is capable of discerning additional structurally distinct features, which are not observed with conventional resolving power ion mobility (IM, resolving power ~ 50) techniques such as traveling wave IM and drift tube ion mobility (DTIM). DTIM in particular is considered to be the “gold standard” IM technique since collision cross section (CCS) values are directly obtained through a first-principles relationship, whereas traveling wave IM techniques require an additional calibration strategy to determine accurate CCS values. In this study, we aim to evaluate the separation capabilities of a traveling wave ion mobility structures for lossless ion manipulation platform integrated with mass spectrometry analysis (SLIM IM-MS) for both lipid isomer standards and complex lipid samples. A cross-platform investigation of seven subclass-specific lipid extracts examined by both DTIM-MS and SLIM IM-MS showed additional features were observed for all lipid extracts when examined under high resolving power IM conditions, with the number of CCS-aligned features that resolve into additional peaks from DTIM-MS to SLIM IM-MS analysis varying between 5 and 50%, depending on the specific lipid sub-class investigated. Lipid CCS values are obtained from SLIM IM ( TW(SLIM) CCS) through a two-step calibration procedure to align these measurements to within 2% average bias to reference values obtained via DTIM ( DT CCS). A total of 225 lipid features from seven lipid extracts are subsequently identified in the high resolving power IM analysis by a combination of accurate mass-to-charge, CCS, retention time, and linear mobility-mass correlations to curate a high-resolution IM lipid structural atlas. These results emphasize the high isomeric complexity present in lipidomic samples and underscore the need for multiple analytical stages of separation operated at high resolution. Graphical abstract

Reardon, Allison R. (ORCID:0000000165830134)↗
DOE OSTI2021

A Miniature Multilevel Structures for Lossless Ion Manipulations Ion Mobility Spectrometer with Wide Mobility Range Separation Capabilities

Here, ion mobility spectrometry employing structures for lossless ion manipulations (SLIM-IMS) is an attractive gas-phase separation technique due to its ability to achieve unprecedented effective ion path lengths (>1 km) and IMS resolving powers in a small footprint. The emergence of multilevel SLIM technology, where ions are transferred between vertically stacked SLIM electrode surfaces, has subsequently allowed for ultralong single pass path lengths (>40 m) to be achieved, enabling ultrahigh resolution IMS measurements to be performed over the entire mobility range in a single experiment. The implementation of multiple SLIM levels requires very little additional space for the SLIM system, and we developed a miniature SLIM module (miniSLIM) based on multilevel SLIM technology and report the performance here. The module is 11.1 cm x 6.7 cm x 1.4 cm (L x W x H) and consists of three SLIM levels totaling 1-meter path length. Ion trajectory simulations were used to optimize the SLIM board spacings and SLIM board thicknesses of the miniSLIM IMS system. Methods of efficiently transferring ions between SLIM levels were examined and a new approach using asymmetric traveling waves (TWs) was developed and implemented in the miniSLIM. We experimentally characterized the performance of the --meter multilevel miniSLIM IMS-MS relative to a drift tube IM--MS using an Agilent tuning mixture and tetraalkylammonium cations. The 1-meter miniSLIM achieved a resolving power of up to 131 (CCS/ΔCCS), ~1.5x higher than achievable with a 78 cm path length drift tube IMS, and successfully transmitted the entire ion mobility range in a single separation. We also demonstrated the miniSLIM’s performance as a standalone IMS system (i.e., without MS), showing baseline separation between Agilent tuning mixture cations with the full mobility range observed, and a standard peptide mixture with different charge states readily differentiated. Overall the miniSLIM provides a compact alternative to high performance IMS instruments possessing similar path lengths.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Development of a Structure for Lossless Ion Manipulations (SLIM) High Charge Capacity Array of Traps

Enhancing the sensitivity of low abundance ions in a complex mixture without sacrificing experiment throughput is highly desirable. This work demonstrates a way to greatly improve the sensitivity of ion mobility (IM) selected ions by accumulating them in an array of high-capacity ion traps located inside a novel structures for lossless ion manipulations ion mobility spectrometer (SLIM-IMS) module. The array of ion traps used in this work consisted of seven independently controllable traps. Each trap was 386 mm long and possessed a charge capacity of ~4.5×10 8 charges, with a linear range extending to ~2.5×10 8 charges. Each ion trap could be used to extract a peak (or ions over a mobility range) from an ion mobility separation based on arrival time. Ions could be stored without losses for long times (>100 s) and then released all at once or one trap at a time. It was possible to accumulate large ion populations by extracting and storing ions over repeated IM separations. We report enrichment of up to seven individual ion distributions could be performed using the seven independently controllable ion traps. Additionally, the ion trapping process effectively compressed ion populations into narrow peaks, which provides a greatly improved basis for subsequent ion manipulations. The array of high charge-capacity ion traps provides a flexible addition to SLIM and a powerful tool for IMS-MS applications requiring high sensitivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗