Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Compression Ratio”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Lossy Compression: An Online Multi-Stage Technology for High-Fidelity Synchro- Waveform Measurements

Effective real-time monitoring and analysis of distributed grids necessitate the use of synchro-waveform measurements, which capture almost all high-frequency disturbances and transient phenomena. However, due to limitations in high-speed measurements and network bandwidth, it is challenging to transfer all high-fidelity synchro-waveforms losslessly and successfully. To cope with these challenges, a hybrid-based online multi-stage compression algorithm is proposed to significantly improve the compression efficiency for synchro-waveform measurements. Initially, the multiple discrete Wavelet transformation is deployed to deconstruct the waveform components. The delta encoding is further developed to decrease the magnitude. In conjunction with the Lempel-Ziv-Markov chain, the hybrid compression algorithm is implemented to achieve real-time compression for the synchro-waveform measurements. Moreover, an innovative error index that synergizes the time and frequency domain error and correlation is formulated to evaluate the waveform distortion. By integrating compression ratio, suitable parameters can be optimally selected. Finally, the simulation, laboratory experiments, as well as field tests across a spectrum of sampling frequencies and time intervals are conducted to substantiate the efficacy of the proposed method. Here, the outcomes demonstrated that a compression ratio of approximately 15.5 and 17.83 can be reached for 0.5 s and 1 s data under both offline and online scenarios, which equates to a substantial 93.5% to 94.39% reduction in data storage requirements.

High-fidelity synchro-waveform measurements↗
DOE OSTI2022

SZ3: A Modular Framework for Composing Prediction-Based Error-Bounded Lossy Compressors

Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage space. Here, error-bounded lossy compression has been considered one of the most effective solutions to the above problem. In practice, however, the best-fit compression method often needs to be customized or optimized in particular because of diverse characteristics in different datasets and various user requirements on the compression quality and performance. In this paper, we address this issue with a novel modular, composable compression framework named SZ3. Our contributions are four-folds. (1) We develop SZ3 which features an innovative modular abstraction for the prediction-based compression framework, such that compression modules can be plugged in easily to create new compressors based on characteristics of data and user requirements. (2) We create a new compression pipeline by SZ3 for GAMESS data, which significantly improves the compression ratios over state-of-the-art compressors. (3) We develop an adaptive compression pipeline by SZ3 for APS data with minimal efforts, which leads to the best rate-distortion among all existing error-bounded lossy compressors for any bit-rate. (4) We compare the sustainability of SZ3 with leading error-bounded prediction-based compressors, and then demonstrate the necessity of diverse pipelines by integrating and evaluating several compression pipelines on diverse scientific datasets from multiple disciplines. Experiments show that SZ3 incurs very limited overhead in compressor integration and our customized compression pipelines lead to up to 20% improvement in compression ratios under the same data distortion, when compared with the best existing approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Evaluating Linear Ion Trap for MS3-Based Multiplexed Single-Cell Proteomics

There is a growing demand to develop high-throughput and high-sensitivity mass spectrometry methods for single-cell proteomics. The commonly used isobaric labeling-based multiplexed single-cell proteomics approach suffers from distorted protein quantification due to co-isolated interfering ions during MS/MS fragmentation, also known as ratio compression. We reasoned that the use of MS3-based quantification could mitigate ratio compression and provide better quantification. However, previous studies indicated reduced proteome coverages in the MS3 method, likely due to long duty cycle time and ion losses during multilevel ion selection and fragmentation. Here, in this paper, we described an improved MS acquisition method for MS3-based single-cell proteomics by employing a linear ion trap to measure reporter ions. We demonstrated that linear ion trap can increase the proteome coverages for single-cell-level peptides with even higher gain obtained via the MS3 method. The optimized real-time search MS3 method was further applied to study the immune activation of single macrophages. Among a total of 126 single cells studied, over 1200 and 1000 proteins were quantifiable when at least 50 and 75% nonmissing data were required, respectively. Our evaluation also revealed several limitations of the low-resolution ion trap detector for multiplexed single-cell proteomics and suggested experimental solutions to minimize their impacts on single-cell analysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1932

Effect of Engine Operating Conditions on the Vaporization of Safety Fuels

Tests were conducted with the N.A.C.A. combustion apparatus to determine the effect of compression ratio and engine temperature on the vaporization of a hydrogenated "safety fuel" during the compression stroke under conditions similar to those in a spark-ignition engine. The effects of fuel boiling temperature on vaporization using gasoline, safety fuel, and Diesel fuel oil was also investigated. The results show that increasing the compression ratio has little effect on the rate of fuel vaporization, but that increasing the air temperature by increasing the engine temperature increases the rate of fuel vaporization. The results also show that the vaporized fuel forms a homogeneous mixture with the air more rapidly that does the atomized fuel spray.

Rothrock, A M↗
DOE OSTI2022

Ultrafast Error-bounded Lossy Compression for Scientific Datasets

Today's scientific high-performance computing applications and advanced instruments are producing vast volumes of data across a wide range of domains, which impose a serious burden on data transfer and storage. Error-bounded lossy compression has been developed and widely used in the scientific community because it not only can significantly reduce the data volumes but also can strictly control the data distortion based on the user-specified error bound. Existing lossy compressors, however, cannot offer ultrafast compression speed, which is highly demanded by numerous applications or use cases (such as in-memory compression and online instrument data compression). In this paper, we propose a novel ultrafast error-bounded lossy compressor that can obtain fairly high compression performance on both CPUs and GPUs and with reasonably high compression ratios. The key contributions are threefold. (1) We propose a generic error-bounded lossy compression framework---called SZx---that achieves ultrafast performance through its novel design comprising only lightweight operations such as bitwise and addition/subtraction operations, while still keeping a high compression ratio. (2) We implement SZx on both CPUs and GPUs and optimize the performance according to their architectures. (3) We perform a comprehensive evaluation with six real-world production-level scientific datasets on both CPUs and GPUs. Experiments show that SZx is 2~16x faster than the second-fastest existing error-bounded lossy compressor (either SZ or ZFP) on CPUs and GPUs, with respect to both compression and decompression.

Yu, Xiaodong↗
DOE OSTI2021

Exploring Autoencoder-based Error-bounded Compression for Scientific Data

Error-bounded lossy compression is becoming an indispensable technique for the success of today's scientific projects with vast volumes of data produced during the simulations or instrument data acquisitions. Not only can it significantly reduce data size, but it also can control the compression errors based on user-specified error bounds. Autoencoder (AE) models have been widely used in image compression, but few AE-based compression approaches support error-bounding features, which are highly required by scientific applications. To address this issue, we explore using convolutional autoencoders to improve error-bounded lossy compression for scientific data, with the following three key contributions. (1) We provide an in-depth investigation of the characteristics of various autoencoder models and develop an error-bounded autoencoder-based framework in terms of the SZ model. (2) We optimize the compression quality for main stages in our designed AE-based error-bounded compression framework, fine-tuning the block sizes and latent sizes and also optimizing the compression efficiency of latent vectors. (3) We evaluate our proposed solution using five real-world scientific datasets and comparing them with six other related works. Experiments show that our solution exhibits a very competitive compression quality from among all the compressors in our tests. In absolute terms, it can obtain a much better compression quality (100%similar to 800% improvement in compression ratio with the same data distortion) compared with SZ2.1 and ZFP in cases with a high compression ratio.

Liu, Jinyang↗
DOE OSTI2021

Strategies for on-chip digital data compression for X-ray pixel detectors

Here, the continued desire for X-ray pixel detectors with higher frame rates will stress the ability of application-specific integrated circuit (ASIC) designers to provide sufficient off-chip bandwidth to reach continuous frame rates in the 1 MHz regime. To move from the current 10 kHz to the 1 MHz frame rate regime, ASIC designers will continue to pack as many power-hungry high-speed transceivers at the periphery of the ASIC as possible. In this paper, however, we present new strategies to make the most efficient use of the off-chip bandwidth by utilizing data compression schemes for X-ray photon-counting and charge-integrating pixel detectors. In particular, we describe a novel in-pixel compression scheme that converts from analog to digital converter units to encoded photon counts near the photon Poisson noise level and achieves a compression ratio of >1.5x independent of the dataset. In addition, we describe a simple yet efficient zero-suppression compression scheme called "zeromask" (ZM) located at the ASIC's edge before streaming data off the ASIC chip. ZM achieves average compression ratios of >4x, >7x, and >8x for high-energy X-ray diffraction, ptychography, and X-ray photon correlation spectroscopy datasets, respectively. We present the conceptual designs, register-transfer level block diagrams, and the physical ASIC implementation of these compression schemes in 65 nm CMOS. When combined, these two digital compression schemes could increase the effective off-chip bandwidth by a factor of 6-12x.

47 OTHER INSTRUMENTATION↗
NASA NTRS1991

Compressed/reconstructed test images for CRAF/Cassini

A set of compressed, then reconstructed, test images submitted to the Comet Rendezvous Asteroid Flyby (CRAF)/Cassini project is presented as part of its evaluation of near lossless high compression algorithms for representing image data. A total of seven test image files were provided by the project. The seven test images were compressed, then reconstructed with high quality (root mean square error of approximately one or two gray levels on an 8 bit gray scale), using discrete cosine transforms or Hadamard transforms and efficient entropy coders. The resulting compression ratios varied from about 2:1 to about 10:1, depending on the activity or randomness in the source image. This was accomplished without any special effort to optimize the quantizer or to introduce special postprocessing to filter the reconstruction errors. A more complete set of measurements, showing the relative performance of the compression algorithms over a wide range of compression ratios and reconstruction errors, shows that additional compression is possible at a small sacrifice in fidelity.

Dolinar, S.↗
DOE OSTI2020

Nonideal mixing effects in warm dense matter studied with first-principles computer simulations

Here, we study nonideal mixing effects in the regime of warm dense matter (WDM) by computing the shock Hugoniot curves of BN, MgO, and MgSiO 3 . First, we derive these curves from the equations of state (EOS) of the fully interacting systems, which were obtained using a combination of path integral Monte Carlo calculations at high temperature and density functional molecular dynamics simulations at lower temperatures. We then use the ideal mixing approximation at constant pressure and temperature to rederive these Hugoniot curves from the EOS tables of the individual elements. We find that the linear mixing approximation works remarkably well at temperatures above ~2 × 10 5 K, where the shock compression ratio exceeds ~3.2. The shape of the Hugoniot curve of each compound is well reproduced. Regions of increased shock compression, which emerge because of the ionization of L and K shell electrons, are well represented, and the maximum compression ratio of the Hugoniot curves is reproduced with high precision. Some deviations are seen near the onset of the L shell ionization regime, where ionization equilibrium in the fully interacting system cannot be well reproduced by the ideal mixing approximation. This approximation also breaks down at lower temperatures, where chemical bonds play an increasingly important role. However, the results imply that the equilibrium properties of binary and ternary mixtures in the regime of WDM can be derived from the EOS tables of the individual elements. This significantly simplifies the characterization of binary and ternary mixtures in the WDM and plasma phases, which otherwise requires large numbers of more computationally expensive first-principles computer simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1936

Friction of Compression-ignition Engines

The cost in mean effective pressure of generating air flow in the combustion chambers of single-cylinder compression-ignition engines was determined for the prechamber and the displaced-piston types of combustion chamber. For each type a wide range of air-flow quantities, speeds, and boost pressures was investigated. Supplementary tests were made to determine the effect of lubricating-oil temperature, cooling-water temperature, and compression ratio on the friction mean effective pressure of the single-cylinder test engine. Friction curves are included for two 9-cylinder, radial, compression-ignition aircraft engines. The results indicate that generating the optimum forced air flow increased the motoring losses approximately 5 pounds per square inch mean effective pressure regardless of chamber type or engine speed. With a given type of chamber, the rate of increase in friction mean effective pressure with engine speed is independent of the air-flow speed. The effect of boost pressure on the friction cannot be predicted because the friction was decreased, unchanged, or increased depending on the combustion-chamber type and design details. High compression ratio accounts for approximately 5 pounds per square inch mean effective pressure of the friction of these single-cylinder compression-ignition engines. The single-cylinder test engines used in this investigation had a much higher friction mean effective pressure than conventional aircraft engines or than the 9-cylinder, radial, compression-ignition engines tested so that performance should be compared on an indicated basis.

Moore, Charles S↗
NASA NTRS2017

Performance of a Space-Based Wavelet Compressor for Plasma Count Data on the MMS Fast Plasma Investigation

Data compression has been a staple of imaging instruments for years. Recently, plasma measurements have utilized compression with relatively low compression ratios. The Fast Plasma Investigation (FPI) on board the Magnetospheric Multiscale (MMS) mission generates data roughly 100 times faster than previous plasma instruments, requiring a higher compression ratio to fit within the telemetry allocation. This study investigates the performance of a space-based compression standard employing a Discrete Wavelet Transform and a Bit Plane Encoder (DWT/BPE) in compressing FPI plasma count data. Data from the first 6 months of FPI operation are analyzed to explore the error modes evident in the data and how to adapt to them. While approximately half of the Dual Electron Spectrometer (DES) maps had some level of loss, it was found that there is little effect on the plasma moments and that errors present in individual sky maps are typically minor. The majority of Dual Ion Spectrometer burst sky maps compressed in a lossless fashion, with no error introduced during compression. Because of induced compression error, the size limit for DES burst images has been increased for Phase 1B. Additionally, it was found that the floating point compression mode yielded better results when images have significant compression error, leading to floating point mode being used for the fast survey mode of operation for Phase 1B. Despite the suggested tweaks, it was found that wavelet-based compression, and a DWT/BPE algorithm in particular, is highly suitable to data compression for plasma measurement instruments and can be recommended for future missions.

plasma↗
NASA NTRS1993

Compression through decomposition into browse and residual images

Economical archival and retrieval of image data is becoming increasingly important considering the unprecedented data volumes expected from the Earth Observing System (EOS) instruments. For cost effective browsing the image data (possibly from remote site), and retrieving the original image data from the data archive, we suggest an integrated image browse and data archive system employing incremental transmission. We produce our browse image data with the JPEG/DCT lossy compression approach. Image residual data is then obtained by taking the pixel by pixel differences between the original data and the browse image data. We then code the residual data with a form of variable length coding called diagonal coding. In our experiments, the JPEG/DCT is used at different quality factors (Q) to generate the browse and residual data. The algorithm has been tested on band 4 of two Thematic mapper (TM) data sets. The best overall compression ratios (of about 1.7) were obtained when a quality factor of Q=50 was used to produce browse data at a compression ratio of 10 to 11. At this quality factor the browse image data has virtually no visible distortions for the images tested.

Novik, Dmitry A.↗
NASA NTRS2009

Optimal Compression Methods for Floating-point Format Images

We report on the results of a comparison study of different techniques for compressing FITS images that have floating-point (real*4) pixel values. Standard file compression methods like GZIP are generally ineffective in this case (with compression ratios only in the range 1.2 - 1.6), so instead we use a technique of converting the floating-point values into quantized scaled integers which are compressed using the Rice algorithm. The compressed data stream is stored in FITS format using the tiled-image compression convention. This is technically a lossy compression method, since the pixel values are not exactly reproduced, however all the significant photometric and astrometric information content of the image can be preserved while still achieving file compression ratios in the range of 4 to 8. We also show that introducing dithering, or randomization, when assigning the quantized pixel-values can significantly improve the photometric and astrometric precision in the stellar images in the compressed file without adding additional noise. We quantify our results by comparing the stellar magnitudes and positions as measured in the original uncompressed image to those derived from the same image after applying successively greater amounts of compression.

Pence, W. D.↗
DOE OSTI2022

Experimental Studies of Low-Load Limit in a Stoichiometric Micro-Pilot Diesel Natural Gas Engine

While operating at light loads, diesel pilot-ignited natural gas engines with lean premixed natural gas suffer from poor combustion efficiency and high methane emissions. This work investigates the limits of low-load operation for a micro-pilot diesel natural gas engine that uses a stoichiometric mixture to enable methane and nitrogen oxide emission control. By optimizing engine hardware, operating conditions, and injection strategies, this study focused on defining the lowest achievable load while maintaining a stoichiometric equivalence ratio and with acceptable combustion stability. A multi-cylinder diesel 6.7 L engine was converted to run natural gas premix with a maximum diesel micro-pilot contribution of 10%. With a base diesel compression ratio of 17.3:1, the intake manifold pressure limit was 80 kPa(absolute). At a reduced compression ratio of 15:1, this limit increased to 85 kPa, raising the minimum stable load. Retarding the combustion phasing, typically used in spark-ignition engines to achieve lower loads, was also tested but found to be limited by degraded diesel ignition at later timings. Reducing the pilot injection pressure improved combustion stability, as did increasing pilot quantity at the cost of lower substitution ratios. The lean operation further reduced load but increased NOx and hydrocarbon emissions. At loads below the practical dual-fuel limit, a transition to lean diesel operation will likely be required with corresponding implications for the aftertreatment system.

03 NATURAL GAS↗
NASA NTRS1944

The Effect of Piston-Head Temperature on Knock-Limited Power

To determine the effect of piston-head temperature on knock-limited power. Tests were made in a supercharged CFR engine over a range of fuel-air ratios from 0.055 to 0.120, using S-3 reference fuel, AN-F-28, Amendment-2, aviation gasoline, and AN-F-28 plus 2 percent xylidines by weight. Tests were run at a compression ratio of 7.0 with inlet-air temperatures of 150 F and 250 F and at a compression ratio of 8.0 with an inlet-air temperature of 250 F. All other engine conditions were held constant. The piston-head temperature was varied by circulation of oil through passages in the crown of a liquid-cooled piston. This method of piston cooling decreased the piston-head temperature about 80 F. The data are not intended to constitute a recommendation as to the advisability of piston cooling in practice.

Imming, Harry S.↗
NASA NTRS1932

Influence of several factors on ignition lag in a compression-ignition engine

This investigation was made to determine the influence of fuel quality, injection advance angle, injection valve-opening pressure, inlet-air pressure, compression ratio, and engine speed on the time lag of auto-ignition of a Diesel fuel oil in a single-cylinder compression-ignition engine as obtained from an analysis of indicator diagrams. Three cam-operated fuel-injection pumps, two pumps cams, and an automatic injection valve with two different nozzles were used. Ignition lag was considered to be the interval between the start of injection of the fuel as determined with a Stroborama and the start of effective combustion as determined from the indicator diagram, the latter being the point where 4.0 x 10(exp-6) pound of fuel had been effectively burned. For this particular engine and fuel it was found that: (1) for a constant start and the same rate of fuel injection up the point of cut-off, a variation in fuel quantity from 1.2 x 10(exp-4) to 4.1 x 10(exp-4) pound per cycle has no appreciable effect on the ignition lag; (2) injection advance angle increases or decreases the lag according to whether density, temperature, or turbulence has the controlling influence; (3) increase in valve-opening pressure slightly increases the lag; and (4) increase of inlet-air pressure, compression ratio, and engine speed reduces the lag.

Gerrish, Harold C↗
DOE OSTI2022

OptZConfig: Efficient Parallel Optimization of Lossy Compression Configuration

Lossless compressors have very low compression ratios that do not meet the needs of today's large-scale scientific applications that produce vast volumes of data. Error-bounded lossy compression (EBLC) is considered a critical technique for the success of scientific research. Although EBLC allows users to set an error bound for the compression, users have been unable to specify the requirements on the compression quality, limiting practical use. Our contributions are: (1) We formulate the problem of configuring EBLC to preserve a user-defined metric as an optimization problem. This allows many classes of new metrics to be preserved, which improves over current practices. (2) We present a framework, OptZConfig, that can adapt to improvements in the search algorithm, compressor, and metrics with minimal changes, enabling future advancements in this area. (3) We demonstrate the advantages of our approach against the leading methods to configure compressors to preserve specific metrics. Here, our approach improves compression ratios against a specialized compressor by up to 3 x, has a 56x speedup over FRaZ, 1000x speedup over MGARD-QOI post tuning, and 110x speedup over systematic approaches which had not been bounded by compressors before.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1990

Design of QMF (Quadrature Mirror Filter) in spatial domain and edge encoding

Simoncelli and Adelson have extended the one dimensional Quadrature Mirror Filter (QMF) to two dimensions with hexagon symmetry and three dimensional spatio-temporal extensions with rhombic-duodecahedray symmetry. Jain and Crochiere presented an excellent QMF design technique in the time domain. It is proposed to extend the design of a two dimensional QMF over a rectangular lattice in the spatial domain based primarily on the extension of the idea of Jain and Crochiere. In addition, the design will investigate the use of two dimensional Z-transformations. Since this proposed QMF is intended for the applications in image processing, all the important and interesting engineering issues will be addressed throughout the development phase. The design of a two dimensional QMF is discussed. The motivation is to achieve an extremely high data compression ratio. It is entirely possible to achieve dramatic results when pattern recognition techniques are employed. The final goal is the demonstration of extremely high data compression ratios using NASA pictures.

Wang, Paul P.↗