Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “compression techniques”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Digital mammography, cancer screening: Factors important for image compression

The use of digital mammography for breast cancer screening poses several novel problems such as development of digital sensors, computer assisted diagnosis (CAD) methods for image noise suppression, enhancement, and pattern recognition, compression algorithms for image storage, transmission, and remote diagnosis. X-ray digital mammography using novel direct digital detection schemes or film digitizers results in large data sets and, therefore, image compression methods will play a significant role in the image processing and analysis by CAD techniques. In view of the extensive compression required, the relative merit of 'virtually lossless' versus lossy methods should be determined. A brief overview is presented here of the developments of digital sensors, CAD, and compression methods currently proposed and tested for mammography. The objective of the NCI/NASA Working Group on Digital Mammography is to stimulate the interest of the image processing and compression scientific community for this medical application and identify possible dual use technologies within the NASA centers.

Clarke, Laurence P.↗

cuZ-Checker: A GPU-Based Ultra-Fast Assessment System for Lossy Compressions

Lossy compression is becoming an indispensable technique for the success of today's extreme-scale high-performance computing projects that produce vast volumes of data during scientific simulations or instrument data acquisitions. Comprehensively understanding the compression quality and performance of different lossy compressors is critical to selecting the best-fit compressors and using them properly and efficiently in practice. A few lossy compression assessment tools (e.g., Z-checker) have been developed, but none of them support the execution in a GPU environment. This is a significant gap because many recent extreme-scale applications and lossy compressors (e.g., cuSZ) can run entirely within GPUs. In this work, we develop an efficient lossy compression measuring system (called cuZ-Checker) on the GPU platform, which aims to perform the lossy compression quality and performance assessment completely within the GPU environment. Our contribution is threefold. (1) We develop a novel GPU-based lossy compression measuring framework using a computation pattern-based design approach. This approach classifies the computing-intensive metrics into three categories based on their patterns which creates large opportunities for kernel fusion and data reuse. (2) For each pattern in cuZ-Checker, we develop a CUDA kernel and provide fine-grained optimizations to boost its performance. (3) We thoroughly evaluate our cuZ-checker on a V100 GPU using four real-world scientific application datasets. Experiments show that cuZ-Checker can significantly accelerate the overall lossy compression assessment performance by 23X similar to 31X compared with the OpenMP-based multithreading CPU performance. To the best of our knowledge, this is the first lossy compression measuring system designed for GPU devices.

GPU↗

Micropillar Compression of Additively Manufactured 316L Stainless Steels after 2 MeV Proton Irradiation: A Comparison Study between Planar and Cross-Sectional Micropillars

A micropillar compression study with two different techniques was performed on proton-irradiated additively manufactured (AM) 316L stainless steels. The sample was irradiated at 360 °C using 2 MeV protons to 1.8 average displacement per atom (dpa) in the near-surface region. A comparison study with mechanical test and microstructure characterization was made between planar and cross-sectional pillars prepared from the irradiated surface. While a 2 MeV proton irradiation creates a relatively flat damage zone up to 12 µm, the dpa gradient by a factor of 2 leads to significant dpa uncertainty along the pillar height direction for the conventional planar technique. Cross-sectional pillars can significantly reduce such dpa uncertainty. From one single sample, three cross-sectional pillars were able to show dpa-dependent hardening. Furthermore, post-compression transmission electron microscopy allows the determination of the deformation mechanism of individual micropillars. Cross-sectional micropillar compression can be used to study radiation-induced mechanical property changes with better resolution and less data fluctuation.

transmission electron microscopy↗

Macro-level mechanical interlocking: A rapid joining approach for additively manufactured compression molded composite panels

Composite joining typically involves multiple steps, such as drilling and surface treatment, as part of the manufacturing process, which leads to low throughput and long cycle times. In the present study, we demonstrated a macro-level mechanical interlocking (MI) based, rapid joining technique to assemble additively manufactured compression molded (AMCM) panels, enabling the production of parts larger than the mold dimensions. Composite panels made of 20 wt% short carbon fiber reinforced acrylonitrile butadiene styrene (CF/ABS) were joined using MI features of various geometries, namely tree (TR), dovetail (Dov), rectangle 2 (Rect2), and rectangle 1 (Rect1), and their in-plane strength was evaluated. The resultant strength of the tested MI joints reached up to 74 % of the baseline tensile strength (i.e., the ‘no joint’ case). Observations from optical and scanning electron microscopy revealed inadequate polymer diffusion between the adherends, indicating that the joint strength was primarily derived from mechanical interlocking. Additionally, the fracture surfaces exhibited stress-whitening marks, which were characterized using differential scanning calorimetry (DSC). The increase in melting enthalpy suggested local stretching of polymer chains due to MI. Finite element analysis (FEA) indicated that the Rect1 MI feature, which generated the lowest stress concentration, outperformed the others in terms of joint strength, achieving 42 MPa. As a demonstration of the MI joining method, a battery box tray measuring 108 cm × 34 cm using a mold with an effective dimension of 36 cm × 34 cm successfully manufactured, resulting in a part with an area three times larger than the mold. In conclusion, this study presents a promising approach to improving composite joining techniques while minimizing production complexities.

In-plane joining↗

Exploring Autoencoder-based Error-bounded Compression for Scientific Data

Error-bounded lossy compression is becoming an indispensable technique for the success of today's scientific projects with vast volumes of data produced during the simulations or instrument data acquisitions. Not only can it significantly reduce data size, but it also can control the compression errors based on user-specified error bounds. Autoencoder (AE) models have been widely used in image compression, but few AE-based compression approaches support error-bounding features, which are highly required by scientific applications. To address this issue, we explore using convolutional autoencoders to improve error-bounded lossy compression for scientific data, with the following three key contributions. (1) We provide an in-depth investigation of the characteristics of various autoencoder models and develop an error-bounded autoencoder-based framework in terms of the SZ model. (2) We optimize the compression quality for main stages in our designed AE-based error-bounded compression framework, fine-tuning the block sizes and latent sizes and also optimizing the compression efficiency of latent vectors. (3) We evaluate our proposed solution using five real-world scientific datasets and comparing them with six other related works. Experiments show that our solution exhibits a very competitive compression quality from among all the compressors in our tests. In absolute terms, it can obtain a much better compression quality (100%similar to 800% improvement in compression ratio with the same data distortion) compared with SZ2.1 and ZFP in cases with a high compression ratio.

Liu, Jinyang↗

Revisiting Huffman Coding: Toward Extreme Performance on Modern GPU Architectures

Today's high-performance computing (HPC) applications are producing vast volumes of data, which are challenging to store and transfer efficiently during the execution, such that data compression is becoming a critical technique to mitigate the storage burden and data movement cost. Huffman coding is arguably the most efficient Entropy coding algorithm in information theory, such that it could be found as a fundamental step in many modern compression algorithms such as DEFLATE. On the other hand, today's HPC applications are more and more relying on the accelerators such as GPU on supercomputers, while Huffman encoding suffers from low throughput on GPUs, resulting in a significant bottleneck in the entire data processing. In this paper, we propose and implement an efficient Huffman encoding approach based on modern GPU architectures, which addresses two key challenges: (1) how to parallelize the entire Huffman encoding algorithm, including codebook construction, and (2) how to fully utilize the high memory-bandwidth feature of modern GPU architectures. The detailed contribution is fourfold. (1) We develop an efficient parallel codebook construction on GPUs that scales effectively with the number of input symbols. (2) We propose a novel reduction based encoding scheme that can efficiently merge the codewords on GPUs. (3) We optimize the overall GPU performance by leveraging the state-of-the-art CUDA APIs such as Cooperative Groups. (4) We evaluate our Huffman encoder thoroughly using six real-world application datasets on two advanced GPUs and compare with our implemented multi-threaded Huffman encoder. Experiments show that our solution can improve the encoding throughput by up to 5.0x and 6.8x on NVIDIA RTX 5000 and V100, respectively, over the state-of-the-art GPU Huffman encoder, and by up to 3.3x over the multi-thread encoder on two 28-core Xeon Platinum 8280 CPUs.

Tian, Jiannan↗

Revisiting Huffman Coding: Toward Extreme Performance on Modern GPU Architectures

Today's high-performance computing (HPC) applications are producing vast volumes of data, which are challenging to store and transfer efficiently during the execution, such that data compression is becoming a critical technique to mitigate the storage burden and data movement cost. Huffman coding is arguably the most efficient Entropy coding algorithm in information theory, such that it could be found as a fundamental step in many modern compression algorithms such as DEFLATE. On the other hand, today's HPC applications are more and more relying on the accelerators such as GPU on supercomputers, while Huffman encoding suffers from low throughput on GPUs, resulting in a significant bottleneck in the entire data processing. In this paper, we propose and implement an efficient Huffman encoding approach based on modern GPU architectures, which addresses two key challenges: (1) how to parallelize the entire Huffman encoding algorithm, including codebook construction, and (2) how to fully utilize the high memory-bandwidth feature of modern GPU architectures. The detailed contribution is fourfold. (1) We develop an efficient parallel codebook construction on GPUs that scales effectively with the number of input symbols. (2) We propose a novel reduction based encoding scheme that can efficiently merge the codewords on GPUs. (3) We optimize the overall GPU performance by leveraging the state-of-the-art CUDA APIs such as Cooperative Groups. (4) We evaluate our Huffman encoder thoroughly using six real-world application datasets on two advanced GPUs and compare with our implemented multithreaded Huffman encoder. Experiments show that our solution can improve the encoding throughput by up to 5.0× and 6.8× on NVIDIA RTX 5000 and V100, respectively, over the state-of-the-art GPU Huffman encoder, and by up to 3.3× over the multithread encoder on two 28-core Xeon Platinum 8280 CPUs.

Tian, Jiannan↗

Accelerating Lossy and Lossless Compression on Emerging BlueField DPU Architectures

Data compression has become a crucial technique in addressing performance bottlenecks caused by increasing data volumes in High-Performance Computing (HPC), Big Data, and Deep Learning (DL). Despite its potential to boost system performance, recent studies have identified significant challenges with existing compression methods, mainly due to their high computational demands amidst continuously growing data sizes. Concurrently, the advent of Data Processing Units (DPUs), equipped with programmable System-on-Chip (SoC) and specialized compression accelerators, offers a promising opportunity to alter the landscape of data compression. This paper explores the complexities and potential of leveraging NVIDIA BlueField DPUs to accelerate lossy and lossless compression. Towards this, we introduce PEDAL, an innovative library that leverages the hardware capabilities of DPUs to unify and optimize data compression designs. Moreover, we seamlessly co-design PEDAL with the popular MPICH MPI library, demonstrating up to 101x speedup in compression time and 88x decrease in communication latency. Drawing on these achievements, we share our experience with various research communities about accelerating data compression on DPUs in communication-oriented HPC scenarios.

Li, Yuke↗

Shrink Tape Technique for Heat Forming Aluminum Substrates for Thin Foil X-Ray Mirrors and the Neutron Star Interior Composition Explorer X-Ray Concentrators

Consistent improvements in the design and fabrication of thin-foil, epoxy-replicated x-ray mirrors for astronomical telescopes have yielded increasingly higher quality and more precise astrophysical data. The Neutron Star Interior Composition Explorer (NICER) x-ray timing mission optics continues this tradition and introduces design elements that promise even more accurate measurements and precise astrophysical parameters. The singly reflecting concentrators have a curved axial profile to improve photon concentration and a sturdy full shell structure for enhanced module stability. These design elements introduced the challenge of reliably forming mirror substrates at an acceptable production rate. By developing a technique using heat shrink tape to compress and conform thin aluminum mirror substrates to shaping mandrels, production rate improved with successful fabrication. The technique's efficiency was analyzed by measuring hundreds of substrate profiles postforming, performance testing completely assembled concentrators composed of every size substrate, and comparing the results to simulated fabrication scenarios. On average, the profiles were copied within 4.6 plus or minus 3.7 percent. These measurements and the overall success of NICER's optics, via ground calibration, have shown that the heat-shrink tape method is reliable, repeatable, and could be used in future missions to increase production rate and improve performance.

Balsamo, Erin↗

Optimization of self-acting herringbone journal bearings for maximum stability

Groove parameters were determined to maximize the stability of herringbone grooved journal bearings. Parameters optimized were groove depth, width, length, and angle. Optimization was performed using a small eccentricity, infinite groove analysis in conjunction with: (1) a previously developed Newton-Raphson procedure for bearings with the smooth member rotating or with the grooved member rotating at low compressibility numbers; (2) a newly-developed vector technique for bearings with the grooved member rotating at high compressibility numbers. The design curves in this report enable one to choose the optimum bearing for a wide range of operating conditions. These include: (1) compressibility numbers from 0 to 80; (2) length to diameter ratios from 1/4 to 2; and (3) smooth or grooved member rotating. Compared to bearings optimized to maximize load capacity, bearings optimized for stability allow a thousandfold increase in bearing-supported mass in some cases before onset of instability. Stability is much greater when the grooved member rotates.

Fleming, D. P.↗

Emerging standards for still image compression: A software implementation and simulation study

The software implementation is described of an emerging standard for the lossy compression of continuous tone still images. This software program can be used to compress planetary images and other 2-D instrument data. It provides a high compression image coding capability that preserves image fidelity at compression rates competitive or superior to most known techniques. This software implementation confirms the usefulness of such data compression and allows its performance to be compared with other schemes used in deep space missions and for data based storage.

Pollara, F.↗

Improved Compression of Wavelet-Transformed Images

A recently developed data-compression method is an adaptive technique for coding quantized wavelet-transformed data, nominally as part of a complete image-data compressor. Unlike some other approaches, this method admits a simple implementation and does not rely on the use of large code tables. A common data compression approach, particularly for images, is to perform a wavelet transform on the input data, and then losslessly compress a quantized version of the wavelet-transformed data. Under this compression approach, it is common for the quantized data to include long sequences, or runs, of zeros. The new coding method uses prefixfree codes for the nonnegative integers as part of an adaptive algorithm for compressing the quantized wavelet-transformed data by run-length coding. In the form of run-length coding used here, the data sequence to be encoded is parsed into strings consisting of some number (possibly 0) of zeros, followed by a nonzero value. The nonzero value and the length of the run of zeros are encoded. For a data stream that contains a sufficiently high frequency of zeros, this method is known to be more effective than using a single variable length code to encode each symbol. The specific prefix-free codes used are from two classes of variable-length codes: a class known as Golomb codes, and a class known as exponential-Golomb codes. The codes within each class are indexed by a single integer parameter. The present method uses exponential-Golomb codes for the lengths of the runs of zeros, and Golomb codes for the nonzero values. The code parameters within each code class are determined adaptively on the fly as compression proceeds, on the basis of statistics from previously encoded values. In particular, a simple adaptive method has been devised to select the parameter identifying the particular exponential-Golomb code to use. The method tracks the average number of bits used to encode recent runlengths, and takes the difference between this average length and the code parameter. When this difference falls outside a fixed range, the code parameter is updated (increased or decreased). The Golomb code parameter is selected based on the average magnitude of recently encoded nonzero samples. The coding method requires no floating- point operations, and more readily adapts to local statistics than other methods. The method can also accommodate arbitrarily large input values and arbitrarily long runs of zeros. In practice, this means that changes in the dynamic range or size of the input data set would not require a change to the compressor. The algorithm has been tested in computational experiments on test images. A comparison with a previously developed algorithm that uses large code tables (generated via Huffman coding on training data) suggests that the data-compression effectiveness of the present algorithm is comparable to the best performance achievable by the previously developed algorithm.

Kiely, Aaron↗

An analysis of supersonic flows with low-Reynolds number compressible two-equation turbulence models using LU finite volume implicit numerical techniques

A generalized flow solver using an implicit Lower-upper (LU) diagonal decomposition based numerical technique has been coupled with three low-Reynolds number kappa-epsilon models for analysis of problems with engineering applications. The feasibility of using the LU technique to obtain efficient solutions to supersonic problems using the kappa-epsilon model has been demonstrated. The flow solver is then used to explore limitations and convergence characteristics of several popular two equation turbulence models. Several changes to the LU solver have been made to improve the efficiency of turbulent flow predictions. In general, the low-Reynolds number kappa-epsilon models are easier to implement than the models with wall-functions, but require much finer near-wall grid to accurately resolve the physics. The three kappa-epsilon models use different approaches to characterize the near wall regions of the flow. Therefore, the limitations imposed by the near wall characteristics have been carefully resolved. The convergence characteristics of a particular model using a given numerical technique are also an important, but most often overlooked, aspect of turbulence model predictions. It is found that some convergence characteristics could be sacrificed for more accurate near-wall prediction. However, even this gain in accuracy is not sufficient to model the effects of an external pressure gradient imposed by a shock-wave/ boundary-layer interaction. Additional work on turbulence models, especially for compressibility, is required since the solutions obtained with base line turbulence are in only reasonable agreement with the experimental data for the viscous interaction problems.

Lee, J.↗

High-performance molded composites using additively manufactured preforms with controlled fiber and pore morphology

Here, large-scale multimaterial preforms produced by additive manufacturing (AM) underwent compression molding (CM) to produce high-performance thermoplastic composites reinforced with short carbon fibers. AM and CM techniques were integrated to control the fiber orientation (microstructure) and to reduce void content for the improved mechanical performance of the composite. The new integrated manufacturing technique is termed “additive manufacturing-compression molding” (AM-CM). For the present study, the most common materials were used for large-scale printing, i.e., acrylonitrile butadiene styrene (ABS), carbon fiber (CF)–filled ABS (CF/ABS) and glass fiber (GF)–filled ABS (GF/ABS). Three different manufacturing processes; (a) AM (b) extrusion compression molding (ECM), and (c) AM-CM were used to prepare four different panel configurations: (1) neat ABS, (2) CF/ABS, (3) overmold (CF/ABS over neat ABS), and (4) sandwich (neat ABS between two CF/ABS layers). The mechanical properties (tensile and flexural strength and modulus, and Izod impact energy) of samples prepared via all three manufacturing processes were compared. X-ray microcomputer tomography was employed to evaluate the fiber orientation distribution and the volumetric porosity content. The preform maintained high fiber alignment (≈ 82% of fibers within the range of 0–20° in the deposition direction), and the volumetric porosity was reduced by 50% from 3.79% to 1.91% after compression. The alignment of long pores along the deposition direction was also observed. The mechanical properties are discussed with correlation to the fiber alignment and void content in the samples. CF/ABS samples prepared by AM-CM showed significant improvement of 11.15%, 35.27%, 28.6%, and 74.3% in the tensile strength, tensile modulus, flexural strength, and flexural modulus, respectively, when compared with samples prepared by ECM. Unique aspects of this study are the demonstration of large-scale multimaterial AM and the use of multimaterials as preforms to make high-performance composites.

36 MATERIALS SCIENCE↗

OptZConfig: Efficient Parallel Optimization of Lossy Compression Configuration

Lossless compressors have very low compression ratios that do not meet the needs of today's large-scale scientific applications that produce vast volumes of data. Error-bounded lossy compression (EBLC) is considered a critical technique for the success of scientific research. Although EBLC allows users to set an error bound for the compression, users have been unable to specify the requirements on the compression quality, limiting practical use. Our contributions are: (1) We formulate the problem of configuring EBLC to preserve a user-defined metric as an optimization problem. This allows many classes of new metrics to be preserved, which improves over current practices. (2) We present a framework, OptZConfig, that can adapt to improvements in the search algorithm, compressor, and metrics with minimal changes, enabling future advancements in this area. (3) We demonstrate the advantages of our approach against the leading methods to configure compressors to preserve specific metrics. Here, our approach improves compression ratios against a specialized compressor by up to 3 x, has a 56x speedup over FRaZ, 1000x speedup over MGARD-QOI post tuning, and 110x speedup over systematic approaches which had not been bounded by compressors before.

97 MATHEMATICS AND COMPUTING↗

Survey of adaptive image coding techniques

The general problem of image data compression is discussed briefly with attention given to the use of Karhunen-Loeve transforms, suboptimal systems, and block quantization. A survey is then conducted encompassing the four categories of adaptive systems: (1) adaptive transform coding (adaptive sampling, adaptive quantization, etc.), (2) adaptive predictive coding (adaptive delta modulation, adaptive DPCM encoding, etc.), (3) adaptive cluster coding (blob algorithms and the multispectral cluster coding technique), and (4) adaptive entropy coding.

Habibi, A.↗

Computer-controlled multi-parameter mapping of 3D compressible flowfields using planar laser-induced iodine fluorescence

A computer-controlled technique, using planar laser-induced iodine fluorescence, for measuring complex compressible flowfields is presented. A new laser permits the use of a planar two-line temperature technique so that all parameters can be measured with the laser operated narrowband. Pressure and temperature measurements in a step flowfield show agreement within 10 percent of a CFD model except in regions close to walls. Deviation of near wall temperature measurements from the model was decreased from 21 percent to 12 percent compared to broadband planar temperature measurements. Computer-control of the experiment has been implemented, except for the frequency tuning of the laser. Image data storage and processing has been improved by integrating a workstation into the experimental setup reducing the data reduction time by a factor of 50.

Donohue, James M.↗