Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “compression techniques”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRS1992

A very efficient RCS data compression and reconstruction technique, volume 4

A very efficient compression and reconstruction scheme for RCS measurement data was developed. The compression is done by isolating the scattering mechanisms on the target and recording their individual responses in the frequency and azimuth scans, respectively. The reconstruction, which is an inverse process of the compression, is granted by the sampling theorem. Two sets of data, the corner reflectors and the F-117 fighter model, were processed and the results were shown to be convincing. The compression ratio can be as large as several hundred, depending on the target's geometry and scattering characteristics.

Tseng, N. Y.↗
DOE OSTI2021

Unbalanced Parallel I/O: An Often-Neglected Side Effect of Lossy Scientific Data Compression

Lossy compression techniques have demonstrated promising results in significantly reducing the scientific data size while guaranteeing the compression error bounds. However, one important yet often neglected side effect of lossy scientific data compression is its impact on the performance of parallel I/O. Our key observation is that the compressed data size is often highly skewed across processes in lossy scientific compression. To understand this behavior, we conduct extensive experiments where we apply three lossy compressors MGARD, ZFP, and SZ, which are specifically designed and optimized for scientific data, to three real-world scientific applications Gray-Scott simulation, WarpX, and XGC. Our analysis result demonstrates that the size of the compressed data is always skewed even if the original data is evenly decomposed among processes. Such skewness widely exists in different scientific applications using different compressors as long as the information density of the data varies across processes. We then systematically study how this side effect of lossy scientific data compression impacts the performance of parallel I/O. We observe that the skewness in the sizes of the compressed data often leads to I/O imbalance, which can significantly reduce the efficiency of I/O bandwidth utilization if not properly handled. In addition, writing data concurrently to a single shared file through MPI-IO library is more sensitive to the unbalanced I/O loads. Therefore, we believe our research community should pay more attention to the unbalanced parallel I/O caused by lossy scientific data compression.

Wang, Xinying↗
DOE OSTI2023

zPerf: A Statistical Gray-Box Approach to Performance Modeling and Extrapolation for Scientific Lossy Compression

With the scaling up of simulation-based scientific discovery on high-performance computing systems, the disparity between compute and I/O has increased, forcing domain scientists to save only a small amount of simulation data to persistent storage. This can result in the loss of essential physics fields that are needed for data analysis. While error-bounded lossy compression has made tremendous progress in bridging the gap between compute and I/O, the lack of understanding of compression performance remains a key hurdle to its wide adoption. Here, in this work, we present zPerf, a statistical gray-box performance modeling approach for scientific lossy compression. Our contributions are threefold: 1) We develop zPerf to estimate the performance of lossy compression techniques, based on in-depth understanding and statistical modeling for data features and core compression metrics; 2) We demonstrate the in-detailed implementation of zPerf using two case studies, where we derive the performance modeling for SZ and ZFP, two leading lossy compressors; 3) We evaluate the effectiveness of zPerf on real-world datasets across various domains. Based on the evaluation, we demonstrate the efficacy of the zPerf performance model; 4) We further discuss three case studies where zPerf is applied to extrapolate the compression ratio of SZ and ZFP with alternative encoding schemes as well as ZFP with an alternative transform scheme. Through the case studies, we demonstrate the potential of zPerf for exploring the design space of lossy compression, which has hardly been studied in the literature.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1992

Real-time demonstration hardware for enhanced DPCM video compression algorithm

The lack of available wideband digital links as well as the complexity of implementation of bandwidth efficient digital video CODECs (encoder/decoder) has worked to keep the cost of digital television transmission too high to compete with analog methods. Terrestrial and satellite video service providers, however, are now recognizing the potential gains that digital video compression offers and are proposing to incorporate compression systems to increase the number of available program channels. NASA is similarly recognizing the benefits of and trend toward digital video compression techniques for transmission of high quality video from space and therefore, has developed a digital television bandwidth compression algorithm to process standard National Television Systems Committee (NTSC) composite color television signals. The algorithm is based on differential pulse code modulation (DPCM), but additionally utilizes a non-adaptive predictor, non-uniform quantizer and multilevel Huffman coder to reduce the data rate substantially below that achievable with straight DPCM. The non-adaptive predictor and multilevel Huffman coder combine to set this technique apart from other DPCM encoding algorithms. All processing is done on a intra-field basis to prevent motion degradation and minimize hardware complexity. Computer simulations have shown the algorithm will produce broadcast quality reconstructed video at an average transmission rate of 1.8 bits/pixel. Hardware implementation of the DPCM circuit, non-adaptive predictor and non-uniform quantizer has been completed, providing realtime demonstration of the image quality at full video rates. Video sampling/reconstruction circuits have also been constructed to accomplish the analog video processing necessary for the real-time demonstration. Performance results for the completed hardware compare favorably with simulation results. Hardware implementation of the multilevel Huffman encoder/decoder is currently under development along with implementation of a buffer control algorithm to accommodate the variable data rate output of the multilevel Huffman encoder. A video CODEC of this type could be used to compress NTSC color television signals where high quality reconstruction is desirable (e.g., Space Station video transmission, transmission direct-to-the-home via direct broadcast satellite systems or cable television distribution to system headends and direct-to-the-home).

Bizon, Thomas P.↗
DOE OSTI2024

Measurements of K-edge and L-edge extended x-ray absorption fine structure at the national ignition facility (invited)

High-energy-density laser facilities and advances in dynamic compression techniques have expanded access to material states in the Terapascal regime relevant to inertial confinement fusion, planetary science, and geophysics. However, experimentally determining the material temperature in these extreme conditions has remained a difficult challenge. Extended X-ray Absorption Fine Structure (EXAFS), referring to the modulations in x-ray absorption above an absorption edge from photoelectrons’ interactions with neighboring atoms, has proven to be a versatile and robust technique for probing material temperature and density for mid-to-high Z elements under dynamic compression. The current platform at the National Ignition Facility has developed six configurations for EXAFS measurements between 7 and 18 keV for different absorption edges (Fe K, Co K, Cu K, Ta L3, Pb L3, and Zr K) using a curved-crystal spectrometer and a bright, continuum foil x-ray source. Here, in this work, we describe the platform geometry, x-ray source performance, spectrometer resolution and throughput, design considerations, and data in ambient and dynamic-compression conditions.

36 MATERIALS SCIENCE↗
NASA NTRS1982

Image data compression application to imaging spectrometers

The potential of image data compression techniques to satisfy the anticipated requirements of imaging spectrometer missions is discussed. Noiseless coding, rate controlled compression, cluster compression, and error protection are addressed.

Rice, R. F.↗
NASA NTRS1991

Scientific requirements for space science data systems

In the 1990's space plasma physics studies will increasingly involve correlative analysis of observations from multiple instruments and multiple spacecraft. The solar terrestrial physics missions in the 1990's will be designed around simultaneous observations from spacecraft monitoring the solar wind, the polar magnetosphere and the near and distant magnetotail. Within these regions, clusters of spacecraft flying in formation will increasingly involve comparative magnetospheric studies. No single lab will have the expertise to process and analyze all of the different types of data so the data repositories will be distributed. Catalog and browse systems will be required to help select events for study. Data compression techniques may be useful in designing the data bases used for selecting events for study. Data compression onboard the spacecraft will be necessary, since instrument data rates will be much larger than available telemetry rates. However, considerable care will be necessary to avoid losing valuable data when applying data compression algorithms.

Walker, Raymond J.↗
NASA NTRS2001

Band-Moment Compression of AVIRIS Hyperspectral Data and its Use in the Detection of Vegetation Stress

A remote sensing campaign was conducted over a U.S. Department of Agriculture test farm at Shelton, Nebraska. An experimental field was set off in plots that were differentially treated with anhydrous ammonia. Four replicates of 0-kg/ha to 200-kg/ha plots, in 50-kg/ha increments, were set out in a random block design. Low-altitude (GSD of 3 m) Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) hyperspectral data were collected over the site in 224 bands. Simultaneously, ground data were collected to support the airborne imagery. In an effort to reduce data load while maintaining or enhancing algorithm performance for vegetation stress detection, band-moment compression and analysis was applied to the AVIRIS image cube. The results indicated that band-moment techniques compress the AVIRIS dataset significantly while retaining the capability of detecting environmentally induced vegetation stress.

Estep, L.↗
DOE OSTI2023

Quantum-enhanced Imaging and Spectroscopy and their Relevance to International Safeguards

As a follow-up to our previous report on quantum sensing for safeguards, here we delve deeper into quantum-enhanced imaging & spectroscopy and address their relevance to international safeguards. Much of the approaches rely on entangled photons, a quantum phenomenon not possible with classical physics, although just correlated photons will work for some applications, such as ghost imaging. We provide a comprehensive survey of quantum approaches, including multiple entangled photon ghost imaging and spectroscopy techniques. Entangled photons for noise reduction are also described, as well as Non-Line-Of-Sight imaging, compressive techniques, and squeezed light. Of particular interest is the generation of entangled photons with large wavelength separation, such as infrared/visible entangled photon pairs. Such entangled pairs would allow interaction with objects in the IR, such as in the molecular “fingerprint” wavelength region, while the recording device captures the visible photons, thus leveraging the high efficiency and lower cost of visible detectors. Unfortunately, entangled x-ray photons are not practical, which would have been useful for safeguards to interrogate shielded materials. Entangled gamma rays are even further beyond reason. We provide our assessment for application of quantum-enhanced imaging & spectroscopy for international safeguards, including suggested improvements to existing IAEA instruments and destructive assay measurements that are done at IAEA lab facilities.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS1984

Information extraction and transmission techniques for spaceborne synthetic aperture radar images

Information extraction and transmission techniques for synthetic aperture radar (SAR) imagery were investigated. Four interrelated problems were addressed. An optimal tonal SAR image classification algorithm was developed and evaluated. A data compression technique was developed for SAR imagery which is simple and provides a 5:1 compression with acceptable image quality. An optimal textural edge detector was developed. Several SAR image enhancement algorithms have been proposed. The effectiveness of each algorithm was compared quantitatively.

Frost, V. S.↗
NASA NTRS1994

Bit-wise arithmetic coding for data compression

This article examines the problem of compressing a uniformly quantized independent and identically distributed (IID) source. We present a new compression technique, bit-wise arithmetic coding, that assigns fixed-length codewords to the quantizer output and uses arithmetic coding to compress the codewords, treating the codeword bits as independent. We examine the performance of this method and evaluate the overhead required when used block-adaptively. Simulation results are presented for Gaussian and Laplacian sources. This new technique could be used as the entropy coder in a transform or subband coding system.

Kiely, A. B.↗
DOE OSTI2020

Deep learning for in situ data compression of large turbulent flow simulations

As the size of turbulent flow simulations continues to grow, in situ data compression is becoming increasingly important for visualization, analysis, and restart checkpointing. For these applications, single-pass compression techniques with low computational and communication overhead are crucial. In this paper we present a deep-learning approach to in situ compression using an autoencoder architecture that is customized for three-dimensional turbulent flows and is well suited for contemporary heterogeneous computing resources. The autoencoder is compared against a recently introduced randomized single-pass singular value decomposition (SVD) for three different canonical turbulent flows: decaying homogeneous isotropic turbulence, a Taylor-Green vortex, and turbulent channel flow. Our proposed fully convolutional autoencoder architecture compresses turbulent flow snapshots by a factor of 64 with a single pass, allows for arbitrarily sized input fields, is cheaper to compute than the randomized single-pass SVD for typical simulation sizes, performs well on unseen flow configurations, and has been made publicly available. The results reported here show that the autoencoder dramatically outperforms a randomized single-pass SVD with similar compression ratio and yields comparable performance to a higher-rank decomposition with an order of magnitude less compression in regard to preserving a number of important statistical quantities such as turbulent kinetic energy, enstrophy, and Reynolds stresses.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

AEflow (Autoencoder fluid flow compression network) [SWR-22-29]

As the size of turbulent flow simulations continues to grow, in situ data compression is becoming increasingly important for visualization, analysis, and restart checkpointing. For these applications, single-pass compression techniques with low computational and communication overhead are crucial. In this paper we present a deep-learning approach to in situ compression using an autoencoder architecture that is customized for three-dimensional turbulent flows and is well suited for contemporary heterogeneous computing resources. The autoencoder is compared against a recently introduced randomized single-pass singular value decomposition (SVD) for three different canonical turbulent flows: decaying homogeneous isotropic turbulence, a Taylor-Green vortex, and turbulent channel flow. Our proposed fully convolutional autoencoder architecture compresses turbulent flow snapshots by a factor of 64 with a single pass, allows for arbitrarily sized input fields, is cheaper to compute than the randomized single-pass SVD for typical simulation sizes, performs well on unseen flow configurations, and has been made publicly available. The results reported here show that the autoencoder dramatically outperforms a randomized single-pass SVD with similar compression ratio and yields comparable performance to a higher-rank decomposition with an order of magnitude less compression in regard to preserving a number of important statistical quantities such as turbulent kinetic energy, enstrophy, and Reynolds stresses.

King, Ryan↗
DOE OSTI2020

Evidence of shock-compressed stishovite above 300 GPa

SiO 2 is one of the most fundamental constituents in planetary bodies, being an essential building block of major mineral phases in the crust and mantle of terrestrial planets (1–10 M E ). Silica at depths greater than 300 km may be present in the form of the rutile-type, high pressure polymorph stishovite (P4 2 /mnm) and its thermodynamic stability is of great interest for understanding the seismic and dynamic structure of planetary interiors. Previous studies on stishovite via static and dynamic (shock) compression techniques are contradictory and the observed differences in the lattice-level response is still not clearly understood. Here, laser-induced shock compression experiments at the LCLS- and SACLA XFEL light-sources elucidate the high-pressure behavior of stishovite on the lattice-level under in situ conditions on the Hugoniot to pressures above 300 GPa. We find stishovite is still (meta-)stable at these conditions, and does not undergo any phase transitions. This contradicts static experiments showing structural transformations to the CaCl 2 , α-PbO 2 and pyrite-type structures. However, rate-limited kinetic hindrance may explain our observations. These results are important to our understanding into the validity of EOS data from nanosecond experiments for geophysical applications.

58 GEOSCIENCES↗
NASA NTRS1971

Unique intermetallic compounds prepared by shock wave synthesis

Technique compresses fine ground metallic powder mixture beyond crystal fusion point. Absence of vapor pressure voids and elimination of incongruous effects permit application of technique to large scale fabrication of intermetallic compounds with specific characteristics, e.g., semiconduction, superconduction, or magnetic properties.

Otto, G.↗
DOE OSTI2025

Overcoming energy limitation in post-compression of picosecond pulses by free beam propagation in air and temporal pulse splitting and recombining

Cryogenically cooled diode-pumped Yb:YAG has been demonstrated to efficiently generate pulses of >1 J energy and several picoseconds duration at a kilohertz repetition rate. Pulse broadening and post-compression techniques capable of operating at these high pulse energies will expand the use of these lasers in applications requiring shorter pulses. Towards this goal, we demonstrate the post-compression of 5.5 ps pulses with energy in the 0.1 J range by spectral broadening of self-collimated large area beams in air. In proof-of-principle experiments, pulses of 65 mJ energy from a cryogenically cooled Yb:YAG laser were compressed to 1.1 ps after 65 m propagation in a compact setup in which the beam was folded using flat mirrors. Further energy scaling was demonstrated by combining this spectral broadening technique with temporal pulse splitting and recombining. 120 mJ pulses were split into two pulses and coherently recombined with 85% efficiency after 50 m of propagation in air to yield 1.4 ps pulses.

High Energy Laser↗
NASA NTRS2004

Space-Based Sensor Web for Earth Science Applications: An Integrated Architecture for Providing Societal Benefits

There is a significant interest in the Earth Science research and user remote sensing community to substantially increase the number of useful observations relative to the current frequency of collection. The obvious reason for such a push is to improve the temporal, spectral, and spatial coverage of the area(s) under investigation. However, there is little analysis available in terms of the benefits, costs and the optimal set of sensors needed to make the necessary observations. Classic observing system solutions may no longer be applicable because of their point design philosophy. Instead, a new intelligent data collection system paradigm employing both reactive and proactive measurement strategies with adaptability to the dynamics of the phenomena should be developed. This is a complex problem that should be carefully studied and balanced across various boundaries including: science, modeling, applications, and technology. Modeling plays a crucial role in making useful predictions about naturally occurring or human-induced phenomena In particular, modeling can serve to mitigate the potentially deleterious impacts a phenomenon may have on human life, property, and the economy. This is especially significant when one is interested in learning about the dynamics of, for example, the spread of forest fires, regional to large-scale air quality issues, the spread of the harmful invasive species, or the atmospheric transport of volcanic plumes and ash. This paper identifies and examines these challenging issues and presents architectural alternatives for an integrated sensor web to provide observing scenarios driving the requisite dynamic spatial, spectral, and temporal characteristics to address these key application areas. A special emphasis is placed on the observing systems and its operational aspects in serving the multiple users and stakeholders in providing societal benefits. We also address how such systems will take advantage of technological advancement in small spacecraft and emerging information technologies, and how sensor web options may be realized and made affordable. Specialized detector subsystems and precision flying techniques may still require substantial innovation, development time and cost: we have presented the considerations for these issues. Finally, data and information gathering and compression techniques are also briefly described.

Habib, Shahid↗