Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

Innovative Video Diagnostic Equipment for Material Science

Materials science experiments under microgravity increasingly rely on advanced optical systems to determine the physical properties of the samples under investigation. This includes video systems with high spatial and temporal resolution. The acquisition, handling, storage and transmission to ground of the resulting video data are very challenging. Since the available downlink data rate is limited, the capability to compress the video data significantly without compromising the data quality is essential. We report on the development of a Digital Video System (DVS) for EML (Electro Magnetic Levitator) which provides real-time video acquisition, high compression using advanced Wavelet algorithms, storage and transmission of a continuous flow of video with different characteristics in terms of image dimensions and frame rates. The DVS is able to operate with the latest generation of high-performance cameras acquiring high resolution video images up to 4Mpixels@60 fps or high frame rate video images up to about 1000 fps@512x512pixels.

Capuano, G.↗

Shock waves data for minerals

Shock compression of the materials of planetary interiors yields data which upon comparison with density-pressure and density-sound velocity profiles constrain internal composition and temperature. Other important applications of shock wave data and related properties are found in the impact mechanics of terrestrial planets and solid satellites. Shock wave equation of state, shock-induced dynamic yielding and phase transitions, and shock temperature are discussed. In regions where a substantial phase change in the material does not occur, the relationship between the particle velocity, U(sub p), and the shock velocity, U(sub s), is given by U(sub s) = C(sub 0) + S U(sub p), where C(sub 0) is the shock velocity at infinitesimally small particle velocity, or the ambient pressure bulk sound velocity. Numerical values for the shock wave equation of state for minerals and related materials of the solar system are provided.

Ahrens, Thomas J.↗

Context Modeler for Wavelet Compression of Spectral Hyperspectral Images

A context-modeling sub-algorithm has been developed as part of an algorithm that effects three-dimensional (3D) wavelet-based compression of hyperspectral image data. The context-modeling subalgorithm, hereafter denoted the context modeler, provides estimates of probability distributions of wavelet-transformed data being encoded. These estimates are utilized by an entropy coding subalgorithm that is another major component of the compression algorithm. The estimates make it possible to compress the image data more effectively than would otherwise be possible. The following background discussion is prerequisite to a meaningful summary of the context modeler. This discussion is presented relative to ICER-3D, which is the name attached to a particular compression algorithm and the software that implements it. The ICER-3D software is summarized briefly in the preceding article, ICER-3D Hyperspectral Image Compression Software (NPO-43238). Some aspects of this algorithm were previously described, in a slightly more general context than the ICER-3D software, in "Improving 3D Wavelet-Based Compression of Hyperspectral Images" (NPO-41381), NASA Tech Briefs, Vol. 33, No. 3 (March 2009), page 7a. In turn, ICER-3D is a product of generalization of ICER, another previously reported algorithm and computer program that can perform both lossless and lossy wavelet-based compression and decompression of gray-scale-image data. In ICER-3D, hyperspectral image data are decomposed using a 3D discrete wavelet transform (DWT). Following wavelet decomposition, mean values are subtracted from spatial planes of spatially low-pass subbands prior to encoding. The resulting data are converted to sign-magnitude form and compressed. In ICER-3D, compression is progressive, in that compressed information is ordered so that as more of the compressed data stream is received, successive reconstructions of the hyperspectral image data are of successively higher overall fidelity.

Kiely, Aaron↗

Elastic-plastic and phase transition of zinc oxide single crystal under shock compression

The Hugoniot data for zinc oxide (ZnO) single crystals were measured up to 80 GPa along both the 〈112{sup ¯}0〉 (a-axis) and 〈0001〉 (c-axis) directions using a velocity interferometer system for any reflector and inclined-mirror method combined with a powder gun and two-stage light gas gun. The Hugoniot-elastic limits of ZnO were determined to be 10.5 and 11.5 GPa along the a- and c-axes, respectively. The wurtzite (B4) to rocksalt (B1) phase transition pressures along the a- and c-axes are 12.3 and 14.4 GPa, respectively. Shock velocity (U{sub s}) versus particle velocity (U{sub p}) relation of the final phase is given by the following relationship: U{sub s} (km/s) = 2.76 + 1.51U{sub p} (km/s). Based on the Debye-Grüneisen model and Birch-Murnaghan equation of state (EOS), we discuss the EOS of the B1 phase ZnO. The bulk modulus (K{sub 0}) and its pressure derivative (K{sub 0}′) are estimated to be K{sub 0} = 174 GPa and K{sub 0}′ = 3.9, respectively.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Assimilating compact phase space retrievals of atmospheric composition with WRF-Chem/DART: a regional chemical transport/ensemble Kalman filter data assimilation system

This study introduces the Weather Research and Forecasting Model with chemistry/Data Assimilation Research Testbed (WRF-Chem/DART) chemical transport forecasting/data assimilation system together with the assimilation of ''compact phase space retrievals'' of satellite-derived atmospheric composition products. WRF-Chem is a state-of-the-art chemical transport model. DART is a flexible software environment for researching ensemble data assimilation with different assimilation and forecast model options. DART's primary assimilation tool is the ensemble adjustment Kalman filter. WRF-Chem/DART is applied to the assimilation of Terra/Measurement of Pollution in the Troposphere (MOPITT) carbon monoxide (CO) trace gas retrieval profiles. Those CO observations are first assimilated as quasi-optimal retrievals (QORs). Our results show that assimilation of the CO retrievals (i) reduced WRF-Chem's CO bias in retrieval and state space, and (ii) improved the CO forecast skill by reducing the Root Mean Square Error (RMSE) and increasing the Coefficient of Determination ($R^2$). Those CO forecast improvements were significant at the 95 % level. Trace gas retrieval data sets contain (i) large amounts of data with limited information content per observation, (ii) error covariance cross-correlations, and (iii) contributions from the retrieval prior profile that should be removed before assimilation. Those characteristics present challenges to the assimilation of retrievals. This paper addresses those challenges by introducing the assimilation of compact phase space retrievals (CPSRs). CPSRs are obtained by preprocessing retrieval data sets with an algorithm that (i) compresses the retrieval data, (ii) diagonalizes the error covariance, and (iii) removes the retrieval prior profile contribution. Most modern ensemble assimilation algorithms can efficiently assimilate CPSRs. Our results show that assimilation of MOPITT CO CPSRs reduced the number of observations (and assimilation computation costs) by ~ 35 %, while providing CO forecast improvements comparable to or better than with the assimilation of MOPITT CO QORs.

58 GEOSCIENCES↗

Wavelet-Based Interpolation and Representation of Non-Uniformly Sampled Spacecraft Mission Data

A well-documented problem in the analysis of data collected by spacecraft instruments is the need for an accurate, efficient representation of the data set. The data may suffer from several problems, including additive noise, data dropouts, an irregularly-spaced sampling grid, and time-delayed sampling. These data irregularities render most traditional signal processing techniques unusable, and thus the data must be interpolated onto an even grid before scientific analysis techniques can be applied. In addition, the extremely large volume of data collected by scientific instrumentation presents many challenging problems in the area of compression, visualization, and analysis. Therefore, a representation of the data is needed which provides a structure which is conducive to these applications. Wavelet representations of data have already been shown to possess excellent characteristics for compression, data analysis, and imaging. The main goal of this project is to develop a new adaptive filtering algorithm for image restoration and compression. The algorithm should have low computational complexity and a fast convergence rate. This will make the algorithm suitable for real-time applications. The algorithm should be able to remove additive noise and reconstruct lost data samples from images.

Bose, Tamal↗

Melt segregation from partially molten source regions - The importance of melt density and source region size

An investigation is conducted regarding the changes expected in the density contrast between basic melts and peridotites with increasing pressure using the limited data available on the compressibilities of silicate melts and data on the densities of mantle minerals. It is concluded that since compressibilities of silicate melts are about an order of magnitude greater than those of mantle minerals, the density contrast between basic melts and mantle minerals must diminish significantly with increasing pressure. An earlier analysis regarding the migration of liquid in partially molten source regions conducted by Walker et al. (1978) is extended, giving particular attention to the influence of the diminished density contrast between melt and residual crystals with increasing source region depth and to the influence of source region size. This analysis leads to several generalizations concerning the factors influencing the depths at which magmas will segregate from their source regions and the degrees of partial melting that can be achieved in these source regions before melt segregation occurs.

Stolper, E.↗

1.2 Mfps standalone X-ray detector for Time-Resolved Experiments

We present a standalone and autonomous X-ray detector capable of operation with the speed of up to1.2Mfps. The detector utilizes UFXC32k hybrid pixel detectors for sensing X-rays, Spartan-6 LX45 FPGA placed in commercially available sbRIO 9628 controller for data acquisition and processing including a compression with zero-suppression algorithm. A Linux-RT system working on the 400 MHz Dual-Core CPU is used for FPGA control and data streaming to the higher-level system over 1 Gbps Ethernet connection. 1.2 M frames per second is achieved in so-called burst mode of operation while in zerodead-time mode 70 kfps is possible. Due to efficient data compression in FPGA there’s no need of using high-speed transceivers and Frame-Grabber cards on the data server side and the detector can stream the data infinitely over standard 1 Gbps network connection. Operation modes were tested at Advanced Photon Source Synchrotron at Argonne National Laboratory.

47 OTHER INSTRUMENTATION↗

High-Pressure Structural Response of an Insensitive Energetic Crystal: Dihydroxylammonium 5,5'-Bistetrazole-1,1'-diolate (TKX-50)

The structural response of a novel, insensitive energetic crystal—dihydroxylammonium 5,5'-bistetrazole-1,1'-diolate (TKX-50)—was examined under high pressure. Using synchrotron single-crystal X-ray diffraction measurements, details of molecular, intermolecular, and crystal changes were determined to ~10 GPa to understand its structural stability. The experimental results showed that TKX-50 exhibits highly anisotropic compression and significantly lower volume compressibility than currently known energetic crystals. These results are found to be in general agreement with our previous predictions from the DFT calculations. Additionally, the experimental data revealed anomalous compression—an expansion of the unit cell along the a axis (negative linear compressibility, NLC) upon compression to ~3 GPa. The structural analyses demonstrated that this unusual effect, the first such observation in an energetic crystal, is a consequence of the highly anisotropic response of 3D motifs, comprised of two parallel anions [(C 2 N 8 O 2 ) 2– ] linked with two cations [(NH 3 OH) + ] through four strong hydrogen bonds. The present results demonstrate that the structural stability of TKX-50 is controlled by the strong and highly anisotropic intermolecular interactions, and these may contribute to its shock insensitivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Simulated and experimental compression of a compact toroid

We present simulation results and experimental data for the compression of a compact toroid by a conducting nozzle without a center electrode. In both simulation and experiment, the flow of the plasma is greatly obstructed by even modest magnetic fields. A simple mechanism for this obstruction is suggested by our simulations. In particular, the configuration of the plasmoid's magnetic field plays a significant role in the success of the experiment. We analyze two types of plasma configurations under compression and demonstrate that the results from the simulations matches those from the experiments, and that the mechanism predicts the different behaviors observed in the two cases.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Compression through decomposition into browse and residual images

Economical archival and retrieval of image data is becoming increasingly important considering the unprecedented data volumes expected from the Earth Observing System (EOS) instruments. For cost effective browsing the image data (possibly from remote site), and retrieving the original image data from the data archive, we suggest an integrated image browse and data archive system employing incremental transmission. We produce our browse image data with the JPEG/DCT lossy compression approach. Image residual data is then obtained by taking the pixel by pixel differences between the original data and the browse image data. We then code the residual data with a form of variable length coding called diagonal coding. In our experiments, the JPEG/DCT is used at different quality factors (Q) to generate the browse and residual data. The algorithm has been tested on band 4 of two Thematic mapper (TM) data sets. The best overall compression ratios (of about 1.7) were obtained when a quality factor of Q=50 was used to produce browse data at a compression ratio of 10 to 11. At this quality factor the browse image data has virtually no visible distortions for the images tested.

Novik, Dmitry A.↗

ZFP: A compressed array representation for numerical computations

HPC trends favor algorithms and implementations that reduce data motion relative to FLOPS. We investigate the use of lossy compressed data arrays in place of traditional IEEE floating point arrays to store the primary data of calculations. Simulation is fundamentally an exercise in controlled approximation, and error introduced by finite-precision arithmetic (or lossy compression) is just one of several sources of error that need to be managed to ensure sufficient accuracy in a computed result. We describe ZFP, a compressed numerical format designed for in-memory storage of multidimensional arrays, and summarize theoretical results that demonstrate that the error of repeated lossy compression can be bounded and controlled. Furthermore, we establish a relationship between grid resolution and compression-induced errors and show that, contrary to conventional floating point, ZFP reduces finite-difference errors with finer grids. We present example calculations that demonstrate data reduction by 4x or more with negligible impact on solution accuracy. Our results further demonstrate several orders-of-magnitude increase in accuracy using ZFP over IEEE floating point and Posits for the same storage budget.

Lindstrom, Peter↗

Integrated photonic encoder for low power and high-speed image processing

Abstract Modern lens designs are capable of resolving greater than 10 gigapixels, while advances in camera frame-rate and hyperspectral imaging have made data acquisition rates of Terapixel/second a real possibility. The main bottlenecks preventing such high data-rate systems are power consumption and data storage. In this work, we show that analog photonic encoders could address this challenge, enabling high-speed image compression using orders-of-magnitude lower power than digital electronics. Our approach relies on a silicon-photonics front-end to compress raw image data, foregoing energy-intensive image conditioning and reducing data storage requirements. The compression scheme uses a passive disordered photonic structure to perform kernel-type random projections of the raw image data with minimal power consumption and low latency. A back-end neural network can then reconstruct the original images with structural similarity exceeding 90%. This scheme has the potential to process data streams exceeding Terapixel/second using less than 100 fJ/pixel, providing a path to ultra-high-resolution data and image acquisition systems.

47 OTHER INSTRUMENTATION↗

Near-Horizontal, Two-Phase Flow Patterns of Nitrogen and Hydrogen at Low Mass Heat and Flux (on CD-ROM)

One reason for NASA's interest in cryogenic two-phase flow with low mass and heat flux is the need to design spacecraft heat exchangers used for vaporizing cryogenic propellants. The CD-ROM provides digitized movies of particular flow patterns observed in experimental work. The movies have been provided in (QuickTime9Trademark) format, encoded at 320w x 240h pixels, 15 fps, using the Sorenson(Trademark) Video Codec for compression. Experiments were conducted to obtain data on the two-phase (liquid and vapor) flow behavior of cryogenic nitrogen and hydrogen under low mass and heat flux conditions. Tests were performed in normal gravity with a 1.5 degree up flow configuration. View ports in the apparatus permitted visual observation of the two-phase flow patterns. Computer codes to predict flow patterns were developed from theoretical/empirical models reported in the literature. Predictions from the computer codes were compared with experimental flow pattern observations. Results are presented employing the traditional two-dimensional flow pattern map format using the liquid and gas superficial velocities as coordinates. In general, the agreement between the experimental results and the analytical predictive methods is reasonably good. Small regions of the flow pattern maps are identified where the models are deficient as a result of neglecting phase change phenomena. Certain regions of the maps were beyond the range of the experiments and could not be completely validated. Areas that could benefit from further work include modeling of the transition from separated flow, collection of additional data in the bubble and annular flow regimes, and collection of experimental data at other inclination angles, tube diameters and high heat flux.

TWO PHASE FLOW↗

A Comparison of Compressed Sensing and Sparse Recovery Algorithms Applied to Simulation Data

The move toward exascale computing for scientific simulations is placing new demands on compression techniques. It is expected that the I/O system will not be able to support the volume of data that is expected to be written out. To enable quantitative analysis and scientific discovery, we are interested in techniques that compress high-dimensional simulation data and can provide perfect or near-perfect reconstruction. In this paper, we explore the use of compressed sensing (CS) techniques to reduce the size of the data before they are written out. Using large-scale simulation data, we investigate how the sufficient sparsity condition and the contrast in the data affect the quality of reconstruction and the degree of compression. Also, we provide suggestions for the practical implementation of CS techniques and compare them with other sparse recovery methods. Finally, our results show that despite longer times for reconstruction, compressed sensing techniques can provide near perfect reconstruction over a range of data with varying sparsity.

97 MATHEMATICS AND COMPUTING↗