Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

Autoignition behavior of unsaturated hydrocarbons in the low and high temperature regions

In this work, numerical and experimental techniques are used to investigate the effect of the position of the double bond on the ignition properties of pentene and hexene linear isomers. A wide-range kinetic model for the oxidation of C{sub 5}-C{sub 6} linear alkenes has been developed. Literature rapid compression machine data were used to validate the model at low temperatures and new shock tube experiments were performed in order to assess the behavior of the considered alkenes in the high temperature region. Some interesting inversions in the relative reactivity of the isomers were detected. The model successfully reproduced the measured behavior and allowed to explain the reason of these reactivity changes. The information gathered will be applied to the development of the kinetic mechanisms of larger unsaturated surrogate components.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Parallel Tensor Compression for Large-Scale Scientific Data.

As parallel computing trends towards the exascale, scientific data produced by high-fidelity simulations are growing increasingly massive. For instance, a simulation on a three-dimensional spatial grid with 512 points per dimension that tracks 64 variables per grid point for 128 time steps yields 8 TB of data. By viewing the data as a dense five way tensor, we can compute a Tucker decomposition to find inherent low-dimensional multilinear structure, achieving compression ratios of up to 10000 on real-world data sets with negligible loss in accuracy. So that we can operate on such massive data, we present the first-ever distributed memory parallel implementation for the Tucker decomposition, whose key computations correspond to parallel linear algebra operations, albeit with nonstandard data layouts. Our approach specifies a data distribution for tensors that avoids any tensor data redistribution, either locally or in parallel. We provide accompanying analysis of the computation and communication costs of the algorithms. To demonstrate the compression and accuracy of the method, we apply our approach to real-world data sets from combustion science simulations. We also provide detailed performance results, including parallel performance in both weak and strong scaling experiments.

59 BASIC BIOLOGICAL SCIENCES↗

Review and Implementation of the Emerging CCSDS Recommended Standard for Multispectral and Hyperspectral Lossless Image Coding

A new standard for image coding is being developed by the MHDC working group of the CCSDS, targeting onboard compression of multi- and hyper-spectral imagery captured by aircraft and satellites. The proposed standard is based on the "Fast Lossless" adaptive linear predictive compressor, and is adapted to better overcome issues of onboard scenarios. In this paper, we present a review of the state of the art in this field, and provide an experimental comparison of the coding performance of the emerging standard in relation to other state-of-the-art coding techniques. Our own independent implementation of the MHDC Recommended Standard, as well as of some of the other techniques, has been used to provide extensive results over the vast corpus of test images from the CCSDS-MHDC.

hyperspectral images↗

Scalable subsurface inverse modeling of huge data sets with an application to tracer concentration breakthrough data from magnetic resonance imaging

When characterizing subsurface properties is crucial for reliable and cost-effective groundwater supply management and contaminant remediation. With recent advances in sensor technology, large volumes of hydro-geophysical and geochemical data can be obtained to achieve high-resolution images of subsurface properties. However, characterization with such a large amount of information requires prohibitive computational costs associated with “big data” processing and numerous large-scale numerical simulations. To tackle such difficulties, the Principal Component Geostatistical Approach (PCGA) has been proposed as a “Jacobian-free” inversion method that requires much smaller forward simulation runs for each iteration than the number of unknown parameters and measurements needed in the traditional inversion methods. PCGA can be conveniently linked to any multi-physics simulation software with independent parallel executions. In our paper, we extend PCGA to handle a large number of measurements (e.g. 106 or more) by constructing a fast preconditioner whose computational cost scales linearly with the data size. For illustration, we characterize the heterogeneous hydraulic conductivity (K) distribution in a laboratory-scale 3-D sand box using about 6 million transient tracer concentration measurements obtained using magnetic resonance imaging. Since each individual observation has little information on the K distribution, the data was compressed by the zero-th temporal moment of breakthrough curves, which is equivalent to the mean travel time under the experimental setting. Moreover, only about 2,000 forward simulations in total were required to obtain the best estimate with corresponding estimation uncertainty, and the estimated K field captured key patterns of the original packing design, showing the efficiency and effectiveness of the proposed method. This article is protected by copyright. All rights reserved.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A comparative study of multi-material data structures for computational physics applications

The data structures used to represent the multi-material state of a computational physics application can have a significant impact on its performance. Here, we look at efficient data structures for applications where there may be many materials overall, but where most computational cells contain only one or a few of these materials. We develop simple performance models for selecting possible data structures and programming patterns. We verify the analytic performance models with a small test program of the representative cases. We discuss the impact of these techniques and analysis for multi-material physics applications, which are also applicable to a wide range of sparse computational data structures.

97 MATHEMATICS AND COMPUTING↗

Determination of a Density Functional Tight Binding Model with an Extended Basis Set and Three-Body Repulsion for Carbon Under Extreme Pressures and Temperatures

In this paper, we report here on development of a density functional tight binding (DFTB) simulation approach for carbon under extreme pressures and temperatures that includes an expanded basis set and an environmentally dependent repulsive energy. We find that including d-orbital interactions in the DFTB Hamiltonian improves determination of the electronic states at high pressure–temperature conditions, compared to standard DFTB implementations that utilize s- and p-orbitals only for carbon. We then determine a three-body repulsive energy through fitting to diamond, BC8, and simple cubic cold compression curve data, as well pressures from metallic liquid configurations from density functional theory (DFT) simulations. Our new model (DFTB-p3b) yields approximately 2 orders of magnitude increase in computational efficiency over standard DFT while retaining its accuracy for condensed phases of carbon under a wide range of conditions, including the metallic liquid phase at conditions up to 2000 GPa and 30 000 K. Finally, our results provide a straightforward method by which DFTB can be extended to studies of covalently bonded materials under extremely high pressures and temperatures such as the interiors of planets and other large celestial bodies.

36 MATERIALS SCIENCE↗

The Complicated Link Between Material Properties and Microfracture Density for an Underground Explosion in Granite

Geophysical techniques are often implemented as quick and inexpensive ways to locate and characterize fractures in the subsurface, which is important for a number of geoscience fields. Seismic velocities are the most widely used proxies for identification of fractures, but the correlation is not always well-defined. In this study we present material property data: unconfined compressive strength (UCS), bulk density (ρ), Young's modulus (E), Poisson's ratio (ν), P wave velocity (V p ), and S wave velocity (V s ), in conjunction with microfracture densities measured on samples of granite collected before and after underground chemical explosions. Results indicate the relationship between fractures and material properties is complex, even in this single-lithology environment. We interpret that this complexity arises from varying fracture mechanisms (e.g. dilation-inducing fractures vs compression-inducing fractures) in different parts of the core, due to differences in stress conditions. Additional complexity may result from chemical interactions between the fresh fractures and the fluids in the area. Water content appears to have a significant, if not dominant, role in the unconfined compressive strength (UCS) of the samples. We suggest caution when using elastic property measurements as a proxy for fracturing in areas of explosion-induced damage, or in other areas where a variety of mechanisms induce fracturing.

58 GEOSCIENCES↗

Mathematical modelling of the beam under axial compression force applied at any point – the buckling problem

The study is devoted to stability of simply supported beam under axial compression. The beam is subjected to an axial load located at any point along the axis of the beam. The buckling problem has been desribed and solved mathematically. Critical loads have been calculated. In the particular case, the Euler’s buckling load is obtained. Explicit solutions are given. The values of critical loads are collected in tables and shown in figure. The relation between the point of the load application and the critical load is presented.

97 MATHEMATICS AND COMPUTING↗

High-speed x-ray imaging with the Keck pixel array detector (Keck PAD) for time-resolved experiments at synchrotron sources

Modern storage rings are readily capable of providing intense x-ray pulses, tens of picoseconds in duration, millions of times per second. Exploiting the temporal structure of these x-ray sources opens avenues for studying rapid structural changes in materials. Many processes (e.g. crack propagation, deformation on impact, turbulence, etc.) differ in detail from one sample trial to the next and would benefit from the ability to record successive x-ray images with single x-ray sensitivity while framing at 5 to 10 MHz rates. To this end, we have pursued the development of fast x-ray imaging detectors capable of collecting bursts of images that enable the isolation of single synchrotron bunches and/or bunch trains. The detector technology used is the hybrid pixel array detector (PAD) with a charge integrating front-end, and high-speed, in-pixel signal storage elements. A 384×256 pixel version, the Keck-PAD, with 150 µm × 150 µm pixels and 8 dedicated in-pixel storage elements is operational, has been tested at CHESS, and has collected data for compression wave studies. An updated version with 27 dedicated storage capacitors and identical pixel size has been fabricated.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The COMPRES/GSECARS gas-loading system for diamond anvil cells at the Advanced Photon Source

We have designed and constructed a new system for loading gases at high pressure into diamond anvil cells at pressures up to 200 MPa. The gases are used either as quasi-hydrostatic pressure media surrounding the sample or as the sample itself. The diamond cell is sealed using a clamping mechanism, which permits nearly any type of diamond anvil cell to be used. Online ruby fluorescence and video imaging systems allow in situ monitoring of the pressure and gasket deformation as the cell is sealed, resulting in a very high success rate in loading cells. The system includes interlocks and computer control that allow it to be safely and easily operated by visiting users at the Advanced Photon Source. We present preliminary X-ray diffraction data on volume compression of single-crystal magnesium oxide (MgO) in helium up to 110 GPa.

43 PARTICLE ACCELERATORS↗

Temporal compression of quantum-information-carrying photons using a photon-echo quantum memory approach

We study quantum compression and decompression of light pulses that carry quantum information using a photon-echo quantum memory technique with controllable inhomogeneous broadening of an isolated atomic absorption line. We investigate media with differently broadened absorption profiles, transverse and longitudinal, finding that the recall efficiency can be as large as unity and that the quantum information encoded into the photonic qubits can remain unperturbed. Our results provide insight into reversible light-atom interaction and are interesting in view of future quantum communication networks, where pulse compression and decompression may play an important role in increasing the qubit rate or in mapping quantum information from photonic carriers with large optical bandwidth into atomic memories with smaller bandwidth.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Cosmological constraints from the Subaru Hyper Suprime-Cam year 1 shear catalogue lensing convergence probability distribution function

Here we utilize the probability distribution function (PDF) of normalized convergence maps reconstructed from the Subaru Hyper Suprime-Cam (HSC) year 1 shear catalogue, in combination with the power spectrum, to measure the matter clustering amplitude S 8 = σ 8 $\sqrt {Ω_{m}/0.3}$. The large-scale structure’s statistical properties are incompletely described by the traditional two-point statistics, motivating our investigation of the PDF—a complementary higher-order statistic. By defining the PDF over the standard-deviation-normalized convergence map, we are able to isolate the non-Gaussian information. We use tailored simulations to compress the data vector and construct a likelihood approximation. We mitigate the impact of survey and astrophysical systematics with cuts on smoothing scales, redshift bins, and data vectors. We find S 8 = $0.860^{+0.066}_{–0.109}$ from the PDF alone and S 8 = 0.798$^{+0.029}_{–0.042}$ from the combination of the PDF and power spectrum (68% confidential level (CL)). The PDF improves the power-spectrum-only constraint by about 10%.

79 ASTRONOMY AND ASTROPHYSICS↗

Pressure-temperature equation of state of Al 2 ⁢O 3 up to 14 Mbar and 40 kK

Sapphire (Al 2 ⁢O 3 ), known for its remarkable incompressibility at ambient conditions, plays a pivotal role in both static and dynamic compression research. Accurately characterizing its equation of state (EoS) is essential for these applications. Here, we present a complete Hugoniot of Al 2 ⁢ O 3 as locus of experimentally assessed, high-precision, pressure, density and temperature states up to 14 Mbar and 43 kK. The Hugoniot is established with single shock experiments using magnetically launched hyper velocity flyers on the Z Accelerator at Sandia National Laboratories. We explore principal Hugoniot states at very high shock 𝑇 and 𝑝 in the solid phase, tracking the solid-liquid boundary and culminating at 2.4-fold compression, where data provides a direct constraint on the liquid phase. Corresponding shock release data probe thermodynamic states complementary to the Hugoniot and place additional constraints on tabular EoS models. Our findings indicate a significant deviation from existing tabular EoS models for Al 2 ⁢ O 3 dictating a comprehensive overhaul. We develop two advanced EoSs for Al 2 ⁢ O 3 the SESAME 97412 model, featuring an extensive phase diagram that includes three solid phases and the liquid phase, and the updated LEOS 2200m2 model. EoS development is assisted with Quantum Molecular Dynamics simulations. Our experimental data allows for stringent testing of our EoSs. Both models accurately capture the Hugoniot of Al 2 ⁢O 3 up to the highest pressures and temperatures. Rigorous experimental determination of extreme pressures and temperatures, paired with sophisticated models, advances the frontier of EoS development beyond 1 terapascal.

Kalita, Patricia [Sandia National Laboratories (SN↗

An Informative Interpretation of Decision Theory: The Information Theoretic Basis for Signal-to-Noise Ratio and Log Likelihood Ratio

The signal processing concept of signal-to-noise ratio (SNR), in its role as a performance measure, is recast within the more general context of information theory, leading to a series of useful insights. Establishing generalized SNR (GSNR) as a rigorous information theoretic measure inherent in any set of observations significantly strengthens its quantitative performance pedigree while simultaneously providing a specific definition under general conditions. This directly leads to consideration of the log likelihood ratio (LLR): first, as the simplest possible information-preserving transformation (i.e., signal processing algorithm) and subsequently, as an absolute, comparable measure of information for any specific observation exemplar. Furthermore, the information accounting methodology that results permits practical use of both GSNR and LLR as diagnostic scalar performance measurements, directly comparable across alternative system/algorithm designs, applicable at any tap point within any processing string, in a form that is also comparable with the inherent performance bounds due to information conservation.

97 MATHEMATICS AND COMPUTING↗

Scalable Communication Trace Compression

Characterizing the communication behavior of parallel programs through tracing can help understand an application’s characteristics, model its performance, and predict behavior on future systems. However, lossless communication traces can get prohibitively large, causing programmers to resort to variety of other techniques. In this paper, we present a novel approach to lossless communication trace compression. We augment the sequitur compression algorithm to employ it in communication trace compression of parallel programs. We present optimizations to reduce the memory overhead, reduce size of the trace files generated, and enable compression across multiple processes in a parallel program. The evaluation shows improved compression and reduced overhead over other approaches, with up to 3 orders of magnitude improvement for the NAS MG benchmark. We also observe that, unlike existing schemes, the trace files sizes and the memory overhead incurred are less sensitive to, if not independent of, the problem size for the NAS benchmarks.

97 MATHEMATICS AND COMPUTING↗

Detecting Anomalies from End-to-End Internet Performance Measurements (PingER) Using Cluster Based Local Outlier Factor

PingER (Ping End-to-End Reporting) is a worldwide end-to-end Internet performance measurement framework. It was developed by the SLAC National Accelerator Laboratory, Stanford, USA and running from the last 20 years. It has more than 700 monitoring agents and remote sites which monitor the performance of Internet links around 170 countries of the world. At present, the size of the compressed PingER data set is about 60 GB comprising of 100,000 flat files. The data is publicly available for valuable Internet performance analyses. However, the data sets suffer from missing values and anomalies due to congestion, bottleneck links, queuing overflow, network software misconfiguration, hardware failure, cable cuts, and social upheavals. Therefore, the objective of this paper is to detect such performance drops or spikes labeled as anomalies or outliers for the PingER data set. In the proposed approach, the raw text files of the data set are transformed into a PingER dimensional model. The missing values are imputed using the k-NN algorithm. The data is partitioned into similar instances using the k-means clustering algorithm. Afterward, clustering is integrated with the Local Outlier Factor (LOF) using the Cluster Based Local Outlier Factor (CBLOF) algorithm to detect the anomalies or outliers from the PingER data. Lastly, anomalies are further analyzed to identify the time frame and location of the hosts generating the major percentage of the anomalies in the PingER data set ranging from 1998 to 2016.

97 MATHEMATICS AND COMPUTING↗

A Study of the Trade-off Between Reducing Precision and Reducing Resolution for Data Analysis and Visualization

There presently exist two dominant strategies to reduce data sizes in analysis and visualization: reducing the precision of the data, e.g., through quantization, or reducing its resolution, e.g., by subsampling. Both have advantages and disadvantages and both face fundamental limits at which the reduced information ceases to be useful. The paper explores the additional gains that could be achieved by combining both strategies. In particular, we present a common framework that allows us to study the trade-off in reducing precision and/or resolution in a principled manner. We represent data reduction schemes as progressive streams of bits and study how various bit orderings such as by resolution, by precision, etc., impact the resulting approximation error across a variety of data sets as well as analysis tasks. Additionally, we compute streams that are optimized for different tasks to serve as lower bounds on the achievable error. Scientific data management systems can use the results proposed in this paper as guidance on how to store and stream data to make efficient use of the limited storage and bandwidth in practice.

97 MATHEMATICS AND COMPUTING↗