Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Scalable subsurface inverse modeling of huge data sets with an application to tracer concentration breakthrough data from magnetic resonance imaging

When characterizing subsurface properties is crucial for reliable and cost-effective groundwater supply management and contaminant remediation. With recent advances in sensor technology, large volumes of hydro-geophysical and geochemical data can be obtained to achieve high-resolution images of subsurface properties. However, characterization with such a large amount of information requires prohibitive computational costs associated with “big data” processing and numerous large-scale numerical simulations. To tackle such difficulties, the Principal Component Geostatistical Approach (PCGA) has been proposed as a “Jacobian-free” inversion method that requires much smaller forward simulation runs for each iteration than the number of unknown parameters and measurements needed in the traditional inversion methods. PCGA can be conveniently linked to any multi-physics simulation software with independent parallel executions. In our paper, we extend PCGA to handle a large number of measurements (e.g. 106 or more) by constructing a fast preconditioner whose computational cost scales linearly with the data size. For illustration, we characterize the heterogeneous hydraulic conductivity (K) distribution in a laboratory-scale 3-D sand box using about 6 million transient tracer concentration measurements obtained using magnetic resonance imaging. Since each individual observation has little information on the K distribution, the data was compressed by the zero-th temporal moment of breakthrough curves, which is equivalent to the mean travel time under the experimental setting. Moreover, only about 2,000 forward simulations in total were required to obtain the best estimate with corresponding estimation uncertainty, and the estimated K field captured key patterns of the original packing design, showing the efficiency and effectiveness of the proposed method. This article is protected by copyright. All rights reserved.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A comparative study of multi-material data structures for computational physics applications

The data structures used to represent the multi-material state of a computational physics application can have a significant impact on its performance. Here, we look at efficient data structures for applications where there may be many materials overall, but where most computational cells contain only one or a few of these materials. We develop simple performance models for selecting possible data structures and programming patterns. We verify the analytic performance models with a small test program of the representative cases. We discuss the impact of these techniques and analysis for multi-material physics applications, which are also applicable to a wide range of sparse computational data structures.

97 MATHEMATICS AND COMPUTING↗

Determination of a Density Functional Tight Binding Model with an Extended Basis Set and Three-Body Repulsion for Carbon Under Extreme Pressures and Temperatures

In this paper, we report here on development of a density functional tight binding (DFTB) simulation approach for carbon under extreme pressures and temperatures that includes an expanded basis set and an environmentally dependent repulsive energy. We find that including d-orbital interactions in the DFTB Hamiltonian improves determination of the electronic states at high pressure–temperature conditions, compared to standard DFTB implementations that utilize s- and p-orbitals only for carbon. We then determine a three-body repulsive energy through fitting to diamond, BC8, and simple cubic cold compression curve data, as well pressures from metallic liquid configurations from density functional theory (DFT) simulations. Our new model (DFTB-p3b) yields approximately 2 orders of magnitude increase in computational efficiency over standard DFT while retaining its accuracy for condensed phases of carbon under a wide range of conditions, including the metallic liquid phase at conditions up to 2000 GPa and 30 000 K. Finally, our results provide a straightforward method by which DFTB can be extended to studies of covalently bonded materials under extremely high pressures and temperatures such as the interiors of planets and other large celestial bodies.

36 MATERIALS SCIENCE↗

The Complicated Link Between Material Properties and Microfracture Density for an Underground Explosion in Granite

Geophysical techniques are often implemented as quick and inexpensive ways to locate and characterize fractures in the subsurface, which is important for a number of geoscience fields. Seismic velocities are the most widely used proxies for identification of fractures, but the correlation is not always well-defined. In this study we present material property data: unconfined compressive strength (UCS), bulk density (ρ), Young's modulus (E), Poisson's ratio (ν), P wave velocity (V p ), and S wave velocity (V s ), in conjunction with microfracture densities measured on samples of granite collected before and after underground chemical explosions. Results indicate the relationship between fractures and material properties is complex, even in this single-lithology environment. We interpret that this complexity arises from varying fracture mechanisms (e.g. dilation-inducing fractures vs compression-inducing fractures) in different parts of the core, due to differences in stress conditions. Additional complexity may result from chemical interactions between the fresh fractures and the fluids in the area. Water content appears to have a significant, if not dominant, role in the unconfined compressive strength (UCS) of the samples. We suggest caution when using elastic property measurements as a proxy for fracturing in areas of explosion-induced damage, or in other areas where a variety of mechanisms induce fracturing.

58 GEOSCIENCES↗

Mathematical modelling of the beam under axial compression force applied at any point – the buckling problem

The study is devoted to stability of simply supported beam under axial compression. The beam is subjected to an axial load located at any point along the axis of the beam. The buckling problem has been desribed and solved mathematically. Critical loads have been calculated. In the particular case, the Euler’s buckling load is obtained. Explicit solutions are given. The values of critical loads are collected in tables and shown in figure. The relation between the point of the load application and the critical load is presented.

97 MATHEMATICS AND COMPUTING↗

High-speed x-ray imaging with the Keck pixel array detector (Keck PAD) for time-resolved experiments at synchrotron sources

Modern storage rings are readily capable of providing intense x-ray pulses, tens of picoseconds in duration, millions of times per second. Exploiting the temporal structure of these x-ray sources opens avenues for studying rapid structural changes in materials. Many processes (e.g. crack propagation, deformation on impact, turbulence, etc.) differ in detail from one sample trial to the next and would benefit from the ability to record successive x-ray images with single x-ray sensitivity while framing at 5 to 10 MHz rates. To this end, we have pursued the development of fast x-ray imaging detectors capable of collecting bursts of images that enable the isolation of single synchrotron bunches and/or bunch trains. The detector technology used is the hybrid pixel array detector (PAD) with a charge integrating front-end, and high-speed, in-pixel signal storage elements. A 384×256 pixel version, the Keck-PAD, with 150 µm × 150 µm pixels and 8 dedicated in-pixel storage elements is operational, has been tested at CHESS, and has collected data for compression wave studies. An updated version with 27 dedicated storage capacitors and identical pixel size has been fabricated.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The COMPRES/GSECARS gas-loading system for diamond anvil cells at the Advanced Photon Source

We have designed and constructed a new system for loading gases at high pressure into diamond anvil cells at pressures up to 200 MPa. The gases are used either as quasi-hydrostatic pressure media surrounding the sample or as the sample itself. The diamond cell is sealed using a clamping mechanism, which permits nearly any type of diamond anvil cell to be used. Online ruby fluorescence and video imaging systems allow in situ monitoring of the pressure and gasket deformation as the cell is sealed, resulting in a very high success rate in loading cells. The system includes interlocks and computer control that allow it to be safely and easily operated by visiting users at the Advanced Photon Source. We present preliminary X-ray diffraction data on volume compression of single-crystal magnesium oxide (MgO) in helium up to 110 GPa.

43 PARTICLE ACCELERATORS↗

Temporal compression of quantum-information-carrying photons using a photon-echo quantum memory approach

We study quantum compression and decompression of light pulses that carry quantum information using a photon-echo quantum memory technique with controllable inhomogeneous broadening of an isolated atomic absorption line. We investigate media with differently broadened absorption profiles, transverse and longitudinal, finding that the recall efficiency can be as large as unity and that the quantum information encoded into the photonic qubits can remain unperturbed. Our results provide insight into reversible light-atom interaction and are interesting in view of future quantum communication networks, where pulse compression and decompression may play an important role in increasing the qubit rate or in mapping quantum information from photonic carriers with large optical bandwidth into atomic memories with smaller bandwidth.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Cosmological constraints from the Subaru Hyper Suprime-Cam year 1 shear catalogue lensing convergence probability distribution function

Here we utilize the probability distribution function (PDF) of normalized convergence maps reconstructed from the Subaru Hyper Suprime-Cam (HSC) year 1 shear catalogue, in combination with the power spectrum, to measure the matter clustering amplitude S 8 = σ 8 $\sqrt {Ω_{m}/0.3}$. The large-scale structure’s statistical properties are incompletely described by the traditional two-point statistics, motivating our investigation of the PDF—a complementary higher-order statistic. By defining the PDF over the standard-deviation-normalized convergence map, we are able to isolate the non-Gaussian information. We use tailored simulations to compress the data vector and construct a likelihood approximation. We mitigate the impact of survey and astrophysical systematics with cuts on smoothing scales, redshift bins, and data vectors. We find S 8 = $0.860^{+0.066}_{–0.109}$ from the PDF alone and S 8 = 0.798$^{+0.029}_{–0.042}$ from the combination of the PDF and power spectrum (68% confidential level (CL)). The PDF improves the power-spectrum-only constraint by about 10%.

79 ASTRONOMY AND ASTROPHYSICS↗

Pressure-temperature equation of state of Al 2 ⁢O 3 up to 14 Mbar and 40 kK

Sapphire (Al 2 ⁢O 3 ), known for its remarkable incompressibility at ambient conditions, plays a pivotal role in both static and dynamic compression research. Accurately characterizing its equation of state (EoS) is essential for these applications. Here, we present a complete Hugoniot of Al 2 ⁢ O 3 as locus of experimentally assessed, high-precision, pressure, density and temperature states up to 14 Mbar and 43 kK. The Hugoniot is established with single shock experiments using magnetically launched hyper velocity flyers on the Z Accelerator at Sandia National Laboratories. We explore principal Hugoniot states at very high shock 𝑇 and 𝑝 in the solid phase, tracking the solid-liquid boundary and culminating at 2.4-fold compression, where data provides a direct constraint on the liquid phase. Corresponding shock release data probe thermodynamic states complementary to the Hugoniot and place additional constraints on tabular EoS models. Our findings indicate a significant deviation from existing tabular EoS models for Al 2 ⁢ O 3 dictating a comprehensive overhaul. We develop two advanced EoSs for Al 2 ⁢ O 3 the SESAME 97412 model, featuring an extensive phase diagram that includes three solid phases and the liquid phase, and the updated LEOS 2200m2 model. EoS development is assisted with Quantum Molecular Dynamics simulations. Our experimental data allows for stringent testing of our EoSs. Both models accurately capture the Hugoniot of Al 2 ⁢O 3 up to the highest pressures and temperatures. Rigorous experimental determination of extreme pressures and temperatures, paired with sophisticated models, advances the frontier of EoS development beyond 1 terapascal.

Kalita, Patricia [Sandia National Laboratories (SN↗

An Informative Interpretation of Decision Theory: The Information Theoretic Basis for Signal-to-Noise Ratio and Log Likelihood Ratio

The signal processing concept of signal-to-noise ratio (SNR), in its role as a performance measure, is recast within the more general context of information theory, leading to a series of useful insights. Establishing generalized SNR (GSNR) as a rigorous information theoretic measure inherent in any set of observations significantly strengthens its quantitative performance pedigree while simultaneously providing a specific definition under general conditions. This directly leads to consideration of the log likelihood ratio (LLR): first, as the simplest possible information-preserving transformation (i.e., signal processing algorithm) and subsequently, as an absolute, comparable measure of information for any specific observation exemplar. Furthermore, the information accounting methodology that results permits practical use of both GSNR and LLR as diagnostic scalar performance measurements, directly comparable across alternative system/algorithm designs, applicable at any tap point within any processing string, in a form that is also comparable with the inherent performance bounds due to information conservation.

97 MATHEMATICS AND COMPUTING↗

Scalable Communication Trace Compression

Characterizing the communication behavior of parallel programs through tracing can help understand an application’s characteristics, model its performance, and predict behavior on future systems. However, lossless communication traces can get prohibitively large, causing programmers to resort to variety of other techniques. In this paper, we present a novel approach to lossless communication trace compression. We augment the sequitur compression algorithm to employ it in communication trace compression of parallel programs. We present optimizations to reduce the memory overhead, reduce size of the trace files generated, and enable compression across multiple processes in a parallel program. The evaluation shows improved compression and reduced overhead over other approaches, with up to 3 orders of magnitude improvement for the NAS MG benchmark. We also observe that, unlike existing schemes, the trace files sizes and the memory overhead incurred are less sensitive to, if not independent of, the problem size for the NAS benchmarks.

97 MATHEMATICS AND COMPUTING↗

Detecting Anomalies from End-to-End Internet Performance Measurements (PingER) Using Cluster Based Local Outlier Factor

PingER (Ping End-to-End Reporting) is a worldwide end-to-end Internet performance measurement framework. It was developed by the SLAC National Accelerator Laboratory, Stanford, USA and running from the last 20 years. It has more than 700 monitoring agents and remote sites which monitor the performance of Internet links around 170 countries of the world. At present, the size of the compressed PingER data set is about 60 GB comprising of 100,000 flat files. The data is publicly available for valuable Internet performance analyses. However, the data sets suffer from missing values and anomalies due to congestion, bottleneck links, queuing overflow, network software misconfiguration, hardware failure, cable cuts, and social upheavals. Therefore, the objective of this paper is to detect such performance drops or spikes labeled as anomalies or outliers for the PingER data set. In the proposed approach, the raw text files of the data set are transformed into a PingER dimensional model. The missing values are imputed using the k-NN algorithm. The data is partitioned into similar instances using the k-means clustering algorithm. Afterward, clustering is integrated with the Local Outlier Factor (LOF) using the Cluster Based Local Outlier Factor (CBLOF) algorithm to detect the anomalies or outliers from the PingER data. Lastly, anomalies are further analyzed to identify the time frame and location of the hosts generating the major percentage of the anomalies in the PingER data set ranging from 1998 to 2016.

97 MATHEMATICS AND COMPUTING↗

A Study of the Trade-off Between Reducing Precision and Reducing Resolution for Data Analysis and Visualization

There presently exist two dominant strategies to reduce data sizes in analysis and visualization: reducing the precision of the data, e.g., through quantization, or reducing its resolution, e.g., by subsampling. Both have advantages and disadvantages and both face fundamental limits at which the reduced information ceases to be useful. The paper explores the additional gains that could be achieved by combining both strategies. In particular, we present a common framework that allows us to study the trade-off in reducing precision and/or resolution in a principled manner. We represent data reduction schemes as progressive streams of bits and study how various bit orderings such as by resolution, by precision, etc., impact the resulting approximation error across a variety of data sets as well as analysis tasks. Additionally, we compute streams that are optimized for different tasks to serve as lower bounds on the achievable error. Scientific data management systems can use the results proposed in this paper as guidance on how to store and stream data to make efficient use of the limited storage and bandwidth in practice.

97 MATHEMATICS AND COMPUTING↗

Determination of equivalent breast phantoms for different age groups of Taiwanese women: An experimental approach

Purpose: Polymethylmethacrylate (PMMA) slab is one of the mostly used phantoms for studying breast dosimetry in mammography. The purpose of this study was to evaluate the equivalence between exposure factors acquired from PMMA slabs and patient cases of different age groups of Taiwanese women in mammography. Methods: This study included 3910 craniocaudal screen/film mammograms on Taiwanese women acquired on one mammographic unit. The tube loading, compressed breast thickness (CBT), compression force, tube voltage, and target/filter combination for each mammogram were collected for all patients. The glandularity and the equivalent thickness of PMMA were determined for each breast using the exposure factors of the breast in combination with experimental measurements from breast-tissue-equivalent attenuation slabs. Equivalent thicknesses of PMMA to the breasts of Taiwanese women were then estimated. Results: The average {+-} standard deviation CBT and breast glandularity in this study were 4.2 {+-} 1.0 cm and 54% {+-} 23%, respectively. The average equivalent PMMA thickness was 4.0 {+-} 0.7 cm. PMMA slabs producing equivalent exposure factors as in the breasts of Taiwanese women were determined for the age groups 30-49 yr and 50-69 yr. For the 4-cm PMMA slab, the CBT and glandularity values of the equivalent breast were 4.1 cm and 65%, respectively, for the age group 30-49 yr and 4.4 cm and 44%, respectively, for the age group 50-69 yr. Conclusions: The average thickness of PMMA slabs producing the same exposure factors as observed in a large group of Taiwanese women is less than that reported for American women. The results from this study can provide useful information for determining a suitable thickness of PMMA for mammographic dose survey in Taiwan. The equivalence of PMMA slabs and the breasts of Taiwanese women is provided to allow average glandular dose assessment in clinical practice.

61 RADIATION PROTECTION AND DOSIMETRY↗

Unified many-worlds browsing of arbitrary physics-based animations

Manually tuning physics-based animation parameters to explore a simulation outcome space or achieve desired motion outcomes can be notoriously tedious. This problem has motivated many sophisticated and specialized optimization-based methods for fine-grained (keyframe) control, each of which are typically limited to specific animation phenomena, usually complicated, and, unfortunately, not widely used. In this paper, we propose Unified Many-Worlds Browsing (UMWB), a practical method for sample-level control and exploration of physics-based animations. Our approach supports browsing of large simulation ensembles of arbitrary animation phenomena by using a unified volumetric WORLDPACK representation based on spatiotemporally compressed voxel data associated with geometric occupancy and other low-fidelity animation state. Beyond memory reduction, the WORLDPACK representation also enables unified query support for interactive browsing: it provides fast evaluation of approximate spatiotemporal queries, such as occupancy tests that find ensemble samples ("worlds") where material is either IN or NOT IN a user-specified spacetime region. WORLDPACKS also support real-time hardware-accelerated voxel rendering by exploiting the spatially hierarchical and temporal RLE raster data structure. Our UMWB implementation supports interactive browsing (and offline refinement) of ensembles containing thousands of simulation samples, and fast spatiotemporal queries and ranking. We show UMWB results using a wide variety of physics-based animation phenomena---not just JELL-O ® .

Computer Science↗

H5TurboPFor v0.0.1

H5TurboPFor is a wrapper for the TurboPFor-Integer-Compression for HDF5 library. Basically, it enables the HDF5 library to compress integer data using the TurboPFor.

Dong, Bin↗