Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “compressing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Compressing micro-operations in scheduler entries in a processor

An electronic device includes a processor having a micro-operation queue, multiple scheduler entries, and scheduler compression logic. When a pair of micro-operations in the micro-operation queue is compressible in accordance with one or more compressibility rules, the scheduler compression logic acquires the pair of micro-operations from the micro-operation queue and stores information from both micro-operations of the pair of micro-operations into different portions in a single scheduler entry. In this way, the scheduler compression logic compresses the pair of micro-operations into the single scheduler entry.

Boyer, Michael W.↗
DOE OSTI2023

Classical and quantum compression for edge computing: the ubiquitous data dimensionality reduction

Edge computing aims to address the challenges associated with communicating and transferring large amounts of data generated remotely to a data center in a timely and efficient manner. A central pillar of edge computing is local (i.e., at- or near-source) data processing capability so that data transfer to a data center for processing can be minimized. Data compression at the edge is therefore a natural component of edge workflows. Here we present a survey of data compression algorithms with a focus on edge computing. Not all compression algorithms can accommodate the data type heterogeneity, tight processing and communication time constraints, or energy efficiency requirement characteristics of edge computing. We discuss specific examples of compression algorithms that are being explored in the context of edge computing. We end our review with a brief survey of emerging quantum compression techniques that are of importance in quantum information processing, including the proposed concept of quantum edge computing.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Macro- and micro-compression testing of shales

Here, macro- and micro-geomechanical properties of shales were investigated at millimeter- and micrometer-scale using an example of the Woodford Shale. Geomechanical properties, such as uniaxial (unconfined) compressive strength and Young's modulus, were quantified at the millimeter-scale and compared with results from micro-compression testing experiments of FIB-SEM-nanofabricated micro-pillars. Size-scale and compositional/structural heterogeneity effect on elasto-plastic deformation and failure behavior of shales were investigated. Also, relationship between elemental/mineral composition and unconfined compressive strength and Young's modulus, at a micrometer-scale, was discussed. It was shown that geomechanical properties of shales are scale-dependent and are strongly affected by compositional/structural anisotropy. In particular, micro-compression testing experiments showed non-uniformly distributed compressive strength and Young's modulus within the investigated Woodford Shale rock samples. It was demonstrated, that geomechanical properties of shales, investigated at the micrometer-scale, tend to be affected by different minerals and/or pores, while the same properties, investigated at the millimeter-scale, are governed by different micro-facies (and/or micro-fractures) present within the rock. This shows that geomechanical properties of shales can be dramatically different depending on the scale of investigation and compositional/structural heterogeneity of these rocks, and therefore are not easily transferable across the scales.

58 GEOSCIENCES↗
DOE OSTI2025

Massive compression for high data rate macromolecular crystallography (HDRMX): impact on diffraction data and subsequent structural analysis

New higher-count-rate, integrating, large-area X-ray detectors with framing rates as high as 17400 images per second are beginning to be available. These will soon be used for specialized macromolecular crystallography experiments but will require optimal lossy compression algorithms to enable systems to keep up with data throughput. Some information may be lost. Can we minimize this loss with acceptable impact on structural information? To explore this question, we have considered several approaches: summing short sequences of images, binning to create the effect of larger pixels, use of JPEG-2000 lossy wavelet-based compression, and use of Hcompress, which is a Haar-wavelet-based lossy compression borrowed from astronomy. We also explore the effect of the combination of summing, binning, and Hcompress or JPEG-2000. In each of these last two methods one can specify approximately how much one wants the result to be compressed from the starting file size. These provide particularly effective lossy compressions that retain essential information for structure solution from Bragg reflections.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Progressive Tree-Based Compression of Large-Scale Particle Data

Scientific simulations and observations using particles have been creating large datasets that require effective and efficient data reduction to store, transfer, and analyze. However, current approaches either compress only small data well while being inefficient for large data, or handle large data but with insufficient compression. Toward effective and scalable compression/decompression of particle positions, we introduce new kinds of particle hierarchies and corresponding traversal orders that quickly reduce reconstruction error while being fast and low in memory footprint. Our solution to compression of large-scale particle data is a flexible block-based hierarchy that supports progressive, random-access, and error-driven decoding, where error estimation heuristics can be supplied by the user. For low-level node encoding, we introduce new schemes that effectively compress both uniform and densely structured particle distributions. Our proposed methods thus target all three phases of a tree-based particle compression pipeline, namely tree construction, tree traversal, and node encoding. In conclusion, the improved efficacy and flexibility of these methods over existing compressors are demonstrated through extensive experimentation, using a wide range of scientific particle datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Physics-Driven Convolutional Autoencoder Approach for CFD Data Compressions: Preprint

With the growing size and complexity of turbulent flow models, data compression approaches are of the utmost importance to analyze, visualize, or restart the simulations. Recently, in-situ autoencoder-based compression approaches have been proposed and shown to be effective at producing reduced representations of turbulent flow data. However, these approaches focus solely on training the model using point-wise sample reconstruction losses that do not take advantage of the physical properties of turbulent flows. In this paper, we show that training autoencoders with additional physics-informed regularizations, e.g., enforcing incompressibility and preserving enstrophy, improves the compression model in three ways: (i) the compressed data better conform to known physics for homogeneous isotropic turbulence without negatively impacting point-wise reconstruction quality, (ii) inspection of the gradients of the trained model uncovers changes to the learned compression mapping that can facilitate the use of explainability techniques, and (iii) as a performance byproduct, training losses are shown to converge up to 12x faster than the baseline model.

auto-encoders↗
DOE OSTI2021

Effect of particle characteristics on the evolution of particle size, particle morphology, and fabric of sands loaded under uniaxial compression

This work presents the results and analyses of uniaxial compression experiments performed on three silica sands. The sands have comparable particle-size distributions, but their particles differ in morphology and strength. Cylindrical samples of the three sands were compressed in a loading device placed inside an X-ray microscope (XRM) and scanned at multiple stress levels during uniaxial compression. 3D tomography data of the samples obtained from the XRM at different stress levels were then analyzed to obtain the distributions of particle size, particle morphology, and interparticle contact normals within the sample. Results indicate that: (1) the compressibility of the sands loaded under uniaxial compression is closely tied to particle morphology and strength and (2) the anisotropy in the orientations of interparticle contact normals generally increases with axial stress; however, this increase is limited by the occurrence of particle crushing in the sample.

3D X-ray computed tomography↗
DOE OSTI2020

Impacts of swinging door lossy compression of synchrophasor data

As the number of operational Phasor Measurement Units (PMUs) is increasing, compression is becoming crucial for efficiently transferring and storing enormous amount of synchrophasor data continuously measured from a power system. Some utilities in the U.S. have already adopted a nonlinear compression technique, called Swinging Door Algorithm (SDA), assuming compressed data meets technical and regulatory requirements without resulting in any degradation of the measurements. This paper studies impacts of this compression algorithm on field measured and simulated PMU data, and presents results from spectral analyses of raw and decompressed measurements. The results show blind application of the SDA compression alters frequency content in the measurements and introduces false harmonics and aliasing. These can lead to false conclusions being drawn from the measurements about the power system condition.

42 ENGINEERING↗
DOE OSTI2021

Transport of Compressed Woody Biomass: Correlating Rheology and Microcompounder Measurements

Transport of milled solid biomass can be problematic in biomass conversion processes due to the material’s high cohesiveness, low bulk density, and poor flowability. Here, the goal is to investigate the flow behavior of compressed biomass under conditions similar to compression-screw feeders. To mimic the flow of woody biomass inside a compression-screw feeder, two lignocellulosic biomass feedstocks were fed to a co-rotating twin-screw microcompounder. Force and screw speed from the microcompounder were correlated to viscosity in a traditional rheometer, where low-density polyethylene served as a control. The deformation of compressed biomass in a lab-scale compounder is strongly dependent on screw speed and moisture content. Shear stress in woody biomass decreased with the shear rate, indicating negative plastic viscosity. Moreover, viscosity decreased one order of magnitude as screw speed increased from 10 to 90 rpm. Increasing moisture from 10 to 50% reduced the viscosity of the compressed biomass by 60%.

09 BIOMASS FUELS↗
DOE OSTI2026

An Algorithm for Atom-Centered Lossy Compression of the Atomic Orbital Basis in Density Functional Theory Calculations

Large atomic-orbital (AO) basis sets of at least triple and preferably quadruple-ζ (QZ) size are required to adequately converge Kohn–Sham density functional theory (DFT) calculations toward the complete basis set limit. However, incrementing the cardinal number by one nearly doubles the AO basis dimension, and the computational cost scales as the cube of the AO dimension, so this is very computationally demanding. Here, in this work, we develop and test a threshold-based natural atomic orbital (NAO) scheme in which ϵ-NAOs are obtained as eigenfunctions of atomic blocks of the density matrix in a one-center orthogonalized representation. This enables compression of the AO basis that is optimal for a given threshold, 10 –ϵ , by discarding NAOs with occupation numbers below that threshold. Extensive pilot test calculations using the Hartree–Fock functional and taking the converged density matrix as input suggest that a threshold of 10 –5 can yield a compression factor (ratio of AO to compressed ϵ-NAO dimension) between 2.5 and 4.5 for the QZ pc-3 basis. The errors in relative energies are typically less than 0.1 kcal/mol when the compressed basis is used instead of the uncompressed basis. Between 10 and 100 times smaller errors (i.e., usually less than 0.01 kcal/mol) can be obtained with a threshold 10 –7 , while the compression factor is typically between 2 and 2.5.

basis sets↗
DOE OSTI2025

System and Machine Learning-Guided Materials Design for High-Pressure Hydrogen Compression

Cost-effective and reliable hydrogen compression remains a challenging barrier in the widespread adoption of hydrogen as an energy carrier. The prevailing technology of mechanical compression suffers from several drawbacks, some of which can be addressed by nonmechanical compression strategies (e.g., electrochemical or metal hydride-based thermal compression). Thermally driven metal hydride compression strategies typically rely on multistage metal hydride-based compressors; however, discovering or optimizing low-stability metal hydrides that can pressurize hydrogen upward of 1000 bar is difficult, both with respect to computational predictions and experimental validation. Here, in this study, we (1) demonstrate that simple machine learning-derived design rules can inform the rational design of alloying strategies yielding low-stability hydrides, (2) validate their experimental pressure–composition–temperature (PCT) isotherms up to 875 bar, and (3) utilize a dynamic system-level model of a metal hydride compressor design to evaluate their performance under realistic operating conditions. Importantly, this analysis yields predicted operational efficiencies of both 2-stage (90–875 bar) and 3-stage (20–875 bar) metal hydride compressors to enable further evaluation of this technology and its techno-economic outlook.

alloy optimization↗
DOE OSTI2022

A compact x-ray diffraction system for dynamic compression experiments on pulsed-power generators

Pulsed-power generators can produce well-controlled continuous ramp compression of condensed matter for high-pressure equation-of-state studies using the magnetic loading technique. X-ray diffraction (XRD) data from dynamically compressed samples provide direct measurements of the elastic compression of the crystal lattice, onset of plastic flow, strength–strain rate dependence, structural phase transitions, and density of crystal defects, such as dislocations. Here, we present a cost-effective, compact, pulsed x-ray source for XRD measurements on pulsed-power-driven ramp-loaded samples. This combination of magnetically driven ramp compression of materials with a single, short-pulse XRD diagnostic will be a powerful capability for the dynamic materials’ community to investigate in situ dynamic phase transitions critical to equation of states. Finally, we present results using this new diagnostic to evaluate lattice compression in Zr and Al and to capture signatures of phase transitions in CdS.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Three-dimensional full-field velocity measurements in shock compression experiments using stereo digital image correlation

Shock compression plate impact experiments conventionally rely on point-wise velocimetry measurements based on laser-based interferometric techniques. This study presents an experimental methodology to measure the free surface full-field particle velocity in shock compression experiments using high-speed imaging and three-dimensional (3D) digital image correlation (DIC). The experimental setup has a temporal resolution of 100 ns with a spatial resolution varying from 90 to 200 μm/pixel. Experiments were conducted under three different plate impact configurations to measure spatially resolved free surface velocity and validate the experimental technique. First, a normal impact experiment was conducted on polycarbonate to measure the macroscopic full-field normal free surface velocity. Second, an isentropic compression experiment on Y-cut quartz–tungsten carbide assembly is performed to measure the particle velocity for experiments involving ramp compression waves. To explore the capability of the technique in multiaxial loading conditions, a pressure shear plate impact experiment was conducted to measure both the normal and transverse free surface velocities under combined normal and shear loading. The velocities measured in the experiments using digital image correlation are validated against previous data obtained from laser interferometry. Numerical simulations were also performed using established material models to compare and validate the experimental velocity profiles for these different impact configurations. The novel ability of the employed experimental setup to measure full-field free surface velocities with high spatial resolutions in shock compression experiments is demonstrated for the first time in this work.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Static and shock compression studies of eutectic high-entropy alloy AlCoCrFeNi 2.1 to ultrahigh pressures

The high-entropy alloy with composition AlCoCrFeNi 2.1 , additively manufactured with the laser powder-bed fusion technique, has a far-from-equilibrium BCC/FCC eutectic nanolamellar structure. We studied the high-pressure response of this alloy under both static compression and high-strain rate shock compression. The response to static compression using a diamond anvil cell was studied at pressures up to 302 GPa with synchrotron x-ray diffraction at the advanced photon source. The high-pressure FCC-only phase of the EHEA previously observed by Pope et al. [AIP Adv. 13, 035124 (2023)] is found to be stable up to the highest pressure achieved in this study with a volume compression of V/V 0 = 0.587 at ambient temperature. The shock experiments were performed by using GEKKO XII lasers at the Institute of Laser Engineering, Osaka University. The principal Hugoniot equation-of-state of the EHEA was measured up to a pressure of 515 GPa and a compression of V/V 0 = 0.613. Additionally, the thermal equation of state of the EHEA was measured up to 6.2 GPa and 1623 K using a large-volume Paris–Edinburgh cell to obtain the temperature dependence of bulk modulus and thermal expansion coefficients. The melting temperature for EHEA AlCoCrFeNi 2.1 at a pressure of 5.6 GPa was measured to be 1648 ± 25 K. These results can be used to refine stochastic (or special) quasi-random structure (SQS) models for high-pressure high-temperature behavior of high-entropy alloys.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Shock compression experiments using the DiPOLE 100-X laser on the high energy density instrument at the European x-ray free electron laser: Quantitative structural analysis of liquid Sn

X-ray free electron laser (XFEL) sources coupled to high-power laser systems offer an avenue to study the structural dynamics of materials at extreme pressures and temperatures. The recent commissioning of the DiPOLE 100-X laser on the high energy density (HED) instrument at the European XFEL represents the state-of-the-art in combining x-ray diffraction with laser compression, allowing for compressed materials to be probed in unprecedented detail. Here, we report quantitative structural measurements of molten Sn compressed to 85(5) GPa and ~3500 K. The capabilities of the HED instrument enable liquid density measurements with an uncertainty of ~1% at conditions which are extremely challenging to reach via static compression methods. We discuss best practices for conducting liquid diffraction dynamic compression experiments and the necessary intensity corrections which allow for accurate quantitative analysis. We also provide a polyimide ablation pressure vs input laser energy for the DiPOLE 100-X drive laser which will serve future users of the HED instrument.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Investigation of fast and efficient lossless compression algorithms for macromolecular crystallography experiments

Structural biology experiments benefit significantly from state-of-the-art synchrotron data collection. One can acquire macromolecular crystallography (MX) diffraction data on large-area photon-counting pixel-array detectors at framing rates exceeding 1000 frames per second, using 200 Gbps network connectivity, or higher when available. In extreme cases this represents a raw data throughput of about 25 GB s −1 , which is nearly impossible to deliver at reasonable cost without compression. Our field has used lossless compression for decades to make such data collection manageable. Many MX beamlines are now fitted with DECTRIS Eiger detectors, all of which are delivered with optimized compression algorithms by default, and they perform well with current framing rates and typical diffraction data. However, better lossless compression algorithms have been developed and are now available to the research community. Here one of the latest and most promising lossless compression algorithms is investigated on a variety of diffraction data like those routinely acquired at state-of-the-art MX beamlines.

36 MATERIALS SCIENCE↗
DOE OSTI2022

OptZConfig: Efficient Parallel Optimization of Lossy Compression Configuration

Lossless compressors have very low compression ratios that do not meet the needs of today's large-scale scientific applications that produce vast volumes of data. Error-bounded lossy compression (EBLC) is considered a critical technique for the success of scientific research. Although EBLC allows users to set an error bound for the compression, users have been unable to specify the requirements on the compression quality, limiting practical use. Our contributions are: (1) We formulate the problem of configuring EBLC to preserve a user-defined metric as an optimization problem. This allows many classes of new metrics to be preserved, which improves over current practices. (2) We present a framework, OptZConfig, that can adapt to improvements in the search algorithm, compressor, and metrics with minimal changes, enabling future advancements in this area. (3) We demonstrate the advantages of our approach against the leading methods to configure compressors to preserve specific metrics. Here, our approach improves compression ratios against a specialized compressor by up to 3 x, has a 56x speedup over FRaZ, 1000x speedup over MGARD-QOI post tuning, and 110x speedup over systematic approaches which had not been bounded by compressors before.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

TopoSZ: Preserving Topology in Error-Bounded Lossy Compression

Existing error-bounded lossy compression techniques control the pointwise error during compression to guarantee the integrity of the decompressed data. However, they typically do not explicitly preserve the topological features in data. When performing post hoc analysis with decompressed data using topological methods, preserving topology in the compression process to obtain topologically consistent and correct scientific insights is desirable. In this paper, we introduce TopoSZ, an error-bounded lossy compression method that preserves the topological features in 2D and 3D scalar fields. Specifically, we aim to preserve the types and locations of local extrema as well as the level set relations among critical points captured by contour trees in the decompressed data. The main idea is to derive topological constraints from contour-tree-induced segmentation from the data domain, and incorporate such constraints with a customized error-controlled quantization strategy from the SZ compressor (version 1.4). In conclusion, our method allows users to control the pointwise error and the loss of topological features during the compression process with a global error bound and a persistence threshold.

97 MATHEMATICS AND COMPUTING↗