Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Compression Ratio”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

To what extent can space be compressed? Bandwidth limits of spaceplates

Spaceplates are novel flat-optic devices that implement the optical response of a free-space volume over a smaller length, effectively “compressing space” for light propagation. Together with flat lenses such as metalenses or diffractive lenses, spaceplates have the potential to enable the miniaturization of any free-space optical system. While the fundamental and practical bounds on the performance metrics of flat lenses have been well studied in recent years, a similar understanding of the ultimate limits of spaceplates is lacking, especially regarding the issue of bandwidth, which remains as a crucial roadblock for the adoption of this platform. In this work, we derive fundamental bounds on the bandwidth of spaceplates as a function of their numerical aperture and compression ratio (ratio by which the free-space pathway is compressed). The general form of these bounds is universal and can be applied and specialized for different broad classes of space-compression devices, regardless of their particular implementation. Our findings also offer relevant insights into the physical mechanism at the origin of generic space-compression effects and may guide the design of higher performance spaceplates, opening new opportunities for ultra-compact, monolithic, planar optical systems for a variety of applications.

Shastri, Kunal (ORCID:0000000169282753)↗
DOE OSTI2024

Identifying Outliers in AI-based Image Compression

Image compression using artificial intelligence (AI) is becoming increasingly prevalent across various fields, including scientific research. Scientific instruments can generate hundreds of images per second, and effectively compressing these images with high compression ratios is crucial for facilitating scientific discoveries. However, automatically detecting outlier cases, where compression may not have succeeded or where interesting scientific phenomena are present, poses a significant challenge. To address this, we have developed a methodology based on unsupervised machine learning techniques for detecting outlier compressed images. This methodology utilizes metrics such as peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), structural texture similarity index measure (STSIM), and deep image and structural texture similarity index (DISTS). We have evaluated our methodology on several unlabeled datasets, including microscopy and x-ray images, and have successfully identified multiple outlier images using our proposed approach. Furthermore, our approach has enabled us to identify image semantics that are valuable for post-experiment analysis by scientists.

Data Analysis↗
DOE OSTI2020

TuckerMPI: A Parallel C++/MPI Software Package for Large-scale Data Compression via the Tucker Tensor Decomposition

With this study, our goal is compression of massive-scale grid-structured data, such as the multi-terabyte output of a high-fidelity computational simulation. For such data sets, we have developed a new software package called TuckerMPI, a parallel C++/MPI software package for compressing distributed data. The approach is based on treating the data as a tensor, i.e., a multidimensional array, and computing its truncated Tucker decomposition, a higher-order analogue to the truncated singular value decomposition of a matrix. The result is a low-rank approximation of the original tensor-structured data. Compression efficiency is achieved by detecting latent global structure within the data, which we contrast to most compression methods that are focused on local structure. In this work, we describe TuckerMPI, our implementation of the truncated Tucker decomposition, including details of the data distribution and in-memory layouts, the parallel and serial implementations of the key kernels, and analysis of the storage, communication, and computational costs. We test the software on 4.5 and 6.7 terabyte data sets distributed across 100 s of nodes (1,000 s of MPI processes), achieving compression ratios between 100 and 200,000×, which equates to 99--99.999% compression (depending on the desired accuracy) in substantially less time than it would take to even read the same dataset from a parallel file system. Moreover, we show that our method also allows for reconstruction of partial or down-sampled data on a single node, without a parallel computer so long as the reconstructed portion is small enough to fit on a single machine, e.g., in the instance of reconstructing/visualizing a single down-sampled time step or computing summary statistics. The code is available at https://gitlab.com/tensors/TuckerMPI.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Multi-millijoule hollow-core fiber compression of short-wave infrared pulses to a single cycle

Approaches for efficient pulse compression can enable dramatic increases in the available peak power, as well as enable the generation of isolated attosecond X-ray pulses. Achieving high compression ratios for longer wavelength drivers has, however, been challenging. We present the compression of few-cycle 2.1 µm central wavelength short-wave infrared laser pulses to 6.9 fs with 2.35 mJ pulse energy at a 10 kHz repetition rate. Electric field resolved measurements reveal a single cycle light field oscillation. With a carrier-envelope-phase stability of 131 mrad and average power fluctuations below 1 %, the system constitutes an excellent light source for strong-field experiments and attosecond physics.

Blöchl, Johannes [Ludwig Maximilian Univ. of Munic↗
DOE OSTI2023

AMRIC: A Novel In Situ Lossy Compression Framework for Efficient I/O in Adaptive Mesh Refinement Applications

As supercomputers advance towards exascale capabilities, computational intensity increases significantly, and the volume of data requiring storage and transmission experiences exponential growth. Adaptive Mesh Refinement (AMR) has emerged as an effective solution to address these two challenges. Concurrently, error-bounded lossy compression is recognized as one of the most efficient approaches to tackle the latter issue. Despite their respective advantages, few attempts have been made to investigate how AMR and error-bounded lossy compression can function together. To this end, this study presents a novel in-situ lossy compression framework that employs the HDF5 filter to improve both I/O costs and boost compression quality for AMR applications. We implement our solution into the AMReX framework and evaluate on two real-world AMR applications, Nyx and WarpX, on the Summit supercomputer. Experiments with 512 cores demonstrate that AMRIC improves the compression ratio by 81X and the I/O performance by 39X over AMReX's original compression solution.

Wang, Daoce↗
DOE OSTI2020

Deep learning for in situ data compression of large turbulent flow simulations

As the size of turbulent flow simulations continues to grow, in situ data compression is becoming increasingly important for visualization, analysis, and restart checkpointing. For these applications, single-pass compression techniques with low computational and communication overhead are crucial. In this paper we present a deep-learning approach to in situ compression using an autoencoder architecture that is customized for three-dimensional turbulent flows and is well suited for contemporary heterogeneous computing resources. The autoencoder is compared against a recently introduced randomized single-pass singular value decomposition (SVD) for three different canonical turbulent flows: decaying homogeneous isotropic turbulence, a Taylor-Green vortex, and turbulent channel flow. Our proposed fully convolutional autoencoder architecture compresses turbulent flow snapshots by a factor of 64 with a single pass, allows for arbitrarily sized input fields, is cheaper to compute than the randomized single-pass SVD for typical simulation sizes, performs well on unseen flow configurations, and has been made publicly available. The results reported here show that the autoencoder dramatically outperforms a randomized single-pass SVD with similar compression ratio and yields comparable performance to a higher-rank decomposition with an order of magnitude less compression in regard to preserving a number of important statistical quantities such as turbulent kinetic energy, enstrophy, and Reynolds stresses.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

AEflow (Autoencoder fluid flow compression network) [SWR-22-29]

As the size of turbulent flow simulations continues to grow, in situ data compression is becoming increasingly important for visualization, analysis, and restart checkpointing. For these applications, single-pass compression techniques with low computational and communication overhead are crucial. In this paper we present a deep-learning approach to in situ compression using an autoencoder architecture that is customized for three-dimensional turbulent flows and is well suited for contemporary heterogeneous computing resources. The autoencoder is compared against a recently introduced randomized single-pass singular value decomposition (SVD) for three different canonical turbulent flows: decaying homogeneous isotropic turbulence, a Taylor-Green vortex, and turbulent channel flow. Our proposed fully convolutional autoencoder architecture compresses turbulent flow snapshots by a factor of 64 with a single pass, allows for arbitrarily sized input fields, is cheaper to compute than the randomized single-pass SVD for typical simulation sizes, performs well on unseen flow configurations, and has been made publicly available. The results reported here show that the autoencoder dramatically outperforms a randomized single-pass SVD with similar compression ratio and yields comparable performance to a higher-rank decomposition with an order of magnitude less compression in regard to preserving a number of important statistical quantities such as turbulent kinetic energy, enstrophy, and Reynolds stresses.

King, Ryan↗
DOE OSTI2020

Equation of state of hot, dense magnesium derived with first-principles computer simulations

Using two first-principles computer simulation techniques, path integral Monte Carlo and density functional theory molecular dynamics, we derive the equation of state of magnesium in the regime of warm dense matter, with densities ranging from 0.43 to 86.11 g cm –3 and temperatures from 20,000 K to 5×10 8 K. These conditions are relevant for the interiors of giant planets and stars as well as for shock compression measurements and inertial confinement fusion experiments. Here, we study ionization mechanisms and the electronic structure of magnesium as a function of density and temperature. We show that the L shell electrons, 2s and 2p energy bands, merge at high densities. This results in gradual ionization of the L-shell with increasing density and temperature. In this regard, Mg differs from MgO, which is also reflected in the shape of its principal shock Hugoniot curve. For Mg, we predict a single broad pressure-temperature region, where the shock compression ratio is approximately 4.9. Mg thus differs from Si and Al plasmas that exhibit two well-separated compression maxima on the Hugoniot curve for L and K shell ionizations. Finally, we study multiple shocks and effects of preheat and precompression.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

A 28 nm multiply-accumulate ASIC architecture for on-chip data compression in MHz frame rate X-ray and electron pixel detectors

Modern X-ray detector systems urgently require compact, efficient, and fast data compression schemes to handle the transmission of big data from pixel arrays, enabling frame rates in the MHz regime. Here, in this work, a data compression ASIC that implements a streaming fixed-length lossy compression scheme is introduced and analyzed, proving the feasibility and benefits of on-chip compression. The compression scheme utilizes a vector matrix product logic, which performs a number of floating-point multiplications, additions, and accumulations. The logic is verified, synthesized, and shown to fit in the area resource available for the X-ray detector under study, which comprises 192 × 168 pixels each of 12-bit width, and having a total area of 20 mm× 20 mm, about 2 mm× 20 mm of which are available for the digital logic. Several system architectures, precisions, and compression ratios ranging from 100 to 250 were analyzed to pave the way for on-chip fixed-length compression (e.g., principal component analysis, singular value decomposition) and data reduction (e.g., azimuthal integration) for X-ray and electron detectors.

Data compression↗
DOE OSTI2023

Genetic algorithm optimization of a chemical kinetic mechanism for propane at engine relevant conditions

Propane has demonstrated significant potential for reductions in greenhouse gas and pollutant emissions in medium- and heavy-duty engine applications, but further improvements require accurate, compact, and scalable chemical kinetic mechanisms to design the next generation of propane fueled engines, particularly at the boosted operating conditions necessary to meet the power density demand of medium- and heavy-duty applications. In this work, six key chemical reactions were identified in a reduced mechanism with 70 species and 352 reactions through a sensitivity analysis performed at conditions typical of thermodynamic trajectories observed in a high compression ratio, long stroke engine operated on propane from throttled to boosted operating conditions. While the original mechanism was validated against rapid compression machine (RCM) data, it was found to overpredict experimental autoignition tendencies in 2-zone, 0-D SI engine simulations performed in Chemkin Pro. Subsequently, a genetic algorithm approach was used to optimize the six reaction rate parameters within established uncertainty bounds by performing RCM simulations and comparing to two independent sets of literature ignition delay times for propane, thus generating two new kinetic mechanisms. The first optimization achieved a mean absolute percent error (MPE) reduction in 2nd stage ignition delay of 61.4% in seven generations, while the second optimization utilized a newer experimental RCM dataset, and achieved MPE reduction of 56.7% in seven generations, and further marginal improvement to 57.8% reduction in 34 generations. Finally, the two mechanisms were then evaluated again in the 2-zone 0-D SI engine model in Chemkin Pro comparing typical mean and knocking cycle trajectories, and it was found that the second optimized mechanism provided better prediction of knock onset at the representative conditions evaluated in this work, particularly for higher load operating conditions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Quasi-static magnetic compression of field-reversed configuration plasma: amended scalings and limits from two-dimensional MHD equilibrium

In this work, several key scaling laws of the quasi-static magnetic compression of field reversed configuration (FRC) plasma (Spencer et al 1983 Phys. Fluids 26 1564) are amended from a series of two-dimensional FRC MHD equilibriums numerically obtained using the Grad–Shafranov equation solver NIMEQ. Based on the new scaling for the elongation and the magnetic fields at the separatrix and the wall, the empirically stable limits for the compression ratio, the fusion gain, and the neutron yield are evaluated, which may serve as a more accurate estimate for the upper ceiling of performance from the magnetic compression of FRC plasma as a potential fusion energy as well as neutron source devices.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Stable compression of a spherical tokamak plasma

In this study, an analysis of toroidal plasma compression by a collapsing flux conserver reveals linearly stable scenarios of operation to high compression ratios. The resistive and ideal MHD stability is calculated in full toroidal geometry using the asymptotic matching method in realistic conditions. A time dependent MHD simulation of the compression is conducted to confirm the conservation principles used to calculate the equilibrium states for the analysis. The near edge current profile, controlled by toroidal field ramping during compression, is shown to be critical to stability due to coupling between poloidal components of the least stable mode. Two cases with slight differences in edge current are examined, one with a stable corridor to high compression and one without.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Cyclobutanedicarboxylate Metal–Organic Frameworks as a Platform for Dramatic Amplification of Pore Partition Effect

Ultrafine tuning of MOF structures at sub-angstrom or picometer levels can help improve separation selectivity for gases with subtle differences. However, for MOFs with large-enough pore size, the effect from ultrafine tuning on sorption can be muted. Here we show an integrative strategy that couples together extreme pore compression with ultrafine pore tuning. Furthermore, this strategy is made possible by unique combination of two features of the pacs platform (pacs = partitioned acs): multi-modular framework and exceptional tolerance towards isoreticular replacement. Specifically, we use one module (Ligand 1, L1) to shrink pore size to an extreme minimum on pacs. A compression ratio of about 30% was achieved (based on unit-cell c/a ratio) from prototypical 1,4-benzenedicarboxylate-pacs to trans-1,3-cyclobutanedicarboxylate-pacs. This is followed by using another module (Ligand 2, L2) for ultrafine pore tuning (< 3% compression). This L1-L2 strategy increases C 2 H 2 /CO 2 selectivity from 2.6 to 20.8 and gives rise to excellent experi-mental breakthrough performance. Being the shortest cyclic dicarboxylate that mimics para-benzene-based moieties us-ing bioisosteric (BIS) strategy on pacs, trans-1,3-cyclobutanedicarboxylate-based MOF chemistry offers new opportuni-ties in MOF chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Invariant regimes of Spencer scaling law for magnetic compression of rotating FRC plasma

Abstract The scaling laws for the magnetic compression of a toroidally rotating field reversed configuration (FRC) have been investigated in this work. The magnetohydrodynamics (MHD) simulations of the magnetic compression on rotating FRCs employing the NIMROD code (Sovinec et al 2004 J. Comput. Phys. 195 355), are compared with the Spencer’s one-dimensional (1D) theory (Spencer et al 1983 Phys. Fluids 26 1564) for a wide range of initial flow speeds and profiles. The toroidal flow can influence the scalings directly through the alteration of the compressional work as also evidenced in the 1D adiabatic model, and indirectly by reshaping the initial equilibrium. However, in comparison to the static initial FRC equilibrium cases, the pressure and the radius scalings remain invariant for the magnetic compression ratio B w 2 / B w 1 up to 6 in presence of the initial equilibrium flow, suggesting a broader applicable regime of the Spencer scaling law for FRC magnetic compression. The invariant scaling has been proven a natural consequence of the conservation of angular momentum of both fluid and magnetic field during the dynamic compression process.

Ma, Yiming↗
DOE OSTI2024

A High-Quality Workflow for Multi-Resolution Scientific Data Reduction and Visualization

Multi-resolution methods such as Adaptive Mesh Refinement (AMR) can enhance storage efficiency for HPC applications generating vast volumes of data. However, their applicability is limited and cannot be universally deployed across all applications. Furthermore, integrating lossy compression with multi-resolution techniques to further boost storage efficiency encounters significant barriers. To this end, we introduce an innovative workflow that facilitates high-quality multi-resolution data compression for both uniform and AMR simulations. Initially, to extend the usability of multi-resolution techniques, our workflow employs a compression-oriented Region of Interest (ROI) extraction method, transforming uniform data into a multi-resolution format. Subsequently, to bridge the gap between multi-resolution techniques and lossy compressors, we optimize three distinct compressors, ensuring their optimal performance on multi-resolution data. These optimizations can improve the compression ratio of SOTA approaches by up to 3.3× under the same data quality loss. Lastly, we incorporate an advanced uncertainty visualization method into our workflow to understand the potential impacts of lossy compression. Experimental evaluation demonstrates that our workflow achieves significant compression quality improvements.

Wang, Daoce↗
DOE OSTI2020

Achieving Diesel-Like Efficiency in a High Stroke-to-Bore Ratio DISI Engine under Stoichiometric Operation

This work explores pathways to achieve diesel-like, high-efficiency combustion with stoichiometric 3-way catalyst compatible spark ignition (SI). A high stroke-to-bore engine design (1.5:1) with cooled exhaust gas recirculation (EGR) and high compression ratio (r c ) was used to improve engine efficiency by up to 30% compared with a production turbocharged gasoline direct injection spark ignition engine. To achieve efficiency improvements, engine experiments were coupled with computational fluid dynamics simulations to guide and explain experimental trends between the original engine and the high stroke-to-bore ratio design (1.5:1). The effects of EGR and late intake valve closing (IVC) and fuel characteristics are investigated through their effects on knock mitigation. Direct injection of 91 RON E10 gasoline, 99 RON E0 gasoline, and liquified petroleum gas (i.e., propane/autogas) were evaluated with geometric rc ranging from 13.3:1 to 16.8:1. Finally, engine experiments demonstrated 47% gross thermal efficiency, and 45% net thermal efficiency at stoichiometric engine operation, at up to 17 bar IMEP and 2000 r/min with 16.8:1 rc.

42 ENGINEERING↗
DOE OSTI2023

zPerf: A Statistical Gray-Box Approach to Performance Modeling and Extrapolation for Scientific Lossy Compression

With the scaling up of simulation-based scientific discovery on high-performance computing systems, the disparity between compute and I/O has increased, forcing domain scientists to save only a small amount of simulation data to persistent storage. This can result in the loss of essential physics fields that are needed for data analysis. While error-bounded lossy compression has made tremendous progress in bridging the gap between compute and I/O, the lack of understanding of compression performance remains a key hurdle to its wide adoption. Here, in this work, we present zPerf, a statistical gray-box performance modeling approach for scientific lossy compression. Our contributions are threefold: 1) We develop zPerf to estimate the performance of lossy compression techniques, based on in-depth understanding and statistical modeling for data features and core compression metrics; 2) We demonstrate the in-detailed implementation of zPerf using two case studies, where we derive the performance modeling for SZ and ZFP, two leading lossy compressors; 3) We evaluate the effectiveness of zPerf on real-world datasets across various domains. Based on the evaluation, we demonstrate the efficacy of the zPerf performance model; 4) We further discuss three case studies where zPerf is applied to extrapolate the compression ratio of SZ and ZFP with alternative encoding schemes as well as ZFP with an alternative transform scheme. Through the case studies, we demonstrate the potential of zPerf for exploring the design space of lossy compression, which has hardly been studied in the literature.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Fast 2D Bicephalous Convolutional Autoencoder for Compressing 3D Time Projection Chamber Data

High-energy large-scale particle colliders produce data at high speed in the order of 1 terabytes per second in nuclear physics and petabytes per second in high energy physics. Developing real-time data compression algorithms to reduce such data at high throughput to fit permanent storage has drawn increasing attention. Specifically, at the newly constructed sPHENIX experiment at the Relativistic Heavy Ion Collider (RHIC), a time projection chamber is used as the main tracking detector, which records particle trajectories in a volume of three-dimensional (3D) cylinder. The resulting data are usually very sparse with occupancy around 10.8%. Such sparsity presents a challenge to conventional learning-free lossy compression algorithms, such as SZ, ZFP, and MGARD. The 3D convolutional neural network (CNN)-based approach, Bicephalous Convolutional Autoencoder (BCAE), outperforms traditional methods both in compression rate and reconstruction accuracy. BCAE can also utilize the computation power of graphical processing units suitable for deployment in a modern heterogeneous highperformance computing environment. This work introduces two BCAE variants: BCAE++ and BCAE-2D. BCAE++ achieves a 15% better compression ratio and a 77% better reconstruction accuracy measured in mean absolute error compared with BCAE. BCAE-2D treats the radial direction as the channel dimension of an image, resulting in a 3× speedup in compression throughput. In addition, we demonstrate an unbalanced autoencoder with a larger decoder can improve reconstruction accuracy without significantly sacrificing throughput. Lastly, we observe both the BCAE++ and BCAE-2D can benefit more from using half-precision mode in throughput (76 - 79% increase) without loss in reconstruction accuracy. The source code and links to data and pretrained models can be found at https://github.com/BNL-DAQ-LDRD/NeuralCompression_v2

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗