Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

First test results of the HGCAL concentrator ASICs: ECON-T and ECON-D

With over 6 million channels, the High Granularity Calorimeter for the CMS HL-LHC upgrade presents a unique data transmission challenge. The ECON ASICs provide a critical stage of on-detector data compression and selection for the trigger path (ECON-T) and data acquisition path (ECON-D) of the HGCAL. The ASICs, fabricated in 65 nm CMOS, are radiation tolerant up to 200 Mrad and require low power consumption: < 2.5 mW/sensor-channel per chip. Here, we report on the first functionality and radiation tests for the ECON-D-P1 full-functionality prototype. We present a comparison of single event effect (SEE) cross sections measured for different methods of triple modular redundancy using test results from the ECON-T-P1 full-functionality prototype.

47 OTHER INSTRUMENTATION↗

OVERVIEW OF THE KEPLER SCIENCE PROCESSING PIPELINE

The Kepler Mission Science Operations Center (SOC) performs several critical functions including managing the {approx}156,000 target stars, associated target tables, science data compression tables and parameters, as well as processing the raw photometric data downlinked from the spacecraft each month. The raw data are first calibrated at the pixel level to correct for bias, smear induced by a shutterless readout, and other detector and electronic effects. A background sky flux is estimated from {approx}4500 pixels on each of the 84 CCD readout channels, and simple aperture photometry is performed on an optimal aperture for each star. Ancillary engineering data and diagnostic information extracted from the science data are used to remove systematic errors in the flux time series that are correlated with these data prior to searching for signatures of transiting planets with a wavelet-based, adaptive matched filter. Stars with signatures exceeding 7.1{sigma} are subjected to a suite of statistical tests including an examination of each star's centroid motion to reject false positives caused by background eclipsing binaries. Physical parameters for each planetary candidate are fitted to the transit signature, and signatures of additional transiting planets are sought in the residual light curve. The pipeline is operational, finding planetary signatures and providing robust eliminations of false positives.

79 ASTRONOMY AND ASTROPHYSICS↗

Shock-Induced Solid-State Reactions in Powders: An Experimentally-Based Reassessment

We have performed a series of ten planar impact experiments on six different materials, including certain reactive powders and two inert materials, using Sandia's 89 - mm powder gun at the STAR facility. Time - resolved particle - velocity histories were determined during each of the experiments from one or more VISAR measurements. We have analyzed the results of these measurements 1) by using jump conditions to determine shock and first reshock states and 2) by comparing measured particle velocity histories to synthetic histories predicted by one - dimensional computational analyses using the CTH shock physics code with various models for inert and reactive materials . These comparisons are consistent with the conclusion for these particular reactive powders, that for the duration of shock loading either 1) there is insignificant reaction or 2) the products of any reaction are indistinguishable from the reactants under the experimental conditions. Shock and reshock states were extracted for shock pressures between 5 and 40 GPa. Densities were at or greater than the theoretical maximum zero - pressure density of the starting mixture. This result would be expected if there were no reaction or negligible reaction for the first two shock states. Two experiments were performed on one reactive powder in a "ring - down " geometry to look for evidence of vapor production on pressure release. In both cases, the measured velocity continued to increase slowly over a period of microseconds for the du ration of the experiment. This observation suggests that vapor is produced along the release path, but information about the mechanism for vapor production cannot be extracted from these data. While it is possible that vapor is produced by a shock - induced reaction involving more than one of the original constituents, a simpler interpretation is that the vapor is made up of products of shock - induced decomposition reactions and/or simple vaporization of the constituents as would be expected to take place under the conditions of these experiments. Other sources of vapor could be water adsorbed on grain surfaces and air originally in the voids. Thus it is not necessary to invoke significant recombination reactions to explain the data. However, in the absence of ring - down control experiments, the possibility remains open. These conclusions are different from those of previous workers, but reassessment of a subset of the earlier data yields results consistent with the present work, i.e., the shock compression data do not provide evidence for strong exothermic reactions.

36 MATERIALS SCIENCE↗

The impact of the fiducial cosmology assumption on BAO distance scale measurements

ABSTRACT Standard analysis pipelines for measurements of Baryon Acoustic Oscillations (BAO) in galaxy surveys make use of a fiducial cosmological model to guide the data compression required to transform from observed redshifts and angles to the measured angular and radial BAO peak positions. In order to remove any dependence on the fiducial cosmology from the results, all models compared to the data should mimic the compression and its dependence on the fiducial model. In practice, approximations are made when testing models: (1) There is assumed to be no residual dependence on the fiducial cosmology after reconstruction, (2) differences in the distance–redshift relationship are assumed to match a linear scaling, and (3) differences in clustering between true and fiducial models are assumed to be removed by the free parameters used to null the non-BAO signal. We test these approximations using the current standard measurement procedure with a set of halo catalogues from the aemulus suite of N-body simulations, which span a range of wCDM cosmological models. We focus on reconstruction of the primordial BAO and locating the BAO. For the range of wCDM cosmologies covered by the aemulus suite, we find no evidence for systematic errors in the measured BAO shift parameters α∥ and α⊥ to $\lt 0.1\%$. However, the measured errors $\sigma _{\alpha _{\parallel }}$ and $\sigma _{\alpha _{\bot }}$ show a notable absolute increase by up to +0.001 and +0.002, respectively, in the case that the fiducial cosmology does not match the truth. These effects on the inferred BAO scale will be important, given the precision of measurements expected from future surveys including DESI, Euclid, and WFIRST.

79 ASTRONOMY AND ASTROPHYSICS↗

AEflow (Autoencoder fluid flow compression network) [SWR-22-29]

As the size of turbulent flow simulations continues to grow, in situ data compression is becoming increasingly important for visualization, analysis, and restart checkpointing. For these applications, single-pass compression techniques with low computational and communication overhead are crucial. In this paper we present a deep-learning approach to in situ compression using an autoencoder architecture that is customized for three-dimensional turbulent flows and is well suited for contemporary heterogeneous computing resources. The autoencoder is compared against a recently introduced randomized single-pass singular value decomposition (SVD) for three different canonical turbulent flows: decaying homogeneous isotropic turbulence, a Taylor-Green vortex, and turbulent channel flow. Our proposed fully convolutional autoencoder architecture compresses turbulent flow snapshots by a factor of 64 with a single pass, allows for arbitrarily sized input fields, is cheaper to compute than the randomized single-pass SVD for typical simulation sizes, performs well on unseen flow configurations, and has been made publicly available. The results reported here show that the autoencoder dramatically outperforms a randomized single-pass SVD with similar compression ratio and yields comparable performance to a higher-rank decomposition with an order of magnitude less compression in regard to preserving a number of important statistical quantities such as turbulent kinetic energy, enstrophy, and Reynolds stresses.

King, Ryan↗

Exacution: Enhancing Scientific Data Management for Exascale

As we continue toward exascale, scientific data volume is continuing to scale and becoming more burdensome to manage. In this paper, we lay out opportunities to enhance state of the art data management techniques. We emphasize well-principled data compression, and using it to achieve progressive refinement. This can both accelerate I/O and afford the user increased flexibility when she interacts with the data. The formulation naturally maps onto enabling partitioning of the progressively improving-quality representations of a data quantity into different media-type destinations, to keep the highest priority information as close as possible to the computation, and take advantage of deepening memory/storage hierarchies in ways not previously possible. Careful monitoring is requisite to our vision, not only to verify that compression has not eliminated salient features in the data, but also to better understand the performance of massively parallel scientific applications. Increased mathematical rigor would be ideal,to help bring compression on a better-understood theoretical footing, closer to the relevant scientific theory, more aware of constraints imposed by the science, and more tightly error-controlled. Throughout, we highlight pathfinding research we have begun exploring related these topics, and comment toward future work that will be needed.

97 MATHEMATICS AND COMPUTING↗

Dense nitrogen-rich energetic materials: A study of 5,5{sup ′}-(1H-tetrazolyl)amine

5,5{sup ′}-(1H-tetrazolyl)amine (BTA), a nitrogen rich molecular solid has been investigated under compression at room temperature. Powder x-ray diffraction using synchrotron radiation and micro-Raman spectroscopy were carried out to pressures up to 12.9 GPa. BTA conserves the crystalline structure of its room condition phase up to the highest pressure, i.e., an orthorhombic unit cell (Pbca). A fit of the isothermal compression data to the Birch-Murnaghan equation of state reveals the high compressibility of BTA. An analysis of the volume change with pressure yields a bulk modulus and its derivative similar to that of high-nitrogen content molecular crystals. Upon laser heating to approximately 1100 K, the sample decomposed while pressurized at 2.1 GPa, resulting in a graphitic compound. Finally, numerical simulations demonstrate that the minimum energy conformation is not experimentally observed since a higher energy conformation allows for a more stable dense packing of the BTA molecules.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Strong converse theorems using Rényi entropies

We use a Rényi entropy method to prove strong converse theorems for certain information-theoretic tasks which involve local operations and quantum (or classical) communication between two parties. These include state redistribution, coherent state merging, quantum state splitting, measurement compression with quantum side information, randomness extraction against quantum side information, and data compression with quantum side information. The method we employ in proving these results extends ideas developed by Sharma [preprint http://arxiv.org/abs/1404.5940 [quant-ph] (2014)], which he used to give a new proof of the strong converse theorem for state merging. For state redistribution, we prove the strong converse property for the boundary of the entire achievable rate region in the (e, q)-plane, where e and q denote the entanglement cost and quantum communication cost, respectively. In the case of measurement compression with quantum side information, we prove a strong converse theorem for the classical communication cost, which is a new result extending the previously known weak converse. For the remaining tasks, we provide new proofs for strong converse theorems previously established using smooth entropies. For each task, we obtain the strong converse theorem from explicit bounds on the figure of merit of the task in terms of a Rényi generalization of the optimal rate. Hence, we identify candidates for the strong converse exponents for each task discussed in this paper. To prove our results, we establish various new entropic inequalities, which might be of independent interest. These involve conditional entropies and mutual information derived from the sandwiched Rényi divergence. In particular, we obtain novel bounds relating these quantities, as well as the Rényi conditional mutual information, to the fidelity of two quantum states.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Kernelized approaches to streaming compression of scientific data

In this paper three algorithms are developed for the streaming compression of scientific data. The algorithms presented are reliant on the theory of vector-valued reproducing kernel Hilbert spaces and operator valued kernel. Further, the scientific data is modeled as a snapshot of time dependent vector field F(x, t) over a manifold M and the recovery of the data is framed as a learning problem. These processes are then appropriately modified and ana lyzed for the streaming scenario in which data is generated without the ability to revisit past entries.

97 MATHEMATICS AND COMPUTING↗

Ti-6Al-4V to over 1.2 TPa: Shock Hugoniot experiments, ab initio calculations, and a broad-range multiphase equation of state

Titanium alloys are used in a large array of applications. In this work we focus our attention on the most used alloy, Ti-6Al-4V (Ti64), which has excellent mechanical and biocompatibility properties with applications in aerospace, defense, biomedical, and other fields. Here we present high-fidelity experimental shock compression data measured on Sandia’s Z machine. We extend the principal shock Hugoniot for Ti64 to more than threefold compression, up to over 1.2 TPa. We use the data to validate our ab initio molecular dynamics simulations and to develop a highly reliable, multiphase equation of state (EOS) for Ti64, spanning a broad range of temperature and pressures. The first-principles simulations show very good agreement with Z data and with previous three-stage gas gun data from Sandia’s STAR facility. The resulting principal Hugoniot and the broad-range EOS and phase diagram up to 10 TPa and 10 5 K are suitable for use in shock experiments and in hydrodynamic simulations. The high-precision experimental results and high-fidelity simulations demonstrate that the Hugoniot of the Ti64 alloy is stiffer than that of pure Ti and reveal that Ti64 melts on the Hugoniot at a significantly lower pressure and temperature than previously modeled.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Experiences with making diffraction image data available: what metadata do we need to archive?

A local raw ‘diffraction data images’ archive was made available and some data sets were retrieved and reprocessed, which led to analysis of the anomalous difference densities of two partially occupied Cl atoms in cisplatin as well as a re-evaluation of the resolution cutoff in these diffraction data. General questions on storing raw data are discussed. It is also demonstrated that often one needs unambiguous prior knowledge to read the (binary) detector format and the setup of goniometer geometries. Recently, the IUCr (International Union of Crystallography) initiated the formation of a Diffraction Data Deposition Working Group with the aim of developing standards for the representation of raw diffraction data associated with the publication of structural papers. Archiving of raw data serves several goals: to improve the record of science, to verify the reproducibility and to allow detailed checks of scientific data, safeguarding against fraud and to allow reanalysis with future improved techniques. A means of studying this issue is to submit exemplar publications with associated raw data and metadata. In a recent study of the binding of cisplatin and carboplatin to histidine in lysozyme crystals under several conditions, the possible effects of the equipment and X-ray diffraction data-processing software on the occupancies and B factors of the bound Pt compounds were compared. Initially, 35.3 GB of data were transferred from Manchester to Utrecht to be processed with EVAL. A detailed description and discussion of the availability of metadata was published in a paper that was linked to a local raw data archive at Utrecht University and also mirrored at the TARDIS raw diffraction data archive in Australia. By making these raw diffraction data sets available with the article, it is possible for the diffraction community to make their own evaluation. This led to one of the authors of XDS (K. Diederichs) to re-integrate the data from crystals that supposedly solely contained bound carboplatin, resulting in the analysis of partially occupied chlorine anomalous electron densities near the Pt-binding sites and the use of several criteria to more carefully assess the diffraction resolution limit. General arguments for archiving raw data, the possibilities of doing so and the requirement of resources are discussed. The problems associated with a partially unknown experimental setup, which preferably should be available as metadata, is discussed. Current thoughts on data compression are summarized, which could be a solution especially for pixel-device data sets with fine slicing that may otherwise present an unmanageable amount of data.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Cinema:Snap: Real-time tools for analysis of dynamic diamond anvil cell experiment data

We report we developed tools and a workflow for real-time analysis of data from dynamic diamond anvil cell experiments performed at user light sources. These tools allow users to determine the phases of matter observed during the compression of materials in order to make decisions during an experiment to improve the quality of experimental results and maximize the use of scarce experimental facility time. The tools fill a gap in dynamic compression data analysis tools that are real-time, are flexible to the needs of high-pressure scientists, connect to automated processing of results, can be easily incorporated into workflows with existing tools and data formats, and support remote experimental data analysis workflows. Specific analytics developed include novel automated two-peak analysis for overlapping peaks and multiple phases, coordinated views of pressure and temperature values, full-compression contour plots, and configurable views of integrated x-ray diffraction. We present an experimental use case to show how the tools produce real-time analytics that help the scientists revise parameters for the next compression

47 OTHER INSTRUMENTATION↗

Machine Learning Techniques for Data Reduction of Climate Applications

Scientists conduct large-scale simulations to compute derived quantities-of-interest (QoI) from primary data. Often, QoI are linked to specific features, regions, or time intervals, such that data can be adaptively reduced without compromising the integrity of QoI. For many spatiotemporal applications, these QoI are binary in nature and represent presence or absence of a physical phenomenon. We present a pipelined compression approach that first uses neural-network-based techniques to derive regions where QoI are highly likely to be present. Then, we employ a Guaranteed Autoencoder (GAE) to compress data with differential error bounds. GAE uses QoI information to apply low-error compression to only these regions. This results in overall high compression ratios while still achieving downstream goals of simulation or data collections. Experimental results are presented for climate data generated from the E3SM Simulation model for downstream quantities such as tropical cyclone and atmospheric river detection and tracking. These results show that our approach is superior to comparable methods in the literature.

Li, Xiao [University of Florida]↗

Performance Optimization for Relative-Error-Bounded Lossy Compression on Scientific Data

Scientific simulations in high-performance computing (HPC) environments generate vast volume of data, which may cause a severe I/O bottleneck at runtime and a huge burden on storage space for postanalysis. Unlike traditional data reduction schemes such as deduplication or lossless compression, not only can error-controlled lossy compression significantly reduce the data size but it also holds the promise to satisfy user demand on error control. Pointwise relative error bounds (i.e., compression errors depends on the data values) are widely used by many scientific applications with lossy compression since error control can adapt to the error bound in the dataset automatically. Pointwise relative-error-bounded compression is complicated and time consuming. In this article, we develop efficient precomputation-based mechanisms based on the SZ lossy compression framework. Our mechanisms can avoid costly logarithmic transformation and identify quantization factor values via a fast table lookup, greatly accelerating the relative-error-bounded compression with excellent compression ratios. In addition, we reduce traversing operations for Huffman decoding, significantly accelerating the decompression process in SZ. Experiments with eight well-known real-world scientific simulation datasets show that our solution can improve the compression and decompression rates (i.e., the speed) by about 40 and 80 p, respectively, in most of cases, making our designed lossy compression strategy the best-in-class solution in most cases.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Efficient Lossy Compression for Scientific Data Based on Pointwise Relative Error Bound

An effective data compressor is becoming increasingly critical to today's scientific research, and many lossy compressors are developed in the context of absolute error bounds. Based on physical/chemical definitions of simulation fields or multiresolution demand, however, many scientific applications need to compress the data with a pointwise relative error bound (i.e., the smaller the data value, the smaller the compression error to tolerate). To this end, we propose two optimized lossy compression strategies under a state-of-the-art three-staged compression framework (prediction + quantization + entropy-encoding). The first strategy (called block-based strategy) splits the data set into many small blocks and computes an absolute error bound for each block, so it is particularly suitable for the data with relatively high consecutiveness in space. The second strategy (called multi-threshold-based strategy) splits the whole value range into multiple groups with exponentially increasing thresholds and performs the compression in each group separately, which is particularly suitable for the data with a relatively large value range and spiky value changes. We implement the two strategies rigorously and evaluate them comprehensively by using two scientific applications which both require lossy compression with point-wise relative error bound. Experiments show that the two strategies exhibit the best compression qualities on different types of data sets respectively. In conclusion, the compression ratio of our lossy compressor is higher than that of other state-of-the-art compressors by 17.2-618 percent on the climate simulation data and 30-210 percent on the N-body simulation data, with the same relative error bound and without degradation of the overall visualization effect of the entire data.

97 MATHEMATICS AND COMPUTING↗

Shock compression of poly(methyl methacrylate) PMMA in the 1000 GPa regime: Z machine experiments

Hydrocarbon polymers are used in a wide variety of practical applications. In the field of dynamic compression at extreme pressures, these polymers are used at several high energy density (HED) experimental facilities. One of the most common polymers is poly(methyl methacrylate) or PMMA, also called Plexiglass® or Lucite®. Here, we present high-fidelity, hundreds of GPa range experimental shock compression data measured on Sandia’s Z machine. We extend the principal shock Hugoniot for PMMA to more than threefold compression up to 650 GPa and re-shock Hugoniot states up to 1020 GPa in an off-Hugoniot regime, where experimental data are even sparser. These data can be used to put additional constraints on tabular equation of state (EOS) models. The present results provide clear evidence for the need to re-examine the existing tabular EOS models for PMMA above ~120 GPa as well as perhaps revisit EOSs of similar hydrocarbon polymers commonly used in HED experiments investigating dynamic compression, hydrodynamics, or inertial confinement fusion.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Kinetic and temperature sensitivity properties of soil exoenzymes through the soil profile down to one-meter depth at a temperate coniferous forest (Blodgett, CA)

This dataset contains data on kinetic and temperature sensitivity parameters of the exoenzymes β-glucosidase (BG), leucine/leucyl aminopeptidase (LAP) and acid phosphatase (AP) across a soil profile down to 90 cm depth at Blodgett forest, CA, USA. These data were generated to determine if kinetic and thermal properties of microbial exoenzymes involved in organic matter decomposition varied with soil depth, following variation in soil properties and microbial communities, as part of the study: Alves et al. (2021). Kinetic Properties of Microbial Exoenzymes Vary with Soil Depth but Have Similar Temperature Sensitivities Through the Soil Profile. Frontiers in Microbiology 12:3618. https://doi.org/10.3389/fmicb.2021.735282. This research was performed within the framework of the TES Belowground Biogeochemistry SFA project, in particular association with a long-term field warming experiment of the whole soil profile at Blodgett forest. Samples for this work were collected from locations representative of the field experimental plots. Potential enzyme activity rates were measured using laboratory fluorometric assays with soils collected at 0-10, 10-20, 30-40, 50-60, 60-70 and 80-90 cm deep in biological triplicates (i.e., three soil cores collected at different representative locations). Assays with each soil were conducted over a gradient of eight substrate concentrations per enzyme, and incubated at 4, 10, 16, 25, 35 or 50°C. Enzyme Michaelis-Menten kinetics were modeled over the eight substrate concentrations at each temperature, and the temperature sensitivity of the kinetic parameters was modeled over the six temperatures using linear Arrhenius/Q10 and non-linear Macromolecular Rate Theory (MMRT) models. The dataset includes the fully processed enzyme activity rate data used to model Michaelis-Menten kinetics, calculated kinetic and temperature sensitivity parameters, and basic soil and microbial biomass chemistry for each sample. All data is provided for each individual biological replicate, and kinetic and temperature sensitivity parameters are also provided as means of the biological replicates. The dataset also includes all raw measurement data and code used to parse, combine and perform the analyses described by Alves et al. (2021). For file descriptions, see the file-level metadata files: “enzymes_dataProcessed_flmd.xlsx” (processed data); “enzymes_dataRaw_flmd.xlsx” (compressed raw data and metadata); and “enzymes_code_flmd.xlsx” (compressed code). The experimental design, list of parameters measured, soil and microbial biomass chemistry data, and means of biological replicates for kinetic and temperature sensitivity parameters are also provided as human-readable tables in file “enzymeTraits_design_results_tables.xlsx”.

54 ENVIRONMENTAL SCIENCES↗