Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Argon equation of state data to 1 TPa: Shock compression experiments and simulations

Argon is the most abundant noble gas on Earth and its noble, atomic fluid nature makes it an excellent candidate for comparison of experiment and theory at extreme conditions. For this study, we performed a combined computational and experimental study on shock compressed cryogenic liquid argon. Using Sandia's Z machine, we shock compressed liquid argon to 600 GPa and reshock states up to 950 GPa. Laser shock experiments at the Omega Laser facility extend the principal Hugoniot to 1000 GPa and provided temperature data along the principal Hugoniot. The plate impact experiments and laser shock experiments used well-characterized impedance matching standards and demonstrate consistent results between the two platforms over a common range. Density functional theory based molecular dynamics simulations provided additional data on the Hugoniot to 600 GPa. The combined experimental data and simulation results provide constraints on the development of new equation of state models at extreme conditions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Delta-Rice: A HDF5 Compression Plugin optimized for Digitized Detector Data

Delta-Rice is an HDF5 (The HDF Group et al., 2020) filter plugin that was developed to compress digitized detector signals recorded by the Nab experiment (Fry et al., 2019), a fundamental neutron physics experiment. This is a two-step process where incoming data is passed through a pre-processing filter and then compressed with Rice coding. A routine for determining the optimal pre-processing filter for a dataset is provided along with an example GPU deployment. When applied to data collected by the Nab data acquisition system, this method produced output files 29% their initial size, and was able to do so with an average read/write throughput in excess of 2 GB/s on a single CPU. Compared to the widely used Gzip compression routine, Delta-Rice reduces the file size by 33% more with over an order of magnitude increase in read/write throughput. Delta-Rice is available on CPU to users through the HDF5 library.

97 MATHEMATICS AND COMPUTING↗

$\mathrm{UPDATED}$ $\mathrm{U3SI2}$ thermal creep model and sensitivity analysis of the $\mathrm{U3SI2-SIC}$ accident tolerant $\mathrm{FUEL}$

U 3 Si 2 is a candidate accident tolerant fuel (ATF) replacement for UO 2 . U 3 Si 2 ’s high uranium density and high thermal conductivity are favorable properties in steady-state and accident conditions. Low power performance of this U3Si2-SiC concept fuel is compared to that of UO 2 -Zr4 fuels by implementing models that describe the properties of U 3 Si 2 and SiC-SiC into Idaho National Laboratory's (INL) fuel performance code, BISON. Included in these material models is a thermal creep model for U 3 Si 2 based on compressive creep data. The simulated results are in keeping with community knowledge that the U 3 Si 2 -SiC concept fuel may serve as a replacement for UO 2 -Zr4 fuels during steady-state operation, provided the mSiC layer remains under compression. Through a moderate power history and three 24-month fuel cycles, the mSiC layer remains under compressive stress through a burnup of 80 MWd/kgU. During low power operation, failure of the mSiC layer generally occurs prior to significant thermal creep in U 3 Si 2 . Generally, U 3 Si 2 creep is temperature sensitive and of little importance at the temperatures and stresses simulated during steady operation and during fuel-to-cladding contact. A parameter variation study including 11,520 individual simulations with variations in nominal fuel thermal creep rate, cladding thermal conductivity, cladding irradiation creep and swelling, cladding gap size, and cladding thickness demonstrated that research priorities for this ATF should revolve around reducing cladding thickness as a means to minimize cladding failure. Generally, despite advances in SiC-SiC compliance, the brittle nature of mSiC excludes U 3 Si 2 -SiC for use where fuel cladding contact may occur.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Feature identification or classification using task-specific metadata

Innovations in the identification or classification of features in a data set are described, such as a data set representing measurements taken by a scientific instrument. For example, a task-specific processing component, such as a video encoder, is used to generate task-specific metadata. When the data set includes video frames, metadata can include information regarding motion of image elements between frames, or other differences between frames. A feature of the data set, such as an event, can be identified or classified based on the metadata. For example, an event can be identified when metadata for one or more elements of the data set exceed one or more threshold values. When the feature is identified or classified, an output, such as a display or notification, can be generated. Although the metadata may be useable to generate a task-specific output, such as compressed video data, the identifying or classifying is not used solely in production of, or the creation of an association with, the task-specific output.

Teuton, Jeremy R.↗

Feature identification or classification using task-specific metadata

Innovations in the identification or classification of features in a data set are described, such as a data set representing measurements taken by a scientific instrument. For example, a task-specific processing component, such as a video encoder, is used to generate task-specific metadata. When the data set includes video frames, metadata can include information regarding motion of image elements between frames, or other differences between frames. A feature of the data set, such as an event, can be identified or classified based on the metadata. For example, an event can be identified when metadata for one or more elements of the data set exceed one or more threshold values. When the feature is identified or classified, an output, such as a display or notification, can be generated. Although the metadata may be useable to generate a task-specific output, such as compressed video data, the identifying or classifying is not used solely in production of, or the creation of an association with, the task-specific output.

Teuton, Jeremy R.↗

Variable Precision Computing

This report summarizes the activities and major accomplishments of the Variable Precision Computing Strategic Initiative project. The overarching goal of this project was to initiate and promote a new paradigm in High Performance Computing (HPC) that would fundamentally change how we represent and make use of representations of real numbers in finite precision and that would establish Lawrence Livermore National Laboratory (LLNL) as a leader in precision-related research for HPC. We pursued three integrated and concurrent research thrusts: new, more dynamic data representations to address data motion and capacity limitations; improved mixed precision algorithms to accelerate computation and to leverage new hardware; and new tools to help developers reason about precision and to automate code transformations. Within these thrust areas, we made significant advances in the use of compressed array data types in numerical calculations, in the theoretical justification, in improved performance, and in the prospects of hardware implementation; in the development of metrics to significantly reduce the storage needs of molecular dynamics simulations; in the development and analysis of efficient mixed-precision algorithms for time-dependent partial differential equations and for orthogonal factorization; and in the capability of tools that can analyze sensitivity of computed results to choices in precision and that can make automated code transformations based on such analysis. We established that there are definite opportunities to realize significant improvements in HPC above and beyond the 2x limits of traditional mixed precision using the technologies we have developed. The project produced numerous papers, presentations, and posters in important venues as well as open-source software contributions to the community, and many of the new capabilities have initiated or are being leveraged in ongoing projects.

97 MATHEMATICS AND COMPUTING↗

FY08 LDRD Final Report LOCAL: Locality-Optimizing Caching Algorithms and Layouts

This project investigated layout and compression techniques for large, unstructured simulation data to reduce bandwidth requirements and latency in simulation I/O and subsequent post-processing, e.g. data analysis and visualization. The main goal was to eliminate the data-transfer bottleneck - for example, from disk to memory and from central processing unit to graphics processing unit - through coherent data access and by trading underutilized compute power for effective bandwidth and storage. This was accomplished by (1) designing algorithms that both enforce and exploit compactness and locality in unstructured data, and (2) adapting offline computations to a novel stream processing framework that supports pipelining and low-latency sequential access to compressed data. This report summarizes the techniques developed and results achieved, and includes references to publications that elaborate on the technical details of these methods.

99 GENERAL AND MISCELLANEOUS↗

Shockless compression and release behavior of beryllium to 110 GPa

A magnetohydrodynamic loading technique was used to shocklessly compress beryllium to peak longitudinal stresses of 19–110 GPa and, subsequently, unload in order to determine both the compressive response and also the shear stress supported upon release. Loading strain rates were on the order of 10{sup 6 }s{sup −1}, while the unloading rates were nearly constant at 3 × 10{sup 5 }s{sup −1}. Velocimetry was used to monitor the ramp and release behavior of a beryllium/lithium fluoride window interface. After applying window corrections to infer in situ beryllium velocities, a Lagrangian analysis was employed to determine the material response. The Lagrangian wavespeed-particle velocity response is integrated to generate the stress-strain path, average change in shear stress over the elastic unloading, and estimates of the shear modulus at peak compression. These data are used to infer the pressure dependence of the flow strength at the unloading rate. Comparisons to several strength models reveal good agreement to 45 GPa, but the data indicate 20%–30% higher strength near 100 GPa.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Detection of Coherent Structures in Extreme-Scale Simulations

The analysis of coherent structures is a common problem in many scientific domains ranging from astrophysics to combustion, fusion, and materials science. The data from three-dimensional simulations are analyzed to detect the structures, extract statistics on them, and track them over time to gain insights into the phenomenon being modeled. This analysis is typically done off-line, using data that have been written out by the simulations. However, the move towards extreme scale architectures, with multi-core processors and graphical processing units, will affect how such analysis is done as it is unlikely that the systems will support the I/O bandwidth required for off-line analysis. Moving the analysis in-situ is a solution only if we know a priori what analysis will be done, as well as the algorithms used and their parameter settings. Even then, we need to ensure that this will not substantially increase the memory requirements or the data movement as the former will be limited and the latter will be expensive. In the Exa-DM project, a collaboration between Lawrence Livermore National Laboratory and University of Minnesota, we are exploring ways in which we can address the conflicting demands of coherent structure analysis of simulation data and the architecture of modern parallel systems, while enabling scientific discovery at the exascale. In this paper, we describe our work in two areas: the in situ implementation of an existing algorithm for coherent structure analysis and the use of graph-based techniques to efficiently compress the data.

79 ASTRONOMY AND ASTROPHYSICS↗

Optimization of SAMtools sorting using OpenMP tasks

SAMtools is a widely-used genomics application for post-processing high-throughput sequence alignment data. Such sequence alignment data are commonly sorted to make downstream analysis more efficient. However, this sorting process itself can be computationally- and I/O-intensive: high-throughput sequence alignment files in the de facto standard binary alignment/map (BAM) format can be many gigabytes in size, and may need to be decompressed before sorting and compressed afterwards. As a result, BAM-file sorting can be a bottleneck in genomics workflows. Here, this paper describes a case study on the performance analysis and optimization of SAMtools for sorting large BAM files. OpenMP task parallelism and memory optimization techniques resulted in a speedup of 5.9X versus the upstream SAMtools 1.3.1 for an internal (in-memory) sort of 24.6 GiB of compressed BAM data (102.6 GiB uncompressed) with 32 processor cores, while a 1.98X speedup was achieved for an external (out-of-core) sort of a 271.4 GiB BAM file.

97 MATHEMATICS AND COMPUTING↗

Hugoniot Models for Na and LiF from LEOS

In this document, we provide the Hugoniot for sodium from two models: LEOS table L110 and Lynx table 110. We also provide the Hugoniot for lithium fluoride from LEOS (L2240) and Lynx (2240). The Hugoniot pressures are supplied for temperatures between 338.0 and 1.16×10 9 Kelvin and densities between 0.968 and 11.5 g/cc. These LEOS models were developed by the quotidian EOS methodology, which is a widely used and robust method for producing tabular EOS data. Tables list the model data for LEOS 110, Lynx 110, LEOS 2240, and Lynx 2240. The Lynx models follow the same methodology as the LEOS models; however, the Purgatorio average-atom DFT code was used to compute the electron thermal part of the EOS. The models for Lynx are only listed at high compression due to known issues with the Lynx library at lower pressures.

36 MATERIALS SCIENCE↗

Custom NEON AOP reflectance mosaics and maps of shade masks, canopy water content

This mosaic of visible to shortwave infrared (VSWIR) data was derived from the assignable asset NEON AOP radiance data that was collected by LBNL’s Watershed Function SFA during the summer of 2018 (DOI: 10.15485/1617204). This atmospheric correction was completed to take into account site-specific terrain variability in the 334 km2 survey area centered around Crested Butte, CO. The atmospheric correction was completed using ACORN atmospheric correction software executed on 200 x 200 pixel kernels rather than line by line in order to capture local flight altitude conditions. Manual cloud delineation removed any small shaded areas that occurred within the data collection areas. Mosaics were developed based on preference for days that were in close timing proximity to the coincident ground campaign and with mosaicing criteria that minimized the angle between the sun and the sensor to retrieve the most consistent reflectance (min_phase_refl_tiled). Finally, we generated shade masks based on the geometry between the sun angle at time of flight, the ground surface, and the sensor. Here we provide the orthomosaiced estimated reflectance data (min_phase_refl_tiled.tif), canopy water content (wtrl), estimated atmospheric water vapor (wtrv), the observational data (obs) for this particular mosaic, the estimated visibility (vis), shade masks derived from the digital surface elevation model (shade) and the digital terrain model (shade_tch) added to the canopy height model (DOI: 10.15485/1617203), and a wavelength metadata file. Each image file is provided as a GeoTiff with internal tiling and LZW compression. These data can also be found on Google Earth Engine for extraction, download, and analysis of smaller extents (Google Earth Engine data is linked in external link table).

2018 NEON and 2025 CHESS Campaigns↗

Spatiotemporally Adaptive Compression for Scientific Dataset with Feature Preservation – A Case Study on Simulation Data with Extreme Climate Events Analysis

Scientific discoveries are increasingly constrained by limited storage space and I/O capacities. For time-series simulations and experiments, their data often need to be decimated over timesteps to accommodate storage and I/O limitations. In this paper, we propose a technique that addresses storage costs while improving post-analysis accuracy through spatiotemporal adaptive, error-controlled lossy compression. We investigate the trade-off between data precision and temporal output rates, revealing that reducing data precision and increasing timestep frequency lead to more accurate analysis outcomes. Additionally, we integrate spatiotemporal feature detection with data compression and demonstrate that performing adaptive error-bounded compression in higher dimensional space enables greater compression ratios, leveraging the error propagation theory of a transformation-based compressor. To evaluate our approach, we conduct experiments using the well-known E3SM climate simulation code and apply our method to compress variables used for cyclone tracking. Our results show a significant reduction in storage size while enhancing the quality of cyclone tracking analysis, both quantitatively and qualitatively, in comparison to the prevalent timestep decimation approach. Compared to three state-of-the-art lossy compressors lacking feature preservation capabilities, our adaptive compression framework improves perfectly matched cases in TC tracking by 26.4-51.3% at medium compression ratios and by 77.3-571.1% at large compression ratios, with a merely 5–11% computational overhead.

Gong, Qian↗

Principal Component Analysis of Spectroscopic Imaging Data in Scanning Probe Microscopy

The approach for data analysis in band excitation family of scanning probe microscopies based on principal component analysis (PCA) is explored. PCA utilizes the similarity between spectra within the image to select the relevant response components. For small signal variations within the image, the PCA components coincide with the results of deconvolution using simple harmonic oscillator model. For strong signal variations, the PCA allows effective approach to rapidly process, de-noise and compress the data. The extension of PCA for correlation function analysis is demonstrated. The prospects of PCA as a universal tool for data analysis and representation in multidimensional SPMs are discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Direct prediction of inelastic neutron scattering spectra from the crystal structure*

Abstract Inelastic neutron scattering (INS) is a powerful technique to study vibrational dynamics of materials with several unique advantages. However, analysis and interpretation of INS spectra often require advanced modeling that needs specialized computing resources and relevant expertise. This difficulty is compounded by the limited experimental resources available to perform INS measurements. In this work, we develop a machine-learning based predictive framework which is capable of directly predicting both one-dimensional INS spectra and two-dimensional INS spectra with additional momentum resolution. By integrating symmetry-aware neural networks with autoencoders, and using a large scale synthetic INS database, high-dimensional spectral data are compressed into a latent-space representation, and a high-quality spectra prediction is achieved by using only atomic coordinates as input. Our work offers an efficient approach to predict complex multi-dimensional neutron spectra directly from simple input; it allows for improved efficiency in using the limited INS measurement resources, and sheds light on building structure-property relationships in a variety of on-the-fly experimental data analysis scenarios.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Chemical kinetic modeling of component mixtures relevant to gasoline

Detailed kinetic models of pyrolysis and combustion of hydrocarbon fuels are nowadays widely used in the design of internal combustion engines and these models are effectively applied to help meet the increasingly stringent environmental and energetic standards. In previous studies by the combustion community, such models not only contributed to the understanding of pure component combustion, but also provided a deeper insight into the combustion behavior of complex mixtures. One of the major challenges in this field is now the definition and the development of appropriate surrogate models able to mimic the actual features of real fuels. Real fuels are complex mixtures of thousands of hydrocarbon compounds including linear and branched paraffins, naphthenes, olefins and aromatics. Their behavior can be effectively reproduced by simpler fuel surrogates containing a limited number of components. Aside the most commonly used surrogates containing iso-octane and n-heptane only, the so called Primary Reference Fuels (PRF), new mixtures have recently been suggested to extend the reference components in surrogate mixtures to also include alkenes and aromatics. It is generally agreed that, including representative species for all the main classes of hydrocarbons which can be found in real fuels, it is possible to reproduce very effectively in a wide range of operating conditions not just the auto-ignition propensity of gasoline or Diesel fuels, but also their physical properties and their combustion residuals [1]. In this work, the combustion behavior of several components relevant to gasoline surrogate formulation is computationally examined. The attention is focused on the autoignition of iso-octane, hexene and their mixtures. Some important issues relevant to the experimental and modeling investigation of such fuels are discussed with the help of rapid compression machine data and calculations. Following the model validation, the behavior of mixtures is discussed on the basis of computational results.

02 PETROLEUM↗

Cascade of transitions in twisted and non-twisted graphene layers within the van Hove scenario

Abstract Motivated by measurements of compressibility and STM spectra in twisted bilayer graphene, we analyze the pattern of symmetry breaking for itinerant fermions near a van Hove singularity. Making use of an approximate SU(4) symmetry of the Landau functional, we show that the structure of the spin/isospin order parameter changes with increasing filling via a cascade of transitions. We compute the feedback from different spin/isospin orders on fermions and argue that each order splits the initially 4-fold degenerate van Hove peak in a particular fashion, consistent with the STM data and compressibility measurements, providing a unified interpretation of the cascade of transitions in twisted bilayer graphene. Our results follow from a generic analysis of an SU(4)-symmetric Landau functional and are valid beyond a specific underlying fermionic model. We argue that an analogous van Hove scenario explains the cascade of phase transitions in non-twisted Bernal bilayer and rhombohedral trilayer graphene.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗